A head-up display method, computer device, storage medium, and program product

Abstract

An embodiment of the present application provides a head-up display method, a computer device, a storage medium, and a program product. The method includes: loading a prototype preview application into the application list of a vehicle to enable the vehicle to have the function of the prototype preview application; obtaining a prototype data packet to be previewed through the prototype preview application and storing the prototype data packet to be previewed in a first file path; rendering the prototype data packet to be previewed in the first file path onto the windshield of the vehicle through the head-up display of the vehicle. Through the prototype preview application, the embodiment of the present application can implement the verification of multiple UI design prototype packages of the HUD. The entire process does not involve operations at the code level, the operation is relatively simple, the technical threshold for UI design verification is reduced, and the development labor cost is saved.

Description

Technical Field

[0001] This application relates to the technical field of vehicle testing, and specifically relates to a head-up display method, a computer device, a storage medium, and a program product. Background Art

[0002] Head Up Display (HUD) is a display technology whose main function is to project important information (such as speed, navigation instructions, warning information, etc.) in front of the driver's field of vision (such as the windshield), so that the driver does not need to look down at the instrument panel or the central control screen, thereby reducing distraction and improving driving safety.

[0003] During the R & D process of HUD, it is necessary to verify the product design. In related technologies, software development engineers write test codes for product design, and the test codes are pushed and verified on a real vehicle. After verification, the package is pushed back to the version before verification.

[0004] The overall operation of the above method is relatively complex, and it requires engineers with a development background to complete, which greatly increases the development labor cost of HUD. Summary of the Invention

[0005] In view of this, this application provides at least a head-up display method, a computer device, a storage medium, and a program product.

[0006] The technical solution of the embodiment of this application is implemented as follows:

[0007] On the one hand, the embodiment of this application provides a head-up display method, including: loading a prototype preview application into the application program list of the vehicle to enable the vehicle to have the function of the prototype preview application; obtaining a prototype data packet to be previewed through the prototype preview application, and storing the prototype data packet to be previewed in a first file path; rendering the prototype data packet to be previewed in the first file path onto the windshield of the vehicle through the head-up display of the vehicle.

[0008] In some embodiments, the above-mentioned loading of the prototype preview application into the application program list of the vehicle includes: controlling the head-up display and the central control unit to enter a screen mirroring mode through the vehicle's cockpit domain controller; in the case where the head-up display and the central control unit are in the screen mirroring mode, loading the prototype preview application into the application program list of the vehicle through the central control unit.

[0009] In some embodiments, obtaining a prototype data packet to be previewed through a prototype preview application and storing the prototype data packet to be previewed in a first file path includes: selecting, through the prototype preview application, the prototype data packet to be previewed from multiple prototype data packets in a second file path; the types of the prototype data packets at least include: a prototype picture packet, a prototype sequence frame packet, and a prototype video packet; responding to a confirmation instruction regarding the prototype data packet to be previewed, deleting the historical prototype data packet in the first file path; storing the prototype data packet to be previewed in the first file path; the first file path is shared by a central control unit and a head-up display.

[0010] In some embodiments, rendering the prototype data packet to be previewed in the first file path on the windshield of the vehicle through the head-up display of the vehicle includes: scanning the data in the first file path at a preset time interval through the head-up display to obtain the prototype data packet to be previewed; rendering the prototype data packet to be previewed on the windshield of the vehicle.

[0011] In some embodiments, the head-up display method further includes: receiving a pull message sent by the cloud in a first transmission protocol; pulling multiple prototype data packets from the cloud in a second transmission protocol based on the pull message; storing the multiple prototype data packets in a second file path of the central control unit.

[0012] In some embodiments, controlling the head-up display and the central control unit to enter a screen mirroring mode through the cockpit domain controller of the vehicle includes: responding to a first instruction regarding the head-up display screen mirroring function triggered on the engineering mode interface of the cockpit domain controller, turning on the head-up display screen mirroring function, so that the central control unit enters the screen mirroring mode; through the central control unit, transmitting the on state of the head-up display screen mirroring function to the head-up display in a dual-screen interaction protocol, so that the head-up display enters the screen mirroring mode and renders in a first mode.

[0013] In some embodiments, the head-up display method further includes: responding to a second instruction regarding the head-up display screen mirroring function triggered on the engineering mode interface of the cockpit domain controller, turning off the head-up display screen mirroring function, so that the central control unit exits the screen mirroring mode, turning off the prototype preview application; hiding the entry of the prototype preview application in the application list; deleting the prototype data packet in the first file path; through the central control unit, transmitting the off state of the head-up display screen mirroring function to the head-up display in a dual-screen interaction protocol, so that the head-up display exits the screen mirroring mode and renders in a second mode.

[0014] On the other hand, an embodiment of the present application provides a head-up display device, including: a loading module for loading a prototype preview application into the application list of the vehicle to enable the vehicle to have the function of the prototype preview application; an acquisition module for acquiring a prototype data packet to be previewed through the prototype preview application and storing the prototype data packet to be previewed in a first file path; a rendering module for rendering the prototype data packet to be previewed in the first file path onto the windshield of the vehicle through the head-up display of the vehicle.

[0015] In yet another aspect, an embodiment of the present application provides a computer device, including a memory and a processor. The memory stores a computer program that can run on the processor, and when the processor executes the program, it implements some or all of the steps in the above method.

[0016] In still another aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements some or all of the steps in the above method.

[0017] In still another aspect, an embodiment of the present application provides a computer program, including computer-readable code. When the computer-readable code runs in a computer device, the processor in the computer device executes to implement some or all of the steps in the above method.

[0018] In still another aspect, an embodiment of the present application provides a computer program product. The computer program product includes a non-transitory computer-readable storage medium storing a computer program. When the computer program is read and executed by a computer, it implements some or all of the steps in the above method.

[0019] In the embodiment of the present application, the prototype preview application is loaded into the application list of the vehicle, so that the vehicle can obtain the prototype data packet to be previewed, and then the previewed prototype data packet is rendered onto the windshield of the vehicle to implement the verification of the UI design prototype package of the HUD. The verification includes the verification of the prototype picture package, the verification of the prototype sequence frame package, and the verification of the prototype video package, etc. In this way, through the prototype preview application, the verification of multiple UI design prototype packages of the HUD can be realized. The whole process does not involve operations at the code level, the operation is relatively simple, the technical threshold of UI design verification is reduced, and the development labor cost is saved. Moreover, the head-up display method provided by the embodiment of the present application can not only realize the UI design prototype preview of the HUD, but also realize the UI design prototype preview of other application programs in the vehicle, and has strong applicability. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 is a schematic implementation flow diagram of a head-up display method provided by an embodiment of the present application Figure 1 ;

[0021] Figure 2Schematic diagram of the type of prototype data packet in a head-up display method provided by an embodiment of the present application;

[0022] Figure 3 Schematic implementation process of a head-up display method provided by an embodiment of the present application Figure 2 ;

[0023] Figure 4 Schematic implementation process of a head-up display method provided by an embodiment of the present application Figure 3 ;

[0024] Figure 5 Schematic diagram of the implementation process of the method for obtaining the UI design prototype package in a head-up display method provided by an embodiment of the present application;

[0025] Figure 6 Schematic diagram of the implementation process of the head-up display and Android entering the screen mirroring mode in a head-up display method provided by an embodiment of the present application;

[0026] Figure 7 Schematic diagram of the implementation process of storing the UI design prototype in the shared file path in a head-up display method provided by an embodiment of the present application;

[0027] Figure 8 Schematic diagram of the implementation process of rendering the UI design prototype package in a head-up display method provided by an embodiment of the present application;

[0028] Figure 9 Schematic diagram of the implementation process of Android and HUD exiting the screen mirroring mode in a head-up display method provided by an embodiment of the present application;

[0029] Figure 10 Schematic diagram of the composition structure of a head-up display device provided by an embodiment of the present application;

[0030] Figure 11 Schematic diagram of the hardware entity of a computer device provided by an embodiment of the present application. Detailed implementation manners

[0031] The technical solutions of the present application will be further elaborated in detail below with reference to the accompanying drawings and specific embodiments.

[0032] In order to enable those skilled in the art to better understand the solutions of the embodiments of the present application, the technical solutions in the embodiments of the present application will be clearly described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments.

[0033] In the embodiments of the specification, claims, and the above-mentioned drawings of this application, terms such as "first", "second", and "third" are used to distinguish similar objects and do not necessarily describe a specific order or sequence. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a method, system, product, or device that comprises a series of steps or units does not necessarily limit to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products, or devices.

[0034] To better understand the head-up display method provided in this application, the related technologies involved in this application will be described first below.

[0035] HUD is an early flight assistance instrument applied to aircraft. Pilots can see the important information they need without having to lower their heads, which can reduce the frequency of pilots lowering their heads to check the instruments, avoid attention interruption, and loss of situational awareness.

[0036] With the development of science and technology, HUD has also been widely used in vehicles. The head-up display on a vehicle can display important driving information, such as speed, engine revolutions per minute, fuel consumption, tire pressure, navigation, and information from external intelligent devices, etc., in real time on the front windshield within the driver's field of vision. This enables the driver to see the driving information without having to lower their head, thus avoiding distraction from the road ahead and eliminating potential driving hazards. Moreover, since the virtual image falls directly in front of the vehicle during projection, the time for the driver to adjust the visual focus will be shortened, which is safer for the driver. At the same time, it enables the driver not to have to adjust their eyes between looking at the distant road and the nearby instruments, avoiding eye fatigue, and can greatly enhance driving safety and improve the driving experience.

[0037] During the R & D process of HUD, to verify the product design, software development engineers need to write code to push packages for verification on a real vehicle to see the effect of the product design. After verification, the package is pushed back to the version before verification. The overall operation is relatively complex and requires engineers with a development background to complete, increasing the development labor cost of HUD.

[0038] Therefore, the embodiments of this application provide a head-up display method, which can be applied to a computer device. The computer device can be a device in a vehicle or other devices outside the vehicle. For example, the vehicle can be a new energy-driven car. The computer device includes but is not limited to fixed devices and / or mobile devices. For example, the fixed devices include but are not limited to: personal computers (PCs) or servers.

[0039] Figure 1Schematic implementation process of a head-up display method provided by an embodiment of the present application Figure 1 As Figure 1 shown, the method may include the following steps 101 to 103:

[0040] Step 101: Load the prototype preview application into the application list of the vehicle to enable the vehicle to have the functions of the prototype preview application.

[0041] The prototype preview application is used to manage prototype data packets. In some embodiments, the prototype preview application is used to: scan the prototype data packets to be projected on the external storage device or fixed file path, and store the prototype data packets to be projected on the shared file path. Among them, the external storage device may include, but is not limited to: Universal Serial Bus Flash Drive (USB flash drive), TransFlash (TF card). In addition, the prototype preview application also supports operations such as adding, modifying, and deleting prototype data packets.

[0042] The prototype data packet refers to a data packet composed of relevant data involved in the User Interface (UI) design for the head-up display. The prototype data packet can also be called a prototype verification packet or a UI design prototype packet.

[0043] In some embodiments, the relevant data includes the UI interface shown to the user, the interaction between UI interfaces, the triggering methods of the interaction (such as buttons, pictures, web addresses, etc.), the size of the UI interface, the layout of the UI interface, and the text, pictures, videos, etc. included in each section.

[0044] In some embodiments, as Figure 2 shown, the types of prototype data packets at least include: UI design prototype picture packets, UI design prototype sequence frame packets, and UI design prototype video packets. Among them, the prototype picture packet refers to a data packet composed of multiple UI pictures designed for the head-up display; the prototype sequence frame packet refers to a data packet composed of multiple UI sequence frames designed for the head-up display; the prototype video packet refers to a UI video designed for the head-up display.

[0045] The application list (Application list, APPlist) refers to the set of some or all application programs included in the vehicle. Loading the prototype preview application into the application list of the vehicle is to enable the vehicle to have the functions of the prototype preview application.

[0046] In some embodiments, the specific implementation method of step 101 may be: through the central control unit, load the prototype preview application into the application list of the vehicle.

[0047] Step 102: Obtain the prototype data packet to be previewed through the prototype preview application, and store the prototype data packet to be previewed at the first file path.

[0048] The prototype data packet to be previewed refers to the prototype data packet that needs to be verified currently. The first file path is shared by the central control unit and the HUD, and can also be called the shared file path.

[0049] In some embodiments, the specific implementation of step 102 may be: obtain the prototype data packet to be previewed in the fixed file path through the prototype preview application; in response to the confirmation instruction regarding the prototype data packet to be previewed, store the prototype data packet to be previewed at the first file path.

[0050] Step 103: Render the prototype data packet to be previewed in the first file path to the windshield of the vehicle through the head-up display of the vehicle.

[0051] Since the first file path is shared by the central control unit and the HUD, the HUD can obtain the prototype data packet to be previewed in the first file path, and then render it to the windshield of the vehicle.

[0052] In some embodiments, the specific implementation of step 103 may be: after storing the prototype data packet to be previewed at the first file path, send a rendering instruction to the head-up display, so that the head-up display renders the prototype data packet to be previewed in the first file path to the windshield of the vehicle.

[0053] In some embodiments, the specific implementation of step 103 may be: through the head-up display, scan the data in the first file path at preset time intervals to obtain the prototype data packet to be previewed in the first file path, and then render the prototype data packet to be previewed in the first file path to the windshield of the vehicle.

[0054] In some embodiments, after rendering the prototype data packet to be previewed to the windshield of the vehicle, compare whether the rendered prototype data packet matches the reference prototype data packet. The reference prototype data packet refers to the prototype data packet designed by the developer. Whether the rendered prototype data packet matches the reference prototype data packet at least includes: whether there are display differences such as distortion and color difference in the rendered prototype data packet, and whether the layout and content of the rendered prototype data packet are the same as those of the reference prototype data packet.

[0055] Since the vehicle does not have the UI design prototype preview function of HUD, a prototype preview application with the UI design prototype preview function is configured and loaded into the application list of the vehicle, so that the vehicle can obtain the prototype data packet to be previewed, and then render the previewed prototype data packet onto the windshield of the vehicle to achieve the UI design prototype preview of HUD.

[0056] It should be noted that in addition to realizing the UI design prototype preview for HUD, the head-up display method of the present application can also be used to realize the UI design prototype preview for other application programs.

[0057] In the embodiment of the present application, the prototype preview application is loaded into the application list of the vehicle, so that the vehicle can obtain the prototype data packet to be previewed, and then render the previewed prototype data packet onto the windshield of the vehicle to achieve the verification of the UI design prototype package of HUD. The verification includes the verification of the prototype picture package, the verification of the prototype sequence frame package, and the verification of the prototype video package, etc. In this way, through the prototype preview application, various UI design prototype package verifications of HUD can be realized. The whole process does not involve operations at the code level, the operation is relatively simple, the technical threshold of UI design verification is reduced, and the development labor cost is saved. Moreover, the head-up display method provided by the embodiment of the present application can not only realize the UI design prototype preview of HUD, but also realize the UI design prototype preview of other application programs in the vehicle, and has strong applicability.

[0058] Figure 3 Schematic diagram of the implementation process of a head-up display method provided by an embodiment of the present application Figure 2 As Figure 3 shown, the method may include the following steps 301 to step 307:

[0059] Step 301: Control the head-up display and the central control unit to enter the screen mirroring mode through the cockpit domain controller of the vehicle.

[0060] The cockpit domain controller is an integrated device used to centrally manage and control various functions in the vehicle cockpit. The cockpit domain controller integrates multiple independent control units (such as: instrument panel, air conditioning control, driving assistance, etc.). Its core purpose is to optimize the function control in the vehicle cockpit in a centralized manner, improving the user experience and system efficiency.

[0061] The central control unit is used to load (release) the prototype preview application into the application list and control the opening and closing of the prototype preview application.

[0062] In some embodiments, the specific implementation of step 301 may be as follows: In response to a first instruction regarding the head-up display mirroring function triggered on the engineering mode interface of the cockpit domain controller, the head-up display mirroring function is turned on, causing the central control unit to enter the mirroring mode; through the central control unit, the on state of the head-up display mirroring function is transmitted to the head-up display via a dual-screen interaction protocol, causing the head-up display to enter the mirroring mode and perform rendering in a first mode.

[0063] The first instruction is used to turn on the head-up display mirroring function.

[0064] The engineering mode interface of the cockpit domain controller is used for developing and testing the functions of the intelligent cockpit system. It provides in-depth access to hardware and software functions, facilitating developers to perform debugging, performance testing, and custom development. The dual-screen interaction protocol is used to implement communication between the central control unit and the HUD to transfer the on / off state of the head-up display mirroring function to the HUD. The dual-screen interaction protocol can be socket communication. The first mode refers to the mode of previewing prototype data packets.

[0065] In some embodiments, a switch for the head-up display mirroring function is developed on the engineering mode interface of the cockpit domain controller; when the switch is "turned on", the head-up display mirroring function is turned on; when the switch of the head-up display mirroring function is in the on state, the central control unit enters the mirroring mode; the central control unit transmits the on state of the head-up display mirroring function to the head-up display via a dual-screen interaction protocol; when the head-up display receives the on state of the head-up display mirroring function, it enters the mirroring mode.

[0066] Step 302: In the case where the head-up display and the central control unit are in the mirroring mode, the prototype preview application is loaded into the application program list of the vehicle through the central control unit.

[0067] Here, steps 301 to 302 correspond to the aforementioned step 101, and the specific implementation can refer to the specific implementation of the aforementioned step 101 when implemented.

[0068] In some embodiments, after the central control unit enters the mirroring mode, the prototype preview application can be loaded into the application program list of the vehicle. At the same time, the on state of the head-up display mirroring function is transmitted to the head-up display to improve the processing efficiency.

[0069] Step 303: Through the prototype preview application, the prototype data packet to be previewed is selected from multiple prototype data packets in the second file path; the types of the prototype data packets at least include: prototype picture packets, prototype sequence frame packets, and prototype video packets.

[0070] The second file path is a fixed folder in the central control unit. For example, the second file path can be the path of the data database. The prototype preview application can scan the prototype data packets in the second file path.

[0071] In some embodiments, the specific implementation of "selecting the prototype data packet to be previewed from multiple prototype data packets in the second file path" in step 303 can be: selecting the prototype data packet to be previewed from multiple prototype data packets in the second file path according to the priority of the prototype data packet. The priority of the prototype data packet can be confirmed based on the importance of the prototype data packet, the interaction order of the prototype data packet, and the identifier of the prototype data packet.

[0072] In some embodiments, the specific implementation of "storing multiple prototype data packets to the second file path of the central control unit" can be: receiving a pull message sent by the cloud in the first transport protocol; based on the pull message, pulling multiple prototype data packets from the cloud in the second transport protocol; storing the multiple prototype data packets to the second file path of the central control unit.

[0073] The first transport protocol is used to send a pull message to the vehicle. The pull message is used to instruct the vehicle to pull multiple prototype data packets from the cloud. The second transport protocol is used to pull multiple prototype data packets from the cloud. For example, the first transport protocol can be the Message Queuing Telemetry Transport (MQTT), and the second transport protocol is the HyperText Transfer Protocol (HTTP).

[0074] In some embodiments, the specific implementation of "storing multiple prototype data packets to the second file path of the central control unit" can also be: copying multiple prototype data packets to a USB flash drive or a TF card; inserting the USB flash drive or the TF card into the USB interface of the cockpit domain controller to store the multiple prototype data packets to the second file path of the central control unit.

[0075] Step 304, in response to the confirmation instruction regarding the prototype data packet to be previewed, delete the historical prototype data packets in the first file path.

[0076] The historical prototype data packets refer to the prototype data packets previously stored in the first file path.

[0077] In some embodiments, after the central control unit enters the screen mirroring mode, the prototype preview application is placed in the application list, which facilitates the user to select the prototype data packet to be previewed on the central control screen. At this time, the user presses and holds the prototype data packet that needs to be rendered currently through the central control unit; after pressing the prototype data packet that needs to be rendered currently, a secondary confirmation pop-up window for whether to perform screen mirroring appears. After clicking the "OK" button, the prototype data packet that needs to be rendered currently is used as the prototype data packet to be rendered, and a confirmation instruction regarding the prototype data packet to be previewed is triggered.

[0078] Step 305: Store the prototype data packet to be previewed in the first file path; the first file path is shared by the central control unit and the head-up display.

[0079] Here, steps 303 to 305 correspond to the aforementioned step 102, and the specific implementation manner of the aforementioned step 102 can be referred to during implementation.

[0080] Since the first file path is shared by the central control unit and the HUD, the prototype data packet can be transferred from the second file path (fixed file path) to the first file path (shared file path) through the central control unit, so that the HUD can obtain the prototype data packet to be previewed in the first file path, and then render it on the windshield of the vehicle.

[0081] It should be noted that after deleting the historical prototype data packet in the first file path and then storing the prototype data packet to be previewed, it is to ensure that only the prototype data packet to be previewed currently is stored in the first file path, which facilitates the head-up display to obtain and render the prototype data packet to be previewed, and the UI design verification of the prototype data packet to be previewed is completed.

[0082] Step 306: Scan the data in the first file path through the head-up display at preset time intervals to obtain the prototype data packet to be previewed.

[0083] The preset time interval can be set in advance, and specifically can be set according to actual business requirements. For example, the preset time interval can be set to 1 second.

[0084] Step 307: Render the prototype data packet to be previewed on the windshield of the vehicle.

[0085] Here, steps 306 to 307 correspond to the aforementioned step 103, and the specific implementation manner of the aforementioned step 103 can be referred to during implementation.

[0086] In some embodiments, after verifying the prototype data packet to be previewed, the head-up display screen mirroring function can also be exited through the following steps 308 to 311:

[0087] Step 308: In response to a second instruction triggered on the engineering mode interface of the cockpit domain controller, turn off the head-up display mirroring function, so that the central control unit exits the mirroring mode and closes the prototype preview application.

[0088] The second instruction is used to turn off the head-up display function.

[0089] In some embodiments, on the engineering mode interface of the cockpit domain controller, turn off the head-up display mirroring function; when the switch of the head-up display mirroring function is in the off state, the central control unit exits the mirroring mode.

[0090] Step 309: Hide the entry of the prototype preview application in the application list.

[0091] Step 310: Delete the prototype data packet in the first file path.

[0092] Step 311: Through the central control unit, transmit the off state of the head-up display mirroring function to the head-up display via the dual-screen interaction protocol, so that the head-up display exits the mirroring mode and performs rendering in the second mode.

[0093] The second mode refers to the normal user mode.

[0094] In some embodiments, the specific implementation manner of step 311 may be: the central control unit transmits the off state of the head-up display mirroring function to the head-up display via the dual-screen interaction protocol; when the head-up display receives the off state of the head-up display mirroring function, it exits the mirroring mode.

[0095] It should be noted that the operations of the central control unit exiting the mirroring mode and the head-up display exiting the mirroring mode may be performed simultaneously or sequentially, and the embodiments of the present application do not make any limitations in this regard.

[0096] In the embodiments of the present application, the prototype preview application is loaded into the application list of the vehicle, so that the vehicle can obtain the prototype data packet to be previewed, and then the previewed prototype data packet is rendered on the windshield of the vehicle to implement the verification of the HUD UI design prototype package, and the verification includes the verification of the prototype picture package, the prototype sequence frame package, and the prototype video package, etc. In this way, through the prototype preview application, multiple HUD UI design prototype packages can be verified. The whole process does not involve operations at the code level, the operation is relatively simple, the technical threshold of UI design verification is reduced, and the development labor cost is saved. Moreover, the head-up display method provided by the embodiments of the present application can not only implement the HUD UI design prototype preview, but also implement the UI design prototype preview of other application programs in the vehicle, and has strong applicability.

[0097] Next, the application of the head-up display method provided by the embodiments of the present application in an actual scenario will be described.

[0098] An embodiment of the present application provides a method for implementing HUD screen projection display (corresponding to the above head-up display method), which can implement the verification of the UI design prototype package of HUD, including picture prototype verification, sequence frame prototype verification, and prototype video verification. The specific implementation method can be: insert a USB flash drive or TF card with the UI design prototype package into the USB interface of the in-vehicle cockpit domain controller, or upload the UI design prototype package to the cloud and distribute it to the cockpit domain controller, and project the UI design prototype package onto the windshield by operating the screen of the central control unit, so as to quickly verify the UI design prototype, solve the complex operations of hard coding and package pushing in the existing solutions, reduce the technical threshold of operators, and save the labor cost of development engineers.

[0099] Copy the UI design prototype package to a USB flash drive or TF card. The types of the UI design prototype package include a prototype picture package, a prototype sequence frame package, and a prototype video package. Insert the USB flash drive or TF card into the USB interface of the cockpit domain controller; or upload the UI design prototype package to the cloud and push it to the vehicle through message push (MQTT). After receiving the push, the vehicle pulls down the UI design prototype package from the cloud through the HTTP method and stores it under a fixed file path (corresponding to the above second file path), and then enters the engineering mode page of the cockpit domain controller to turn on the "HUD screen projection function" switch, so that the central control unit (Android) and HUD can enter the screen projection mode.

[0100] After Android enters the screen projection mode, release the prototype preview application in the APPlist. The prototype preview application has the following functions: in the prototype preview application, the UI design prototype package to be projected can be scanned in the USB flash drive or TF card or the fixed file path, and the deletion of the UI design prototype package is supported; after long pressing the UI design prototype package, a secondary confirmation pop-up window for whether to project the screen will pop up, and after clicking "Confirm", this UI design prototype package can be projected onto the HUD for display. After HUD enters the screen projection mode, it displays according to the UI design prototype package selected in Android. When the verification is completed, enter the engineering mode page of the cockpit domain controller to turn off the "HUD screen projection function" switch, Android closes the prototype preview application, and hides the entry of the prototype preview application in the APPlist; HUD will turn off the screen projection function and restore to the normal user mode.

[0101] As Figure 4 shown, based on the above content, the overall process of this method may include the following steps 401 to 405:

[0102] Step 401: Insert a USB flash drive with the UI design prototype package into the USB interface of the cockpit domain controller; or upload the UI design prototype package to the cloud and distribute it to the cockpit domain controller.

[0103] Step 402: Open the "HUD Screen Mirroring Function" in the engineering mode interface of the cockpit domain controller.

[0104] Step 403: Through the prototype preview application, long-press to select the UI design prototype package to be screen mirrored.

[0105] Step 404: The HUD renders the UI design prototype package to be screen mirrored.

[0106] Step 405: Close the "HUD Screen Mirroring Function" in the engineering mode interface of the cockpit domain controller.

[0107] The specific implementation of this method is as follows:

[0108] As Figure 5 shown, the acquisition method of the UI design prototype package includes: Step 501: The designer uploads the UI design prototype package to the cloud. Step 502: The cloud pushes the message (MQTT) to the cockpit domain controller. Step 503: The cockpit domain controller pulls down the UI design prototype from the cloud via HTTP and stores it in the fixed file path (data database) of the Android system.

[0109] As Figure 6 shown, develop a "HUD Screen Mirroring Function" switch in the engineering mode interface of the cockpit domain controller. At this time, the implementation methods for the HUD and Android to enter the screen mirroring mode can include: Step 601: Open the "HUD Screen Mirroring Function" in the engineering mode interface of the cockpit domain controller. Step 602: Android transmits the open state of the "HUD Screen Mirroring Function" to the HUD through Socket communication. Step 603: The HUD enters the screen mirroring mode. Step 604: Android enters the screen mirroring mode. Among them, the operations from Step 602 to Step 603 and the operation of Step 604 can be carried out simultaneously.

[0110] When the "HUD Screen Mirroring Function" switch is in the open state, as Figure 7 shown, the UI design prototype can be stored in the shared file path through the following steps 701 to 706 so that the HUD can obtain it. Step 701: Android enters the screen mirroring mode and releases the prototype preview application in the APP list. Step 702: Open the prototype preview application, and the prototype preview application scans the UI design prototype package in the USB flash drive, or TF card, or fixed file path and displays it. Step 703: Long-press to select the UI design prototype package to be screen mirrored in the prototype preview application. Step 704: Confirm whether to perform screen mirroring. If it is determined to perform screen mirroring, execute Step 705; if it is determined not to perform screen mirroring, end. Step 705: Delete the UI design prototype package in the shared path folder of Android and the HUD. Step 706: Store the selected UI design prototype package in the shared path folder of Android and the HUD.

[0111] Among them, the prototype preview application has the following functions: Through the prototype preview application, the UI design prototype package to be screen-cast can be scanned from a USB flash drive, or a TF card, or a fixed file path; and the deletion of the UI design prototype package is supported; when entering the screen-cast mode, after long-pressing the UI design prototype package of the prototype preview application, a secondary confirmation dialog box will pop up; after "confirmation", first delete the UI design prototype package in the shared path folders of Android and HUD, and then store the selected UI design prototype package in the shared path folders of Android and HUD.

[0112] When the "HUD screen-cast function" switch received by the HUD is in the on state, as Figure 8 shown, the UI design prototype package can be rendered through the following steps 801 to step 806. Step 801, the HUD enters the screen-cast mode. Step 802, the HUD periodically obtains the UI design prototype package in the shared paths of Android and HUD at 1S (calibratable). Step 803, whether the UI design prototype package is obtained. If the UI design prototype package is obtained, execute step 804; if the UI design prototype package is not obtained, execute step 806. Step 804, read the UI design prototype package in the shared path folders of Android and HUD. Step 805, render the read UI design prototype package. Step 806, display "Please open the prototype preview application on the center console screen and select the UI design prototype package to be screen-cast" on the HUD.

[0113] After the engineer finishes validating the UI design prototype package, as Figure 9 shown, Android and HUD can exit the screen-cast mode through the following steps 901 to step 906. Step 901, turn off the "HUD screen-cast function" in the engineering mode interface of the cockpit domain controller. Step 902, Android exits the screen-cast mode. Step 903, Android closes the prototype preview application, hides the entry of the prototype preview application in the APP list, and deletes the UI design prototype package in the shared paths of Android and HUD. Step 904, Android transmits the off state of the "HUD screen-cast function" to the HUD through Socket communication. Step 905, the HUD exits the screen-cast mode. Step 906, the HUD renders in the normal mode.

[0114] Based on the foregoing embodiments, an embodiment of the present application provides a head-up display device. The device includes each unit included therein, as well as each module included in each unit, and can be implemented by a processor in a computer device; of course, it can also be implemented by specific logic circuits; during implementation, the processor can be a central processing unit (CPU), a microprocessor unit (MPU), a digital signal processor (DSP), or a field programmable gate array (FPGA), etc.

[0115] Figure 10 FIG. is a schematic structural diagram of a head-up display device provided by an embodiment of the present application. As Figure 10 shown, the head-up display device 1000 includes: a loading module 1010, an obtaining module 1020, and a rendering module 1030, where:

[0116] The loading module 1010 is configured to load a prototype preview application into the application list of the vehicle;

[0117] The obtaining module 1020 is configured to obtain a prototype data packet to be previewed through the prototype preview application, and store the prototype data packet to be previewed in a first file path;

[0118] The rendering module 1030 is configured to render the prototype data packet to be previewed in the first file path onto the windshield of the vehicle through the head-up display.

[0119] In some embodiments, the loading module 1010 is further configured to: control the head-up display and the central control unit to enter a screen mirroring mode through the cockpit domain controller of the vehicle; in the case where the head-up display and the central control unit enter the screen mirroring mode, load the prototype preview application into the application list of the vehicle through the central control unit.

[0120] In some embodiments, the obtaining module 1020 is further configured to: select a prototype data packet to be previewed from multiple prototype data packets in a second file path through the prototype preview application; the types of the prototype data packets at least include: a prototype picture packet, a prototype sequence frame packet, and a prototype video packet; in response to a confirmation instruction regarding the prototype data packet to be previewed, delete the historical prototype data packet in the first file path; store the prototype data packet to be previewed in the first file path; the first file path is shared by the central control unit and the head-up display.

[0121] In some embodiments, the rendering module 1030 is further configured to: scan the data in the first file path through the head-up display at preset time intervals to obtain the prototype data packet to be previewed; render the prototype data packet to be previewed onto the windshield of the vehicle.

[0122] In some embodiments, the obtaining module 1020 is further configured to: receive a pull message sent by the cloud in a first transmission protocol; based on the pull message, pull multiple prototype data packets from the cloud in a second transmission protocol; store the multiple prototype data packets in a second file path of the center console.

[0123] In some embodiments, the loading module 1010 is further configured to: respond to a first instruction regarding the head-up display mirroring function triggered in the engineering mode interface of the cockpit domain controller, turn on the head-up display mirroring function, so that the center console enters the mirroring mode; through the center console, transmit the on state of the head-up display mirroring function to the head-up display in a dual-screen interaction protocol, so that the head-up display enters the mirroring mode and performs rendering in a first mode.

[0124] In some embodiments, the loading module 1010 is further configured to: respond to a second instruction triggered in the engineering mode interface of the cockpit domain controller, turn off the head-up display mirroring function, so that the center console exits the mirroring mode, close the prototype preview application; hide the entry of the prototype preview application in the application list; delete the prototype data packet in the first file path; through the center console, transmit the off state of the head-up display mirroring function to the head-up display in a dual-screen interaction protocol, so that the head-up display exits the mirroring mode and performs rendering in a second mode.

[0125] The description of the above device embodiments is similar to that of the above method embodiments and has similar beneficial effects to the method embodiments. In some embodiments, the functions or modules included in the device provided in the embodiments of the present application can be used to execute the methods described in the above method embodiments. For the technical details not disclosed in the device embodiments of the present application, please refer to the description of the method embodiments of the present application for understanding.

[0126] It should be noted that in the embodiments of the present application, if the above-mentioned head-up display method is implemented in the form of software function modules and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the embodiments of the present application essentially or the part that contributes to the related technology can be embodied in the form of a software product. The software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in the various embodiments of the present application. The foregoing storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROM), magnetic disks, or optical discs that can store program codes. In this way, the embodiments of the present application are not limited to any specific hardware, software, or firmware, or any combination among hardware, software, and firmware.

[0127] The embodiments of the present application provide a computer device, including a memory and a processor. The memory stores a computer program that can run on the processor, and when the processor executes the program, it implements some or all of the steps in the above method.

[0128] The embodiments of the present application provide a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements some or all of the steps in the above method. The computer-readable storage medium can be transient or non-transient.

[0129] The embodiments of the present application provide a computer program, including computer-readable code. When the computer-readable code runs on a computer device, the processor in the computer device executes to implement some or all of the steps in the above method.

[0130] The embodiments of the present application provide a computer program product. The computer program product includes a non-transient computer-readable storage medium storing a computer program. When the computer program is read and executed by a computer, it implements some or all of the steps in the above method. The computer program product can be specifically implemented in the form of hardware, software, or a combination thereof. In some embodiments, the computer program product is specifically embodied as a computer storage medium. In other embodiments, the computer program product is specifically embodied as a software product, such as a software development kit (SDK), etc.

[0131] It should be noted here that: the above descriptions of the various embodiments tend to emphasize the differences between the various embodiments, and their similarities can be referred to each other. The descriptions of the above embodiments of the device, storage medium, computer program, and computer program product are similar to the descriptions of the above method embodiments and have beneficial effects similar to those of the method embodiments. For the technical details not disclosed in the embodiments of the device, storage medium, computer program, and computer program product of the present application, please refer to the descriptions of the method embodiments of the present application for understanding.

[0132] It should be noted that Figure 11 is a schematic diagram of a hardware entity of a computer device in an embodiment of the present application. As Figure 11 shown, the hardware entity of the computer device 1100 includes: a processor 1101, a communication interface 1102, and a memory 1103, where:

[0133] The processor 1101 generally controls the overall operation of the computer device 1100.

[0134] The communication interface 1102 enables the computer device to communicate with other terminals or servers through a network.

[0135] The memory 1103 is configured to store instructions and applications executable by the processor 1101, and can also cache data to be processed or already processed by the processor 1101 and each module in the computer device 1100 (for example, image data, audio data, voice communication data, and video communication data), and can be implemented by flash memory (FLASH) or random access memory (Random Access Memory, RAM). Data transmission can be performed between the processor 1101, the communication interface 1102, and the memory 1103 through a bus 1104.

[0136] It should be understood that the "one embodiment" or "an embodiment" mentioned throughout the specification means that a specific feature, structure, or characteristic related to the embodiment is included in at least one embodiment of the present application. Therefore, the appearances of "in one embodiment" or "in an embodiment" throughout the specification do not necessarily refer to the same embodiment. In addition, these specific features, structures, or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the magnitudes of the sequence numbers of the above steps / processes do not mean the order of execution, and the execution order of each step / process should be determined by its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present application. The sequence numbers of the embodiments of the present application above are only for description and do not represent the superiority or inferiority of the embodiments.

[0137] It should be noted that in this text, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, such that a process, method, article or device comprising a series of elements not only includes those elements but also other elements not explicitly listed, or elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "comprising one..." does not exclude the existence of additional identical elements in the process, method, article or device comprising that element.

[0138] In several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division, and there can be other division methods in actual implementation. For example, multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. Additionally, the coupling, direct coupling, or communication connection between the various components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical, or other forms.

[0139] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units; they can be located in one place or distributed to multiple network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0140] Furthermore, in each embodiment of this application, the various functional units can all be integrated in one processing unit, or each unit can be separately a unit alone, or two or more units can be integrated in one unit; the above-mentioned integrated units can be implemented in the form of hardware, or in the form of hardware plus software functional units.

[0141] Those of ordinary skill in the art can understand that all or part of the steps to implement the above method embodiments can be completed by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps including the above method embodiments; and the aforementioned storage medium includes: various media that can store program codes such as removable storage devices, read-only memory (ROM), magnetic disks, or optical discs.

[0142] Alternatively, if the above integrated units of the present application are implemented in the form of software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the related technology can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: various media such as removable storage devices, ROMs, magnetic disks, or optical discs that can store program codes.

[0143] As described above, the above are only the implementation manners of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present application can easily think of changes or substitutions, which should all be covered within the protection scope of the present application.

Claims

1. A head-up display method, characterized in that, The head-up display method includes: Controlling the head-up display and the center console of the vehicle to enter the screen mirroring mode through the vehicle's cockpit domain controller; In the case where the head-up display and the center console enter the screen mirroring mode, loading a prototype preview application to the vehicle's application list through the center console, so that the vehicle has the function of the prototype preview application; the prototype preview application is an application for managing prototype data packets; Obtaining a prototype data packet to be previewed through the prototype preview application, and storing the prototype data packet to be previewed to a first file path; Rendering the prototype data packet to be previewed in the first file path to the vehicle's windshield through the vehicle's head-up display.

2. The head-up display method according to claim 1, wherein The step of obtaining a prototype data packet to be previewed through the prototype preview application and storing the prototype data packet to be previewed to a first file path includes: Selecting the prototype data packet to be previewed from multiple prototype data packets in a second file path through the prototype preview application; the prototype data packet includes at least one of a prototype picture packet, a prototype sequence frame packet, and a prototype video packet; Responding to a confirmation instruction for the prototype data packet to be previewed, and deleting the historical prototype data packet in the first file path; Storing the prototype data packet to be previewed to the first file path; the first file path is shared by the center console and the head-up display.

3. The head-up display method according to claim 1 or 2, characterized in that The step of rendering the prototype data packet to be previewed in the first file path to the vehicle's windshield through the vehicle's head-up display includes: Scanning the data in the first file path at preset time intervals through the head-up display to obtain the prototype data packet to be previewed; Rendering the prototype data packet to be previewed to the vehicle's windshield.

4. The head-up display method according to claim 2, wherein The head-up display method further includes: Receiving a pull message sent by the cloud in a first transmission protocol; Pulling multiple prototype data packets from the cloud in a second transmission protocol based on the pull message; Storing the multiple prototype data packets to a second file path of the center console.

5. The head-up display method according to claim 1, wherein The step of controlling the head-up display and the center console to enter the screen mirroring mode through the vehicle's cockpit domain controller includes: Responding to a first instruction for the head-up display screen mirroring function triggered on the engineering mode interface of the cockpit domain controller, turning on the head-up display screen mirroring function, so that the center console enters the screen mirroring mode; Transmitting the turned-on state of the head-up display screen mirroring function to the head-up display through the center console in a dual-screen interaction protocol, so that the head-up display enters the screen mirroring mode and renders in a first mode.

6. The head-up display method according to claim 5, wherein, The head-up display method further includes: Responding to a second instruction triggered on the engineering mode interface of the cockpit domain controller, turning off the head-up display screen mirroring function, so that the center console exits the screen mirroring mode and closes the prototype preview application; Hiding the entry of the prototype preview application in the application list; Deleting the prototype data packet in the first file path; Through the central control unit, the off state of the head-up display projection function is transmitted to the head-up display through a dual-screen interaction protocol, so that the head-up display exits the projection mode and is rendered in a second mode.

7. A computer device, comprising a memory and a processor, the memory storing a computer program that can run on the processor, characterized in that, When the processor executes the program, the steps of the method according to any one of claims 1 to 6 are implemented.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer program product, the computer program product comprising a non-transitory computer-readable storage medium storing a computer program, and when the computer program is read and executed by a computer, the steps of the method according to any one of claims 1 to 6 are implemented.

Images