Head-up display method, computer equipment, storage medium and program product

Abstract

The embodiment of the invention provides a head-up display method, computer equipment, a storage medium and a program product, and the method comprises the steps: loading a prototype preview application to an application program list of a vehicle, and enabling the vehicle to have the function of the prototype preview application; obtaining a to-be-previewed prototype data packet through the prototype preview application, and storing the to-be-previewed prototype data packet to a first file path; and rendering the prototype data packet to be previewed in the first file path to a windshield of the vehicle through head-up display of the vehicle. According to the embodiment of the invention, through the prototype preview application, verification of various UI design prototype packages of the HUD can be realized, the whole process does not involve operation of a code level, the operation is relatively simple and convenient, the technical threshold of UI design verification is reduced, and the development labor cost is saved.

Description

Technical Field

[0001] This application relates to the technical field of vehicle testing, and in particular, to a head-up display method, a computer device, a storage medium, and a program product. Background Art

[0002] Head Up Display (HUD) is a display technology whose main function is to project important information (such as speed, navigation instructions, warning information, etc.) in front of the driver's field of vision (such as the windshield), so that the driver does not need to look down at the instrument panel or the central control screen, thereby reducing distraction and improving driving safety.

[0003] During the R & D process of HUD, it is necessary to verify the product design. In related technologies, software development engineers write test codes for the product design, and the test codes are pushed and verified on a real vehicle. After verification, the package is pushed back to the version before verification.

[0004] The overall operation of the above method is relatively complex, and it requires engineers with a development background to complete, which greatly increases the development labor cost of HUD. Summary of the Invention

[0005] In view of this, this application provides at least a head-up display method, a computer device, a storage medium, and a program product.

[0006] The technical solution of the embodiment of this application is implemented as follows: On the one hand, the embodiment of this application provides a head-up display method, including: loading a prototype preview application into the application program list of the vehicle to enable the vehicle to have the function of the prototype preview application; obtaining a prototype data packet to be previewed through the prototype preview application, and storing the prototype data packet to be previewed in a first file path; rendering the prototype data packet to be previewed in the first file path to the windshield of the vehicle through the head-up display of the vehicle.

[0007] In some embodiments, the above-mentioned loading the prototype preview application into the application program list of the vehicle includes: controlling the head-up display and the central control unit to enter a screen mirroring mode through the vehicle's cockpit domain controller; in the case where the head-up display and the central control unit are in the screen mirroring mode, loading the prototype preview application into the application program list of the vehicle through the central control unit.

[0008] In some embodiments, obtaining a prototype data packet to be previewed through a prototype preview application and storing the prototype data packet to be previewed in a first file path includes: selecting, through the prototype preview application, the prototype data packet to be previewed from multiple prototype data packets in a second file path; the types of the prototype data packets at least include: a prototype picture packet, a prototype sequence frame packet, and a prototype video packet; in response to a confirmation instruction regarding the prototype data packet to be previewed, deleting the historical prototype data packet in the first file path; storing the prototype data packet to be previewed in the first file path; the first file path is shared by a central control unit and a head-up display.

[0009] In some embodiments, rendering the prototype data packet to be previewed in the first file path on the windshield of the vehicle through the head-up display of the vehicle includes: scanning the data in the first file path at a preset time interval through the head-up display to obtain the prototype data packet to be previewed; rendering the prototype data packet to be previewed on the windshield of the vehicle.

[0010] In some embodiments, the head-up display method further includes: receiving a pull message sent by the cloud in a first transmission protocol; pulling multiple prototype data packets from the cloud in a second transmission protocol based on the pull message; storing the multiple prototype data packets in a second file path of the central control unit.

[0011] In some embodiments, controlling the head-up display and the central control unit to enter a screen mirroring mode through the cockpit domain controller of the vehicle includes: in response to a first instruction regarding the head-up display screen mirroring function triggered on the engineering mode interface of the cockpit domain controller, turning on the head-up display screen mirroring function to enable the central control unit to enter the screen mirroring mode; through the central control unit, transmitting the turned-on state of the head-up display screen mirroring function to the head-up display in a dual-screen interaction protocol to enable the head-up display to enter the screen mirroring mode and perform rendering in a first mode.

[0012] In some embodiments, the head-up display method further includes: in response to a second instruction regarding the head-up display screen mirroring function triggered on the engineering mode interface of the cockpit domain controller, turning off the head-up display screen mirroring function to enable the central control unit to exit the screen mirroring mode, closing the prototype preview application; hiding the entry of the prototype preview application in the application list; deleting the prototype data packet in the first file path; through the central control unit, transmitting the turned-off state of the head-up display screen mirroring function to the head-up display in a dual-screen interaction protocol to enable the head-up display to exit the screen mirroring mode and perform rendering in a second mode.

[0013] On the other hand, an embodiment of the present application provides a head-up display device, including: a loading module, configured to load a prototype preview application into the application list of the vehicle, so that the vehicle has the function of the prototype preview application; an acquisition module, configured to obtain a prototype data packet to be previewed through the prototype preview application, and store the prototype data packet to be previewed in a first file path; a rendering module, configured to render the prototype data packet to be previewed in the first file path onto the windshield of the vehicle through the head-up display of the vehicle.

[0014] In yet another aspect, an embodiment of the present application provides a computer device, including a memory and a processor. The memory stores a computer program that can run on the processor, and when the processor executes the program, it implements some or all of the steps in the above method.

[0015] In still another aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements some or all of the steps in the above method.

[0016] In still another aspect, an embodiment of the present application provides a computer program, including computer-readable code. When the computer-readable code runs in a computer device, a processor in the computer device executes to implement some or all of the steps in the above method.

[0017] In still another aspect, an embodiment of the present application provides a computer program product. The computer program product includes a non-transitory computer-readable storage medium storing a computer program. When the computer program is read and executed by a computer, it implements some or all of the steps in the above method.

[0018] In the embodiment of the present application, the prototype preview application is loaded into the application list of the vehicle, so that the vehicle can obtain the prototype data packet to be previewed, and then the previewed prototype data packet is rendered onto the windshield of the vehicle to implement the verification of the UI design prototype package of the HUD. The verification includes the verification of the prototype picture package, the verification of the prototype sequence frame package, and the verification of the prototype video package, etc. In this way, through the prototype preview application, the verification of multiple UI design prototype packages of the HUD can be realized. The whole process does not involve operations at the code level, the operation is relatively simple, the technical threshold of UI design verification is reduced, and the development labor cost is saved. Moreover, the head-up display method provided by the embodiment of the present application can not only realize the UI design prototype preview of the HUD, but also realize the UI design prototype preview of other application programs in the vehicle, and has strong applicability. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 is a schematic implementation flow diagram of a head-up display method provided by an embodiment of the present application Figure 1 ; Figure 2Schematic diagram of the type of prototype data packet in a head-up display method provided by an embodiment of the present application; Figure 3 Schematic flow chart of the implementation of a head-up display method provided by an embodiment of the present application Figure 2 ; Figure 4 Schematic flow chart of the implementation of a head-up display method provided by an embodiment of the present application Figure 3 ; Figure 5 Schematic flow chart of the implementation of the acquisition method of the UI design prototype package in a head-up display method provided by an embodiment of the present application; Figure 6 Schematic flow chart of the implementation of the head-up display (HUD) and Android entering the screen mirroring mode in a head-up display method provided by an embodiment of the present application; Figure 7 Schematic flow chart of the implementation of storing the UI design prototype in the shared file path in a head-up display method provided by an embodiment of the present application; Figure 8 Schematic flow chart of the implementation of rendering the UI design prototype package in a head-up display method provided by an embodiment of the present application; Figure 9 Schematic flow chart of the implementation of Android and HUD exiting the screen mirroring mode in a head-up display method provided by an embodiment of the present application; Figure 10 Schematic diagram of the composition structure of a head-up display device provided by an embodiment of the present application; Figure 11 Schematic diagram of the hardware entity of a computer device provided by an embodiment of the present application. Detailed implementation manners

[0020] The technical solutions of the present application will be further elaborated in detail below with reference to the accompanying drawings and specific embodiments.

[0021] In order to enable those skilled in the art to better understand the solutions of the embodiments of the present application, the technical solutions in the embodiments of the present application will be clearly described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments.

[0022] In the embodiments of the specification, claims, and the above-mentioned drawings of this application, terms such as "first", "second", and "third" are used to distinguish similar objects and do not necessarily describe a specific order or sequence. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a method, system, product, or device comprising a series of steps or units does not necessarily limit to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products, or devices.

[0023] To better understand the head-up display method provided in this application, the related technologies involved in this application will be described first below.

[0024] HUD is an early flight assistance instrument applied to aircraft. Pilots can see the important information they need without having to lower their heads, which can reduce the frequency of pilots looking down at the instruments, avoid attention interruption, and prevent loss of situational awareness.

[0025] With the development of science and technology, HUD is also widely used in vehicles. The head-up display in a vehicle can display important driving information, such as speed, engine revolutions, fuel consumption, tire pressure, navigation, and information from external intelligent devices, etc., in real time on the front windshield within the driver's field of vision. This enables the driver to see the driving information without having to lower their head, thus avoiding distraction from the road ahead and eliminating potential driving hazards. Moreover, since the virtual image falls directly in front of the vehicle during projection, the time for the driver to adjust the visual focus will be shortened, which is safer for the driver. At the same time, the driver does not have to adjust their eyes between looking at the distant road and the nearby instrument panel, which can avoid eye fatigue and greatly enhance driving safety and improve the driving experience.

[0026] During the R & D process of HUD, to verify the product design, software development engineers need to write code to perform package pushing and verification on a real vehicle to see the effect of the product design. After verification, the package is pushed back to the version before verification. The overall operation is relatively complex and requires engineers with a development background to complete, increasing the development labor cost of HUD.

[0027] Therefore, the embodiments of this application provide a head-up display method, which can be applied to a computer device. The computer device can be a device in a vehicle or other devices outside the vehicle. For example, the vehicle can be a new energy-driven vehicle. The computer device includes but is not limited to fixed devices and / or mobile devices. For example, the fixed devices include but are not limited to: personal computers (PCs) or servers.

[0028] Figure 1Schematic implementation process of a head-up display method provided by an embodiment of this application Figure 1 As Figure 1 shown, the method may include the following steps 101 to 103: Step 101: Load the prototype preview application into the application list of the vehicle to enable the vehicle to have the functions of the prototype preview application.

[0029] The prototype preview application is used to manage prototype data packets. In some embodiments, the prototype preview application is used to: scan the prototype data packets to be projected on the external storage device or fixed file path, and store the prototype data packets to be projected on the shared file path. Among them, the external storage device may include, but is not limited to: Universal Serial Bus Flash Drive (USB flash drive), TransFlash (TF card). In addition, the prototype preview application also supports operations such as adding, modifying, and deleting prototype data packets.

[0030] The prototype data packet refers to a data packet composed of relevant data involved in the User Interface (UI) design for the head-up display. The prototype data packet can also be called a prototype verification packet or a UI design prototype packet.

[0031] In some embodiments, the relevant data includes the UI interface shown to the user, the interaction between UI interfaces, the triggering methods of the interaction (such as buttons, pictures, web addresses, etc.), the size of the UI interface, the layout of the UI interface, and the text, pictures, videos, etc. included in each section.

[0032] In some embodiments, as Figure 2 shown, the types of prototype data packets at least include: UI design prototype picture packet, UI design prototype sequence frame packet, and UI design prototype video packet. Among them, the prototype picture packet refers to a data packet composed of multiple UI pictures designed for the head-up display; the prototype sequence frame packet refers to a data packet composed of multiple UI sequence frames designed for the head-up display; the prototype video packet refers to a UI video designed for the head-up display.

[0033] The application list (Application list, APPlist) refers to the set of some or all application programs included in the vehicle. Loading the prototype preview application into the application list of the vehicle is to enable the vehicle to have the functions of the prototype preview application.

[0034] In some embodiments, the specific implementation manner of step 101 may be: through the central control unit, load the prototype preview application into the application list of the vehicle.

[0035] Step 102: Obtain the prototype data packet to be previewed through the prototype preview application, and store the prototype data packet to be previewed in the first file path.

[0036] The prototype data packet to be previewed refers to the prototype data packet that needs to be verified currently. The first file path is shared by the central control unit and the HUD, and can also be called the shared file path.

[0037] In some embodiments, the specific implementation of step 102 may be: obtain the prototype data packet to be previewed in the fixed file path through the prototype preview application; in response to the confirmation instruction regarding the prototype data packet to be previewed, store the prototype data packet to be previewed in the first file path.

[0038] Step 103: Render the prototype data packet to be previewed in the first file path to the windshield of the vehicle through the head-up display of the vehicle.

[0039] Since the first file path is shared by the central control unit and the HUD, the HUD can obtain the prototype data packet to be previewed in the first file path, and then render it to the windshield of the vehicle.

[0040] In some embodiments, the specific implementation of step 103 may be: after storing the prototype data packet to be previewed in the first file path, send a rendering instruction to the head-up display so that the head-up display renders the prototype data packet to be previewed in the first file path to the windshield of the vehicle.

[0041] In some embodiments, the specific implementation of step 103 may be: through the head-up display, scan the data in the first file path at preset time intervals to obtain the prototype data packet to be previewed in the first file path, and then render the prototype data packet to be previewed in the first file path to the windshield of the vehicle.

[0042] In some embodiments, after rendering the prototype data packet to be previewed to the windshield of the vehicle, compare whether the rendered prototype data packet matches the reference prototype data packet. The reference prototype data packet refers to the prototype data packet designed by the developer. Whether the rendered prototype data packet matches the reference prototype data packet at least includes: whether there are display differences such as distortion and color difference in the rendered prototype data packet, and whether the layout and content of the rendered prototype data packet are the same as those of the reference prototype data packet.

[0043] Since the vehicle does not have the UI design prototype preview function of HUD, a prototype preview application with the UI design prototype preview function is configured and loaded into the application list of the vehicle, so that the vehicle can obtain the prototype data packet to be previewed, and then render the previewed prototype data packet onto the windshield of the vehicle to achieve the UI design prototype preview of HUD.

[0044] It should be noted that in addition to realizing the UI design prototype preview for HUD, the head-up display method of the present application can also be used to realize the UI design prototype preview for other application programs.

[0045] In the embodiment of the present application, the prototype preview application is loaded into the application list of the vehicle, so that the vehicle can obtain the prototype data packet to be previewed, and then render the previewed prototype data packet onto the windshield of the vehicle to achieve the verification of the UI design prototype package of HUD. The verification includes the verification of the prototype picture package, the verification of the prototype sequence frame package, and the verification of the prototype video package, etc. In this way, through the prototype preview application, the verification of multiple UI design prototype packages of HUD can be realized. The whole process does not involve operations at the code level, the operation is relatively simple, the technical threshold of UI design verification is reduced, and the development labor cost is saved. Moreover, the head-up display method provided by the embodiment of the present application can not only realize the UI design prototype preview of HUD, but also realize the UI design prototype preview of other application programs in the vehicle, and has strong applicability.

[0046] Figure 3 Schematic diagram of the implementation process of a head-up display method provided by an embodiment of the present application Figure 2 As Figure 3 shown, the method may include the following steps 301 to step 307: Step 301, through the cockpit domain controller of the vehicle, control the head-up display and the central control unit to enter the screen mirroring mode.

[0047] The cockpit domain controller is an integrated device used to centrally manage and control various functions in the vehicle cockpit. The cockpit domain controller integrates multiple independent control units (such as: instrument panel, air conditioning control, driving assistance, etc.). Its core purpose is to optimize the function control in the vehicle cockpit through a centralized method, improving the user experience and system efficiency.

[0048] The central control unit is used to load (release) the prototype preview application into the application list and control the opening and closing of the prototype preview application.

[0049] In some embodiments, the specific implementation of step 301 may be as follows: in response to a first instruction regarding the head-up display mirroring function triggered on the engineering mode interface of the cockpit domain controller, the head-up display mirroring function is turned on, so that the central control unit enters the mirroring mode; through the central control unit, the on state of the head-up display mirroring function is transmitted to the head-up display via a dual-screen interaction protocol, so that the head-up display enters the mirroring mode and performs rendering in a first mode.

[0050] The first instruction is used to turn on the head-up display mirroring function.

[0051] The engineering mode interface of the cockpit domain controller is used for developing and testing the functions of the intelligent cockpit system. It provides in-depth access to hardware and software functions, facilitating developers to perform debugging, performance testing, and custom development. The dual-screen interaction protocol is used to implement communication between the central control unit and the HUD to transmit the on / off state of the head-up display mirroring function to the HUD. The dual-screen interaction protocol can be socket communication. The first mode refers to the mode of previewing prototype data packets.

[0052] In some embodiments, a switch for the head-up display mirroring function is developed on the engineering mode interface of the cockpit domain controller; when the switch is "turned on", the head-up display mirroring function is turned on; when the switch of the head-up display mirroring function is in the on state, the central control unit enters the mirroring mode; the central control unit transmits the on state of the head-up display mirroring function to the head-up display via a dual-screen interaction protocol; when the head-up display receives the on state of the head-up display mirroring function, it enters the mirroring mode.

[0053] Step 302: In the case where the head-up display and the central control unit are in the mirroring mode, the prototype preview application is loaded into the application program list of the vehicle through the central control unit.

[0054] Here, steps 301 to 302 correspond to the aforementioned step 101, and the specific implementation can refer to the specific implementation of the aforementioned step 101 when implemented.

[0055] In some embodiments, after the central control unit enters the mirroring mode, the prototype preview application can be loaded into the application program list of the vehicle. At the same time, the on state of the head-up display mirroring function is transmitted to the head-up display to improve processing efficiency.

[0056] Step 303: Through the prototype preview application, the prototype data packet to be previewed is selected from multiple prototype data packets in the second file path; the types of the prototype data packets at least include: prototype picture packets, prototype sequence frame packets, and prototype video packets.

[0057] The second file path is a fixed folder in the central control unit. For example, the second file path can be the path of the data database. The prototype preview application can scan the prototype data packets in the second file path.

[0058] In some embodiments, the specific implementation of "selecting the prototype data packet to be previewed from multiple prototype data packets in the second file path" in step 303 can be: selecting the prototype data packet to be previewed from multiple prototype data packets in the second file path according to the priority of the prototype data packet. The priority of the prototype data packet can be confirmed based on the importance of the prototype data packet, the interaction order of the prototype data packet, and the identifier of the prototype data packet.

[0059] In some embodiments, the specific implementation of "storing multiple prototype data packets to the second file path of the central control unit" can be: receiving a pull message sent by the cloud in the first transmission protocol; based on the pull message, pulling multiple prototype data packets from the cloud in the second transmission protocol; storing multiple prototype data packets to the second file path of the central control unit.

[0060] The first transmission protocol is used to send a pull message to the vehicle. The pull message is used to instruct the vehicle to pull multiple prototype data packets from the cloud. The second transmission protocol is used to pull multiple prototype data packets from the cloud. For example, the first transmission protocol can be the Message Queuing Telemetry Transport (MQTT), and the second transmission protocol is the HyperText Transfer Protocol (HTTP).

[0061] In some embodiments, the specific implementation of "storing multiple prototype data packets to the second file path of the central control unit" can also be: copying multiple prototype data packets to a USB flash drive or a TF card; inserting the USB flash drive or the TF card into the USB interface of the cockpit domain controller to store multiple prototype data packets to the second file path of the central control unit.

[0062] Step 304, in response to a confirmation instruction regarding the prototype data packet to be previewed, delete the historical prototype data packet in the first file path.

[0063] The historical prototype data packet refers to the prototype data packet previously stored in the first file path.

[0064] In some embodiments, after the central control unit enters the screen mirroring mode, the prototype preview application is placed in the application list, which facilitates the user to select the prototype data packet to be previewed on the central control screen. At this time, the user presses and holds the prototype data packet that needs to be rendered currently through the central control unit; after pressing the prototype data packet that needs to be rendered currently, a secondary confirmation dialog box for whether to perform screen mirroring pops up. After clicking the "OK" button, the prototype data packet that needs to be rendered currently is used as the prototype data packet to be rendered, and a confirmation instruction regarding the prototype data packet to be previewed is triggered.

[0065] Step 305: Store the prototype data packet to be previewed in the first file path; the first file path is shared by the central control unit and the head-up display.

[0066] Here, steps 303 to 305 correspond to the aforementioned step 102, and the specific implementation method of the aforementioned step 102 can be referred to during implementation.

[0067] Since the first file path is shared by the central control unit and the HUD, the prototype data packet can be transferred from the second file path (fixed file path) to the first file path (shared file path) through the central control unit, so that the HUD can obtain the prototype data packet to be previewed in the first file path, and then render it on the windshield of the vehicle.

[0068] It should be noted that after deleting the historical prototype data packet in the first file path and then storing the prototype data packet to be previewed, it is to ensure that only the current prototype data packet to be previewed is stored in the first file path, which is convenient for the head-up display to obtain and render the prototype data packet to be previewed, and the UI design verification of the prototype data packet to be previewed is completed.

[0069] Step 306: Through the head-up display, scan the data in the first file path every preset time period to obtain the prototype data packet to be previewed.

[0070] The preset time period can be set in advance, and specifically can be set according to actual business requirements. For example, the preset time period can be set to 1 second.

[0071] Step 307: Render the prototype data packet to be previewed on the windshield of the vehicle.

[0072] Here, steps 306 to 307 correspond to the aforementioned step 103, and the specific implementation method of the aforementioned step 103 can be referred to during implementation.

[0073] In some embodiments, after verifying the prototype data packet to be previewed, the head-up display screen mirroring function can also be exited through the following steps 308 to 311: Step 308: In response to a second instruction triggered on the engineering mode interface of the cockpit domain controller, turn off the head-up display projection function, so that the central control unit exits the projection mode and closes the prototype preview application.

[0074] The second instruction is used to turn off the head-up display function.

[0075] In some embodiments, on the engineering mode interface of the cockpit domain controller, turn off the head-up display projection function; when the switch of the head-up display projection function is in the off state, the central control unit exits the projection mode.

[0076] Step 309: Hide the entry of the prototype preview application in the application list.

[0077] Step 310: Delete the prototype data packet in the first file path.

[0078] Step 311: Through the central control unit, transmit the off state of the head-up display projection function to the head-up display via the dual-screen interaction protocol, so that the head-up display exits the projection mode and performs rendering in the second mode.

[0079] The second mode refers to the normal user mode.

[0080] In some embodiments, the specific implementation of step 311 may be: the central control unit transmits the off state of the head-up display projection function to the head-up display via the dual-screen interaction protocol; when the head-up display receives the off state of the head-up display projection function, it exits the projection mode.

[0081] It should be noted that the operations of the central control unit exiting the projection mode and the head-up display exiting the projection mode can be performed simultaneously or sequentially, and the embodiments of the present application do not limit this.

[0082] In the embodiments of the present application, the prototype preview application is loaded into the application list of the vehicle, so that the vehicle can obtain the prototype data packet to be previewed, and then the previewed prototype data packet is rendered on the windshield of the vehicle to implement the verification of the HUD UI design prototype package, and the verification includes the verification of the prototype picture package, the verification of the prototype sequence frame package, and the verification of the prototype video package, etc. In this way, through the prototype preview application, multiple HUD UI design prototype packages can be verified. The whole process does not involve operations at the code level, the operation is relatively simple, the technical threshold of UI design verification is reduced, and the development labor cost is saved. Moreover, the head-up display method provided by the embodiments of the present application can not only implement the HUD UI design prototype preview, but also implement the UI design prototype preview of other application programs in the vehicle, and has strong applicability. The following describes the application of the head-up display method provided by the embodiments of the present application in an actual scenario.

[0083] An embodiment of the present application provides a method for implementing HUD screen mirroring display (corresponding to the above head-up display method), which can realize the verification of the UI design prototype package of HUD, including picture prototype verification, sequence frame prototype verification, and prototype video verification. The specific implementation method can be: inserting a USB flash drive or TF card with the UI design prototype package into the USB interface of the in-vehicle cockpit domain controller, or uploading the UI design prototype package to the cloud and sending it to the cockpit domain controller, and casting the UI design prototype package to the windshield by operating the screen of the central control unit, so as to quickly verify the UI design prototype, solve the complex operations of hard coding and pushing packages in the existing solutions, reduce the technical threshold of operators, and save the labor cost of development engineers.

[0084] Copy the UI design prototype package to a USB flash drive or TF card. The types of the UI design prototype package include a prototype picture package, a prototype sequence frame package, and a prototype video package. Insert the USB flash drive or TF card into the USB interface of the cockpit domain controller; or upload the UI design prototype package to the cloud and push it to the vehicle through message push (MQTT). After receiving the push, the vehicle pulls down the UI design prototype package from the cloud through HTTP and stores it in a fixed file path (corresponding to the above second file path), and then enters the engineering mode page of the cockpit domain controller to turn on the "HUD screen mirroring function" switch, so that the central control unit (Android) and HUD can enter the screen mirroring mode.

[0085] After Android enters the screen mirroring mode, release the prototype preview application in the APPlist. The prototype preview application has the following functions: in the prototype preview application, the UI design prototype package to be screen mirrored can be scanned in the USB flash drive or TF card or the fixed file path, and the deletion of the UI design prototype package is supported; after long pressing the UI design prototype package, a secondary confirmation pop-up box for whether to perform screen mirroring will pop up, and after clicking "Confirm", this UI design prototype package can be screen mirrored and displayed on the HUD. After HUD enters the screen mirroring mode, it will display according to the UI design prototype package selected on Android. After the verification is completed, enter the engineering mode page of the cockpit domain controller to turn off the "HUD screen mirroring function" switch, Android closes the prototype preview application, and hides the entry of the prototype preview application in the APPlist; HUD will turn off the screen mirroring function and restore to the normal user mode.

[0086] As Figure 4 shown, based on the above content, the overall process of this method may include the following steps 401 to step 405: Step 401: Insert a USB flash drive with the UI design prototype package into the USB interface of the cockpit domain controller; or upload the UI design prototype package to the cloud and send it to the cockpit domain controller.

[0087] Step 402: Turn on the "HUD screen mirroring function" in the engineering mode interface of the cockpit domain controller.

[0088] Step 403: Long - press and select the UI design prototype package to be screen - casted through the prototype preview application.

[0089] Step 404: The HUD renders the UI design prototype package to be screen - casted.

[0090] Step 405: Turn off the "HUD screen - casting function" in the engineering mode interface of the cockpit domain controller.

[0091] The specific implementation of this method is as follows: As Figure 5 shown, the acquisition method of the UI design prototype package includes: Step 501: The designer uploads the UI design prototype package to the cloud. Step 502: The cloud pushes the message (MQTT) to the cockpit domain controller. Step 503: The cockpit domain controller pulls down the UI design prototype from the cloud through the HTTP method and stores it in the fixed file path (data database) of the Android system.

[0092] As Figure 6 shown, develop a "HUD screen - casting function" switch in the engineering mode interface of the cockpit domain controller. At this time, the implementation methods for the HUD and Android to enter the screen - casting mode can include: Step 601: Open the "HUD screen - casting function" in the engineering mode interface of the cockpit domain controller. Step 602: Android transmits the open state of the "HUD screen - casting function" to the HUD through Socket communication. Step 603: The HUD enters the screen - casting mode. Step 604: Android enters the screen - casting mode. Among them, the operations from Step 602 to Step 603 and the operation of Step 604 can be carried out simultaneously.

[0093] When the "HUD screen - casting function" switch is in the open state, as Figure 7 shown, the UI design prototype can be stored in the shared file path through the following steps 701 to 706 so that the HUD can obtain it. Step 701: Android enters the screen - casting mode and releases the prototype preview application in the APPlist. Step 702: Open the prototype preview application, and the prototype preview application scans the UI design prototype package in the USB flash drive, or TF card, or fixed file path and displays it. Step 703: Long - press and select the UI design prototype package to be screen - casted in the prototype preview application. Step 704: Confirm whether to screen - cast. If it is determined to screen - cast, execute Step 705; if it is determined not to screen - cast, end. Step 705: Delete the UI design prototype package in the shared path folder of Android and the HUD. Step 706: Store the selected UI design prototype package in the shared path folder of Android and the HUD.

[0094] Among them, the prototype preview application has the following functions: The UI design prototype package to be screen-cast can be scanned through the prototype preview application from a USB flash drive, a TF card, or a fixed file path; and the deletion of the UI design prototype package is supported; when entering the screen-cast mode, after long-pressing the UI design prototype package of the prototype preview application, a secondary confirmation dialog box will pop up; after "confirmation", first delete the UI design prototype package in the shared path folders of Android and HUD, and then store the selected UI design prototype package in the shared path folders of Android and HUD.

[0095] When the "HUD screen-cast function" switch received by HUD is in the on state, as Figure 8 shown, the UI design prototype package can be rendered through the following steps 801 to step 806. Step 801, HUD enters the screen-cast mode. Step 802, HUD periodically obtains the UI design prototype package in the shared paths of Android and HUD at 1S (calibratable). Step 803, whether the UI design prototype package is obtained. If the UI design prototype package is obtained, execute step 804; if the UI design prototype package is not obtained, execute step 806. Step 804, read the UI design prototype package in the shared path folders of Android and HUD. Step 805, render the read UI design prototype package. Step 806, display "Please open the prototype preview application on the center console screen and select the UI design prototype package to be screen-cast" on HUD.

[0096] After the engineer finishes validating the UI design prototype package, as Figure 9 shown, Android and HUD can exit the screen-cast mode through the following steps 901 to step 906. Step 901, turn off the "HUD screen-cast function" in the engineering mode interface of the cockpit domain controller. Step 902, Android exits the screen-cast mode. Step 903, Android closes the prototype preview application, hides the entry of the prototype preview application in the APP list, and deletes the UI design prototype package in the shared path of Android and HUD. Step 904, Android transmits the off state of the "HUD screen-cast function" to HUD through Socket communication. Step 905, HUD exits the screen-cast mode. Step 906, HUD renders in the normal mode. Based on the foregoing embodiments, an embodiment of the present application provides a head-up display device. The device includes each unit included and each module included in each unit, and can be implemented by a processor in a computer device; of course, it can also be implemented by specific logic circuits. During implementation, the processor can be a central processing unit (CPU), a microprocessor unit (MPU), a digital signal processor (DSP), or a field programmable gate array (FPGA), etc.

[0097] Figure 10 FIG. is a schematic structural diagram of a head-up display device provided by an embodiment of the present application. As Figure 10 shown, the head-up display device 1000 includes: a loading module 1010, an acquisition module 1020, and a rendering module 1030, where: The loading module 1010 is configured to load a prototype preview application into the application list of the vehicle; The acquisition module 1020 is configured to obtain a prototype data packet to be previewed through the prototype preview application, and store the prototype data packet to be previewed in a first file path; The rendering module 1030 is configured to render the prototype data packet to be previewed in the first file path onto the windshield of the vehicle through the head-up display.

[0098] In some embodiments, the loading module 1010 is further configured to: control the head-up display and the center console to perform a screen mirroring mode through the vehicle's cockpit domain controller; in the case where the head-up display and the center console perform a screen mirroring mode, load the prototype preview application into the application list of the vehicle through the center console.

[0099] In some embodiments, the acquisition module 1020 is further configured to: select a prototype data packet to be previewed from multiple prototype data packets in a second file path through the prototype preview application; the types of the prototype data packets at least include: a prototype picture packet, a prototype sequence frame packet, and a prototype video packet; in response to a confirmation instruction regarding the prototype data packet to be previewed, delete the historical prototype data packet in the first file path; store the prototype data packet to be previewed in the first file path; the first file path is shared by the center console and the head-up display.

[0100] In some embodiments, the rendering module 1030 is further configured to: scan the data in the first file path through the head-up display at preset time intervals to obtain the prototype data packet to be previewed; render the prototype data packet to be previewed onto the windshield of the vehicle.

[0101] In some embodiments, the obtaining module 1020 is further configured to: receive a pull message sent by the cloud in a first transmission protocol; based on the pull message, pull multiple prototype data packets from the cloud in a second transmission protocol; store the multiple prototype data packets in a second file path of the central control unit.

[0102] In some embodiments, the loading module 1010 is further configured to: respond to a first instruction regarding the head-up display mirroring function triggered in the engineering mode interface of the cockpit domain controller, turn on the head-up display mirroring function, so that the central control unit enters the mirroring mode; through the central control unit, transmit the on state of the head-up display mirroring function to the head-up display in a dual-screen interaction protocol, so that the head-up display enters the mirroring mode and performs rendering in a first mode.

[0103] In some embodiments, the loading module 1010 is further configured to: respond to a second instruction triggered in the engineering mode interface of the cockpit domain controller, turn off the head-up display mirroring function, so that the central control unit exits the mirroring mode, close the prototype preview application; hide the entry of the prototype preview application in the application list; delete the prototype data packet in the first file path; through the central control unit, transmit the off state of the head-up display mirroring function to the head-up display in a dual-screen interaction protocol, so that the head-up display exits the mirroring mode and performs rendering in a second mode.

[0104] The description of the above device embodiments is similar to that of the above method embodiments and has similar beneficial effects to those of the method embodiments. In some embodiments, the functions or modules included in the device provided in the embodiments of the present application can be used to execute the methods described in the above method embodiments. For the technical details not disclosed in the device embodiments of the present application, please refer to the description of the method embodiments of the present application for understanding.

[0105] It should be noted that in the embodiments of the present application, if the above head-up display method is implemented in the form of software function modules and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the embodiments of the present application, in essence, or the part that contributes to the related technology, can be embodied in the form of a software product. The software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROMs), magnetic disks, or optical discs that can store program codes. In this way, the embodiments of the present application are not limited to any specific hardware, software, or firmware, or any combination among hardware, software, and firmware.

[0106] The embodiments of the present application provide a computer device, including a memory and a processor. The memory stores a computer program that can run on the processor, and when the processor executes the program, it implements some or all of the steps in the above method.

[0107] The embodiments of the present application provide a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by the processor, it implements some or all of the steps in the above method. The computer-readable storage medium can be transient or non-transient.

[0108] The embodiments of the present application provide a computer program, including computer-readable code. When the computer-readable code runs in a computer device, the processor in the computer device executes to implement some or all of the steps in the above method.

[0109] The embodiments of the present application provide a computer program product. The computer program product includes a non-transient computer-readable storage medium storing a computer program. When the computer program is read and executed by a computer, it implements some or all of the steps in the above method. The computer program product can be specifically implemented in a manner of hardware, software, or a combination thereof. In some embodiments, the computer program product is specifically embodied as a computer storage medium. In other embodiments, the computer program product is specifically embodied as a software product, such as a software development kit (SDK), etc.

[0110] It should be noted here that: the descriptions of the above embodiments tend to emphasize the differences between the embodiments, and their similarities can be referred to each other. The descriptions of the above embodiments of the device, storage medium, computer program, and computer program product are similar to the descriptions of the above method embodiments and have similar beneficial effects to those of the method embodiments. For the technical details not disclosed in the embodiments of the device, storage medium, computer program, and computer program product of the present application, please refer to the descriptions of the method embodiments of the present application for understanding.

[0111] It should be noted that Figure 11 is a schematic diagram of a hardware entity of a computer device in an embodiment of the present application. As Figure 11 shown, the hardware entity of the computer device 1100 includes: a processor 1101, a communication interface 1102, and a memory 1103, where: The processor 1101 generally controls the overall operation of the computer device 1100.

[0112] The communication interface 1102 enables the computer device to communicate with other terminals or servers through a network.

[0113] The memory 1103 is configured to store instructions and applications executable by the processor 1101, and can also cache data to be processed or already processed by the processor 1101 and each module in the computer device 1100 (for example, image data, audio data, voice communication data, and video communication data), and can be implemented by flash memory (FLASH) or random access memory (Random Access Memory, RAM). Data transmission can be performed between the processor 1101, the communication interface 1102, and the memory 1103 through a bus 1104.

[0114] It should be understood that the "one embodiment" or "an embodiment" mentioned throughout the specification means that the specific features, structures, or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, the appearances of "in one embodiment" or "in an embodiment" throughout the specification do not necessarily refer to the same embodiment. In addition, these specific features, structures, or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the magnitudes of the sequence numbers of the above steps / processes do not mean the order of execution. The execution order of each step / process should be determined by its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present application. The sequence numbers of the embodiments of the present application above are only for description and do not represent the advantages or disadvantages of the embodiments.

[0115] It should be noted that in this article, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, such that a process, method, article or device comprising a series of elements not only includes those elements but also includes other elements not expressly listed, or also includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "comprising a..." does not exclude the presence of additional identical elements in the process, method, article or device comprising such element.

[0116] In several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division, and there may be other division methods in actual implementation. For example, multiple units or components can be combined, or can be integrated into another system, or some features can be ignored, or not executed. In addition, the couplings, direct couplings, or communication connections between the various components shown or discussed may be through some interfaces, and the indirect couplings or communication connections of devices or units may be electrical, mechanical, or other forms.

[0117] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units; they may be located in one place or distributed to multiple network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0118] In addition, in each embodiment of this application, the various functional units can all be integrated in one processing unit, or each unit can be separately regarded as a unit, or two or more units can be integrated in one unit; the above-mentioned integrated units can be implemented in the form of hardware, or in the form of a combination of hardware and software functional units.

[0119] Those of ordinary skill in the art can understand that all or part of the steps for implementing the above method embodiments can be completed by hardware related to program instructions. The foregoing program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps including the above method embodiments; and the foregoing storage medium includes: various media such as removable storage devices, read-only memory (ROM), magnetic disks, or optical discs that can store program codes.

[0120] Alternatively, if the above integrated units of the present application are implemented in the form of software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present application, in essence or the part that contributes to the related technology, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in various embodiments of the present application. The foregoing storage medium includes: various media that can store program codes such as removable storage devices, ROMs, magnetic disks, or optical discs.

[0121] As described above, the above are only the implementation manners of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present application can easily think of changes or substitutions, which should all be covered within the protection scope of the present application.

Claims

1. A head-up display method, characterized in that: The head-up display method comprises: Loading the prototype preview application to an application list of a vehicle so that the vehicle has the function of the prototype preview application; Obtaining a prototype data package to be previewed through the prototype preview application, and storing the prototype data package to be previewed in a first file path; The prototype data package to be previewed in the first file path is rendered to the windshield of the vehicle through the head-up display of the vehicle.

2. The head-up display method according to claim 1, characterized in that: The application list for loading the prototype preview application into the vehicle includes: Controlling the head-up display and the central control machine to perform screen projection mode through the cockpit domain controller of the vehicle; When the head-up display and the central control machine are in projection mode, the prototype preview application is loaded into the application list of the vehicle through the central control machine.

3. The head-up display method according to claim 1, characterized in that: The method of obtaining a prototype data package to be previewed through the prototype preview application and storing the prototype data package to be previewed in a first file path includes: Selecting the prototype data packet to be previewed from a plurality of prototype data packets in the second file path through the prototype preview application; the types of the prototype data packets at least include: a prototype picture packet, a prototype sequence frame packet, and a prototype video packet; In response to a confirmation instruction regarding the prototype data package to be previewed, deleting the historical prototype data package in the first file path; The prototype data package to be previewed is stored in a first file path; the first file path is shared by the central control machine and the head-up display.

4. The head-up display method according to any one of claims 1 to 3, characterized in that: The step of rendering the prototype data package to be previewed in the first file path to the windshield of the vehicle through the head-up display of the vehicle includes: Scanning the data in the first file path at a preset time interval through the head-up display to obtain the prototype data package to be previewed; The prototype data packet to be previewed is rendered onto the windshield of the vehicle.

5. The head-up display method according to claim 3, characterized in that: The head-up display method further includes: receiving a pull message sent by the cloud using a first transmission protocol; Based on the pull message, pull a plurality of the prototype data packets from the cloud using a second transmission protocol; The plurality of prototype data packages are stored in the second file path of the central control machine.

6. The head-up display method according to claim 2, characterized in that: The controlling the head-up display and the central control machine to perform screen projection mode by the cockpit domain controller of the vehicle includes: In response to a first instruction about a head-up display screen projection function triggered on an engineering mode interface of the cockpit domain controller, turning on the head-up display screen projection function so that the central control machine enters a screen projection mode; The opening state of the head-up display projection function is transmitted to the head-up display through the central control machine using a dual-screen interactive protocol, so that the head-up display enters the projection mode and is rendered in the first mode.

7. The head-up display method according to claim 6, characterized in that: The head-up display method further includes: In response to a second instruction triggered on the engineering mode interface of the cockpit domain controller, the head-up display projection function is turned off to make the central control machine exit the projection mode and close the prototype preview application; hiding the entry of the prototype preview application in the application list; Deleting the prototype data package in the first file path; Through the central control machine, the closed state of the head-up display projection function is transmitted to the head-up display using the dual-screen interactive protocol, so that the head-up display exits the projection mode and is rendered in the second mode.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program executable on the processor, wherein: When the processor executes the program, the steps of the method according to any one of claims 1 to 7 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer program product, comprising a non-transitory computer-readable storage medium storing a computer program, wherein when the computer program is read and executed by a computer, the steps of the method according to any one of claims 1 to 7 are implemented.

Images