In-vehicle infotainment system, in-vehicle infotainment display method and vehicle

Abstract

The invention provides a vehicle-mounted machine system, a display method and a vehicle. The vehicle-mounted machine display method comprises the steps that a vehicle-mounted machine MCU collects a whole vehicle signal; in the vehicle machine SOC, AR algorithm fusion is carried out on a whole vehicle signal and a built-in graphic file through a pre-integrated AR Creator algorithm module, graphic modeling is carried out in combination with human eye calibration data, HUD calibration data and ADAS calibration data, and a graphic file visible to a user is formed; the vehicle machine SOC sends the graphic file to the AR-HUD optical component; and the AR-HUD optical component projects the graphic file to the front windshield for display. The AR-HUD control algorithm, namely the AR Creator algorithm, is integrated into the vehicle-mounted terminal SOC, an additional controller does not need to be added on the hardware level, the AR-HUD optical component can cancel the arrangement of an SOC chip, the AR Creator algorithm and an existing functional module in the vehicle-mounted terminal SOC can be subjected to OTA upgrading together, an OTA upgrading package does not need to be additionally manufactured, and the user experience is improved.

Description

Technical Field

[0001] The present invention relates to the field of augmented reality head-up display, and in particular to a vehicle system, a vehicle display method and a vehicle. Background Art

[0002] The in-vehicle AR-HUD (augmented reality head-up display) is an intelligent product that integrates the entire vehicle information and then feeds it back to the driver in a graphic form. It can effectively prevent the driver from being distracted by looking down at the screen and improve driving safety.

[0003] Reference Figure 1 At present, the AR-HUD solutions used in the industry integrate the HUD control and Creator algorithm into the AR-HUD components, and use the algorithm to form a patterned signal for display after receiving the vehicle signal. This solution requires the use of a separate SOC chip in the AR-HUD component to provide computing power to support the graphics algorithm, resulting in a high cost for AR-HUD. The Creator algorithm is responsible for fusing and processing various information from the vehicle (such as ADAS radar / camera information, map / navigation information, interior camera information, high-precision positioning information, vehicle body status information, etc.), and converting this data into AR image signals through complex algorithms.

[0004] The prior art provides a vehicle-mounted AR-HUD system, including an ADAS, a HUD system, a processing unit and a display screen; wherein the ADAS is used to obtain and analyze vehicle data, the HUD system projects the analysis results onto the display screen, the processing unit recalculates the coordinates displayed on the display screen based on the content of the analysis results and the location where the HUD system is installed in the vehicle, and the display screen is used to display the analysis results based on the content and its corresponding coordinates.

[0005] The prior art also provides an integrated display system based on AR-HUD, which includes: an A-pillar information acquisition module, a night vision information acquisition module, a control unit and an AR-HUD; the control unit is respectively connected to the A-pillar information acquisition module, the night vision information acquisition module and the AR-HUD; the A-pillar information acquisition module is used to collect A-pillar video information, the night vision information acquisition module is used to collect night vision video information, the control unit is used to transmit the A-pillar video information and the night vision video information to the AR-HUD, and the AR-HUD is used to project the A-pillar video information and the night vision video information onto the windshield for display.

[0006] In the above existing technologies, AR-HUD is used as a separate controller to implement the algorithm and control of AR-HUD. Summary of the invention

[0007] The present invention provides a vehicle system, a display method and a vehicle, which are used to solve the problem that a separate controller is required in the prior art to implement an AR-HUD control algorithm.

[0008] The technical solution of the present invention is: On the one hand, the present application provides a vehicle computer display method, comprising: The vehicle MCU collects vehicle signals; The vehicle SOC uses the pre-integrated AR Creator algorithm module to fuse the vehicle signal and the built-in graphic file with the AR algorithm, and combines the human eye calibration data, HUD calibration data, and ADAS calibration data for graphic modeling to form a user-visible graphic file; The vehicle computer SOC sends the graphic file to the AR-HUD optical component; The AR-HUD optical component projects the graphic file onto the windshield for display.

[0009] Preferably, the step of the vehicle computer SOC sending the graphic file to the AR-HUD optical component includes: The vehicle computer SOC serially encodes the graphic file through a serial chip and transmits it to the AR-HUD optical element in a LVDS manner.

[0010] Preferably, the step of the AR-HUD optical component projecting the graphic file onto the windshield for display comprises: After receiving the graphic file, the AR-HUD optical component decodes the graphic file through a deserialization chip, and then transmits the decoded graphic file in the form of an analog signal to the display screen inside the AR-HUD optical component for display. The AR-HUD optical component also projects the decoded graphic file in front of the windshield for display.

[0011] Preferably, the method further comprises: The vehicle MCU receives the OTA upgrade package sent from the cloud; The vehicle computer SOC performs OTA upgrade on the existing functional modules and the ARCreator algorithm module in the vehicle computer SOC according to the OTA upgrade package.

[0012] On the other hand, the present application also provides a vehicle system, including: a vehicle and an AR-HUD optical component; the vehicle includes: a vehicle MCU and a vehicle SOC, and the vehicle SOC is integrated with an AR Creator algorithm module; The vehicle computer MCU collects vehicle signals and sends the vehicle signals to the vehicle computer SOC; The vehicle SOC uses the AR Creator algorithm module to fuse the vehicle signal and the built-in graphic file with an AR algorithm, and combines the human eye calibration data, the HUD calibration data, and the ADAS calibration data for graphic modeling to form a user-visible graphic file; The vehicle computer SOC sends the graphic file to the AR-HUD optical component; The AR-HUD optical component projects the graphic file onto the windshield for display.

[0013] Preferably, the step of the vehicle computer SOC sending the graphic file to the AR-HUD optical component includes: The vehicle computer SOC serially encodes the graphic file through a serial chip and transmits it to the AR-HUD optical element in a LVDS manner.

[0014] Preferably, the step of the AR-HUD optical component projecting the graphic file onto the windshield for display comprises: After receiving the graphic file, the AR-HUD optical component decodes the graphic file through a deserialization chip, and then transmits the decoded graphic file in the form of an analog signal to the display screen inside the AR-HUD optical component for display. The HUD optical component also projects the decoded graphic file in front of the windshield for display.

[0015] Preferably, the vehicle computer MCU sends the whole vehicle signal to the vehicle computer SOC through an SPI interface.

[0016] Preferably, the AR-HUD optical component is not equipped with a SOC chip integrating the AR Creator algorithm.

[0017] On the other hand, the present application also provides a vehicle, comprising the above-mentioned vehicle system.

[0018] The beneficial effects of the present invention are: The algorithm for implementing AR-HUD control, namely the AR Creator algorithm, is integrated into the vehicle SOC, making full use of the surplus computing power of the vehicle SOC to implement AR-HUD control and avoiding the waste of computing power of the vehicle SOC; and at the hardware level, there is no need to add an additional controller to the AR-HUD optical component for AR-HUD control, that is, the SOC chip can be removed from the AR-HUD optical component, thereby reducing the hardware cost of the AR-HUD optical component. Furthermore, since the ARCreator algorithm is integrated into the vehicle SOC, the AR Creator algorithm can be OTA upgraded together with the existing functional modules in the vehicle SOC without the need to make additional OTA upgrade packages, thus improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 It is a block diagram of the AR-HUD solution in the prior art; Figure 2 A schematic diagram of a vehicle computer display method in an embodiment of the present application; Figure 3 This is a principle block diagram of the vehicle-mounted integrated AR Creator algorithm in the embodiment of the present application; Figure 4 This is a functional block diagram of the AR Creator in the embodiment of the present application; Figure 5 A schematic diagram of a vehicle computer outputting a graphic file in an embodiment of the present application; Figure 6 This is a schematic diagram of the AR-HUD in an embodiment of the present application receiving and displaying a graphic file. DETAILED DESCRIPTION

[0020] In order to make the purpose, technical scheme and advantages of the present invention clearer, the present invention is further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings. It should be understood that these descriptions are only exemplary and are not intended to limit the scope of the present invention. In addition, in the following description, the description of well-known structures and technologies is omitted to avoid unnecessary confusion of the concept of the present invention.

[0021] Reference Figure 2 In this embodiment, a vehicle display method is provided, including: S1, the vehicle MCU collects vehicle signals; S2: The vehicle SOC uses the pre-integrated AR Creator algorithm module to fuse the vehicle signal and the built-in graphic file with the AR algorithm, and combines the human eye calibration data, HUD calibration data, and ADAS calibration data for graphic modeling to form a user-visible graphic file. S3, the vehicle SOC sends the graphic file to the AR-HUD optical component; S4, AR-HUD optical components project the graphic file onto the windshield for display.

[0022] The algorithm for implementing AR-HUD control, namely the AR Creator algorithm, is integrated into the vehicle SOC, which makes full use of the surplus computing power of the vehicle SOC to implement AR-HUD control and avoids the waste of computing power of the vehicle SOC. Moreover, at the hardware level, there is no need to add an additional controller to the AR-HUD optical component for AR-HUD control, that is, the SOC chip can be eliminated in the AR-HUD optical component, thereby reducing the hardware cost of the AR-HUD optical component.

[0023] In the embodiments of this application, refer to Figure 2 , Figure 3 and Figure 4 , where the vehicle MCU obtains the vehicle signal through the gateway GW, which includes navigation signal, body signal and ADAS signal. After the vehicle MCU analyzes the vehicle signal, it transmits it to the vehicle SOC through the SPI interface for algorithm fusion.

[0024] The AR Creator algorithm module of the vehicle SOC uses a series of graphic files stored inside the vehicle. These graphic files include road markings, indicator arrows, virtual dashboards, and even dynamic landscapes based on changes in vehicle position.

[0025] After complex calculations and precise fusion of the AR Creator algorithm module, these elements from vehicle signals, graphic files, and calibration data are integrated into a user-visible, highly realistic AR graphic file.

[0026] In the embodiment of the present application, step S3 of the vehicle computer SOC sending the graphic file to the AR-HUD optical component includes: The vehicle computer SOC serially encodes the graphic file through a serial chip and transmits it to the AR-HUD optical element in LVDS (Low-Voltage Differential Signaling) mode.

[0027] The steps for serial encoding of graphic files include: First, the graphic file data to be transmitted (usually parallel data) is input into the serial chip. These data may include image pixel values, color information, transparency information, etc.

[0028] Parallel-to-serial conversion: Inside the serial chip, the input parallel data is converted into serial data through parallel-to-serial conversion. Parallel-to-serial conversion usually uses an N-bit register to temporarily store the parallel data, and then outputs the data in the register to the serial output port bit by bit through the shift operation of the shift register.

[0029] Clock signal synchronization: In the process of parallel-to-serial conversion, a clock signal is needed to synchronize the transmission of data. The clock signal is provided by the clock structure inside the serializer (such as the PLL module) to ensure that the data is sampled and transmitted at the correct time.

[0030] Serial data transmission: After parallel-to-serial conversion, the serial data is transmitted to the receiving end (i.e., AR-HUD optical element) through a transmission medium (such as LVDS cable). During the transmission process, the serial data exists in the form of a differential signal to reduce electromagnetic interference and improve transmission stability.

[0031] In the embodiment of the present application, step S4 of the AR-HUD optical component projecting the graphic file onto the windshield for display includes: After the AR-HUD optical component receives the graphic file, it decodes the graphic file through the deserialization chip, and then transmits the decoded graphic file in the form of an analog signal to the display screen inside the AR-HUD optical component for display. The AR-HUD optical component also projects the decoded graphic file in front of the windshield for display.

[0032] At the receiving end (AR-HUD optical element), the received serial data is deserialized by the deserializer. The deserializer converts the serial data back into parallel data and restores it to the original graphic file data. Then, this data is used to drive the optical elements of the AR-HUD, generate augmented reality images and project them in front of the driver's line of sight.

[0033] By integrating the algorithm for implementing AR-HUD control, namely the AR Creator algorithm, into the vehicle SOC, the surplus computing power of the vehicle SOC is fully utilized to implement AR-HUD control, thereby avoiding the waste of computing power of the vehicle SOC. In addition, for AR-HUD optical components, at the hardware level, there is no need to add a SOC chip for implementing AR-HUD control to the AR-HUD optical components, so that the originally arranged SOC chip in the AR-HUD optical components can be eliminated, thereby achieving the effect of reducing the hardware cost of the AR-HUD optical components.

[0034] like Figure 4 The vehicle SOC in the embodiment of the present application provides a computing power of 6k DMIPS. The AR-Creator algorithm in the vehicle SOC combines the vehicle signals (navigation signals, body signals and ADAS signals) sent by the vehicle MCU, integrates the built-in graphic files with the AR algorithm, and combines the human eye calibration data, HUD calibration data, and ADAS calibration data for three-dimensional graphic modeling and three-dimensional conversion to form a user-visible graphic file.

[0035] like Figure 5 After the vehicle SOC completes the graphics modeling, it serially encodes the graphics file through the serial chip and transmits it to the AR-HUD optical components in LVDS mode.

[0036] like Figure 6 After the AR-HUD optical component receives the graphic file sent by the vehicle MCU, it decodes the graphic file through the deserialization chip, and then transmits the decoded graphic file in the form of an analog signal to the AR-HUD display screen inside the AR-HUD optical component for display. The AR-HUD optical component also projects the decoded graphic signal to the front of the windshield for display.

[0037] Reference Figure 2 , the vehicle display method in the embodiment of the present application further includes: S5, the vehicle MCU receives the OTA upgrade package sent from the cloud; S6: The vehicle computer SOC performs OTA upgrades on the existing functional modules and AR Creator algorithm modules in the vehicle computer SOC according to the OTA upgrade package.

[0038] Since the AR Creator algorithm is integrated into the vehicle SOC, the OTA upgrade of the AR Creator algorithm can be performed together with the existing functional modules in the vehicle SOC without the need to make additional upgrade packages, thereby improving the user experience.

[0039] The above-mentioned vehicle display method in the embodiment of the present application integrates the control algorithm of the AR-HUD optical component (i.e., the AR Creator algorithm) into the vehicle SOC when the computing power of the vehicle SOC is sufficient. The patterned information is generated by the vehicle SOC and then transmitted to the AR-HUD optical component for display via LVDS. This solution makes full use of the existing computing power resources of the vehicle, can eliminate the SOC chip of the AR-HUD optical component, and reduces the unit cost of the AR-HUD optical component. The vehicle has an OTA function, and the HUD can be updated OTA in real time after mass production to improve the user experience.

[0040] Reference Figure 3 and Figure 5 , the embodiment of the present application further provides a vehicle system, including: a vehicle and an AR-HUD optical component; the vehicle includes: a vehicle MCU and a vehicle SOC, and the vehicle SOC is integrated with an AR Creator algorithm module; The vehicle MCU collects vehicle signals and sends them to the vehicle SOC; In the vehicle SOC, the AR Creator algorithm module is used to fuse the vehicle signal and the built-in graphic file using the AR algorithm, and the human eye calibration data, HUD calibration data, and ADAS calibration data are combined for graphic modeling to form a user-visible graphic file. The vehicle SOC sends the graphic file to the AR-HUD optical component; The AR-HUD optical components project the graphic files onto the windshield for display.

[0041] In the embodiment of the present application, the step of the vehicle SOC sending the graphic file to the AR-HUD optical component includes: The vehicle computer SOC serially encodes the graphic file through a serial chip and transmits it to the AR-HUD optical element via LVDS.

[0042] In the embodiment of the present application, the step of the AR-HUD optical component projecting the graphic file sent by the vehicle SOC onto the windshield for display includes: After the AR-HUD optical component receives the graphic file, it decodes the graphic file through the deserialization chip, and then transmits the decoded graphic file in the form of an analog signal to the display screen inside the AR-HUD optical component for display. The HUD optical component also projects the decoded graphic file in front of the windshield for display.

[0043] Preferably, the vehicle computer MCU sends the vehicle signal to the vehicle computer SOC through the SPI interface.

[0044] Preferably, the AR-HUD optical component is not equipped with a SOC chip integrating the AR Creator algorithm.

[0045] An embodiment of the present application also provides a vehicle, comprising the above-mentioned vehicle system.

[0046] It should be noted that the various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0047] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0048] It should also be noted that, in this article, the orientation or position relationship indicated by the terms "center", "up", "down", "left", "right", "vertical", "horizontal", "inside", "outside", etc. is based on the orientation or position relationship shown in the drawings, which is for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation of the present invention. In addition, relational terms such as "first" and "second" are used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is any such actual relationship or order between these entities or operations, nor can they be understood as indicating or implying relative importance. Moreover, the terms "include", "comprise" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements does not include those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such a process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "including one..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0049] The technical solution provided by the present invention is described in detail above. The principle and implementation mode of the present invention are described in this article using specific examples. The description of the above embodiments is only used to help understand the present invention, and the content of this specification should not be understood as limiting the present invention. At the same time, for those skilled in the art, according to the present invention, there will be different forms of changes in the specific implementation mode and application scope. It is not necessary and impossible to list all the implementation modes here, and the obvious changes or modifications derived therefrom are still within the protection scope of the present invention.

Claims

1. A vehicle computer display method, characterized in that: include: The vehicle MCU collects vehicle signals; The vehicle SOC uses the pre-integrated AR Creator algorithm module to fuse the vehicle signal and the built-in graphic file with the AR algorithm, and combines the human eye calibration data, HUD calibration data, and ADAS calibration data for graphic modeling to form a user-visible graphic file; The vehicle computer SOC sends the graphic file to the AR-HUD optical component; The AR-HUD optical component projects the graphic file onto the windshield for display.

2. The vehicle computer display method according to claim 1, characterized in that: The step of the vehicle computer SOC sending the graphic file to the AR-HUD optical component includes: The vehicle computer SOC serially encodes the graphic file through a serial chip and transmits it to the AR-HUD optical element in a LVDS manner.

3. The vehicle computer display method according to claim 1, characterized in that: The step of the AR-HUD optical component projecting the graphic file onto the windshield for display comprises: After receiving the graphic file, the AR-HUD optical component decodes the graphic file through a deserialization chip, and then transmits the decoded graphic file in the form of an analog signal to the display screen inside the AR-HUD optical component for display. The AR-HUD optical component also projects the decoded graphic file in front of the windshield for display.

4. The vehicle computer display method according to claim 1, characterized in that: The method further comprises: The vehicle MCU receives the OTA upgrade package sent from the cloud; The vehicle computer SOC performs OTA upgrade on the existing functional modules and the AR Creator algorithm module in the vehicle computer SOC according to the OTA upgrade package.

5. A vehicle computer system, characterized in that: include: A vehicle computer and an AR-HUD optical component; the vehicle computer comprises: a vehicle computer MCU and a vehicle computer SOC, and the vehicle computer SOC is integrated with an AR Creator algorithm module; The vehicle computer MCU collects vehicle signals and sends the vehicle signals to the vehicle computer SOC; The vehicle SOC uses the AR Creator algorithm module to fuse the vehicle signal and the built-in graphic file with an AR algorithm, and combines the human eye calibration data, the HUD calibration data, and the ADAS calibration data for graphic modeling to form a user-visible graphic file; The vehicle computer SOC sends the graphic file to the AR-HUD optical component; The AR-HUD optical component projects the graphic file onto the windshield for display.

6. The vehicle system according to claim 5, characterized in that: The step of the vehicle computer SOC sending the graphic file to the AR-HUD optical component includes: The vehicle computer SOC serially encodes the graphic file through a serial chip and transmits it to the AR-HUD optical element in a LVDS manner.

7. The vehicle system according to claim 5, characterized in that: The step of the AR-HUD optical component projecting the graphic file onto the windshield for display comprises: After receiving the graphic file, the AR-HUD optical component decodes the graphic file through a deserialization chip, and then transmits the decoded graphic file in the form of an analog signal to the display screen inside the AR-HUD optical component for display. The HUD optical component also projects the decoded graphic file in front of the windshield for display.

8. The vehicle system according to claim 5, characterized in that: The vehicle computer MCU sends the whole vehicle signal to the vehicle computer SOC through the SPI interface.

9. The vehicle system according to claim 5, characterized in that: The AR-HUD optical component does not have a SOC chip with an integrated AR Creator algorithm installed in it.

10. A vehicle, characterized in that: A vehicle system comprising any one of claims 5-9.

Images