Inter-chip communication method for head-up display and related equipment

Through the collaborative work of inter-chip communication and embedded operating system, the single information and angle correction problems of Hud map navigation in Android smart car systems are solved, achieving rich head-up display and high security user experience.

CN118890366AActive Publication Date: 2024-11-01WUHAN LOTUS CARS CO LTD
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
CN202410909365.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-11-09
Filing Date
2024-07-08
Publication Date
2024-11-01
Estimated Expiration
2044-07-08

AI Technical Summary

Technical Problem

In the existing Android smart car system, the Hud map navigation method has the problem of single information and poor user interaction experience, and the inability to perform angle correction, resulting in visual offset and distortion of view.

Method used

Through communication between the first chip and the second chip, the initial preset format video stream is received and parsed in real time, and the distortion data transmitted by the embedded real-time operating system is obtained. Based on this data, the video stream is corrected and rendered to the head-up display device to ensure that the video is The angle of the flow is consistent with the vehicle state, providing a better user experience.

Benefits of technology

It provides richer head-up display information without affecting the display effect of the on-board navigation main map, improves user experience and driving safety, avoids the driving entertainment system interfering with the driving control system, and ensures low latency and high safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118890366A_ABST
    Figure CN118890366A_ABST
Patent Text Reader

Abstract

The invention provides an inter-chip communication method for head-up display and related equipment, and relates to the technical field of automobile navigation. Establishing a communication connection with the second chip through the first chip in response to a communication request of the second chip; receiving and analyzing an initial preset format video stream sent by the second chip in real time; acquiring real-time distortion data which is transmitted by the embedded real-time operating system and aims at the initial preset format video stream, wherein the real-time distortion data at least comprises video stream angle distortion information; correcting the initial preset format video stream based on the real-time distortion data to obtain a target preset format video stream; and rendering the target preset format video stream to a head-up display device of the current vehicle, so that the head-up display device displays the target map information. The driving entertainment system is effectively prevented from interfering with the driving control system, low time delay is guaranteed, high driving safety is achieved, it is guaranteed that the head-up display map navigation at the visual angle of a driver does not deviate or distort, and the user experience is improved.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application claims priority to a Chinese patent application filed with the China Patent Office on November 9, 2023, with application number 202311499737.8 and application name “A chip-to-chip communication method and related equipment for head-up display”, the entire contents of which are incorporated by reference in this application. Technical Field

[0002] The present application relates to the field of automobile navigation technology, and in particular to an inter-chip communication method for head-up display and related equipment. Background Art

[0003] HUD (Head-Up Display) is a transparent display technology that can accurately project dashboard information, navigation information or other data obtained by intelligent driving sensors (such as cameras and radars) to the user's front field of vision in the vehicle without looking down. In this way, when the car is driving, the driver does not need to look away from the road in front of him because of looking down at the dashboard, thus avoiding the resulting visual blind spots.

[0004] The current method of implementing HUD map navigation in Android smart car systems has certain defects, such as single displayed information, poor user interaction experience, the need for additional customized navigation services, and the inability to perform angle correction after the navigation map is projected onto the HUD, which will cause visual offset and perspective distortion. Summary of the invention

[0005] The present application provides an inter-chip communication method and related equipment for head-up display to solve the above-mentioned problems.

[0006] In a first aspect, the present application provides a chip-to-chip communication method for a head-up display, which is applied to a first chip, and the method includes:

[0007] In response to a communication request of the second chip, a communication connection with the second chip is established; the first chip and the second chip are both arranged in the current vehicle;

[0008] receiving and parsing in real time an initial preset format video stream sent by the second chip, where the initial preset format video stream is rendered by the second chip based on target map information;

[0009] Acquire real-time distortion data for an initial preset format video stream transmitted by an embedded real-time operating system, wherein the real-time distortion data at least includes video stream angle distortion information;

[0010] The initial preset format video stream is corrected based on the real-time distortion data to obtain a target preset format video stream; the target preset format video stream is rendered to a head-up display device of the current vehicle so that the head-up display device displays the target map information.

[0011] Optionally, receiving and parsing the initial preset format video stream sent by the second chip in real time includes:

[0012] receiving in real time an initial preset format video stream sent by the second chip; the initial preset format video stream is a real-time message transmission protocol video stream; the initial preset format video stream carries video encoding data;

[0013] The video decoding data corresponding to the initial preset format video stream is determined based on the video encoding data, and the initial preset format video stream is parsed based on the video decoding data.

[0014] Optionally, obtaining real-time distortion data for an initial preset format video stream transmitted by the embedded real-time operating system includes:

[0015] Sending a data call request to the communication middleware, so that the communication middleware responds to the data call request and sends real-time distortion data for the initial preset format video stream to the first chip; the real-time distortion data is transmitted to the communication middleware by the embedded real-time operating system;

[0016] Receive real-time distortion data sent by the communication middleware.

[0017] Optionally, correcting the initial preset format video stream based on the real-time distortion data to obtain a target preset format video stream includes:

[0018] Determining an initial angle of an initial preset format video stream;

[0019] Determining the desired correction angle of the initial preset format video stream adapted to the current vehicle based on the real-time distortion data; the real-time distortion data is determined based on the initial angle of the initial preset format video stream, vehicle parameters of the current vehicle, and driving state information;

[0020] Calling a preset graphics operation function to determine the coordinates of the vertices to be corrected of the initial preset format video stream based on the expected correction angle;

[0021] The initial angle of the initial preset format video stream is corrected based on the vertex coordinates to be corrected to obtain a target preset format video stream.

[0022] Optionally, the method further comprises:

[0023] receiving and parsing in real time an initial media data stream sent by the second chip; the initial media data stream is obtained by rendering by the second chip based on media data information, and the media data information includes any one or more of historical driving trajectory information, safety reminder information, and leisure and entertainment information at a target time;

[0024] Correcting the initial media data stream based on the real-time distortion data to obtain a target media data stream;

[0025] The target media data stream is rendered onto a head-up display device of the current vehicle, so that the head-up display device displays the media data information.

[0026] Optionally, the method further comprises:

[0027] Performing fusion processing on the target preset format video stream and the target media data stream to obtain a fused video stream;

[0028] The fused video stream is rendered onto a head-up display device of the current vehicle, so that the head-up display device displays the fused target map information and media data information.

[0029] In a second aspect, the present application provides a chip-to-chip communication method for a head-up display, which is applied to a second chip, and the method includes:

[0030] Sending a communication request to the first chip to establish a communication connection with the first chip; the first chip and the second chip are both arranged in the current vehicle;

[0031] Obtaining target map information in the initial map information; the target map information at least includes local road network information and current vehicle speed information;

[0032] Rendering based on target map information to obtain an initial preset format video stream;

[0033] The initial preset format video stream is sent to the first chip so that the first chip obtains real-time distortion data for the initial preset format video stream transmitted by the embedded real-time operating system, corrects the initial preset format video stream based on the real-time distortion data to obtain a target preset format video stream, and renders the target preset format video stream to a head-up display device of the current vehicle so that the head-up display device displays target map information.

[0034] Optionally, rendering an initial preset format video stream based on the target map information includes:

[0035] Create a video stream rendering thread, and execute the video stream rendering thread based on the target map information to obtain the video stream output bytes corresponding to the target map information;

[0036] The video stream output bytes are encapsulated based on a preset encapsulation format to obtain an initial preset format video stream.

[0037] Optionally, the method further comprises:

[0038] Acquire media data information; the media data information includes any one or more of historical driving trajectory information, safety reminder information, and leisure and entertainment information at a target time;

[0039] Rendering based on the media data information to obtain an initial media data stream;

[0040] The initial media data stream is sent to the first chip, so that the first chip corrects the initial media data stream based on the real-time distortion data to obtain a target media data stream, and renders the target media data stream to a head-up display device of the current vehicle, so that the head-up display device displays the media data information; or, the first chip fuses the target preset format video stream and the target media data stream to obtain a fused video stream, and renders the fused video stream to the head-up display device of the current vehicle, so that the head-up display device displays the fused target map information and media data information.

[0041] Optionally, the method further comprises:

[0042] In response to a user's control instruction, the content to be sent is determined; wherein the content to be sent includes the initial preset format video stream and / or the initial media data stream.

[0043] In a third aspect, the present application provides an inter-chip communication device for head-up display, applied to a first chip, the device comprising:

[0044] A communication module, configured to establish a communication connection with the second chip in response to a communication request of the second chip; the first chip and the second chip are both arranged in the current vehicle;

[0045] A first data receiving module is used to receive and parse in real time an initial preset format video stream sent by the second chip, where the initial preset format video stream is rendered by the second chip based on target map information;

[0046] A second data receiving module is used to obtain real-time distortion data for an initial preset format video stream transmitted by an embedded real-time operating system, wherein the real-time distortion data at least includes video stream angle distortion information;

[0047] The display module is used to correct the initial preset format video stream based on real-time distortion data to obtain a target preset format video stream; and render the target preset format video stream to a head-up display device of the current vehicle so that the head-up display device displays target map information.

[0048] Optionally, the first data receiving module includes:

[0049] The video stream receiving unit is used to receive in real time the video stream in the initial preset format sent by the second chip; the video stream in the initial preset format is a real-time message transmission protocol video stream; the video stream in the initial preset format carries video encoding data;

[0050] The video stream parsing unit is used to determine the video decoding data corresponding to the initial preset format video stream based on the video encoding data, and parse the initial preset format video stream based on the video decoding data.

[0051] Optionally, the second data receiving module includes:

[0052] A data call request unit is used to send a data call request to the communication middleware, so that the communication middleware responds to the data call request and sends real-time distortion data for the initial preset format video stream to the first chip; the real-time distortion data is transmitted to the communication middleware by the embedded real-time operating system;

[0053] The data receiving unit is used to receive the real-time distortion data sent by the communication middleware.

[0054] Optionally, the display module includes:

[0055] A first calculation unit, used to determine an initial angle of an initial preset format video stream;

[0056] A second calculation unit is used to determine the desired correction angle of the initial preset format video stream adapted to the current vehicle based on the real-time distortion data; the real-time distortion data is determined according to the initial angle of the initial preset format video stream, the vehicle parameters of the current vehicle and the driving state information;

[0057] A coordinate determination unit, used for calling a preset graphic operation function to determine the coordinates of the vertices to be corrected of the initial preset format video stream based on the expected correction angle;

[0058] The correction unit is used to correct the initial angle of the initial preset format video stream based on the coordinates of the vertices to be corrected to obtain the target preset format video stream.

[0059] In a fourth aspect, the present application provides an inter-chip communication device for head-up display, which is applied to a second chip, and the device includes:

[0060] A communication module, used for sending a communication request to the first chip to establish a communication connection with the first chip; the first chip and the second chip are both arranged in the current vehicle;

[0061] A map information acquisition module is used to acquire target map information from the initial map information; the target map information at least includes local road network information and current vehicle speed information;

[0062] A rendering module, used for rendering to obtain an initial preset format video stream based on target map information;

[0063] The data sending module is used to send the initial preset format video stream to the first chip, so that the first chip obtains the real-time distortion data for the initial preset format video stream transmitted by the embedded real-time operating system, corrects the initial preset format video stream based on the real-time distortion data to obtain the target preset format video stream, and renders the target preset format video stream to the head-up display device of the current vehicle, so that the head-up display device displays the target map information.

[0064] Optionally, the rendering module includes:

[0065] A thread creation unit, used for creating a video stream rendering thread, and executing the video stream rendering thread based on the target map information to obtain video stream output bytes corresponding to the target map information;

[0066] The encapsulation unit is used to encapsulate the video stream output bytes based on a preset encapsulation format to obtain an initial preset format video stream.

[0067] In a fifth aspect, the present application provides an inter-chip communication system for a head-up display, comprising a first chip, a second chip, an embedded real-time operating system and a head-up display device, for implementing the inter-chip communication method for a head-up display as described above.

[0068] In a sixth aspect, the present application provides an electronic device, including a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the at least one instruction or at least one program is loaded and executed by the processor to implement the inter-chip communication method for head-up display as described above.

[0069] In a seventh aspect, the present application provides a computer-readable storage medium, in which at least one instruction or at least one program is stored, and the at least one instruction or at least one program is loaded and executed by a processor to implement the inter-chip communication method for head-up display as described above.

[0070] In an eighth aspect, the present application provides a computer program product or a computer program, which includes computer instructions, which are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the inter-chip communication method for head-up display as described above.

[0071] By adopting the above technical solution, the present invention has the following beneficial effects:

[0072] The second chip transmits the initial preset format video stream of the target map information to the first chip. The target map information is part of the navigation information extracted from the vehicle navigation. The calling process is convenient and fast, and there is no need to customize an additional navigation service. On the basis of not affecting the display effect of the main map of the vehicle navigation, the head-up display device can only display the desired target map information, which can not only ensure the needs of user experience, but also ensure driving safety. The two chips correspond to different tasks respectively, which effectively avoids the driving entertainment system of the second chip interfering with the driving control system of the first chip, which ensures low latency and high security. Furthermore, while the first chip receives and parses the initial preset format video stream, it also performs angle correction on the initial preset format video stream based on the real-time distortion data transmitted by the embedded real-time operating system, which can avoid the angle of the target preset format video stream being inconsistent with the pitch angle of the head-up display device relative to the driver and the current vehicle turning angle, thereby reducing the user experience.

[0073] Other features and advantages of the present invention will be described in detail in the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0074] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention, where the same reference numerals generally represent the same components. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without creative work.

[0075] Figure 1 A schematic diagram of a system architecture for implementing an inter-chip communication method for head-up display provided in an embodiment of the present application;

[0076] Figure 2 A schematic diagram of a flow chart of an inter-chip communication method for head-up display provided in an embodiment of the present application;

[0077] Figure 3 A schematic flow chart of another inter-chip communication method for head-up display provided in an embodiment of the present application;

[0078] Figure 4 A schematic diagram of a flow chart of an inter-chip communication device for head-up display provided in an embodiment of the present application;

[0079] Figure 5 A schematic diagram of a flow chart of another inter-chip communication device for head-up display provided in an embodiment of the present application;

[0080] Figure 6A schematic diagram of the hardware structure of a server for running an inter-chip communication method for a head-up display provided for the implementation of the present invention. DETAILED DESCRIPTION

[0081] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0082] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the invention described herein, for example, can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0083] HUD (Head-Up Display) is a transparent display technology that can accurately project dashboard information, navigation information or other data obtained by analyzing the vehicle and road conditions through intelligent driving sensors (such as cameras and radars) into the user's front field of view in the vehicle without having to look down. Although it was first used in flight aids for military aircraft, HUD technology has been used in car driving assistance since the late 1980s. When the car is driving with an in-vehicle HUD system, the driver does not need to take his eyes off the road in front of him because of looking down at the dashboard, thus avoiding the resulting visual blind spots.

[0084] The current mainstream development method of Android smart car systems is to use a CPU (Central Processing Unit) to carry all car control and driving entertainment systems. Therefore, it is more direct to realize the projection of map navigation to the in-vehicle HUD system, but there are also corresponding defects.

[0085] For example, the HUD head-up display device is directly connected to the car's CAN (Controller Area Network) bus or to the OBD (On-Board Diagnostics) to directly obtain information such as vehicle speed and rotation speed without the need for secondary processing by the Android smart car system. It has a short communication link, fast rendering speed, low performance loss, and the widest application. However, the displayed information is relatively simple, navigation is impossible, user interaction is limited, and the experience is poor.

[0086] Or the Android smart car system is equipped with a 3G module and a GPS module, which has basic communication and positioning capabilities. Then, by installing the navigation service, the HUD screen can be projected for navigation, and certain media information can be loaded. However, this method still displays relatively simple information and cannot interact with users. The instrument content already exists in the car, which overlaps with the car's functions. Although there is navigation, it cannot achieve the effect of mobile phone navigation. There is no real-time traffic conditions and road congestion, and it cannot interact with the phone.

[0087] Or you can directly use the navigation service on the car to project the HUD screen for navigation. The navigation display is consistent with the main screen display on the car, and information such as vehicle speed and rotation speed can also be obtained through the underlying interface. However, since the angle cannot be corrected after the map is projected on the HUD, it will cause visual offset and perspective distortion.

[0088] Based on the above-mentioned existing technical defects, the present invention provides a chip-to-chip communication method and related equipment for implementing a head-up display.

[0089] refer to Figure 1 , which shows a system architecture diagram for implementing a chip-to-chip communication method for a head-up display provided in an embodiment of the present application, wherein the system includes a first chip, a second chip, an embedded real-time operating system, and a head-up display device, and the system is mounted on a current vehicle, which can be broadly understood as any usable vehicle with an Android smart car system.

[0090] The first chip is a chip with a native Android open source operating system, which serves as the real-time operating system of the car to ensure reliable vehicle control and driving safety; the second chip is a chip with a deeply customized Android open source operating system, which is responsible for smart experience and infotainment. The first chip and the second chip have communication functions, and realize data transmission through synchronous / asynchronous communication.

[0091] The embedded real-time operating system is QNX, which is a distributed, embedded, scalable hard real-time operating system, widely used in the automotive field, and can perform process scheduling, inter-process communication, underlying network communication and interrupt processing services. In the present invention, the first chip obtains real-time distortion data from the embedded real-time operating system side, which is used to correct the preset format video stream containing target map information to be rendered, and / or, to correct the initial media data stream containing media data information to be rendered, which will be introduced in detail in the method flow later.

[0092] The head-up display device may be a common head-up display device such as a C-HUD (Combiner Head-Up Display), a W-HUD (Windshield Head-Up Display), an AR-HUD (Augmented Reality Head-Up Display), etc. Various types of head-up display devices have different optical imaging components. For example, the optical imaging component of C-HUD is resin glass; the optical imaging component of W-HUD and AR-HUD is the front windshield of the vehicle, which has a wider range of information display and more display and supported functions, such as road traffic sign recognition, vehicle speed, etc. However, different types of head-up display devices all include an image generation unit to generate an image / video stream based on the navigation information transmitted by the first chip and the second chip, and project it onto the corresponding optical imaging component.

[0093] refer to Figure 2 , which shows a flow chart of a chip-to-chip communication method for head-up display provided in an embodiment of the present application. It should be noted that this specification provides method operation steps such as the embodiments or flow charts, but more or fewer operation steps may be included based on conventional or non-creative labor. The order of steps listed in the embodiments is only one way of executing the steps among many orders and does not represent the only order of execution. When the system device or product is executed in practice, it can be executed in the order of the methods shown in the embodiments or the drawings or in parallel (for example, in a parallel processor or multi-threaded processing environment). Figure 2 The inter-chip communication method for head-up display shown is applied to a first chip, including:

[0094] S201, in response to a communication request of the second chip, establishing a communication connection with the second chip; the first chip and the second chip are both arranged in the current vehicle.

[0095] In the embodiment of the present application, the first chip is a chip with a native Android open source operating system, which serves as a real-time operating system for the car to ensure reliable vehicle control and driving safety; the second chip is a chip with a deeply customized Android open source operating system, which is responsible for intelligent experience and infotainment. The first chip is the master device (Master), and the second chip is the slave device (Slave), which can communicate through the SPI (Service Provider Interface) protocol. For example, the first chip initiates a communication request by writing bytes to the SPI serial shift register, and the serial shift register transmits the bytes to the second chip. At the same time, the second chip also returns the contents of its serial shift register to the first chip through the signal line to establish a communication connection.

[0096] S202, receiving and parsing in real time an initial preset format video stream sent by the second chip, where the initial preset format video stream is rendered by the second chip based on target map information.

[0097] In a possible implementation, step S202 may include:

[0098] (1) receiving in real time an initial preset format video stream sent by the second chip; the initial preset format video stream is a real-time messaging protocol video stream; the initial preset format video stream carries video encoding data;

[0099] (2) Determine video decoding data corresponding to the initial preset format video stream based on the video encoding data, and parse the initial preset format video stream based on the video decoding data.

[0100] Specifically, the second chip obtains the global map information of the vehicle navigation, and then extracts the target map information from the global map information according to the information desired to be displayed on the head-up display device. In the embodiment of the present application, the vehicle navigation can be a common map navigation such as Amap navigation and Baidu map navigation. The target map information can include but is not limited to important vehicle speed information, local road network information, etc. In other embodiments, the vehicle navigation can adopt other map navigation, and the target map information can also include other map navigation information.

[0101] The second chip renders the target map information off-screen into an initial preset format video stream, which is implemented in the embodiment of the present application through SurfaceView, which is a common and important view component in the Android system and provides an independent thread for drawing graphics. A video stream rendering thread is created, and based on the target map information, a video frame corresponding to the target map information is drawn in the rendering thread, and the video stream output bytes are encapsulated into an initial preset format video stream based on a preset encapsulation format.

[0102] In an embodiment of the present application, the initial preset format video stream is a real-time messaging protocol video stream, and the preset encapsulation format can be an RTMP (Real-Time Messaging Protocol) format. RTMP is based on TCP (Transmission Control Protocol) and is used for real-time data communication. The video frame is encoded by an RTMP encoder to obtain an initial preset format video stream, which is published to an RTMP streaming media server. The initial preset format video stream carries video encoding data. The RTMP streaming media server is deployed on a first chip, and the first chip receives the initial preset format video stream in real time through the RTMP streaming media server, determines the video decoding data corresponding to the initial preset format video stream based on the video encoding data, and parses the initial preset format video stream based on the video decoding data.

[0103] Through this implementation, the second chip can transmit the initial preset format video stream of the target map information to the first chip. The target map information is part of the information extracted from the navigation information of the vehicle navigation. It is convenient and fast to call, and there is no need to customize a navigation service. On the basis of not affecting the display effect of the main map of the vehicle navigation, the head-up display device can only display the desired target map information, which can not only ensure the user experience needs, but also ensure driving safety; and the two chips each correspond to different tasks, which effectively avoids the driving entertainment system of the second chip interfering with the driving control system of the first chip, which ensures low latency and high security.

[0104] In a possible implementation manner, in addition to receiving and parsing the initial preset format video stream sent by the second chip in real time, the first chip can also: receive and parse the initial media data stream sent by the second chip in real time. The initial media data stream is rendered by the second chip based on media data information, and the media data information includes any one or more of historical driving trajectory information, safety reminder information, and leisure and entertainment information at the target moment.

[0105] For example, the historical driving trajectory information at the target moment can be the driving trajectory information closest to the current moment, or it can be the driving trajectory information of any time interval selected by the user. The driving trajectory information can be used to indicate the driving condition of the vehicle at that time. Based on the historical driving trajectory information, the user can preview the driving trajectory in real time, so that the driving route can be better planned, which plays a role in assisting driving. For example, in driving scenarios such as racing, based on high-precision historical driving trajectory information, the user can complete more accurate driving and have a better driving experience.

[0106] Optionally, the driving trajectory information can be obtained by fitting the position, speed, direction and other data collected by the global positioning system (GPS) and other sensors during the driving process. For example, during the driving process, according to the preset data collection frequency (for example, collecting data every 0.5s, and the collection frequency can be higher in the racing scene), the GPS module on the vehicle can obtain the real-time position information of the vehicle (such as longitude, latitude, etc.), and the inertial measurement unit (IMU) on the vehicle can obtain the acceleration and angular velocity of the vehicle. After using a filtering algorithm (such as Kalman filtering) to remove the noise and outliers that may appear in the collection process, the filtered data collected by the GPS module and the inertial measurement unit IMU are fused, and the GPS data is converted into a suitable coordinate system (such as from a geographic coordinate system to a plane coordinate system); finally, the trajectory points are drawn according to the processed data, and the trajectory is smoothed using a smoothing algorithm (such as a Bezier curve) to eliminate noise and discontinuities, and then the trajectory information is visualized using a map service, so that the driving trajectory information displayed on the map can be obtained. In addition, the historical driving trajectory information may also be generated by other methods, and the embodiment of the present application does not limit the method for generating the historical driving trajectory information.

[0107] Exemplarily, the safety reminder information may be various reminder information to remind the driver to pay attention to driving safety, such as speeding reminder information, fatigue driving reminder information, forward collision warning information, etc. Optionally, the safety reminder information may be obtained based on a combination of multiple sensors, data sources, and technologies. For example, the vehicle speed may be monitored by a speed sensor to provide speeding reminder information; etc., which are not limited in the embodiments of the present application. Based on the safety reminder information, the driver may be reminded to improve driving safety.

[0108] For example, the leisure and entertainment information may include various information provided by the in-vehicle entertainment system, such as music playlist information, lyrics display information, video playback information, and other information permitted by laws and regulations; alternatively, the leisure and entertainment information may also be other entertainment information obtained based on the Internet, streaming services, or other third-party devices, which is not limited in the embodiments of the present application. Based on the leisure and entertainment information, the entertainment can be improved, thereby improving the user experience.

[0109] In addition, the media data information may also include consumer electronics information, game interface information, social software information and other information that is permitted to be displayed by laws and regulations, and the embodiments of the present application do not limit this. When displaying these media data information, it will not affect traffic safety and can also improve driving entertainment.

[0110] It can be understood that after obtaining any one or more media data information including historical driving trajectory information, safety reminder information, and leisure and entertainment information at the target moment, the second chip can use a similar method to the above to render and encapsulate the media data information into an initial media data stream through SurfaceView. The same technical means will not be repeated here.

[0111] Among them, the second chip can send the initial media data stream to the first chip through the Socket channel. Socket is an inter-process communication mechanism provided by the operating system. By deploying a socket on the second chip and the first chip respectively, a Socket channel can be formed, so that the second chip can send the initial media data stream to the first chip. The Socket channel has the characteristics of independent transmission channel, high efficiency, strong scalability, and low loss. If you need to add another Socket channel to send other initial media data later, it is also convenient. You only need to modify the port to receive the data source of another channel, which has more flexibility in multi-layer fusion.

[0112] It can be understood that when the target map information is to be displayed on the head-up display device, the first chip receives the initial preset format video stream sent by the second chip; when the media data information is to be displayed on the head-up display device, the first chip receives the initial media data stream sent by the second chip; when the target map information and the media data information are to be displayed on the head-up display device at the same time, the first chip receives the initial preset format video stream and the initial media data stream.

[0113] S203, obtaining real-time distortion data for the video stream in the initial preset format transmitted by the embedded real-time operating system, wherein the real-time distortion data at least includes video stream angle distortion information.

[0114] In an embodiment of the present application, the embedded real-time operating system obtains parameter information of the current vehicle provided by the bottom hardware device, including but not limited to vehicle parameters and driving status information of the current vehicle. The vehicle parameter information may include the pitch angle of the windshield of the current vehicle relative to the driver, the height difference of the seat relative to the head-up display device, etc.; the driving status information may include the driving speed, steering angle, etc. of the current vehicle.

[0115] In addition, the embedded real-time operating system obtains the initial angle of the initial preset format video stream, and calculates the distortion that may occur if the initial preset format video stream is projected onto the head-up display device at the initial angle through the above vehicle parameters and driving status information of the current vehicle, and obtains real-time distortion data for the initial preset format video stream. The real-time distortion data at least includes the video stream angle distortion information, that is, the angle distortion of the initial preset format video stream is mainly considered. Of course, in other embodiments, other distortion information can be added according to actual needs, so that the initial preset format video stream can display the target map information on the head-up display device with high quality after correction.

[0116] The first chip acquires the real-time distortion data transmitted from the embedded real-time operating system, which can be implemented by the following steps. In a possible implementation, step S203 may include:

[0117] Sending a data call request to the communication middleware, so that the communication middleware responds to the data call request and sends real-time distortion data for the initial preset format video stream to the first chip; the real-time distortion data is transmitted to the communication middleware by the embedded real-time operating system;

[0118] Receive real-time distortion data sent by the communication middleware.

[0119] In an embodiment of the present application, the communication middleware is SOME / IP (Scalable service-Oriented MiddlewarE over IP), the communication middleware, the embedded real-time operating system and the first chip transmit real-time distortion data in the SOME / IP message format, the embedded real-time operating system transmits the real-time distortion data to the communication middleware, the first chip sends a data call request to the communication middleware, and the communication middleware responds to the data call request and sends real-time distortion data for the initial preset format video stream to the first chip.

[0120] It can be appreciated that when the media data information is to be displayed on a head-up display device, the real-time distortion data can also be used to correct the initial media data stream.

[0121] S204, correcting the initial preset format video stream based on the real-time distortion data to obtain a target preset format video stream; rendering the target preset format video stream to a head-up display device of the current vehicle, so that the head-up display device displays target map information.

[0122] From the above, it can be seen that the vehicle parameters and driving status information of the current vehicle will affect the angle at which the initial preset format video is projected onto the head-up display device, thereby causing distortion. Therefore, it is necessary to correct the initial preset format video stream based on real-time distortion data to obtain the target preset format video stream, and finally the target preset format video stream is projected onto the head-up display device.

[0123] In a possible implementation, correcting the initial preset format video stream based on the real-time distortion data to obtain the target preset format video stream may include:

[0124] Determining an initial angle of an initial preset format video stream;

[0125] Determining the desired correction angle of the initial preset format video stream adapted to the current vehicle based on the real-time distortion data; the real-time distortion data is determined based on the initial angle of the initial preset format video stream, vehicle parameters of the current vehicle, and driving state information;

[0126] Calling a preset graphics operation function to determine the coordinates of the vertices to be corrected of the initial preset format video stream based on the expected correction angle;

[0127] The initial angle of the initial preset format video stream is corrected based on the vertex coordinates to be corrected to obtain a target preset format video stream.

[0128] Specifically, the initial angle of the initial preset format video stream is compared and calculated with the vehicle parameters and driving status information of the current vehicle to determine the expected correction angle of the initial preset format video stream, so that the initial preset format video stream adapts to the angle of the head-up display device, and the driver can see the complete and clear target map information in the eye box. In the embodiment of the present application, the correction is performed through OpenGL (Open Graphics Library), which is a cross-platform, cross-language graphics programming interface that can be used to implement 2D and 3D graphics rendering. Based on the expected correction angle, the coordinates of the vertices to be corrected of the initial preset format video stream are determined, the coordinates of the vertices to be corrected are defined as the drawing vertices, and the corresponding preset graphics operation function of OpenGL is called. Based on the drawing vertices, the shape corresponding to the target preset format video stream is drawn on the basis of the initial angle of the initial preset format video stream.

[0129] It should be noted that the above-mentioned correction process is updated in real time. The above-mentioned correction process is performed based on the initial preset format video stream received in real time, as well as the vehicle parameters and driving status information of the current vehicle that change in real time. This can avoid the angle of the target preset format video stream being inconsistent with the pitch angle of the head-up display device relative to the driver and the current vehicle turning angle, thereby reducing the user experience.

[0130] Render the target preset format video stream to the head-up display device of the current vehicle through SurfaceView, create a video stream rendering thread, draw the corresponding video frame in the rendering thread based on the target preset format video stream, transmit the video frame to the image generation unit of the head-up display device, and project it to the corresponding optical imaging component such as the windshield in real time, so that the head-up display device displays the target map information.

[0131] It is understandable that when the first chip receives an initial media data stream in addition to the initial preset format video stream, the initial media data stream can also be displayed on the head-up display device. The vehicle parameters and driving status information of the current vehicle will not only affect the angle at which the initial preset format video is projected onto the head-up display device, thereby causing distortion, but will also cause the initial media data stream projected onto the head-up display device to be distorted. Therefore, in order to avoid visual offset and perspective distortion of the initial media data stream, the initial media data stream needs to be corrected to obtain the target media data stream.

[0132] Among them, since the target map information corresponding to the initial preset format video stream and the media data information corresponding to the initial media data stream are displayed together, the real-time distortion data corresponding to the two data are the same, and the first chip can directly correct the initial media data stream based on the real-time distortion data obtained in step 203 to obtain the target media data stream. The implementation method of correcting the initial media data stream based on the real-time distortion data to obtain the target media data stream is similar to the implementation method of correcting the initial preset format video stream based on the real-time distortion data to obtain the target preset format video stream, and both can be corrected through OpenGL, which will not be described in detail here.

[0133] Exemplarily, after the target media data stream is corrected, the first chip can render the target media data stream to the head-up display device of the current vehicle, so that the head-up display device displays the media data information. Specifically, the first chip can render the target media data stream to the head-up display device of the current vehicle through SurfaceView, create a video stream rendering thread, draw the corresponding video frame in the rendering thread based on the target media data stream, transmit the video frame to the image generation unit of the head-up display device, and project it to the corresponding optical imaging component such as the windshield in real time, so that the head-up display device displays the media data information.

[0134] In a possible implementation, when the target map information corresponding to the target preset format video stream and the media data information corresponding to the target media data stream are to be displayed simultaneously, the inter-chip communication method for head-up display applied to the first chip may further include:

[0135] The target preset format video stream and the target media data stream are fused to obtain a fused video stream; the fused video stream is rendered to a head-up display device of the current vehicle so that the head-up display device displays the fused target map information and media data information.

[0136] Exemplarily, the fusion processing of the target preset format video stream and the target media data stream can be realized by OpenGL. When fusion is performed, the target preset format video stream is first decoded into the original video frame, and the target media data stream is decoded into the original media data, and then the video frame and the media data are synchronized on the timeline through the timestamp; if the video frame rate and the audio sampling rate do not match, interpolation or resampling processing can be performed to synchronize the video frame and the media data on the timeline; then the decoded video frame and the media data are fused, for example, audio data can be embedded in the video frame, or the audio data can be matched with the video frame according to the timestamp, etc.; finally, the fused data is re-encoded into a video stream in the target format to obtain a fused video stream. For example, in an embodiment of the present application, the target media data stream can be fused into the target preset format video stream to obtain a fused video stream in the target preset format. Further, the fused video stream can be rendered to the head-up display device of the current vehicle through SurfaceView, so that the head-up display device displays the fused target map information and media data information.

[0137] Based on this, users can not only see the target map information in the head-up display, but also see the historical driving trajectory information, safety reminder information, leisure and entertainment information and other media data information at the target time, which can improve driving safety while also improving user experience.

[0138] refer to Figure 3 , which is a flow chart of another inter-chip communication method for head-up display provided in an embodiment of the present application, Figure 3 The inter-chip communication method for head-up display shown is applied to the second chip, including:

[0139] S301, sending a communication request to the first chip to establish a communication connection with the first chip; the first chip and the second chip are both set in the current vehicle.

[0140] S302, obtaining target map information in the initial map information; the target map information at least includes local road network information and current vehicle speed information.

[0141] S303, rendering based on the target map information to obtain an initial preset format video stream.

[0142] S304, sending the initial preset format video stream to the first chip, so that the first chip obtains the real-time distortion data for the initial preset format video stream transmitted by the embedded real-time operating system, corrects the initial preset format video stream based on the real-time distortion data to obtain the target preset format video stream, and renders the target preset format video stream to the head-up display device of the current vehicle, so that the head-up display device displays the target map information.

[0143] In a possible implementation, rendering to obtain an initial preset format video stream based on target map information includes:

[0144] Create a video stream rendering thread, and execute the video stream rendering thread based on the target map information to obtain the video stream output bytes corresponding to the target map information;

[0145] The video stream output bytes are encapsulated based on a preset encapsulation format to obtain an initial preset format video stream.

[0146] In a possible implementation manner, the chip-to-chip communication method for head-up display applied to the second chip provided in the embodiment of the present application may further include:

[0147] S1. Acquire media data information; the media data information includes any one or more of historical driving trajectory information, safety reminder information, and leisure and entertainment information at the target time;

[0148] S2. Rendering based on the media data information to obtain an initial media data stream;

[0149] S3. Sending the initial media data stream to the first chip so that the first chip corrects the initial media data stream based on the real-time distortion data to obtain the target media data stream, and renders the target media data stream to the head-up display device of the current vehicle so that the head-up display device displays the media data information; or, enabling the first chip to fuse the target preset format video stream and the target media data stream to obtain a fused video stream, and renders the fused video stream to the head-up display device of the current vehicle so that the head-up display device displays the fused target map information and media data information.

[0150] In a possible implementation manner, the chip-to-chip communication method for head-up display applied to the second chip provided in the embodiment of the present application may further include:

[0151] In response to a user's control instruction, the content to be sent is determined; wherein the content to be sent includes an initial preset format video stream and / or an initial media data stream.

[0152] It can be understood that based on the method of the embodiment of the present application, the target map information and / or media data information can be displayed on the head-up display device. The user can set the content to be displayed in the setting interface so that the second chip knows the content to be sent. Based on this, not only can personalized customization be achieved, which is more user-friendly, but also interaction with the user can be increased to improve the user experience.

[0153] The inter-chip communication method for head-up display applied to the second chip is consistent with the inter-chip communication method for head-up display applied to the first chip, and will not be described in detail here.

[0154] Through the embodiments of the present invention, not only can the second chip transmit the initial preset format video stream of the target map information to the first chip, but the target map information is part of the information extracted from the navigation information of the vehicle navigation, which is convenient and fast to call, and there is no need to customize a navigation service. On the basis of not affecting the display effect of the main map of the vehicle navigation, the head-up display device can only display the desired target map information, which can not only ensure the user experience needs, but also ensure driving safety; it can also be achieved that the second chip transmits the initial media data stream of the media data information to the first chip, and the media data information includes any one or more of the historical driving trajectory information, safety prompt information, leisure and entertainment information, etc. at the target moment, and the media data information is displayed on the head-up display display device, which can increase the fun and further improve the user experience; and the two chips correspond to different tasks respectively, which effectively prevents the driving entertainment system of the second chip from interfering with the driving control system of the first chip, ensuring both low latency and high security; further, while the first chip receives and parses the initial preset format video stream and / or the initial media data stream, it also performs angle correction on the initial preset format video stream and / or the initial media data stream based on the real-time distortion data transmitted by the embedded real-time operating system, which can avoid the angle of the target preset format video stream, or the angle of the target media data stream, or the angle of the fused video stream being inconsistent with the pitch angle of the head-up display device relative to the driver and the current vehicle turning angle, thereby reducing the user experience.

[0155] Corresponding to the above-mentioned inter-chip communication method for head-up display, an embodiment of the present application also provides an inter-chip communication device for head-up display applied to a first chip. Since the inter-chip communication device for head-up display corresponds to the inter-chip communication method for head-up display applied to the first chip provided in the above-mentioned embodiment, the implementation method of the above-mentioned inter-chip communication method for head-up display applied to the first chip is also applicable to the inter-chip communication device for head-up display provided in the present embodiment, and will not be repeated in the embodiments of the present application.

[0156] refer to Figure 4, which is a schematic diagram of the structure of an inter-chip communication device for head-up display applied to a first chip provided in an embodiment of the present application. The device has the function of implementing the inter-chip communication method for head-up display in the above method embodiment. The function can be implemented by hardware or by hardware executing corresponding software. The device may include:

[0157] The communication module 410 is used to establish a communication connection with the second chip in response to a communication request of the second chip; the first chip and the second chip are both arranged in the current vehicle;

[0158] The first data receiving module 420 is used to receive and parse the initial preset format video stream sent by the second chip in real time, where the initial preset format video stream is rendered by the second chip based on the target map information;

[0159] The second data receiving module 430 is used to obtain real-time distortion data for the video stream in the initial preset format transmitted by the embedded real-time operating system, where the real-time distortion data at least includes the video stream angle distortion information;

[0160] The display module 440 is used to correct the initial preset format video stream based on the real-time distortion data to obtain a target preset format video stream; and render the target preset format video stream to the head-up display device of the current vehicle so that the head-up display device displays the target map information.

[0161] Optionally, the first data receiving module 420 includes:

[0162] The video stream receiving unit is used to receive in real time the video stream in the initial preset format sent by the second chip; the video stream in the initial preset format is a real-time message transmission protocol video stream; the video stream in the initial preset format carries video encoding data;

[0163] The video stream parsing unit is used to determine the video decoding data corresponding to the initial preset format video stream based on the video encoding data, and parse the initial preset format video stream based on the video decoding data.

[0164] Optionally, the second data receiving module 430 includes:

[0165] A data call request unit is used to send a data call request to the communication middleware, so that the communication middleware responds to the data call request and sends real-time distortion data for the initial preset format video stream to the first chip; the real-time distortion data is transmitted to the communication middleware by the embedded real-time operating system;

[0166] The data receiving unit is used to receive the real-time distortion data sent by the communication middleware.

[0167] Optionally, the display module 440 includes:

[0168] A first calculation unit, used to determine an initial angle of an initial preset format video stream;

[0169] A second calculation unit is used to determine the desired correction angle of the initial preset format video stream adapted to the current vehicle based on the real-time distortion data; the real-time distortion data is determined according to the initial angle of the initial preset format video stream, the vehicle parameters of the current vehicle and the driving state information;

[0170] A coordinate determination unit, used for calling a preset graphic operation function to determine the coordinates of the vertices to be corrected of the initial preset format video stream based on the expected correction angle;

[0171] The correction unit is used to correct the initial angle of the initial preset format video stream based on the coordinates of the vertices to be corrected to obtain the target preset format video stream.

[0172] Optionally, the first data receiving module 420 is further used to: receive and parse the initial media data stream sent by the second chip in real time; the initial media data stream is obtained by rendering by the second chip based on media data information, and the media data information includes any one or more of historical driving trajectory information, safety prompt information, and leisure and entertainment information at the target time;

[0173] The display module 440 is further used to: correct the initial media data stream based on the real-time distortion data to obtain a target media data stream; and render the target media data stream to a head-up display device of the current vehicle so that the head-up display device displays the media data information.

[0174] Optionally, the display module 440 is also used to: fuse the target preset format video stream and the target media data stream to obtain a fused video stream; and render the fused video stream to the head-up display device of the current vehicle so that the head-up display device displays the fused target map information and media data information.

[0175] refer to Figure 5 The embodiment of the present application further provides an inter-chip communication device for head-up display applied to a second chip, corresponding to the inter-chip communication method for head-up display applied to the second chip, including:

[0176] The communication module 510 is used to send a communication request to the first chip to establish a communication connection with the first chip; the first chip and the second chip are both arranged in the current vehicle;

[0177] The map information acquisition module 520 is used to acquire target map information in the initial map information; the target map information at least includes local road network information and current vehicle speed information;

[0178] A rendering module 530, configured to render an initial preset format video stream based on target map information;

[0179] The data sending module 540 is used to send the initial preset format video stream to the first chip, so that the first chip obtains the real-time distortion data for the initial preset format video stream transmitted by the embedded real-time operating system, corrects the initial preset format video stream based on the real-time distortion data to obtain the target preset format video stream, and renders the target preset format video stream to the head-up display device of the current vehicle, so that the head-up display device displays the target map information.

[0180] Optionally, the rendering module 530 includes:

[0181] A thread creation unit, used for creating a video stream rendering thread, and executing the video stream rendering thread based on the target map information to obtain video stream output bytes corresponding to the target map information;

[0182] The encapsulation unit is used to encapsulate the video stream output bytes based on a preset encapsulation format to obtain an initial preset format video stream.

[0183] Optionally, the map information acquisition module 520 is further used to: acquire media data information; the media data information includes any one or more of historical driving trajectory information, safety reminder information, and leisure and entertainment information at the target time;

[0184] The rendering module 530 is further used to: render and obtain an initial media data stream based on the media data information;

[0185] The data sending module 540 is also used to: send the initial media data stream to the first chip, so that the first chip corrects the initial media data stream based on the real-time distortion data to obtain the target media data stream, and renders the target media data stream to the head-up display device of the current vehicle, so that the head-up display device displays the media data information; or, so that the first chip fuses the target preset format video stream and the target media data stream to obtain a fused video stream, and renders the fused video stream to the head-up display device of the current vehicle, so that the head-up display device displays the fused target map information and media data information.

[0186] Optionally, the communication module 510 is further used to: determine the sending content in response to a user's control instruction; wherein the sending content includes an initial preset format video stream and / or an initial media data stream.

[0187] It should be noted that the device provided in the above embodiment, when implementing its functions, is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0188] An embodiment of the present application also provides an inter-chip communication system for a head-up display, including a first chip, a second chip, an embedded real-time operating system and a head-up display device, for implementing the inter-chip communication method for a head-up display as described above.

[0189] An embodiment of the present application also provides an electronic device, including a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the at least one instruction or at least one program is loaded and executed by the processor to implement the steps of the above-mentioned chip-to-chip communication method for head-up display.

[0190] The memory can be used to store software programs and modules, and the processor executes various functional applications by running the software programs and modules stored in the memory. The memory may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, application programs required for functions, etc.; the data storage area may store data created according to the use of the device, etc. In addition, the memory may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage device. Accordingly, the memory may also include a memory controller to provide the processor with access to the memory. The processor may be a central processing unit, or other general-purpose processors, digital signal processors, application-specific integrated circuits or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0191] The method embodiments provided in the embodiments of the present application can be executed in a computer terminal, a server or a similar computing device. Figure 6 , which is a schematic diagram of the hardware structure of a terminal running an inter-chip communication method for head-up display provided in an embodiment of the present application.

[0192] Specifically, the terminal may include an RF (Radio Frequency) circuit 610, a memory 620 including one or more computer-readable storage media, an input unit 630, a display unit 640, a sensor 650, an audio circuit 660, a WiFi (wireless fidelity) module 660, a processor 680 including one or more processing cores, and a power supply 690. Those skilled in the art will appreciate that Figure 6 The terminal structure shown in the figure does not constitute a limitation on the terminal, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0193] in:

[0194] The RF circuit 610 can be used for receiving and sending signals during information transmission or calls. In particular, after receiving the downlink information of the base station, it is handed over to one or more processors 680 for processing; in addition, the data related to the uplink is sent to the base station. Generally, the RF circuit 610 includes but is not limited to an antenna, at least one amplifier, a tuner, one or more oscillators, a user identity module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier), a duplexer, etc. In addition, the RF circuit 610 can also communicate with the network and other terminals through wireless communication. Wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), email, SMS (Short Messaging Service), etc.

[0195] The memory 620 can be used to store software programs and modules. The processor 680 executes various functional applications and data processing by running the software programs and modules stored in the memory 620. The memory 620 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, application programs required for functions, etc.; the data storage area may store data created according to the use of the terminal, etc. In addition, the memory 620 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 620 may also include a memory controller to provide the processor 680 and the input unit 630 with access to the memory 620.

[0196] The input unit 630 can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control. Specifically, the input unit 630 may include a touch-sensitive surface 631 and other input devices 632. The touch-sensitive surface 631, also known as a touch display screen or touchpad, can collect user touch operations on or near it (such as operations performed by users using fingers, styluses, or any other suitable objects or accessories on or near the touch-sensitive surface 631), and drive corresponding connection devices according to a pre-set program. Optionally, the touch-sensitive surface 631 may include a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then sends it to the processor 680, and can receive and execute commands sent by the processor 680. In addition, the touch-sensitive surface 631 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch-sensitive surface 631, the input unit 630 may further include other input devices 632. Specifically, the other input devices 632 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

[0197] The display unit 640 can be used to display information input by the user or information provided to the user and various graphical user interfaces of the terminal, which can be composed of graphics, text, icons, videos and any combination thereof. The display unit 640 may include a display panel 641. Optionally, the display panel 641 may be configured in the form of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), etc. Further, the touch-sensitive surface 631 may cover the display panel 641. When the touch-sensitive surface 631 detects a touch operation on or near it, it is transmitted to the processor 680 to determine the type of touch event, and then the processor 680 provides corresponding visual output on the display panel 641 according to the type of touch event. Among them, the touch-sensitive surface 631 and the display panel 641 can be two independent components to realize input and output functions, but in some embodiments, the touch-sensitive surface 631 and the display panel 641 can also be integrated to realize input and output functions.

[0198] The terminal may also include at least one sensor 650, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 641 according to the brightness of the ambient light, and the proximity sensor may turn off the display panel 641 and / or the backlight when the terminal is moved to the ear. As a type of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the terminal posture (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can be configured in the terminal, such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.

[0199] The audio circuit 660, the speaker 661, and the microphone 662 can provide an audio interface between the user and the terminal. The audio circuit 660 can transmit the received audio data to the speaker 661 after converting the electrical signal, which is converted into a sound signal for output; on the other hand, the microphone 662 converts the collected sound signal into an electrical signal, which is received by the audio circuit 660 and converted into audio data, and then the audio data is processed by the output processor 680, and then sent to another terminal through the RF circuit 610, or the audio data is output to the memory 620 for further processing. The audio circuit 660 may also include an earplug jack to provide communication between an external headset and the terminal.

[0200] WiFi is a short-range wireless transmission technology. The terminal can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 670. It provides users with wireless broadband Internet access. Figure 6 A WiFi module 670 is shown, but it is understandable that it is not an essential component of the terminal and can be omitted as needed without changing the essence of the invention.

[0201] The processor 680 is the control center of the terminal. It uses various interfaces and lines to connect various parts of the entire terminal. It executes various functions of the terminal and processes data by running or executing software programs and / or modules stored in the memory 620, and calling data stored in the memory 620, so as to monitor the terminal as a whole. Optionally, the processor 680 may include one or more processing cores; preferably, the processor 680 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 680.

[0202] The terminal also includes a power supply 690 (such as a battery) for supplying power to each component. Preferably, the power supply can be logically connected to the processor 680 through a power management system, so that the power management system can manage charging, discharging, and power consumption management. The power supply 690 can also include any components such as one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, and power status indicators.

[0203] Although not shown, the terminal may also include a camera, a Bluetooth module, etc., which will not be described in detail. Specifically in this embodiment, the terminal also includes a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors.

[0204] The embodiment of the present application also provides a computer-readable storage medium, in which at least one instruction or at least one program is stored, and the at least one instruction or at least one program is loaded and executed by a processor to implement the steps of the inter-chip communication method for head-up display as described above. In the embodiment of the present application, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form, etc. The computer-readable storage medium may include: any entity or device capable of carrying computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory, random access memory, electrical carrier signal, telecommunication signal and software distribution medium, etc.

[0205] The embodiment of the present application also provides a computer storage medium, in which at least one instruction or at least one program is stored, and at least one instruction or at least one program is loaded and executed by a processor to implement the above method. In the embodiment of the present application, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form, etc. Computer-readable storage media may include: any entity or device capable of carrying computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory, random access memory, electric carrier signal, telecommunication signal and software distribution medium, etc.

[0206] The embodiment of the present application also provides a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the inter-chip communication method for head-up display provided in the above-mentioned various optional implementations.

[0207] The above are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A chip-to-chip communication method for head-up display, characterized in that: Applied to the first chip, the method includes: In response to a communication request of the second chip, a communication connection with the second chip is established; the first chip and the second chip are both arranged in the current vehicle; receiving and parsing in real time an initial preset format video stream sent by the second chip, where the initial preset format video stream is rendered by the second chip based on target map information; Acquire real-time distortion data for the initial preset format video stream transmitted by the embedded real-time operating system, wherein the real-time distortion data at least includes video stream angle distortion information; The initial preset format video stream is corrected based on the real-time distortion data to obtain a target preset format video stream; and the target preset format video stream is rendered to a head-up display device of the current vehicle so that the head-up display device displays the target map information.

2. The method according to claim 1, characterized in that The real-time receiving and parsing of the initial preset format video stream sent by the second chip includes: receiving in real time an initial preset format video stream sent by the second chip; the initial preset format video stream is a real-time messaging protocol video stream; the initial preset format video stream carries video encoding data; The video decoding data corresponding to the initial preset format video stream is determined based on the video encoding data, and the initial preset format video stream is parsed based on the video decoding data.

3. The method according to claim 1, characterized in that The step of obtaining real-time distortion data for the initial preset format video stream transmitted by the embedded real-time operating system comprises: Sending a data call request to the communication middleware, so that the communication middleware sends real-time distortion data for the initial preset format video stream to the first chip in response to the data call request; the real-time distortion data is transmitted from the embedded real-time operating system to the communication middleware; Receive the real-time distortion data sent by the communication middleware.

4. The method according to claim 3, characterized in that The correcting the initial preset format video stream based on the real-time distortion data to obtain a target preset format video stream comprises: Determining an initial angle of the initial preset format video stream; Determining, based on the real-time distortion data, that the initial preset format video stream is adapted to the desired correction angle of the current vehicle; the real-time distortion data is determined according to the initial angle of the initial preset format video stream, the vehicle parameters of the current vehicle, and the driving state information; Calling a preset graphics operation function to determine the coordinates of the vertices to be corrected of the initial preset format video stream based on the expected correction angle; The initial angle of the initial preset format video stream is corrected based on the vertex coordinates to be corrected to obtain the target preset format video stream.

5. The method according to any one of claims 1 to 4, characterized in that The method further comprises: receiving and parsing in real time an initial media data stream sent by the second chip; the initial media data stream is obtained by rendering by the second chip based on media data information, and the media data information includes any one or more of historical driving trajectory information, safety reminder information, and leisure and entertainment information at a target time; Correcting the initial media data stream based on the real-time distortion data to obtain a target media data stream; The target media data stream is rendered onto a head-up display device of the current vehicle, so that the head-up display device displays the media data information.

6. The method according to claim 5, characterized in that The method further comprises: Performing fusion processing on the target preset format video stream and the target media data stream to obtain a fused video stream; The fused video stream is rendered onto a head-up display device of the current vehicle, so that the head-up display device displays the fused target map information and media data information.

7. A chip-to-chip communication method for head-up display, characterized in that: Applied to the second chip, the method includes: Sending a communication request to a first chip to establish a communication connection with the first chip; the first chip and the second chip are both arranged in the current vehicle; Acquire target map information in the initial map information; the target map information at least includes local road network information and speed information of the current vehicle; Rendering to obtain an initial preset format video stream based on the target map information; The initial preset format video stream is sent to the first chip so that the first chip obtains real-time distortion data for the initial preset format video stream transmitted by the embedded real-time operating system, corrects the initial preset format video stream based on the real-time distortion data to obtain a target preset format video stream, and renders the target preset format video stream to a head-up display device of the current vehicle so that the head-up display device displays the target map information.

8. The method according to claim 7, characterized in that The rendering based on the target map information to obtain an initial preset format video stream comprises: Creating a video stream rendering thread, and executing the video stream rendering thread based on the target map information to obtain video stream output bytes corresponding to the target map information; The video stream output bytes are encapsulated based on a preset encapsulation format to obtain the initial preset format video stream.

9. The method according to claim 7 or 8, characterized in that: The method further comprises: Acquire media data information; the media data information includes any one or more of historical driving trajectory information, safety reminder information, and leisure and entertainment information at a target time; Rendering based on the media data information to obtain an initial media data stream; The initial media data stream is sent to the first chip, so that the first chip corrects the initial media data stream based on the real-time distortion data to obtain a target media data stream, and renders the target media data stream to a head-up display device of the current vehicle, so that the head-up display device displays the media data information; or, the first chip fuses the target preset format video stream and the target media data stream to obtain a fused video stream, and renders the fused video stream to the head-up display device of the current vehicle, so that the head-up display device displays the fused target map information and media data information.

10. The method according to claim 9, characterized in that The method further comprises: In response to a user's control instruction, the content to be sent is determined; wherein the content to be sent includes the initial preset format video stream and / or the initial media data stream.

11. An inter-chip communication device for head-up display, characterized in that: Applied to a first chip, the device comprises: a communication module, configured to establish a communication connection with the second chip in response to a communication request of the second chip; the first chip and the second chip are both arranged in the current vehicle; A first data receiving module is used to receive and parse in real time an initial preset format video stream sent by the second chip, where the initial preset format video stream is rendered by the second chip based on target map information; A second data receiving module is used to obtain real-time distortion data for the initial preset format video stream transmitted by the embedded real-time operating system, wherein the real-time distortion data at least includes video stream angle distortion information; The display module is used to correct the initial preset format video stream based on the real-time distortion data to obtain a target preset format video stream; and render the target preset format video stream to a head-up display device of the current vehicle so that the head-up display device displays the target map information.

12. An inter-chip communication device for head-up display, characterized in that: Applied to the second chip, the device comprises: A communication module, used for sending a communication request to the first chip to establish a communication connection with the first chip; the first chip and the second chip are both arranged in the current vehicle; A map information acquisition module, used to acquire target map information in the initial map information; the target map information at least includes local road network information and speed information of the current vehicle; A rendering module, used for rendering to obtain an initial preset format video stream based on the target map information; A data sending module is used to send the initial preset format video stream to the first chip, so that the first chip obtains real-time distortion data for the initial preset format video stream transmitted by the embedded real-time operating system, corrects the initial preset format video stream based on the real-time distortion data to obtain a target preset format video stream, and renders the target preset format video stream to the head-up display device of the current vehicle, so that the head-up display device displays the target map information.

13. A chip-to-chip communication system for head-up display, characterized in that: The invention comprises a first chip, a second chip, an embedded real-time operating system and a head-up display device, and is used to implement the chip-to-chip communication method for head-up display as claimed in any one of claims 1 to 10.

14. An electronic device, characterized in that: It comprises a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the at least one instruction or the at least one program is loaded and executed by the processor to implement the chip-to-chip communication method for head-up display according to any one of claims 1 to 10.

15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores at least one instruction or at least one program, and the at least one instruction or the at least one program is loaded and executed by the processor to implement the chip-to-chip communication method for head-up display according to any one of claims 1 to 10.

Citation Information

Patent Citations

  • Integrated control device for pure electric vehicle

    CN104354654A

  • Image distortion correction method and device for vehicle-mounted head-up display system

    CN109993713A

  • Head-up display method and system based on WHUD

    CN113433695A

  • Vehicle-mounted control system and method, and video data and audio data processing method

    CN113872838A

  • Multi-mode entertainment interaction method and device, equipment and medium

    CN116610212A