An inter-chip communication method for head-up display and related device

Abstract

This application provides an inter-chip communication method and related equipment for head-up displays (HUDs), relating to the field of automotive navigation technology. The method involves a first chip responding to a communication request from a second chip to establish a communication connection; receiving and parsing an initial preset format video stream sent by the second chip in real time; acquiring real-time distortion data of the initial preset format video stream transmitted by the embedded real-time operating system, the real-time distortion data containing at least video stream angle distortion information; correcting the initial preset format video stream based on the real-time distortion data to obtain a target preset format video stream; and rendering the target preset format video stream onto the HUD device of the current vehicle to display target map information. This application effectively avoids interference between the in-vehicle entertainment system and the vehicle control system, ensuring low latency, high driving safety, and preventing offset and distortion of the HUD map navigation from the driver's perspective, thus improving the user experience.

Description

[0001] This application claims priority to Chinese Patent Application No. 202311499737.8, filed on November 9, 2023, entitled "A chip-to-chip communication method and related equipment for head-up display", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of automotive navigation technology, and in particular to an inter-chip communication method and related equipment for head-up displays. Background Technology

[0003] A Head-Up Display (HUD) is a transparent display technology that accurately projects dashboard information, navigation information, or other data obtained from vehicle and road conditions analysis by sensors (such as cameras and radar) into the driver's field of vision without requiring them to look down. This eliminates the need for the driver to look down at the dashboard while the car is in motion, thus avoiding blind spots.

[0004] The current method of implementing Hud map navigation in Android smart car systems has certain drawbacks, such as limited information display, poor user interaction experience, the need for additional customized navigation services, and the inability to correct the angle after the navigation map is projected onto the Hud, which will cause visual offset and perspective distortion. Summary of the Invention

[0005] This application provides a chip-to-chip communication method and related equipment for head-up displays to solve the above-mentioned problems.

[0006] In a first aspect, this application provides an inter-chip communication method for a head-up display, applied to a first chip, the method comprising:

[0007] In response to a communication request from the second chip, a communication connection is established with the second chip; both the first chip and the second chip are located in the current vehicle.

[0008] The system receives and parses the initial preset format video stream sent by the second chip in real time. The initial preset format video stream is rendered by the second chip based on the target map information.

[0009] Acquire real-time distortion data of an initially preset format video stream transmitted by an embedded real-time operating system. The real-time distortion data shall contain at least video stream angle distortion information.

[0010] The target preset format video stream is obtained by correcting the initial preset format video stream based on real-time distortion data; the target preset format video stream is then rendered onto the head-up display device of the current vehicle so that the head-up display device can display the target map information.

[0011] Optionally, receiving and parsing the initial preset format video stream sent by the second chip in real time includes:

[0012] The system receives an initial preset format video stream sent by the second chip in real time; the initial preset format video stream is a real-time message transmission protocol video stream; the initial preset format video stream carries video encoding data.

[0013] Based on the video encoding data, determine the video decoding data corresponding to the initial preset format video stream, and parse the initial preset format video stream based on the video decoding data.

[0014] Optionally, acquiring real-time distortion data of the video stream in the initial preset format transmitted by the embedded real-time operating system includes:

[0015] A data request is sent to the communication middleware, so that the communication middleware responds to the data request and sends real-time distortion data for the initial preset format video stream to the first chip; the real-time distortion data is transmitted to the communication middleware by the embedded real-time operating system;

[0016] Receive real-time distorted data sent by the communication middleware.

[0017] Optionally, obtaining the target preset format video stream by correcting the initial preset format video stream based on real-time distortion data includes:

[0018] Determine the initial angle of the initial preset format video stream;

[0019] The desired correction angle for the initial preset format video stream to adapt to the current vehicle is determined based on real-time distortion data; the real-time distortion data is determined based on the initial angle of the initial preset format video stream, the vehicle parameters of the current vehicle, and driving status information.

[0020] Call the preset graphics operation function to determine the coordinates of the vertex to be corrected in the initial preset format video stream based on the desired correction angle;

[0021] The initial angle of the initial preset format video stream is corrected based on the coordinates of the vertex to be corrected, and the target preset format video stream is obtained.

[0022] Optionally, the method further includes:

[0023] The system receives and parses the initial media data stream sent by the second chip in real time. The initial media data stream is rendered by the second chip based on media data information, which includes any one or more of the following: historical driving trajectory information at the target time, safety prompt information, and leisure and entertainment information.

[0024] The target media data stream is obtained by correcting the initial media data stream based on the real-time distortion data.

[0025] The target media data stream is rendered onto the head-up display device of the current vehicle so that the head-up display device displays the media data information.

[0026] Optionally, the method further includes:

[0027] The target preset format video stream and the target media data stream are fused to obtain a fused video stream;

[0028] The fused video stream is rendered onto the head-up display (HUD) of the current vehicle, so that the HUD displays the fused target map information and media data information.

[0029] Secondly, this application provides an inter-chip communication method for a head-up display, applied to a second chip, the method comprising:

[0030] A communication request is sent to the first chip to establish a communication connection with the first chip; both the first chip and the second chip are located in the current vehicle.

[0031] Obtain the target map information from the initial map information; the target map information should at least include local road network information and the current vehicle speed information;

[0032] An initial preset format video stream is obtained by rendering based on the target map information;

[0033] An initial preset format video stream is sent to a first chip, which then obtains real-time distortion data for the initial preset format video stream transmitted by the embedded real-time operating system. Based on the real-time distortion data, the initial preset format video stream is corrected to obtain a target preset format video stream, which is then rendered onto the head-up display device of the current vehicle to display the target map information.

[0034] Optionally, the initial preset format video stream rendered based on the target map information includes:

[0035] Create a video stream rendering thread, and execute the video stream rendering thread based on the target map information to obtain the video stream output bytes corresponding to the target map information;

[0036] The video stream output bytes are encapsulated based on a preset encapsulation format to obtain an initial preset format video stream.

[0037] Optionally, the method further includes:

[0038] Acquire media data information; the media data information includes any one or more of the following: historical driving trajectory information at the target time, safety alert information, and leisure and entertainment information.

[0039] An initial media data stream is rendered based on the aforementioned media data information;

[0040] The initial media data stream is sent to the first chip, so that the first chip corrects the initial media data stream based on the real-time distortion data to obtain the target media data stream, and renders the target media data stream onto the head-up display device of the current vehicle, so that the head-up display device displays the media data information; or, the first chip performs fusion processing on the target preset format video stream and the target media data stream to obtain a fused video stream, and renders the fused video stream onto the head-up display device of the current vehicle, so that the head-up display device displays the fused target map information and media data information.

[0041] Optionally, the method further includes:

[0042] In response to a user's control command, the content to be sent is determined; wherein the content to be sent includes the initial preset format video stream and / or the initial media data stream.

[0043] Thirdly, this application provides an inter-chip communication device for a head-up display, applied to a first chip, the device comprising:

[0044] A communication module is used to establish a communication connection with the second chip in response to a communication request from the second chip; both the first chip and the second chip are located in the current vehicle.

[0045] The first data receiving module is used to receive and parse the initial preset format video stream sent by the second chip in real time. The initial preset format video stream is rendered by the second chip based on the target map information.

[0046] The second data receiving module is used to acquire real-time distortion data of the video stream in the initial preset format transmitted by the embedded real-time operating system. The real-time distortion data includes at least video stream angle distortion information.

[0047] The display module is used to correct the initial preset format video stream based on real-time distortion data to obtain the target preset format video stream; and to render the target preset format video stream onto the head-up display device of the current vehicle so that the head-up display device can display the target map information.

[0048] Optionally, the first data receiving module includes:

[0049] The video stream receiving unit is used to receive an initial preset format video stream sent by the second chip in real time; the initial preset format video stream is a real-time message transmission protocol video stream; the initial preset format video stream carries video encoding data;

[0050] The video stream parsing unit is used to determine the video decoding data corresponding to the initial preset format video stream based on the video encoding data, and to parse the initial preset format video stream based on the video decoding data.

[0051] Optionally, the second data receiving module includes:

[0052] The data retrieval request unit is used to send a data retrieval request to the communication middleware, so that the communication middleware responds to the data retrieval request and sends real-time distortion data for the initial preset format video stream to the first chip; the real-time distortion data is transmitted to the communication middleware by the embedded real-time operating system;

[0053] The data receiving unit is used to receive real-time distorted data sent by the communication middleware.

[0054] Optionally, the display module includes:

[0055] The first calculation unit is used to determine the initial angle of the initial preset format video stream;

[0056] The second calculation unit is used to determine the desired correction angle of the initial preset format video stream adapted to the current vehicle based on real-time distortion data; the real-time distortion data is determined based on the initial angle of the initial preset format video stream, the vehicle parameters of the current vehicle, and driving status information.

[0057] The coordinate determination unit is used to call a preset graphics operation function to determine the coordinates of the vertex to be corrected in the initial preset format video stream based on the desired correction angle.

[0058] The correction unit is used to correct the initial angle of the initial preset format video stream based on the coordinates of the vertex to be corrected, so as to obtain the target preset format video stream.

[0059] Fourthly, this application provides an inter-chip communication device for a head-up display, applied to a second chip, the device comprising:

[0060] A communication module is used to send a communication request to the first chip and establish a communication connection with the first chip; both the first chip and the second chip are located in the current vehicle.

[0061] The map information acquisition module is used to acquire target map information from the initial map information; the target map information includes at least local road network information and the current vehicle speed information.

[0062] The rendering module is used to render an initial preset format video stream based on the target map information;

[0063] The data transmission module is used to send an initial preset format video stream to the first chip, so that the first chip can obtain real-time distortion data of the initial preset format video stream transmitted by the embedded real-time operating system, correct the initial preset format video stream based on the real-time distortion data to obtain a target preset format video stream, and render the target preset format video stream onto the head-up display device of the current vehicle, so that the head-up display device can display target map information.

[0064] Optionally, the rendering module includes:

[0065] The thread creation unit is used to create a video stream rendering thread, which executes the video stream rendering thread based on the target map information to obtain the video stream output bytes corresponding to the target map information;

[0066] The encapsulation unit is used to encapsulate the output bytes of the video stream based on a preset encapsulation format to obtain an initial preset format video stream.

[0067] Fifthly, this application provides an inter-chip communication system for head-up displays, including a first chip, a second chip, an embedded real-time operating system, and a head-up display device, for implementing the inter-chip communication method for head-up displays as described above.

[0068] In a sixth aspect, this application provides an electronic device, including a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the at least one instruction or at least one program is loaded and executed by the processor to implement the chip-to-chip communication method for head-up display as described above.

[0069] In a seventh aspect, this application provides a computer-readable storage medium storing at least one instruction or at least one program, wherein the at least one instruction or at least one program is loaded and executed by a processor to implement the chip-to-chip communication method for head-up display as described above.

[0070] Eighthly, this application provides a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the chip-to-chip communication method for head-up display as described above.

[0071] By adopting the above technical solution, the present invention has the following beneficial effects:

[0072] The second chip transmits the initial preset format video stream of the target map information to the first chip. The target map information is a portion extracted from the navigation information provided by the in-vehicle navigation system, making the retrieval process convenient and quick, without the need for additional customized navigation services. Without affecting the display effect of the main map of the in-vehicle navigation system, the head-up display device can only display the desired target map information, ensuring both user experience needs and driving safety. Furthermore, the two chips each have their own specific functions, effectively preventing the second chip's in-vehicle entertainment system from interfering with the first chip's driving control system, ensuring both low latency and high safety. In addition, while receiving and parsing the initial preset format video stream, the first chip also performs angle correction on the initial preset format video stream based on real-time distortion data transmitted by the embedded real-time operating system. This avoids the angle of the target preset format video stream being inconsistent with the pitch angle of the head-up display device relative to the driver and the current turning angle of the vehicle, which would reduce the user experience.

[0073] Other features and advantages of the present invention will be described in detail in the following detailed description section. Attached Figure Description

[0074] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention, and the same reference numerals usually represent the same parts. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0075] Figure 1 A schematic diagram of a system architecture for implementing an inter-chip communication method for a head-up display, provided as an embodiment of this application;

[0076] Figure 2 A schematic flowchart illustrating an inter-chip communication method for a head-up display provided in an embodiment of this application;

[0077] Figure 3 A flowchart illustrating another inter-chip communication method for head-up displays provided in this application embodiment;

[0078] Figure 4 A schematic flowchart of an inter-chip communication device for a head-up display provided in an embodiment of this application;

[0079] Figure 5 A schematic flowchart of another chip-to-chip communication device for a head-up display provided in an embodiment of this application;

[0080] Figure 6A schematic diagram of the server hardware structure for implementing the inter-chip communication method for head-up display provided for the purpose of this invention. Detailed Implementation

[0081] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0082] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a particular order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of the invention described herein can be implemented, for example, in orders other than those illustrated or described herein. Furthermore, the terms “comprising” and “having,” and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0083] A Head-Up Display (HUD) is a transparent display technology that accurately projects dashboard information, navigation information, or other data obtained from vehicle and road conditions analysis by sensors (such as cameras and radar) into the driver's field of vision without requiring them to look down. Although initially used in flight aids for military aircraft, HUD technology has been applied to automotive driver assistance since the late 1980s. With an in-vehicle HUD system, the driver does not need to look down at the dashboard, eliminating blind spots.

[0084] The current mainstream development approach for Android smart in-vehicle systems is to use a single CPU (Central Processing Unit) to handle all vehicle control and in-vehicle entertainment systems. This approach is more direct in enabling map navigation to be projected onto the in-vehicle HUD system, but it also has its own drawbacks.

[0085] For example, HUD (Head-Up Display) devices can directly connect to the car's CAN (Controller Area Network) bus or OBD (On-Board Diagnostics) system to obtain information such as vehicle speed and RPM without secondary processing by the Android smart vehicle system. They have short communication links, fast rendering speed, low performance loss, and are the most widely used. However, they display relatively simple information, cannot provide navigation, have little user interaction, and offer a poor user experience.

[0086] Alternatively, an Android smart car system equipped with a 3G and GPS module can provide basic communication and positioning capabilities. By installing a navigation service, it can then project the screen onto the HUD for navigation and load some media information. However, this method still displays limited information and lacks user interaction. While the car's instrument panel already contains information that overlaps with the car's functions, and navigation is available, it cannot achieve the same effect as mobile phone navigation. It lacks real-time traffic updates and congestion information, and cannot interact with a mobile phone.

[0087] Alternatively, navigation can be achieved by projecting the map onto the HUD directly through the vehicle's navigation service. The navigation display will be identical to the main screen on the vehicle's infotainment system, and information such as vehicle speed and RPM can be obtained through the underlying interface. However, since the angle cannot be corrected after the map is projected onto the HUD, it will cause visual shift and perspective distortion.

[0088] In view of the above-mentioned defects in the existing technology, the present invention provides a method and related equipment for implementing inter-chip communication for head-up displays.

[0089] refer to Figure 1 The diagram shows a system architecture for implementing an inter-chip communication method for head-up display, as provided in an embodiment of this application. The system includes a first chip, a second chip, an embedded real-time operating system, and a head-up display device. The system is installed in the current vehicle, which can be broadly understood as any usable vehicle equipped with an Android smart vehicle system.

[0090] The first chip is a chip with a native Android open-source operating system, serving as the car's real-time operating system to ensure reliable vehicle control and driving safety. The second chip is a chip with a deeply customized Android open-source operating system, responsible for intelligent experience and infotainment. Both chips have communication capabilities, using synchronous / asynchronous communication to achieve data transmission.

[0091] The embedded real-time operating system is QNX, a distributed, embedded, scalable hard real-time operating system widely used in the automotive field. It can perform process scheduling, inter-process communication, low-level network communication, and interrupt handling services. In this invention, the first chip obtains real-time distortion data from the embedded real-time operating system side to correct the preset format video stream containing target map information to be rendered, and / or to correct the initial media data stream containing media data information to be rendered. The method flow will be described in detail later.

[0092] Head-up display (HUD) devices can include common types such as C-HUD (Combiner Head-Up Display), W-HUD (Windshield Head-Up Display), and AR-HUD (Augmented Reality Head-Up Display). Each type of HUD has different optical imaging components. For example, the optical imaging component of a C-HUD is resin glass; while the optical imaging component of a W-HUD and AR-HUD is the windshield of a vehicle, offering a wider information display range and supporting more functions, such as road traffic sign recognition and vehicle speed. However, all types of HUD devices include an image generation unit to generate image / video streams based on navigation information transmitted between a first chip and a second chip, and then project these streams onto the corresponding optical imaging components.

[0093] refer to Figure 2 The diagram illustrates a flowchart of an inter-chip communication method for a heads-up display (HUD) according to an embodiment of this application. It should be noted that while this specification provides method steps as shown in the embodiments or flowcharts, more or fewer steps may be included based on conventional or non-inventive methods. The order of steps listed in the embodiments is merely one possible execution order among many and does not represent the only possible execution order. In actual system devices or products, the methods can be executed sequentially according to the embodiments or drawings, or in parallel (e.g., in a parallel processor or multi-threaded processing environment). Figure 2 The chip-to-chip communication method for head-up display shown is applied to the first chip and includes:

[0094] S201, in response to the communication request of the second chip, establish a communication connection with the second chip; both the first chip and the second chip are located in the current vehicle.

[0095] In this embodiment, the first chip is a chip with a native Android open-source operating system, serving as the vehicle's real-time operating system to ensure reliable vehicle control and driving safety. The second chip is a chip with a deeply customized Android open-source operating system, responsible for intelligent experience and infotainment. The first chip is the master device, and the second chip is the slave device, communicating via the SPI (Service Provider Interface) protocol. For example, the first chip initiates a communication request by writing bytes to the SPI serial shift register. The serial shift register transmits the bytes to the second chip, and simultaneously, the second chip returns the contents of its own serial shift register to the first chip via a signal line, establishing a communication connection.

[0096] S202 receives and parses the initial preset format video stream sent by the second chip in real time. The initial preset format video stream is rendered by the second chip based on the target map information.

[0097] In one possible implementation, step S202 may include:

[0098] (1) Receive the initial preset format video stream sent by the second chip in real time; the initial preset format video stream is a real-time message transmission protocol video stream; the initial preset format video stream carries video encoding data;

[0099] (2) Determine the video decoding data corresponding to the initial preset format video stream based on the video encoding data, and parse the initial preset format video stream based on the video decoding data.

[0100] Specifically, the second chip acquires the global map information of the vehicle navigation system, and then extracts the target map information from the global map information based on the information to be displayed by the desired head-up display device. In this embodiment, the vehicle navigation system can be a common map navigation system such as Gaode Map Navigation or Baidu Map Navigation, and the target map information can include, but is not limited to, important vehicle speed information and local road network information. In other embodiments, the vehicle navigation system can use other map navigation systems, and the target map information can also include other map navigation information.

[0101] The second chip renders the target map information off-screen into a video stream in an initial preset format. In this embodiment, this is achieved using SurfaceView, a common and important view component in the Android system that provides an independent thread for drawing graphics. A video stream rendering thread is created, and based on the target map information, the video frames corresponding to the target map information are drawn in the rendering thread. The video stream output bytes are then encapsulated into an initial preset format video stream based on a preset encapsulation format.

[0102] In this embodiment, the initial preset format video stream is a Real-Time Messaging Protocol (RTMP) video stream, and the preset encapsulation format can be RTMP. RTMP is based on TCP (Transmission Control Protocol) and is used for real-time data communication. The video frames are encoded using an RTMP encoder to obtain the initial preset format video stream, which is then published to an RTMP streaming media server. The initial preset format video stream carries video encoding data. The RTMP streaming media server is deployed on a first chip. The first chip receives the initial preset format video stream in real time through the RTMP streaming media server, determines the corresponding video decoding data based on the video encoding data, and parses the initial preset format video stream based on the video decoding data.

[0103] This implementation allows the second chip to transmit an initial preset format video stream of the target map information to the first chip. The target map information is a portion extracted from the navigation information provided by the in-vehicle navigation system, making it convenient and quick to access without needing to customize a separate navigation service. Without affecting the display effect of the main map of the in-vehicle navigation system, the head-up display device can only display the desired target map information, ensuring both user experience and driving safety. Furthermore, the two chips each have different functions, effectively preventing the in-vehicle entertainment system of the second chip from interfering with the driving control system of the first chip, thus ensuring both low latency and high security.

[0104] In one possible embodiment, in addition to receiving and parsing the initial preset format video stream sent by the second chip in real time, the first chip can also: receive and parse the initial media data stream sent by the second chip in real time. The initial media data stream is rendered by the second chip based on media data information, which includes any one or more of the following: historical driving trajectory information at the target time, safety alert information, and entertainment information.

[0105] For example, the historical driving trajectory information at the target time can be the driving trajectory information most recent to the current time, or it can be the driving trajectory information for any time interval selected by the user. The driving trajectory information can be used to indicate the vehicle's driving status at that time. Based on the historical driving trajectory information, users can preview the driving trajectory in real time, thereby better planning driving routes and playing a role in assisting driving. For example, in driving scenarios such as racing, based on high-precision historical driving trajectory information, users can perform more accurate driving and have a better driving experience.

[0106] Optionally, the driving trajectory information can be obtained by fitting data such as the vehicle's position, speed, and direction collected by the Global Positioning System (GPS) and other sensors during the driving process. For example, during the driving process, according to a preset data collection frequency (e.g., data is collected every 0.5 seconds, and the collection frequency can be higher in racing scenarios), the vehicle's GPS module can obtain the vehicle's real-time position information (such as longitude and latitude), and the vehicle's Inertial Measurement Unit (IMU) can obtain information such as the vehicle's acceleration and angular velocity. After using filtering algorithms (such as Kalman filtering) to remove noise and outliers that may occur during the collection process, the filtered data collected by the GPS module and the IMU are fused, and the GPS data is converted to a suitable coordinate system (such as converting from a geographic coordinate system to a planar coordinate system). Finally, the trajectory points are plotted based on the processed data, and the trajectory is smoothed using a smoothing algorithm (such as Bézier curves) to eliminate noise and discontinuities. Then, the trajectory information is visualized using map services, thus obtaining the driving trajectory information displayed on the map. In addition, historical driving trajectory information can also be generated in other ways. This application embodiment does not limit the way historical driving trajectory information is generated.

[0107] For example, safety alert information can be various reminders to the driver to pay attention to driving safety, such as speeding warnings, driver fatigue warnings, and forward collision warnings. Optionally, safety alert information can be acquired based on a combination of multiple sensors, data sources, and technologies. For example, a speed sensor can be used to monitor vehicle speed to provide speeding warnings; and so on. This application embodiment does not impose any limitations. Based on safety alert information, the driver can be reminded, thereby improving driving safety.

[0108] For example, leisure and entertainment information may include various information provided by the in-vehicle entertainment system, such as music playlist information, lyrics display information, video playback information, and other information permitted by regulations; alternatively, leisure and entertainment information may also be other entertainment information obtained based on the Internet, streaming media services, or other third-party devices, and this application embodiment does not impose any limitations. Based on leisure and entertainment information, entertainment value can be enhanced, thereby improving the user experience.

[0109] Furthermore, media data information may also include information permitted by regulations, such as consumer electronics information, game interface information, and social media information; this application embodiment does not impose such restrictions. Displaying this media data information will not affect traffic safety and can even enhance driving entertainment.

[0110] Understandably, after the second chip obtains any one or more media data information from the historical driving trajectory information, safety prompt information, and leisure and entertainment information at the target time, it can use a similar method to render and encapsulate the media data information into an initial media data stream through SurfaceView. The same technical means will not be elaborated here.

[0111] The second chip can send the initial media data stream to the first chip via a Socket channel. A Socket is an inter-process communication mechanism provided by the operating system. By deploying a Socket on both the second and first chips, a Socket channel can be formed, allowing the second chip to send the initial media data stream to the first chip. Socket channels are characterized by independent transmission channels, high efficiency, strong scalability, and low loss. Adding another Socket channel to send other initial media data is also convenient; only the port needs to be modified to receive data from another channel, providing greater flexibility in multi-layer fusion.

[0112] Understandably, when displaying target map information on the head-up display device, the first chip receives an initial preset format video stream sent by the second chip; when displaying media data information on the head-up display device, the first chip receives an initial media data stream sent by the second chip; when displaying target map information and media data information simultaneously on the head-up display device, the first chip receives both the initial preset format video stream and the initial media data stream.

[0113] S203, acquire real-time distortion data of the video stream in the initial preset format transmitted by the embedded real-time operating system, wherein the real-time distortion data contains at least video stream angle distortion information.

[0114] In this embodiment, the embedded real-time operating system obtains the current vehicle parameter information provided by the bottom hardware device, including but not limited to the current vehicle parameters and driving status information. The vehicle parameter information may include the pitch angle of the windshield relative to the driver, the height difference of the seat relative to the head-up display device, etc.; the driving status information may include the current vehicle speed, steering angle, etc.

[0115] In addition, the embedded real-time operating system obtains the initial angle of the initial preset format video stream. Using the vehicle parameters and driving status information of the current vehicle, it calculates the potential distortion if the initial preset format video stream is projected onto the head-up display device at the initial angle, thus obtaining real-time distortion data for the initial preset format video stream. This real-time distortion data includes at least video stream angle distortion information; that is, it primarily considers the angle distortion of the initial preset format video stream. Of course, in other embodiments, other distortion information can be added according to actual needs to ensure that the initially preset format video stream, after correction, can display the target map information on the head-up display device with high quality.

[0116] The acquisition of real-time distorted data transmitted from the embedded real-time operating system by the first chip can be achieved through the following steps. In one possible implementation, step S203 may include:

[0117] A data request is sent to the communication middleware, so that the communication middleware responds to the data request and sends real-time distortion data for the initial preset format video stream to the first chip; the real-time distortion data is transmitted to the communication middleware by the embedded real-time operating system;

[0118] Receive real-time distorted data sent by the communication middleware.

[0119] In this embodiment, the communication middleware is SOME / IP (Scalable service-oriented middleware over IP). The communication middleware transmits real-time distortion data with the embedded real-time operating system and the first chip via SOME / IP message format. The embedded real-time operating system transmits the real-time distortion data to the communication middleware. The first chip sends a data call request to the communication middleware. In response to the data call request, the communication middleware sends real-time distortion data for the initial preset format video stream to the first chip.

[0120] Understandably, when displaying media data information on a head-up display device, real-time distortion data can also be used to correct the initial media data stream.

[0121] S204, Based on real-time distortion data, correct the initial preset format video stream to obtain the target preset format video stream; render the target preset format video stream onto the head-up display device of the current vehicle so that the head-up display device displays the target map information.

[0122] As mentioned above, the vehicle parameters and driving status information of the current vehicle will affect the angle at which the initial preset format video is projected onto the head-up display device, thus causing distortion. Therefore, it is necessary to correct the initial preset format video stream based on real-time distortion data to obtain the target preset format video stream. Finally, the target preset format video stream is projected onto the head-up display device.

[0123] In one possible implementation, obtaining a target preset format video stream by correcting an initial preset format video stream based on real-time distortion data may include:

[0124] Determine the initial angle of the initial preset format video stream;

[0125] The desired correction angle for the initial preset format video stream to adapt to the current vehicle is determined based on real-time distortion data; the real-time distortion data is determined based on the initial angle of the initial preset format video stream, the vehicle parameters of the current vehicle, and driving status information.

[0126] Call the preset graphics operation function to determine the coordinates of the vertex to be corrected in the initial preset format video stream based on the desired correction angle;

[0127] The initial angle of the initial preset format video stream is corrected based on the coordinates of the vertex to be corrected, and the target preset format video stream is obtained.

[0128] Specifically, the initial angle of the initial preset format video stream is compared and calculated with the vehicle parameters and driving status information of the current vehicle to determine the expected correction angle of the initial preset format video stream. This ensures that the initial preset format video stream adapts to the angle of the head-up display device, allowing the driver to see clear target map information within the eye box. In this embodiment, OpenGL (Open Graphics Library) is used for correction. OpenGL is a cross-platform, cross-language graphics programming interface that can be used to implement 2D and 3D graphics rendering. Based on the expected correction angle, the coordinates of the vertices to be corrected in the initial preset format video stream are determined. These coordinates are then used to define and draw vertices. The corresponding preset graphics operation functions in OpenGL are called, and based on these vertices, the shape corresponding to the target preset format video stream is drawn according to the initial angle of the initial preset format video stream.

[0129] It is important to note that the above correction process is updated in real time. The correction process is performed based on the initial preset format video stream received in real time, as well as the vehicle parameters and driving status information of the current vehicle that are changing in real time. This can avoid the user experience being reduced due to the inconsistency between the angle of the target preset format video stream and the pitch angle of the head-up display device relative to the driver and the current turning angle of the vehicle.

[0130] The target preset format video stream is rendered onto the head-up display device of the current vehicle through SurfaceView. A video stream rendering thread is created. Based on the target preset format video stream, the corresponding video frames are drawn in the rendering thread. The video frames are transmitted to the image generation unit of the head-up display device and projected in real time onto the corresponding optical imaging components, such as the windshield, so that the head-up display device can display the target map information.

[0131] Understandably, when the first chip receives both the initial preset format video stream and the initial media data stream, it can also display the initial media data stream on the head-up display device. However, the vehicle's current parameters and driving status information not only affect the angle at which the initial preset format video is projected onto the head-up display device, causing distortion, but also distort the initial media data stream projected onto the head-up display device. Therefore, to avoid visual shifts and viewing angle distortions in the initial media data stream, it is necessary to correct it to obtain the target media data stream.

[0132] Since the target map information corresponding to the initial preset format video stream and the media data information corresponding to the initial media data stream are displayed together, the real-time distortion data corresponding to the two data streams is the same. The first chip can directly correct the initial media data stream to obtain the target media data stream based on the real-time distortion data obtained in step 203. The implementation method of obtaining the target media data stream by correcting the initial media data stream based on real-time distortion data is similar to the implementation method of obtaining the target preset format video stream by correcting the initial preset format video stream based on real-time distortion data. Both can be corrected using OpenGL, which will not be elaborated here.

[0133] For example, after obtaining the target media data stream through calibration, the first chip can render the target media data stream onto the head-up display (HUD) of the current vehicle, so that the HUD displays the media data information. Specifically, the first chip can render the target media data stream onto the HUD of the current vehicle through a SurfaceView, create a video stream rendering thread, draw the corresponding video frames in the rendering thread based on the target media data stream, transmit the video frames to the image generation unit of the HUD, and project them in real time onto the corresponding optical imaging component, such as the windshield, so that the HUD displays the media data information.

[0134] In one possible implementation, when simultaneously displaying target map information corresponding to a target preset format video stream and media data information corresponding to a target media data stream, the inter-chip communication method for head-up display applied to the first chip may further include:

[0135] The target preset format video stream and the target media data stream are fused to obtain a fused video stream; the fused video stream is rendered onto the head-up display device of the current vehicle so that the head-up display device can display the fused target map information and media data information.

[0136] For example, the fusion of a target preset format video stream and a target media data stream can be implemented using OpenGL. During fusion, the target preset format video stream is first decoded into original video frames, and the target media data stream is decoded into original media data. Then, timestamps are used to synchronize the video frames and media data on the timeline. If the video frame rate and audio sampling rate do not match, interpolation or resampling can be performed to synchronize the video frames and media data on the timeline. Next, the decoded video frames and media data are fused; for example, audio data can be embedded in the video frames, or the audio data can be matched with the video frames by timestamps. Finally, the fused data is re-encoded into a video stream of the target format to obtain a fused video stream. For example, in this embodiment, the target media data stream can be fused into the target preset format video stream to obtain a fused video stream of the target preset format. Furthermore, a SurfaceView can be used to render the fused video stream onto the head-up display (HUD) of the current vehicle, allowing the HUD to display the fused target map information and media data information.

[0137] Therefore, users can not only see target map information on the head-up display, but also historical driving trajectory information, safety tips, entertainment information and other media data information at the target time, which can improve driving safety and enhance user experience.

[0138] refer to Figure 3 The diagram shown is a flowchart illustrating another inter-chip communication method for head-up displays provided in this application embodiment. Figure 3 The chip-to-chip communication method for head-up display shown is applied to the second chip and includes:

[0139] S301, a communication request is sent to the first chip to establish a communication connection with the first chip; both the first chip and the second chip are located in the current vehicle.

[0140] S302, Obtain target map information from the initial map information; the target map information includes at least local road network information and the current vehicle speed information.

[0141] S303, an initial preset format video stream is obtained by rendering based on the target map information.

[0142] S304, the initial preset format video stream is sent to the first chip so that the first chip can obtain the real-time distortion data of the initial preset format video stream transmitted by the embedded real-time operating system, correct the initial preset format video stream based on the real-time distortion data to obtain the target preset format video stream, and render the target preset format video stream onto the head-up display device of the current vehicle so that the head-up display device can display the target map information.

[0143] In one possible implementation, rendering an initial preset format video stream based on target map information includes:

[0144] Create a video stream rendering thread, and execute the video stream rendering thread based on the target map information to obtain the video stream output bytes corresponding to the target map information;

[0145] The video stream output bytes are encapsulated based on a preset encapsulation format to obtain an initial preset format video stream.

[0146] In one possible implementation, the inter-chip communication method for a head-up display applied to a second chip provided in this application embodiment may further include:

[0147] S1. Obtain media data information; media data information includes any one or more of the following: historical driving trajectory information at the target time, safety alert information, and leisure and entertainment information.

[0148] S2. Render the initial media data stream based on media data information;

[0149] S3. The initial media data stream is sent to the first chip, so that the first chip corrects the initial media data stream based on real-time distortion data to obtain the target media data stream, and renders the target media data stream onto the head-up display device of the current vehicle, so that the head-up display device displays the media data information; or, the first chip performs fusion processing on the target preset format video stream and the target media data stream to obtain a fused video stream, and renders the fused video stream onto the head-up display device of the current vehicle, so that the head-up display device displays the fused target map information and media data information.

[0150] In one possible implementation, the inter-chip communication method for a head-up display applied to a second chip provided in this application embodiment may further include:

[0151] In response to user control commands, determine the content to be sent; wherein, the content to be sent includes an initial preset format video stream and / or an initial media data stream.

[0152] Understandably, the method based on the embodiments of this application can display target map information and / or media data information on a head-up display device. Users can set the content they want to display in the settings interface, so that the second chip knows the content to be sent. Based on this, not only can personalized customization be achieved, which is more user-friendly, but also interaction with the user can be increased to improve the user experience.

[0153] The inter-chip communication method for head-up display applied to the second chip is consistent with the inter-chip communication method for head-up display applied to the first chip, and will not be described again here.

[0154] Through the various embodiments of the present invention, not only can the second chip transmit the initial preset format video stream of the target map information to the first chip, where the target map information is a portion extracted from the navigation information provided by the in-vehicle navigation system, making it convenient and quick to access without needing to customize a separate navigation service, but the head-up display device can also display only the desired target map information without affecting the display effect of the main map of the in-vehicle navigation system, thus ensuring both user experience and driving safety; it can also enable the second chip to transmit the initial media data stream of media data information to the first chip, where the media data information includes any one or more of the following: historical driving trajectory information at the target time, safety warning information, and entertainment information, and the media data information is displayed on the head-up display. The display device can increase interest and further improve the user experience; and the two chips each have different functions, effectively preventing the second chip's in-vehicle entertainment system from interfering with the first chip's driving control system, ensuring both low latency and high safety; furthermore, while the first chip receives and parses the initial preset format video stream and / or initial media data stream, it also performs angle correction on the initial preset format video stream and / or initial media data stream based on the real-time distortion data transmitted by the embedded real-time operating system. This can prevent the angle of the target preset format video stream, or the target media data stream, or the angle of the merged video stream from being inconsistent with the tilt angle of the head-up display device relative to the driver and the current turning angle of the vehicle, thus avoiding a decrease in user experience.

[0155] Corresponding to the above-described inter-chip communication method for head-up displays, this application also provides an inter-chip communication device for head-up displays applied to a first chip. Since this inter-chip communication device for head-up displays corresponds to the inter-chip communication method for head-up displays applied to a first chip provided in the above embodiments, the implementation methods of the aforementioned inter-chip communication method for head-up displays applied to a first chip are also applicable to the inter-chip communication device for head-up displays provided in this embodiment, and will not be repeated in this application embodiment.

[0156] refer to Figure 4The diagram shows a schematic of an inter-chip communication device for a head-up display applied to a first chip, provided in an embodiment of this application. This device has the function of implementing the inter-chip communication method for a head-up display described in the above method embodiments. The function can be implemented in hardware or by hardware executing corresponding software. The device may include:

[0157] The communication module 410 is used to establish a communication connection with the second chip in response to a communication request from the second chip; both the first chip and the second chip are located in the current vehicle.

[0158] The first data receiving module 420 is used to receive and parse the initial preset format video stream sent by the second chip in real time. The initial preset format video stream is rendered by the second chip based on the target map information.

[0159] The second data receiving module 430 is used to acquire real-time distortion data of the video stream with an initial preset format transmitted by the embedded real-time operating system. The real-time distortion data includes at least video stream angle distortion information.

[0160] Display module 440 is used to correct the initial preset format video stream based on real-time distortion data to obtain a target preset format video stream; and to render the target preset format video stream onto the head-up display device of the current vehicle so that the head-up display device displays the target map information.

[0161] Optionally, the first data receiving module 420 includes:

[0162] The video stream receiving unit is used to receive an initial preset format video stream sent by the second chip in real time; the initial preset format video stream is a real-time message transmission protocol video stream; the initial preset format video stream carries video encoding data;

[0163] The video stream parsing unit is used to determine the video decoding data corresponding to the initial preset format video stream based on the video encoding data, and to parse the initial preset format video stream based on the video decoding data.

[0164] Optionally, the second data receiving module 430 includes:

[0165] The data retrieval request unit is used to send a data retrieval request to the communication middleware, so that the communication middleware responds to the data retrieval request and sends real-time distortion data for the initial preset format video stream to the first chip; the real-time distortion data is transmitted to the communication middleware by the embedded real-time operating system;

[0166] The data receiving unit is used to receive real-time distorted data sent by the communication middleware.

[0167] Optionally, the display module 440 includes:

[0168] The first calculation unit is used to determine the initial angle of the initial preset format video stream;

[0169] The second calculation unit is used to determine the desired correction angle of the initial preset format video stream adapted to the current vehicle based on real-time distortion data; the real-time distortion data is determined based on the initial angle of the initial preset format video stream, the vehicle parameters of the current vehicle, and driving status information.

[0170] The coordinate determination unit is used to call a preset graphics operation function to determine the coordinates of the vertex to be corrected in the initial preset format video stream based on the desired correction angle.

[0171] The correction unit is used to correct the initial angle of the initial preset format video stream based on the coordinates of the vertex to be corrected, so as to obtain the target preset format video stream.

[0172] Optionally, the first data receiving module 420 is further configured to: receive and parse the initial media data stream sent by the second chip in real time; the initial media data stream is rendered by the second chip based on media data information, and the media data information includes any one or more of the following: historical driving trajectory information at the target time, safety prompt information, and leisure and entertainment information;

[0173] The display module 440 is also used to: correct the initial media data stream based on real-time distortion data to obtain a target media data stream; and to render the target media data stream onto the head-up display device of the current vehicle so that the head-up display device displays media data information.

[0174] Optionally, the display module 440 is further configured to: perform fusion processing on the target preset format video stream and the target media data stream to obtain a fused video stream; and render the fused video stream onto the head-up display device of the current vehicle so that the head-up display device displays the fused target map information and media data information.

[0175] refer to Figure 5 This application also provides an inter-chip communication device for a head-up display applied to a second chip, corresponding to an inter-chip communication method for a head-up display applied to a second chip, including:

[0176] The communication module 510 is used to send a communication request to the first chip and establish a communication connection with the first chip; both the first chip and the second chip are located in the current vehicle.

[0177] The map information acquisition module 520 is used to acquire target map information from the initial map information; the target map information includes at least local road network information and the current vehicle speed information;

[0178] Rendering module 530 is used to render an initial preset format video stream based on the target map information;

[0179] The data transmission module 540 is used to send an initial preset format video stream to the first chip, so that the first chip can obtain real-time distortion data of the initial preset format video stream transmitted by the embedded real-time operating system, correct the initial preset format video stream based on the real-time distortion data to obtain a target preset format video stream, and render the target preset format video stream onto the head-up display device of the current vehicle, so that the head-up display device can display target map information.

[0180] Optionally, the rendering module 530 includes:

[0181] The thread creation unit is used to create a video stream rendering thread, which executes the video stream rendering thread based on the target map information to obtain the video stream output bytes corresponding to the target map information;

[0182] The encapsulation unit is used to encapsulate the output bytes of the video stream based on a preset encapsulation format to obtain an initial preset format video stream.

[0183] Optionally, the map information acquisition module 520 is also used to: acquire media data information; the media data information includes any one or more of the following: historical driving trajectory information at the target time, safety reminder information, and leisure and entertainment information;

[0184] Rendering module 530 is also used to: render an initial media data stream based on media data information;

[0185] The data transmission module 540 is further configured to: send an initial media data stream to a first chip, so that the first chip corrects the initial media data stream based on real-time distortion data to obtain a target media data stream, and render the target media data stream onto the head-up display device of the current vehicle, so that the head-up display device displays media data information; or, enable the first chip to perform fusion processing on the target preset format video stream and the target media data stream to obtain a fused video stream, and render the fused video stream onto the head-up display device of the current vehicle, so that the head-up display device displays the fused target map information and media data information.

[0186] Optionally, the communication module 510 is further configured to: determine the content to be sent in response to a user's control command; wherein the content to be sent includes an initial preset format video stream and / or an initial media data stream.

[0187] It should be noted that the apparatus provided in the above embodiments is only illustrated by the division of the above functional modules when implementing its functions. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.

[0188] This application also provides an inter-chip communication system for head-up displays, including a first chip, a second chip, an embedded real-time operating system, and a head-up display device, for implementing the inter-chip communication method for head-up displays as described above.

[0189] This application also provides an electronic device, including a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the processor loads and executes the at least one instruction or at least one program to implement the steps of the chip-to-chip communication method for head-up display as described above.

[0190] Memory is used to store software programs and modules. The processor executes various functional applications by running these stored software programs and modules. Memory can primarily consist of a program storage area and a data storage area. The program storage area stores the operating system, application programs required for functionality, etc.; the data storage area stores data created based on device usage, etc. Furthermore, memory can include high-speed random access memory (RAM) and non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, memory can also include a memory controller to provide the processor with access to the memory. The processor can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor.

[0191] The methods and embodiments provided in this application can be executed on a computer terminal, server, or similar computing device. Taking running on a terminal as an example, refer to... Figure 6 The diagram shown is a hardware structure schematic of a terminal that runs an inter-chip communication method for head-up display, according to an embodiment of this application.

[0192] Specifically, the terminal may include an RF (Radio Frequency) circuit 610, a memory 620 including one or more computer-readable storage media, an input unit 630, a display unit 640, a sensor 650, an audio circuit 660, a WiFi (Wireless Fidelity) module 660, a processor 680 including one or more processing cores, and a power supply 690, among other components. Those skilled in the art will understand that... Figure 6 The terminal structure shown does not constitute a limitation on the terminal and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein:

[0193] RF circuit 610 can be used for receiving and transmitting signals during information transmission or calls. Specifically, it receives downlink information from the base station and hands it over to one or more processors 680 for processing; additionally, it transmits uplink data to the base station. Typically, RF circuit 610 includes, but is not limited to, an antenna, at least one amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier), a duplexer, etc. Furthermore, RF circuit 610 can also communicate wirelessly with networks and other terminals. Wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), email, SMS (Short Messaging Service), etc.

[0194] The memory 620 can be used to store software programs and modules. The processor 680 executes various functional applications and data processing by running the software programs and modules stored in the memory 620. The memory 620 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for functions, etc.; the data storage area may store data created according to the use of the terminal, etc. In addition, the memory 620 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 620 may also include a memory controller to provide access to the memory 620 for the processor 680 and the input unit 630.

[0195] The input unit 630 can be used to receive input digital or character information, and to generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control. Specifically, the input unit 630 may include a touch-sensitive surface 631 and other input devices 632. The touch-sensitive surface 631, also known as a touch display screen or touchpad, can collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near the touch-sensitive surface 631), and drive the corresponding connection device according to a pre-set program. Optionally, the touch-sensitive surface 631 may include two parts: a touch detection device and a touch controller. The touch detection device detects the user's touch position and the signal generated by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, sends it to the processor 680, and can receive and execute commands sent by the processor 680. In addition, the touch-sensitive surface 631 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch-sensitive surface 631, the input unit 630 may also include other input devices 632. Specifically, other input devices 632 may include, but are not limited to, one or more of the following: physical keyboard, function keys (such as volume control buttons, power buttons, etc.), trackball, mouse, joystick, etc.

[0196] The display unit 640 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces of the terminal. These graphical user interfaces can be composed of graphics, text, icons, video, and any combination thereof. The display unit 640 may include a display panel 641, which may optionally be configured as an LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), or similar display. Furthermore, a touch-sensitive surface 631 may cover the display panel 641. When the touch-sensitive surface 631 detects a touch operation on or near it, it transmits the information to the processor 680 to determine the type of touch event. Subsequently, the processor 680 provides corresponding visual output on the display panel 641 according to the type of touch event. The touch-sensitive surface 631 and the display panel 641 can be two independent components to implement input and output functions. However, in some embodiments, the touch-sensitive surface 631 and the display panel 641 can be integrated to achieve both input and output functions.

[0197] The terminal may also include at least one sensor 650, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor. The ambient light sensor can adjust the brightness of the display panel 641 according to the ambient light level, and the proximity sensor can turn off the display panel 641 and / or the backlight when the terminal is moved to the ear. As a type of motion sensor, a gravity acceleration sensor can detect the magnitude of acceleration in various directions (generally three axes). When stationary, it can detect the magnitude and direction of gravity and can be used for applications that identify the terminal's posture (such as landscape / portrait switching, related games, magnetometer posture calibration), vibration recognition-related functions (such as pedometers, taps), etc. Other sensors that the terminal may be equipped with, such as gyroscopes, barometers, hygrometers, thermometers, and infrared sensors, will not be described in detail here.

[0198] Audio circuitry 660, speaker 661, and microphone 662 provide an audio interface between the user and the terminal. Audio circuitry 660 converts received audio data into electrical signals, which are then transmitted to speaker 661, where they are converted into sound signals for output. Conversely, microphone 662 converts collected sound signals into electrical signals, which are received by audio circuitry 660, converted back into audio data, and then processed by processor 680 before being transmitted via RF circuitry 610 to, for example, another terminal, or output to memory 620 for further processing. Audio circuitry 660 may also include an earphone jack to facilitate communication between peripheral headphones and the terminal.

[0199] WiFi is a short-range wireless transmission technology. Terminals using the WiFi module 670 can help users send and receive emails, browse web pages, and access streaming media, providing users with wireless broadband internet access. Although Figure 6 WiFi module 670 is shown, but it is understood that it is not a necessary component of the terminal and can be omitted as needed without changing the essence of the invention.

[0200] The processor 680 is the control center of the terminal, connecting various parts of the terminal through various interfaces and lines. It performs various functions and processes data by running or executing software programs and / or modules stored in the memory 620, and by calling data stored in the memory 620, thereby providing overall monitoring of the terminal. Optionally, the processor 680 may include one or more processing cores; preferably, the processor 680 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may also not be integrated into the processor 680.

[0201] The terminal also includes a power supply 690 (such as a battery) to power various components. Preferably, the power supply can be logically connected to the processor 680 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 690 may also include one or more DC or AC power supplies, recharging systems, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0202] Although not shown, the terminal may also include a camera, Bluetooth module, etc., which will not be described in detail here. Specifically, in this embodiment, the terminal also includes a memory and one or more programs, wherein one or more programs are stored in the memory and configured to be executed by one or more processors.

[0203] This application also provides a computer-readable storage medium storing at least one instruction or at least one program segment. This instruction or program segment is loaded and executed by a processor to implement the steps of the chip-to-chip communication method for head-up displays described above. In this application embodiment, the computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable storage medium can include any entity or device capable of carrying computer program code, a recording medium, a USB flash drive, a portable hard drive, a magnetic disk, an optical disk, a computer memory, a read-only memory, a random access memory, an electrical carrier signal, a telecommunication signal, and a software distribution medium, etc.

[0204] This application also provides a computer storage medium storing at least one instruction or at least one program segment, which is loaded and executed by a processor to implement the above-described method. In this application embodiment, the computer program includes computer program code, which can be in the form of source code, object code, executable file, or some intermediate form. Computer-readable storage media can include: any entity or device capable of carrying computer program code, recording media, USB flash drive, portable hard drive, magnetic disk, optical disk, computer memory, read-only memory, random access memory, electrical carrier signals, telecommunication signals, and software distribution media, etc.

[0205] This application also provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the inter-chip communication method for head-up displays provided in the various optional implementations described above.

[0206] The above are merely preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A chip-to-chip communication method for head-up displays, characterized in that, Applied to a first chip, the method includes: In response to a communication request from the second chip, a communication connection is established with the second chip; both the first chip and the second chip are located in the current vehicle. The system receives and parses the initial preset format video stream sent by the second chip in real time. The initial preset format video stream is rendered by the second chip based on the target map information. Acquire real-time distortion data of the video stream in the initial preset format transmitted by the embedded real-time operating system, wherein the real-time distortion data includes at least video stream angle distortion information; The initial preset format video stream is corrected based on the real-time distortion data to obtain a target preset format video stream; the target preset format video stream is rendered onto the head-up display device of the current vehicle so that the head-up display device displays the target map information; The step of correcting the initial preset format video stream based on the real-time distortion data to obtain the target preset format video stream includes: Determine the initial angle of the initial preset format video stream; The desired correction angle for adapting the initial preset format video stream to the current vehicle is determined based on the real-time distortion data; the real-time distortion data is determined based on the initial angle of the initial preset format video stream, the vehicle parameters of the current vehicle, and driving status information. Call the preset graphics operation function to determine the coordinates of the vertex to be corrected in the initial preset format video stream based on the desired correction angle; The initial angle of the initial preset format video stream is corrected based on the coordinates of the vertex to be corrected, thereby obtaining the target preset format video stream.

2. The method according to claim 1, characterized in that, The real-time reception and parsing of the initial preset format video stream sent by the second chip includes: The system receives an initial preset format video stream sent by the second chip in real time; the initial preset format video stream is a real-time message transmission protocol video stream; the initial preset format video stream carries video encoding data. Based on the video encoding data, determine the video decoding data corresponding to the initial preset format video stream, and parse the initial preset format video stream based on the video decoding data.

3. The method according to claim 1, characterized in that, The acquisition of real-time distortion data for the initial preset format video stream transmitted by the embedded real-time operating system includes: A data request is sent to the communication middleware, so that the communication middleware responds to the data request by sending real-time distortion data for the initial preset format video stream to the first chip; the real-time distortion data is transmitted from the embedded real-time operating system to the communication middleware. Receive the real-time distortion data sent by the communication middleware.

4. The method according to any one of claims 1-3, characterized in that, The method further includes: The system receives and parses the initial media data stream sent by the second chip in real time. The initial media data stream is rendered by the second chip based on media data information, which includes any one or more of the following: historical driving trajectory information at the target time, safety prompt information, and leisure and entertainment information. The target media data stream is obtained by correcting the initial media data stream based on the real-time distortion data. The target media data stream is rendered onto the head-up display device of the current vehicle so that the head-up display device displays the media data information.

5. The method according to claim 4, characterized in that, The method further includes: The target preset format video stream and the target media data stream are fused to obtain a fused video stream; The fused video stream is rendered onto the head-up display (HUD) of the current vehicle, so that the HUD displays the fused target map information and media data information.

6. A chip-to-chip communication method for head-up displays, characterized in that, Applied to a second chip, the method includes: A communication request is sent to the first chip to establish a communication connection with the first chip; both the first chip and the second chip are located in the current vehicle. Obtain target map information from the initial map information; the target map information includes at least local road network information and the current vehicle speed information; An initial preset format video stream is rendered based on the target map information; The initial preset format video stream is sent to the first chip, so that the first chip obtains real-time distortion data for the initial preset format video stream transmitted by the embedded real-time operating system, corrects the initial preset format video stream based on the real-time distortion data to obtain a target preset format video stream, and renders the target preset format video stream onto the head-up display device of the current vehicle, so that the head-up display device displays the target map information; The step of correcting the initial preset format video stream based on the real-time distortion data to obtain the target preset format video stream includes: Determine the initial angle of the initial preset format video stream; The desired correction angle for adapting the initial preset format video stream to the current vehicle is determined based on the real-time distortion data; the real-time distortion data is determined based on the initial angle of the initial preset format video stream, the vehicle parameters of the current vehicle, and driving status information. Call the preset graphics operation function to determine the coordinates of the vertex to be corrected in the initial preset format video stream based on the desired correction angle; The initial angle of the initial preset format video stream is corrected based on the coordinates of the vertex to be corrected, thereby obtaining the target preset format video stream.

7. The method according to claim 6, characterized in that, The process of rendering an initial preset format video stream based on the target map information includes: Create a video stream rendering thread, and execute the video stream rendering thread based on the target map information to obtain the video stream output bytes corresponding to the target map information; The video stream output bytes are encapsulated based on a preset encapsulation format to obtain the initial preset format video stream.

8. The method according to claim 6 or 7, characterized in that, The method further includes: Acquire media data information; the media data information includes any one or more of the following: historical driving trajectory information at the target time, safety alert information, and leisure and entertainment information. An initial media data stream is rendered based on the aforementioned media data information; The initial media data stream is sent to the first chip, so that the first chip corrects the initial media data stream based on the real-time distortion data to obtain the target media data stream, and renders the target media data stream onto the head-up display device of the current vehicle, so that the head-up display device displays the media data information; or, the first chip performs fusion processing on the target preset format video stream and the target media data stream to obtain a fused video stream, and renders the fused video stream onto the head-up display device of the current vehicle, so that the head-up display device displays the fused target map information and media data information.

9. The method according to claim 8, characterized in that, The method further includes: In response to a user's control command, the content to be sent is determined; wherein the content to be sent includes the initial preset format video stream and / or the initial media data stream.

10. A chip-to-chip communication device for a head-up display, characterized in that, Applied to a first chip, the device includes: A communication module is used to establish a communication connection with the second chip in response to a communication request from the second chip; both the first chip and the second chip are located in the current vehicle. The first data receiving module is used to receive and parse the initial preset format video stream sent by the second chip in real time. The initial preset format video stream is rendered by the second chip based on the target map information. The second data receiving module is used to acquire real-time distortion data of the video stream in the initial preset format transmitted by the embedded real-time operating system, wherein the real-time distortion data includes at least video stream angle distortion information. The display module is used to correct the initial preset format video stream based on the real-time distortion data to obtain a target preset format video stream; and to render the target preset format video stream onto the head-up display device of the current vehicle so that the head-up display device displays the target map information. The display module is specifically used for: Determine the initial angle of the initial preset format video stream; The desired correction angle for adapting the initial preset format video stream to the current vehicle is determined based on the real-time distortion data; the real-time distortion data is determined based on the initial angle of the initial preset format video stream, the vehicle parameters of the current vehicle, and driving status information. Call the preset graphics operation function to determine the coordinates of the vertex to be corrected in the initial preset format video stream based on the desired correction angle; The initial angle of the initial preset format video stream is corrected based on the coordinates of the vertex to be corrected, thereby obtaining the target preset format video stream.

11. A chip-to-chip communication device for a head-up display, characterized in that, Applied to a second chip, the device includes: A communication module is used to send a communication request to the first chip and establish a communication connection with the first chip; both the first chip and the second chip are located in the current vehicle. The map information acquisition module is used to acquire target map information from the initial map information; the target map information includes at least local road network information and the current vehicle speed information; The rendering module is used to render an initial preset format video stream based on the target map information; The data transmission module is used to send the initial preset format video stream to the first chip, so that the first chip can obtain real-time distortion data for the initial preset format video stream transmitted by the embedded real-time operating system, correct the initial preset format video stream based on the real-time distortion data to obtain a target preset format video stream, and render the target preset format video stream to the head-up display device of the current vehicle, so that the head-up display device can display the target map information; The data sending module is specifically used for: Determine the initial angle of the initial preset format video stream; The desired correction angle for adapting the initial preset format video stream to the current vehicle is determined based on the real-time distortion data; the real-time distortion data is determined based on the initial angle of the initial preset format video stream, the vehicle parameters of the current vehicle, and driving status information. Call the preset graphics operation function to determine the coordinates of the vertex to be corrected in the initial preset format video stream based on the desired correction angle; The initial angle of the initial preset format video stream is corrected based on the coordinates of the vertex to be corrected, thereby obtaining the target preset format video stream.

12. A chip-to-chip communication system for head-up displays, characterized in that, It includes a first chip, a second chip, an embedded real-time operating system, and a head-up display device, for implementing the inter-chip communication method for head-up display as described in any one of claims 1 to 9.

13. An electronic device, characterized in that, It includes a processor and a memory, wherein the memory stores at least one instruction or at least one program, the at least one instruction or the at least one program being loaded and executed by the processor to implement the inter-chip communication method for head-up display as described in any one of claims 1 to 9.

14. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores at least one instruction or at least one program segment, which is loaded and executed by a processor to implement the inter-chip communication method for head-up display as described in any one of claims 1 to 9.

Images