Operation method of vehicle display system and vehicle display system

Abstract

This application discloses an operation method for an in-vehicle display system and an in-vehicle display system itself. The operation method includes: the camera hardware interface of the in-vehicle display system receiving video frames from a camera; the camera hardware interface writing the video frames into a hardware buffer and sending a first message to the display hardware unit only through the driver layer, thereby shortening the transmission path of the first message to notify the display hardware unit to read / receive the video frames. The driver layer includes a camera driver and a display driver. This method enables low-latency display of video for driving video assistance functions such as reversing, improving the real-time performance of the in-vehicle display system. This, in turn, enhances driving safety and improves product competitiveness.

Description

Technical Field

[0001] This application relates to the field of vehicle systems, and in particular to an operating method for a vehicle display system and a vehicle display system. Background Technology

[0002] Modern in-vehicle display systems have become standard equipment in people's lives. With the development of the automotive industry in recent years and the popularization of in-vehicle display systems, reversing cameras or parking assistance systems are widely used in the field of reversing or driving safety assistance for various large, medium and small vehicles. Reversing cameras allow users to see the situation behind the vehicle more intuitively when reversing, avoiding various unexpected situations that may occur due to a lack of awareness of what's behind the vehicle.

[0003] The video display latency (the time from when video data enters the system to when it is displayed on the vehicle's screen) of in-vehicle systems, such as the Rearview Camera (RVC) and Ambient View Monitor (AVM), is crucial to driving safety. Therefore, reducing the transmission latency of rearview images to assist in-vehicle display systems has become an urgent problem to be solved. Summary of the Invention

[0004] This application provides an operation method for an in-vehicle display system and an in-vehicle display system itself, enabling low-latency display of video for driving assistance functions such as reversing, thereby improving the real-time performance of the in-vehicle display system. This, in turn, enhances driving safety and strengthens product competitiveness.

[0005] To address the aforementioned technical problems, this application provides an operation method for an in-vehicle display system. The camera hardware interface of the in-vehicle display system receives video frames from a camera. The camera hardware interface writes the video frames into a hardware buffer and sends a first message to the display hardware unit only through the driver layer, thereby shortening the transmission path of the first message to notify the display hardware unit to read / receive the video frames. The driver layer includes a camera driver and a display driver.

[0006] To address the aforementioned technical problems, this application provides an operation method for an in-vehicle display system. A camera hardware interface receives video frames from a camera; the camera hardware interface sends the video frames to an intermediate layer via a camera driver; the intermediate layer processes the video frames and sends a first message to a display hardware unit via a display driver to shorten the transmission path of the first message, thereby notifying the display hardware unit to read / receive the processed video frames; the display hardware unit reads / receives the processed video frames and sends them to a display for display; wherein, when the display hardware unit reads / receives the first frame of the processed video frame, the timing of the first message transmission is configured to enable the display hardware unit to completely read / receive the first frame of the processed video frame.

[0007] To address the aforementioned technical problems, this application provides an in-vehicle display system, which includes a camera, a chip, and a display. The chip is used to execute the method described in any embodiment, wherein the camera is connected to the chip, and the chip is connected to the display.

[0008] To address the aforementioned technical problems, this application provides a chip for an in-vehicle display system. The chip includes a camera hardware interface, an intermediate layer, a driver layer, a display hardware unit, and a hardware cache. The chip is used to execute the methods described in any embodiment. The driver layer includes a camera driver and a display driver. The camera hardware interface is connected to the camera, the camera driver, and the hardware cache. The intermediate layer is connected to the camera driver and the display driver. The camera driver is connected to the camera hardware interface, the display driver, and the intermediate layer. The display driver is connected to the camera driver, the intermediate layer, and the display hardware unit. The display hardware unit is connected to the hardware cache, the hardware driver, and the display. The camera hardware interface receives video frames from the camera. The camera hardware interface writes the video frames into the hardware cache, and only through the driver layer. A first message is sent to the display hardware unit to shorten the transmission path of the first message notifying the display hardware unit to read / receive the video frame; or, the camera hardware interface receives a video frame from the camera; the camera hardware interface sends the video frame to the intermediate layer through the camera driver; the intermediate layer processes the video frame and sends the first message to the display hardware unit through the display driver to shorten the transmission path of the first message to notify the display hardware unit to read / receive the processed video frame; the display hardware unit reads / receives the processed video frame and sends the processed video frame to the display for display; wherein, when the display hardware unit reads / receives the first frame of the processed video frame, the time point at which the first message is sent is configured to enable the display hardware unit to completely read / receive the first frame of the processed video frame.

[0009] Compared with existing technologies, the beneficial effects of this application are: it discloses an operation method for an in-vehicle display system and an in-vehicle display system. By enabling the camera hardware interface to notify the display hardware unit in advance or shortening the notification path between the camera hardware interface and the display hardware unit, the time required for the camera hardware interface to notify the display hardware unit to prepare for reading video data is saved. This enables low-latency display of video for driving video assistance functions such as reversing, improving the real-time performance of the in-vehicle display system. This, in turn, improves driving safety and enhances product competitiveness.

[0010] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this application. Attached Figure Description

[0011] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0012] Figure 1 This is a first flowchart illustrating the operation method of the vehicle-mounted display system of this application.

[0013] Figure 2 This is the first timing diagram of the display driver sending the first message to the display hardware unit.

[0014] Figure 3 This is the second timing diagram of the display driver sending the first message to the display hardware unit.

[0015] Figure 4 This is a second flowchart illustrating the operation method of the vehicle-mounted display system of this application.

[0016] Figure 5 This is a third flowchart illustrating the operation method of the vehicle-mounted display system of this application.

[0017] Figure 6 This is the fourth flowchart illustrating the operation method of the vehicle-mounted display system of this application.

[0018] Figure 7 This is a timing diagram showing how the intermediate layer of this application sends the first message to the display hardware unit.

[0019] Figure 8 This is a schematic diagram of the structure of an embodiment of the vehicle display system of this application. Detailed Implementation

[0020] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of the embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0021] The following detailed description of some embodiments of this application is provided in conjunction with the accompanying drawings. Unless otherwise specified, the following embodiments and features can be combined with each other.

[0022] The terms "first," "second," etc., used in this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.

[0023] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0024] Nowadays, many car models from major brands come equipped with in-vehicle RVC (rearview camera) and AVM (around-the-view monitor) systems. Car owners can also add dashcams or in-vehicle electronic control systems with RVC and AVM functions according to their needs. Therefore, the video display latency (the time from when a video data frame enters the system to when it is displayed on the screen) of in-vehicle systems with RVC and AVM functions is crucial to driving safety. The latency of existing RVC and AVM systems based on Android and Linux systems exceeds 100ms or even longer, which can have a significant impact on driving safety.

[0025] Through observation, reflection, and testing, the inventors of this application have proposed a method to shorten the video display latency of functions such as RVC and AVM. This method significantly reduces video display latency by shortening the transmission path of video data and control / notification messages and by employing advance notification and simultaneous write and read operations. The embodiments provided in this application ensure a latency of less than 80ms, improving the real-time performance of in-vehicle system video display and thus increasing the safety factor during the use of RVC & AVM systems. This not only adds an extra layer of safety for vehicle users but also enhances the competitiveness of the brand's products.

[0026] Figure 1 This is a first flowchart illustrating the operation method of the vehicle-mounted display system of this application. It should be noted that if substantially the same result is achieved, this embodiment does not necessarily reflect that result. Figure 1 The illustrated process sequence is limited. For example... Figure 1 As shown, this embodiment includes:

[0027] S11: The camera hardware interface of the vehicle display system receives video frames from the camera.

[0028] The camera is a camera or image sensor that can continuously acquire video frames. The video frames can be in RGB, HSV, SILTP, etc., and the video frames are digitized and converted into YUV format. There are no restrictions on this.

[0029] The camera interface is a hardware interface based on the Mobile Industry Processor Interface Camera Serial Interface (MIPI CSI).

[0030] S12: The camera hardware interface writes video frames to the hardware buffer.

[0031] The hardware cache is the shared memory between the camera hardware interface and the display hardware unit.

[0032] S13: The camera hardware interface sends the first message to the camera driver.

[0033] The camera hardware interface sends a first message to the camera driver before finishing writing video frames to the hardware buffer. For example, the camera hardware interface sends a first message to the camera driver 16ms before the video is finished writing to the hardware buffer.

[0034] The timing of this completion can be determined according to specific circumstances, but it must be ensured that when the display hardware unit reads / receives video frames, the timing of the first message being sent is configured to enable the display hardware unit to continuously read / receive the video frames. The camera hardware interface sends the first message to the display hardware unit so that the display hardware unit is ready to read the video frames written by the camera hardware interface in the hardware buffer.

[0035] The first message is used to notify the display hardware unit to prepare to read the video frame written by the camera hardware interface in the hardware cache and the storage address of the video frame written by the camera hardware interface in the hardware cache. Finally, the display hardware unit reads the video frame according to the first message.

[0036] In this embodiment, in order to send the first message to the display hardware unit, the camera hardware interface first sends the first message to the camera driver.

[0037] S14: The camera driver sends the first message to the display driver.

[0038] The camera driver sends the first message to the display driver, where the camera driver belongs to the driver layer.

[0039] S15: The display driver sends the first message to the display hardware unit.

[0040] The display driver notifies the display hardware unit of the storage address of the video frame it needs to read and prepares the display hardware unit to read the video frame. The display driver belongs to the driver layer.

[0041] S16: The display hardware unit is ready to read video frames.

[0042] The display hardware unit enters a state ready to read the video frame based on the storage address of the video frame in the first message.

[0043] S17: The display hardware unit reads video frames from the hardware buffer.

[0044] The display hardware unit reads the video frame based on the storage address of the video frame in the first message.

[0045] S18: The display hardware unit sends video frames to the display.

[0046] The display hardware unit sends the read video frames to the display.

[0047] S19: The monitor displays video frames.

[0048] The monitor receives and displays video frames.

[0049] Figure 2 This is the first timing diagram of the display driver sending the first message to the display hardware unit in this application. For example... Figure 2 As shown, this embodiment is as follows:

[0050] S21: The camera hardware interface begins writing video frames to the hardware buffer.

[0051] After receiving a video frame from the camera, the camera hardware interface writes the video frame into the hardware buffer.

[0052] S22: The camera hardware interface sends the first message to the display hardware unit.

[0053] In this embodiment, after a preset time period following the start of the camera hardware interface writing video frames into the hardware buffer, the camera hardware interface sends a first message to the display hardware unit through the display driver.

[0054] The length of the preset time period is such that when the display hardware unit receives the first message and begins reading, the camera hardware interface has already finished writing the video frame into the hardware buffer.

[0055] For example, 15ms before the camera hardware interface finishes writing the video frame to the hardware buffer, the camera hardware interface sends the first message to the display hardware unit. After a period of time, the display hardware unit receives the first message and begins to read the video frame. At this time, the camera hardware interface has finished writing the video frame to the hardware buffer.

[0056] S23: The camera hardware interface ends and the video is written to the hardware buffer.

[0057] The camera hardware interface writes a video frame completely into the hardware buffer so that the video frame can be directly read by the display hardware unit.

[0058] S24: The display hardware unit has received the first message.

[0059] In this embodiment, after the camera hardware interface finishes writing video frames into the hardware buffer, the display hardware unit receives the first message, at which point the camera hardware interface has finished writing video frames into the hardware buffer.

[0060] S25: The display hardware unit begins reading video from the hardware cache.

[0061] The display hardware unit reads the video frame written by the camera hardware interface from the same address.

[0062] Figure 3 This is the second timing diagram of the display driver sending the first message to the display hardware unit in this application. For example... Figure 3 As shown, this embodiment is as follows:

[0063] S31: The camera hardware interface begins writing video frames to the hardware buffer.

[0064] After receiving a video frame from the camera, the camera hardware interface writes the video frame into the hardware buffer.

[0065] S32: The camera hardware interface sends the first message to the display hardware unit.

[0066] In this embodiment, after a preset time period following the start of the camera hardware interface writing video frames into the hardware buffer, the camera hardware interface sends a first message to the display hardware unit through the display driver.

[0067] The length of the preset time period is sufficient to ensure that the amount of video frame data written by the camera hardware interface to the hardware buffer within the preset time period is sufficient for the display hardware unit to begin continuously reading video frames.

[0068] For example, 15ms before the camera hardware interface finishes writing the video frame to the hardware buffer, the camera hardware interface sends a first message to the display hardware unit. After a period of time, the display hardware unit receives the first message and begins to read the video frame. The process of reading the video frame continues until the display hardware unit has completely read the video frame written by the camera hardware interface.

[0069] S33: The display hardware unit has received the first message.

[0070] In this embodiment, the display hardware unit receives a first message before the camera hardware interface finishes writing the video frame to the hardware buffer. For example, the first message is received 4ms before the camera hardware interface finishes writing the video frame to the hardware buffer.

[0071] S34: The display hardware unit begins reading video from the hardware cache.

[0072] The display hardware unit reads the video frame written by the camera hardware interface from the same address.

[0073] Meanwhile, the camera hardware interface has not yet finished writing the video frame to the hardware buffer, which will cause a "write-while-read" situation. However, since the camera hardware interface has already written most of the video frame to the hardware buffer, and the reading speed is less than the writing speed, there will be no data interruption during the reading of the video frame.

[0074] Figure 4 This is a second flowchart illustrating the operation method of the vehicle-mounted display system of this application. For example... Figure 4 As shown, this embodiment is as follows:

[0075] S41: The camera hardware interface of the vehicle display system receives video frames from the camera.

[0076] For details, please refer to the description of step S11, which will not be repeated here.

[0077] S42: The camera hardware interface transmits video frames to the hardware buffer.

[0078] The hardware cache is the shared memory between the camera hardware interface and the display hardware unit.

[0079] Before the camera hardware interface finishes writing the video frame to the hardware buffer, for example, 16ms before the video is written to the hardware buffer (the timing of this completion can be determined according to the specific situation and is not limited here), the camera hardware interface sends a first message to the display hardware unit so that the display hardware unit is ready to read the video frame written by the camera hardware interface from the hardware buffer.

[0080] S43: The intermediate layer sends the second message to the display driver.

[0081] The intermediate layer sends a second message to the display driver.

[0082] The second message is used to notify the display hardware unit that it has received the preprocessed first trajectory line.

[0083] S44: The display driver receives the second message and sends it to the display hardware unit.

[0084] The display driver receives the second message from the intermediate layer and sends it to the display hardware unit, notifying the display hardware unit to prepare to receive the preprocessed first trajectory line.

[0085] S45: The intermediate layer sends the pre-processed first trajectory line to the display driver.

[0086] In this embodiment, before the camera hardware interface finishes writing the video frame into the hardware buffer, the intermediate layer sends the first trajectory line to the display driver.

[0087] S46: The display driver sends the pre-processed first trajectory line to the display hardware unit.

[0088] S43 and S45 are performed synchronously without any order, and S44 and S46 are performed similarly. The display hardware unit responds to the second message in S44 and receives the preprocessed first trajectory line sent by the display driver in S46.

[0089] In this embodiment, before the camera hardware interface finishes writing the video frame into the hardware buffer, the display driver sends the first trajectory line to the display hardware unit.

[0090] In this embodiment, the display hardware unit receives the first trajectory line before the camera hardware interface finishes writing the video frame into the hardware buffer.

[0091] S47: Display hardware unit reads video frames.

[0092] In response to the first message, the display hardware unit reads video frames from the hardware buffer. For detailed procedures, please refer to [link / reference]. Figure 2 , Figure 3 This will not be elaborated upon here.

[0093] S48: The display hardware unit merges the preprocessed first trajectory line with the video frame into a first merged frame.

[0094] The first trajectory line is displayed at a fixed position in the video frame. For example, it can be an auxiliary line displayed in a reversing radar, and there is no limitation here.

[0095] In this embodiment, the first trajectory line and the video frame are merged in the display hardware unit to form a first merged frame. The merging can be achieved by hardware synthesis of the first trajectory line and the video frame in the display hardware unit, or by other methods, which are not limited here. For example, the first merged frame C = α*A + (1-α)*B can be obtained through hardware, where C is the first merged frame, A is the video frame, B is the first trajectory line, and α is a constant.

[0096] S49: The display hardware unit sends the first merged frame to the display.

[0097] The display hardware unit sends the first merged frame to the display.

[0098] S410: The display shows the first merged frame.

[0099] The monitor receives and displays the first merged frame.

[0100] Figure 5 This is a schematic diagram of the third step in the operation method of the vehicle-mounted display system of this application. For example... Figure 5 As shown, this embodiment is as follows:

[0101] S51: The camera hardware interface of the vehicle display system receives video frames from the camera.

[0102] For details, please refer to step S11, which will not be repeated here.

[0103] S52: The camera hardware interface merges the video frame with the second trajectory line into a second merged frame.

[0104] The second trajectory line is displayed at a fixed position in the video frame. For example, it can be an auxiliary line displayed in a reversing radar, and there are no restrictions on this.

[0105] In this embodiment, a merging function is added to the camera hardware interface. This merging function can merge the second trajectory line and the video frame in hardware form, or in other ways, which are not limited here.

[0106] S53: The camera hardware interface writes the second merged frame to the hardware buffer.

[0107] The hardware cache is the shared memory between the camera hardware interface and the display hardware unit.

[0108] S54: The camera hardware interface sends the first message to the camera driver.

[0109] The first message is used to notify the display hardware unit to prepare to read the video frame written by the camera hardware interface in the hardware cache and the storage address of the video frame written by the camera hardware interface in the hardware cache, so that the display driver can notify the display hardware unit to read the video frame.

[0110] S55: The camera driver sends the first message to the display driver.

[0111] The camera driver sends the first message to the display driver.

[0112] S56: The display driver sends the first message to the display hardware unit.

[0113] The display driver sends the first message to the display hardware unit.

[0114] S57: The display hardware unit is ready to read the second merged frame.

[0115] The display driver notifies the display hardware unit of the storage address of the second merged frame that it needs to read and prepares the display hardware unit to read the second merged frame.

[0116] S58: The display hardware unit reads the second merged frame from the hardware cache.

[0117] The second merged frame is a merged frame of the video frame and the second trajectory line.

[0118] S59: The display hardware unit sends the second merged frame to the display.

[0119] The display hardware unit sends the second merged frame to the display.

[0120] S510: The display shows the second merged frame.

[0121] The monitor receives and displays the second merged frame.

[0122] Figure 6 This is the fourth flowchart illustrating the operation method of the vehicle-mounted display system of this application. (For example...) Figure 6 As shown, the first message in this embodiment differs from the first messages in the other embodiments described above. This embodiment is as follows:

[0123] S61: The camera hardware interface of the vehicle display system receives video frames from the camera.

[0124] For details, please refer to the description of step S11, which will not be repeated here.

[0125] S62: The camera hardware interface sends video frames to the camera driver.

[0126] The camera hardware interface sends video frames to the camera driver.

[0127] S63: The camera driver sends video frames to the intermediate layer.

[0128] The camera driver sends video frames to the intermediate layer.

[0129] S64: Intermediate layer processes video frames.

[0130] For details, please refer to the description of S81, which will not be repeated here.

[0131] S65: The intermediate layer sends the first message to the display driver.

[0132] The first message is used to notify the display hardware unit to prepare to receive the processed video frame.

[0133] The intermediate layer sends the first message to the display driver.

[0134] S66: The display driver sends the first message to the display hardware unit.

[0135] The display driver sends the first message to the display hardware unit.

[0136] In this embodiment, before the intermediate layer finishes processing the video frame, the intermediate layer sends a first message to the display hardware unit.

[0137] In this embodiment, when the intermediate layer finishes processing the video frame, the display hardware unit receives the first message.

[0138] S67: The display hardware unit is ready to read the processed video frame.

[0139] In this embodiment, before the intermediate layer finishes processing the video frames, the display hardware unit receives the first message and is ready to receive the processed video frames.

[0140] S68: Display hardware unit receives and processes video frames.

[0141] S69: The display hardware unit sends the processed video frames to the display.

[0142] The display hardware unit sends processed video frames to the display.

[0143] S610: The monitor displays the processed video frames.

[0144] The monitor receives and displays the processed video frames.

[0145] Figure 7 This is a timing diagram showing how the intermediate layer of this application sends the first message to the display hardware unit. For example... Figure 7 As shown, this embodiment is as follows:

[0146] S71: The intermediate layer begins processing video frames.

[0147] For specific steps, please refer to the description of S81, which will not be repeated here.

[0148] S72: The intermediate layer sends the first message to the display hardware unit.

[0149] In this embodiment, the intermediate layer sends a first message to the display hardware unit before it finishes processing the video frame. For example, 14ms before the intermediate layer finishes processing the video frame (this advance time is set according to specific circumstances and is not limited here), the intermediate layer sends the first message to the display hardware unit. After receiving the first message, the display hardware unit prepares to read the video frame.

[0150] In this embodiment, when the intermediate layer finishes processing the video frame, the display hardware unit receives the first message and is ready to read the processed video frame.

[0151] S73: The display hardware unit has received the first message.

[0152] S74: The display hardware unit is ready to receive the processed video frames.

[0153] S75: The intermediate layer ends the processing of video frames.

[0154] S76: The intermediate layer sends the processed video frames to the display hardware unit.

[0155] The intermediate layer sends the processed video frames to the display hardware unit.

[0156] In another embodiment, S81: The intermediate layer processes the video frame into a panoramic image.

[0157] In this embodiment, the intermediate layer seamlessly stitches together multiple video frames obtained at the same time to obtain a single panoramic image (bird's-eye view or other image information, such as image information around the vehicle, which is not limited here). These multiple video frames at the same time can be obtained through multiple cameras or image sensors, for example, image information around the vehicle obtained from different directions.

[0158] The above description is merely an embodiment of this application and does not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

[0159] Figure 8 This is a schematic diagram of the structure of an embodiment of the vehicle-mounted display system of this application. Figure 8 As shown, this embodiment is as follows: This embodiment is a chip for an in-vehicle display system and a camera and display connected thereto.

[0160] The chip of the vehicle-mounted display system includes a camera hardware interface, an intermediate layer, a driver layer, a display hardware unit, and a hardware cache. The driver layer includes a camera driver and a display driver. This chip is used to execute the operation method of the vehicle-mounted display system described in any of the above embodiments. The camera hardware interface is connected to the camera, camera driver, and hardware cache; the intermediate layer is connected to the camera driver, display driver, and display hardware unit; the camera driver is connected to the camera hardware interface, display driver, and intermediate layer; the display driver is connected to the camera driver, intermediate layer, and display hardware unit; and the display hardware unit is connected to the hardware cache, hardware driver, and display.

[0161] The camera hardware interface receives video frames from the camera; the camera hardware interface writes the video frames to a hardware buffer and sends a first message to the display hardware unit only through the driver layer to shorten the sending path of the first message notifying the display hardware unit to read / receive the video frames; or, the camera hardware interface receives video frames from the camera; the camera hardware interface sends the video frames to the intermediate layer through the camera driver; the intermediate layer processes the video frames and sends a first message to the display hardware unit through the display driver to shorten the sending path of the first message to notify the display hardware unit to read / receive the processed video frames; the display hardware unit reads / receives the processed video frames and sends the processed video frames to the display for display; wherein, when the display hardware unit reads / receives the first processed video frame, the timing of the first message being sent is configured to enable the display hardware unit to completely read / receive the first processed video frame.

[0162] The chip can be a CPU (Central Processing Unit). It may be an integrated circuit chip with signal processing capabilities. It can also be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The general-purpose processor can be a microprocessor, or the chip can be any conventional processor.

[0163] The hardware cache can be RAM, ROM, or other types of storage devices. Specifically, the memory can include one or more computer-readable storage media, which can be non-transitory. The memory can also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory is used to store at least one line of program code.

Claims

1. An operation method for an in-vehicle display system, characterized in that, include: The camera hardware interface of the vehicle display system receives video frames from the camera. The camera hardware interface writes the video frame into the hardware buffer and sends a first message to the display hardware unit only through the driver layer to shorten the sending path of the first message to notify the display hardware unit to read / receive the video frame. The driver layer includes a camera driver and a display driver. The camera hardware interface writes the first captured video frame into the hardware buffer, and before writing is complete, it sends a first message to the display hardware unit through the driver layer to notify the display hardware unit to read / receive the first video frame. Wherein, when the display hardware unit reads / receives the video frame, the time point at which the first message is sent is configured to enable the display hardware unit to completely read / receive the first video frame.

2. The method according to claim 1, characterized in that, The camera hardware interface writes the video frame into the hardware cache, and before writing is complete, it sends a first message to the display hardware unit only through the driver layer to notify the display hardware unit to read / receive the video frame, including: the camera hardware interface writes the video frame into the hardware cache, and waits to send a first message to the camera driver before writing is complete; The camera driver sends the first message to the display driver; The display driver sends the first message to the display hardware unit so that the display hardware unit can read the video frame; The display hardware unit reads the video frame and sends the video frame to the display for display.

3. The method according to claim 1, characterized in that, The camera hardware interface writes the video frame into the hardware buffer, and before writing is complete, it sends a first message to the display hardware unit only through the driver layer to notify the display hardware unit to read / receive the video frame. It also includes: the intermediate layer sends a second message and a pre-processed first trajectory line to the display hardware unit through the display driver. The display hardware unit reads the video frame according to the first message and receives the first trajectory line according to the second message, merges the first trajectory line and the video frame into a first merged frame, and sends it to the display for display.

4. The method according to any one of claims 1-2, characterized in that, The camera hardware interface writes the video frame into the hardware buffer, and before writing is complete, it sends a first message to the display hardware unit only through the driver layer to notify the display hardware unit to read / receive the video frame. This includes: the camera hardware interface merging the video frame with the second trajectory line into a second merged frame, sending the second merged frame to the hardware buffer, and sending a first message to the camera driver. The camera driver sends the first message to the display driver; The display driver sends the first message to the display hardware unit so that the display hardware unit is ready to read the second merged frame; The display hardware unit reads the second merged frame and sends it to the display for display.

5. An operation method for an in-vehicle display system, characterized in that, include: The camera hardware interface receives video frames from the camera. The camera hardware interface sends the video frames to the intermediate layer through the camera driver; The intermediate layer processes the video frame and sends the processed video frame and the first message to the display hardware unit through the display driver, so as to shorten the sending path of the first message and notify the display hardware unit to read / receive the processed video frame. The intermediate layer sends the processed first video frame to the display hardware unit through the display driver, and before the sending is completed, it sends a first message to the display hardware unit through the display driver to notify the display hardware unit to read / receive the first video frame. Wherein, when the display hardware unit reads / receives the first processed video frame, the time point at which the first message is sent is configured to enable the display hardware unit to completely read / receive the first processed video frame.

6. The method according to claim 5, characterized in that, The intermediate layer processes the video frame, including: the intermediate layer processes the video frame into a panoramic image.

7. A vehicle-mounted display system, characterized in that, include: A camera, a chip, and a display, the chip being used to perform the method according to any one of claims 1-6, wherein the camera is connected to the chip, and the chip is connected to the display.

8. A chip for an in-vehicle display system, characterized in that, include: The chip comprises a camera hardware interface, an intermediate layer, a driver layer, a display hardware unit, and a hardware cache, and is used to execute the method according to any one of claims 1-6, wherein the driver layer includes: a camera driver and a display driver; The camera hardware interface is connected to the camera, the camera driver, and the hardware cache; the middleware layer is connected to the camera driver and the display driver; the camera driver is connected to the camera hardware interface, the display driver, and the middleware layer; the display driver is connected to the camera driver, the middleware layer, and the display hardware unit; and the display hardware unit is connected to the hardware cache, the hardware driver, and the display.

Images