Rapid image display method, cabin operation system and storage medium

Abstract

The invention relates to the field of image processing, and discloses a fast image display method, a cabin operating system and a storage medium, the method is applied to a Linux drive program layer of the cabin operating system, and the method comprises the following steps: creating a kernel mode thread named as a fast camera logic driver; the fast camera logic driver responds to one received reversing signal, obtains a memory address corresponding to video data storage and generates a control signal for processing the video data; and sending the memory address and the control signal to a hardware layer, so that the hardware layer reads video data corresponding to the memory address according to the received memory address, generates a target image from the video data according to the control signal, and outputs the target image to a target display device. According to the technical scheme, the effect of quickly displaying the reversing image after power-on can be achieved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of image processing, and in particular to a rapid image display method, a cockpit operation system and a storage medium. BACKGROUND

[0002] With the rapid development of automobile technology, each OEM (Original Equipment Manufacturer) has requirements for the display time of the reversing image during cold start. The industry requires that the image be displayed within 8s, and some vehicle manufacturers require that the display time be faster than 8s.

[0003] At present, the display scheme of the reversing image in the prior art generally starts the user space of Android / Linux, then starts a camera service process to receive the corresponding external image, and then displays the image. However, this method generally takes 6s to 8s to display. This results in slow display of the reversing image, which cannot meet the use requirements of vehicle manufacturers and some users, and affects the user experience.

[0004] Therefore, the present application is proposed. SUMMARY

[0005] To solve the above technical problems, the present application provides a rapid image display method, a cockpit operation system and a storage medium, which can realize the effect of quickly displaying the reversing image after power-on.

[0006] The present application provides a rapid image display method applied to the Linux driver layer of the cockpit operation system, which comprises the following steps:

[0007] creating a kernel state thread named a quick camera logical driver;

[0008] The quick camera logical driver acquires the memory address corresponding to the video data in response to a received reversing signal, and generates a control signal for processing the video data;

[0009] The memory address and the control signal are sent to the hardware layer, so that the hardware layer reads the video data corresponding to the memory address according to the received memory address, generates a target image according to the control signal, and outputs the target image to a target display device.

[0010] The present application provides a rapid image display method applied to the hardware layer of the cockpit operation system, which comprises the following steps:

[0011] In response to the microcontroller of the hardware layer receiving a reversing signal, the reversing signal is forwarded to the Linux driver layer of the cockpit operation system.

[0012] reading the video data corresponding to the memory address in response to receiving the control signal sent by the Linux driver layer and the video data;

[0013] generating a target image from the video data according to the control signal, and outputting the target image to a target display device;

[0014] The memory address is a memory address corresponding to video data obtained by a fast camera logical driver in the Linux driver layer in response to receiving a reverse signal.

[0015] The cockpit operating system comprises:

[0016] a Linux driver layer and a hardware layer;

[0017] The Linux driver layer is configured to execute the steps of the image fast display method.

[0018] The hardware layer is configured to execute the steps of the image fast display method.

[0019] The computer readable storage medium stores programs or instructions, and the programs or instructions cause a computer to execute the steps of the image fast display method.

[0020] The cockpit operating system has the following technical effects:

[0021] A kernel thread named fast camera logical driver is created in the Linux driver layer of the cockpit operating system, and the fast camera logical driver obtains a memory address corresponding to video data in response to receiving a reverse signal, and generates a control signal for processing the video data, and sends the memory address and the control signal to the hardware layer, so that the hardware layer reads the video data corresponding to the memory address according to the received memory address, and generates a target image from the video data according to the control signal, and outputs the target image to a target display device, thereby achieving the effect of quickly displaying a reverse image without waiting for a user space to start after the Linux driver layer of the cockpit operating system is powered on. BRIEF DESCRIPTION OF DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the specific embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the specific embodiments or prior art description. Obviously, the drawings described below are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0023] Figure 1 is a flowchart of an image rapid display method provided by an embodiment of the present application;

[0024] Figure 2 is a flowchart of another image rapid display method provided by an embodiment of the present application;

[0025] Figure 3 is a structural schematic diagram of a cockpit operation system provided by an embodiment of the present application;

[0026] Figure 4 is an architecture diagram of an existing image display provided by an embodiment of the present application;

[0027] Figure 5 is an architecture diagram of an image rapid display provided by an embodiment of the present application. DETAILED DESCRIPTION

[0028] In order to make the objects, technical solutions and advantages of the present application clearer, the technical solutions of the present application will be described clearly and completely. Obviously, the described embodiments are only some of the embodiments of the present application, not all. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.

[0029] The image rapid display method provided by the embodiment of the present application is mainly applicable to the case that the reverse image is displayed only through the Linux driver program layer and the hardware layer without the help of the hardware abstraction layer and the native layer of the cockpit operation system. The image rapid display method provided by the embodiment of the present application can be executed by the cockpit operation system.

[0030] Figure 1 is a flowchart of an image rapid display method provided by an embodiment of the present application. Referring to Figure 1 , the image rapid display method is applied to the Linux driver program layer of the cockpit operation system, and specifically includes the following steps:

[0031] S110, a kernel state thread named a quick camera logical driver is created; the quick camera logical driver acquires a memory address corresponding to the video data in response to receiving a reverse signal, and generates a control signal for processing the video data.

[0032] The fast camera logic driver is a driver for obtaining and forwarding the memory address corresponding to the video data, and is a kernel thread. The Linux driver layer is a driver running in the Linux kernel space, directly controlling hardware operation. The hardware layer is a bottom component directly interacting with physical hardware, usually including a controller processor, etc., responsible for managing hardware resources and providing basic support for hardware functions, such as image processing, data acquisition, etc. The reverse signal is a signal triggered by the vehicle reverse gear. The video data is each image video frame stored in the memory of the hardware layer at the current time. The memory address is the address of the memory for storing the video data. The control signal is a signal for processing the video data into the reverse image.

[0033] Specifically, a kernel thread named fast camera logic driver is created. If the fast camera logic driver receives the reverse signal, it means that the reverse image needs to be obtained, processed and provided. Since the video data obtained by real-time acquisition and processing is stored in the memory of the hardware layer, the memory address corresponding to the video data needs to be obtained in order to facilitate subsequent memory access and use. In addition, the control signal for processing the video data is generated to control the video data to form the reverse image, i.e., the target image, in the subsequent.

[0034] S120, the memory address and the control signal are sent to the hardware layer, so that the hardware layer reads the video data corresponding to the memory address according to the received memory address, generates the target image from the video data according to the control signal, and outputs the target image to the target display device.

[0035] The target image is the reverse image obtained by processing and integrating the video data. The target display device is a display device for displaying the reverse image, which can be a car display, etc.

[0036] Specifically, the Linux driver layer sends the memory address of the video data and the corresponding control signal to the hardware layer. When the hardware layer receives the memory address, it can read the data according to these memory addresses, so as to read the corresponding video data in the hardware layer. Then, according to the control signal, the read video data can be processed and integrated to obtain the reverse image at the current time, i.e., the target image. In addition, the target image can be output to the target display device through a predetermined interface, so that the user can quickly view the target image through the target display device.

[0037] On the basis of the above example, the Linux driver layer also needs to receive external video streams and store them as video data for subsequent calling. Specifically, it can be:

[0038] acquire the external video stream collected by the at least one external camera via the high-speed image data transmission interface of the hardware layer;

[0039] The video device driver in the Linux driver layer converts each external video stream into video data and stores each video data into a memory address respectively.

[0040] The memory address is an address corresponding to a memory in a cache area of a direct memory read mode applied by the fast camera logical driver in the hardware layer. The video device driver (Video for linux2, V4L2) is a kernel driver of a video device in Linux. The external video stream is a video stream collected by an image collection device (such as a camera) of a vehicle in real time.

[0041] Specifically, the video device driver in the Linux driver layer can receive the external video stream acquired by the high-speed image data transmission interface of the hardware layer, and can convert each external video stream into video data respectively.

[0042] The present application has the following technical effects: a kernel state thread named fast camera logical driver is created in the Linux driver layer of the cockpit operating system. The fast camera logical driver acquires a memory address corresponding to video data in response to receiving a reverse signal, generates a control signal for processing the video data, and sends the memory address and the control signal to the hardware layer. The hardware layer reads the video data corresponding to the memory address according to the received memory address, generates a target image according to the control signal, and outputs the target image to a target display device.

[0043] Figure 2 is a flowchart of another image fast display method provided by an embodiment of the present application. Figure 2 The image fast display method is applied to the hardware layer of the cockpit operating system and specifically includes the following steps:

[0044] S210, in response to the microcontroller of the hardware layer receiving a reverse signal, the reverse signal is forwarded to the Linux driver layer of the cockpit operating system.

[0045] Specifically, the microcontroller of the hardware layer can receive the reverse signal through SPI (Serial Peripheral Interface) / Uart (Universal Asynchronous Receiver / Transmitter) / GPIO (General Purpose Input / Output), and forward the received reverse signal to the Linux driver layer of the cockpit operating system to trigger the fast processing logic in the Linux driver layer.

[0046] Specifically, the microcontroller of the hardware layer can receive the reverse signal through SPI (Serial Peripheral Interface) / Uart (Universal Asynchronous Receiver / Transmitter) / GPIO (General Purpose Input / Output), and forward the received reverse signal to the Linux driver layer of the cockpit operating system to trigger the fast processing logic in the Linux driver layer.

[0047] S220, in response to receiving the memory address and video data control signal sent by the Linux driver layer, reading the video data corresponding to the memory address.

[0048] Specifically, if the hardware layer receives the memory address sent by the Linux driver layer, the video data corresponding to the memory address can be read according to the memory address.

[0049] Specifically, if the hardware layer receives the memory address sent by the Linux driver layer, the video data corresponding to the memory address can be read according to the memory address.

[0050] Based on the above example, the video data corresponding to the memory address in the Linux driver layer can be read in the following way:

[0051] The display processing unit of the hardware layer reads the video data corresponding to the memory address through direct memory reading according to the memory address.

[0052] The display processing unit (DPU) is a processor for data-centric computing. The direct memory reading (DMA) is a way of transferring data within the system, and is a way of executing data transmission under the programming control of the display processing unit.

[0053] Specifically, if the display processing unit of the hardware layer receives the memory address, the buffer (Buf) reads the corresponding video data according to the memory address using the direct memory reading.

[0054] It can be understood that the number of buffer areas is determined according to the number of videos collected by the external camera. For example, if the directions of the videos collected by the external camera include front, back, left and right, the number of memory addresses is 4, and the number of buffer areas is also 4; if the number of videos collected by the external camera is 1, the number of memory addresses is 1, and the number of buffer areas is also 1.

[0055] S230, generating a target image from the video data according to the control signal, and outputting the target image to the target display device.

[0056] Specifically, the read video data is processed according to a preset processing mode according to the control signal to obtain a target image. The preset processing mode can include a preset resolution, image size, display position, etc. Further, the target image is output to the target display device for the user to view when reversing.

[0057] Based on the above examples, the video data can be processed to generate a target image according to a control signal, and the target image can be output to a target display device in the following manner:

[0058] For each processing layer in the display processing unit of the hardware layer, the video data is processed according to the control signal, the sub-data corresponding to the processing layer is determined, and the sub-data is rendered to obtain a grouped image, and the grouped image is input to a layout module in the display processing unit;

[0059] The layout module arranges the received grouped images to generate a target image;

[0060] The target image is output to the target display device through a mobile device display interface in the hardware layer.

[0061] The processing layer is a layer structure for obtaining data from the buffer area and performing image rendering. The sub-data is the video data that needs to be processed by the processing layer, which can be understood as video data captured by different external cameras. The grouped image is the image data output after the processing layer is rendered. The layout module is a module for arranging the positions of the grouped images and processing the images. The mobile device display interface can be a DP (DisplayPort, DisplayPort) / DSI (Display Serial Interface, Display Serial Interface).

[0062] Specifically, for each processing layer in the display processing unit of the hardware layer, different data corresponding to different external cameras can be processed according to the control signal. Therefore, each processing layer obtains corresponding sub-data from the video data. Specifically, the data obtained from the corresponding cache area can be used as the sub-data. Further, the sub-data can be image rendered to obtain grouped images in the processing layer. The grouped images rendered in the processing layer are all input to the layout module in the display processing unit. When receiving each grouped image, the layout module processes each grouped image according to a preset processing manner and performs layout to obtain a target image. The obtained target image can be quickly output to a target display device through a mobile device display interface in the hardware layer.

[0063] On the basis of the above examples, the video data can be processed according to the control signal to determine the sub-data corresponding to the processing layer by the following manner, including:

[0064] According to the control signal, the video shooting parameter corresponding to the processing layer is determined.

[0065] According to the video data and the video shooting parameter, the sub-data corresponding to the processing layer is determined.

[0066] The video shooting parameter is a shooting parameter corresponding to different video data, for example, a shooting camera identifier, a shooting angle, a shooting direction, and the like.

[0067] Specifically, the control signal can be analyzed to know the video shooting parameter of the video data required for generating the target image subsequently, and accordingly the video shooting parameter corresponding to each processing layer can be determined. The part of the video data corresponding to the video shooting parameter is determined as the sub-data of the corresponding processing layer.

[0068] On the basis of the above examples, the layout module can generate the target image according to the received grouped images by the following manner:

[0069] The layout module receives each grouped image and determines a layout position and an image processing parameter corresponding to each grouped image.

[0070] The layout module processes each grouped image according to the image processing parameter corresponding to the grouped image to determine a layout sub-image.

[0071] The layout module determines the target image according to the layout position and the layout sub-image corresponding to each grouped image.

[0072] The layout position can be a position where different grouped images should be displayed, and the display according to the layout position can be displayed in layers or close to each other. The image processing parameter can be a parameter for processing the grouped image, such as resolution, brightness, contrast, scaling, and the like. The layout sub-image is an image of the grouped image processed according to the image processing parameter.

[0073] Specifically, the layout module receives each grouped image, and for each grouped image, according to the cache area corresponding to the grouped image, the pre-configured layout position and image processing parameter corresponding to the cache area are taken as the layout position and image processing parameter corresponding to the grouped image. Then, for each grouped image, the image is adjusted and processed according to the image processing parameter corresponding to the grouped image to obtain the corresponding layout sub-image. Further, the layout sub-images corresponding to each grouped image are arranged according to the respective layout positions, and the target image is obtained after the arrangement, splicing and combination.

[0074] For example, if the grouped image includes a left front image, a right front image, a left rear image, and a right rear image, the corresponding layout positions are left front, right front, left rear, and right rear, respectively. It can be understood that if the layout sub-images corresponding to each grouped image are arranged according to the corresponding layout positions, there is an overlap, which can be processed by image splicing technology to make the display effect of the target image better. If there is only one grouped image, the layout sub-image processed according to the image processing parameter can be directly taken as the target image.

[0075] Based on the above example, the hardware layer also needs to obtain a video stream from an external camera and forward it to the Linux driver layer. Specifically, it can be:

[0076] Obtain the external video stream collected by the external camera through the high-speed image data transmission interface of the hardware layer;

[0077] Send the external video stream to the video device driver in the Linux driver layer.

[0078] The high-speed image data transmission interface can be MIPI CSI-2 (Mobile Industry Processor Interface Camera Serial Interface 2), which is a serial interface standard for connecting image sensors (external cameras in this example) and image processors (cabin operating systems in this example). The external camera can be a camera that can cover all field of view ranges around the vehicle, which is pre-configured on the vehicle.

[0079] Specifically, the external camera is connected with the cockpit operating system through a high-speed image data transmission interface of the hardware layer, so that the external video stream collected by the external camera can be received through the high-speed image data transmission interface. Moreover, the external video stream obtained by the hardware layer can be sent to a video device driver in the Linux driver layer for subsequent storage and processing.

[0080] It can be understood that the scheme of the above example can quickly display the target image as long as the Linux driver layer, that is, the Linux kernel of the cockpit operating system, is started. For example, the RVC (Rear View Camera, rear view image recognition system) does not need to wait for a series of services and display frameworks in the user space of the cockpit operating system to be started. The scheme of the above example is expected to display the target image in about 3s after power-on. The scheme of the above example directly creates a kernel thread (fast camera logical driver) in the Linux kernel (Linux driver layer) to obtain the memory address corresponding to the video data from the V4L2 driver, and then gives it to the processing layer (Layer) of the DPU and controls the DPU Layer and the Compositor (layout module) to synthesize and display the image. Moreover, the scheme of the above example can process one or more video streams, that is, it can meet the requirement of separately and quickly displaying the RVC of a single external camera in full screen, and can also meet the requirement of displaying the AVM (Around View Monitor, around view monitoring image system) of four external cameras in a 4-quadrant manner.

[0081] The application has the following technical effects: in response to the microcontroller of the hardware layer receiving the reverse signal, the reverse signal is forwarded to the Linux driver layer of the cockpit operating system, and in response to receiving the memory address and the control signal of the video data sent by the Linux driver layer, the video data corresponding to the memory address is read, the video data is generated into a target image according to the control signal, and the target image is output to a target display device, so that the video is processed in the hardware layer without calling the camera service in the user space, the display speed of the reverse image is improved.

[0082] Figure 3 is a structural diagram of a cockpit operating system provided by an embodiment of the application. As shown in Figure 3 The cockpit operating system includes a Linux driver layer 310 and a hardware layer 320.

[0083] The Linux driver layer 310 is configured to execute the steps of the image fast display method provided by any of the embodiments of the present application, and the hardware layer 320 is configured to execute the steps of the image fast display method provided by any of the embodiments of the present application.

[0084] The Linux driver layer 310 is configured to create a kernel-level thread named fast camera logical driver, and the fast camera logical driver is configured to, in response to receiving a reverse signal, acquire a memory address corresponding to storage of video data, and generate a control signal for processing the video data, and send the memory address and the control signal to the hardware layer, so that the hardware layer reads the video data corresponding to the memory address according to the received memory address, generates a target image according to the control signal, and outputs the target image to a target display device.

[0085] Based on the above example, the Linux driver layer 310 is further configured to acquire at least one external video stream collected by an external camera via a high-speed image data transmission interface of the hardware layer, and a video device driver in the Linux driver layer is configured to convert each external video stream into video data and store each video data in the memory address, wherein the memory address is an address corresponding to a memory in a cache area in a direct memory reading mode applied by the fast camera logical driver in the hardware layer.

[0086] The hardware layer 320 is configured to, in response to the microcontroller of the hardware layer receiving a reverse signal, forward the reverse signal to the Linux driver layer of the cockpit operating system, in response to receiving the memory address and the control signal of the video data sent by the Linux driver layer, read the video data corresponding to the memory address in the Linux driver layer, generate a target image according to the control signal, and output the target image to a target display device, wherein the memory address is a memory address corresponding to storage of video data acquired by the fast camera logical driver in the Linux driver layer in response to receiving a reverse signal, and the fast camera logical driver is a kernel-level thread created in the Linux driver layer.

[0087] Based on the above example, the hardware layer 320 is further configured to, based on the display processing unit of the hardware layer, read the video data corresponding to the memory address by a direct memory reading mode according to the memory address.

[0088] On the basis of the above examples, the hardware layer 320 is further configured to, for each processing layer in the display processing unit of the hardware layer, process the video data (which can be from multiple cameras) according to the control signal, determine sub-data corresponding to the processing layer, and render the sub-data to obtain grouped images, and input the grouped images to a layout module in the display processing unit; the layout module performs layout according to the received grouped images to generate a target image; and the target image is output to a target display device through a mobile device display interface in the hardware layer. The sub-data is video data that needs to be processed by the processing layer, which can be understood as video data captured by different external cameras.

[0089] On the basis of the above examples, the hardware layer 320 is further configured to determine video shooting parameters corresponding to the processing layer according to the control signal; and determine sub-data corresponding to the processing layer according to the video data and the video shooting parameters.

[0090] On the basis of the above examples, the hardware layer 320 is further configured to determine, based on the layout module, a layout position and image processing parameters corresponding to each grouped image according to the received grouped images; the layout module processes each grouped image according to the image processing parameters corresponding to the grouped image to determine a layout sub-image; and the layout module determines a target image according to the layout position and the layout sub-image corresponding to each grouped image.

[0091] On the basis of the above examples, the hardware layer 320 is further configured to acquire an external video stream captured by an external camera through a high-speed image data transmission interface of the hardware layer; and send the external video stream to a video device driver in the Linux driver layer.

[0092] Figure 4 is an architecture diagram of existing image display provided by an embodiment of the present application, Figure 5 is an architecture diagram of fast image display provided by an embodiment of the present application.

[0093] As Figure 4As shown, in existing technology, the external video stream is transmitted to the high-speed image data transmission controller via the high-speed image data transmission interface in the hardware layer. Driven by the high-speed image data transmission controller in the Linux driver layer, it is transmitted to the video device driver, and then to the user space, specifically the camera service in the Hardware Abstraction Layer (HAL) and Native layer. The reversing signal is transmitted to the camera service in the HAL and Native layer via the signal input interface in the hardware layer, such as SPI / UART / GPIO, through the signal input interface controller and the corresponding driver in the Linux driver layer. Upon receiving the reversing signal, the camera service sends the received video stream to the same-layer display frame (Surfaceflinger). The video stream is then driven by the display processing unit in the Linux driver layer to the display processing unit in the hardware layer for image processing, and finally output to the target display device via the mobile device display interface.

[0094] like Figure 5 As shown, in this example, the external video stream is transmitted to the high-speed image data transmission controller via the high-speed image data transmission interface in the hardware layer. Driven by the high-speed image data transmission controller in the Linux driver layer, it is then transmitted to the video device driver to store the video data corresponding to the external video stream in memory. The transmission of the reversing signal is similar to that in existing technologies, being transmitted to the fast camera logic driver in the Linux driver layer. When the fast camera logic driver receives the reversing signal, it retrieves the memory address corresponding to the video data from the memory in the hardware layer, generates a control signal, and drives it to the display processing unit in the hardware layer via the display processing unit in the Linux driver layer. This allows the display processing unit to read the video data corresponding to the memory address via direct memory access. In the display processing unit, the sub-data corresponding to different external cameras is processed according to the control signal through each processing layer to obtain grouped images. The layout module in the display processing unit then performs layout processing on each grouped image, outputting the target image, which is then output to the target display device via the mobile device display interface.

[0095] In combination with the above-mentioned control, the Android system is generally used as the cockpit operating system in a vehicle. However, the Android system is relatively slow to start, especially the display framework such as Surfaceflinger. Some customers have their own start standards, and require that the target display device can display as quickly as possible, and even some customers require that the display can be displayed in 2 seconds. In the prior art, the Android / Linux user space is started first, and then a camera service process is started to receive the required image, and then the image is displayed. However, this method generally takes 6-8 seconds to start and display. In the present example, the image can be quickly displayed after the Linux driver layer is started, and there is no need to wait for a series of services and display frameworks in the user space to be started. It is expected that the image can be displayed in about 3 seconds after power-on.

[0096] In addition to the above method and system, an embodiment of the present application can also be a computer program product, which includes computer program instructions that, when executed by a processor, cause the processor to perform the steps of the image fast display method provided by any embodiment of the present application.

[0097] The computer program product can be written in any combination of one or more programming languages to perform the operations of the embodiments of the present application, including object-oriented programming languages such as Java, C++, and conventional procedural programming languages such as "C" language or similar programming languages. The program code can be executed entirely on a user computing device, partially on a user device, as an independent software package, partially on a user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0098] In addition, an embodiment of the present application can also be a computer readable storage medium, which stores computer program instructions, and the computer program instructions, when executed by a processor, cause the processor to perform the steps of the image fast display method provided by any embodiment of the present application.

[0099] The computer readable storage medium can be any combination of one or more computer readable medium(s). The computer readable medium can be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium include an electrical connection having one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0100] It should be noted that the terms used in the present application are only intended to describe specific embodiments and are not intended to limit the scope of the present application. As shown in the specification of the present application, unless the context clearly indicates otherwise, the terms "one", "a", "an", and / or "the" do not refer to the singular, but can also include the plural. The terms "include", "contain" or any other variants thereof are intended to cover non-exclusive inclusion, so that the process, method or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method or device. Without more limitations, the element defined by the statement "including a" does not exclude the presence of other identical elements in the process, method or device including the element.

[0101] It should also be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", and the like indicate the orientation or positional relationship shown in the drawings, and are only intended to facilitate the description of the present application and simplify the description, and do not indicate or imply that the devices or elements referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as limiting the present application. Unless otherwise specified and limited, the terms "mount", "connect", "connect" and the like should be broadly understood, for example, it can be fixedly connected, or it can be detachably connected, or integrally connected; it can be mechanically connected, or it can be electrically connected; it can be directly connected, or it can be indirectly connected through an intermediate medium, or it can be connected internally between two elements. For those skilled in the art, the specific meaning of the above terms in the present application can be understood according to the specific circumstances.

[0102] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, and are not intended to limit the present application; although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that the technical solutions recorded in the above embodiments can still be modified, or some or all of the technical features can be replaced by equivalents; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the embodiments of the present application.

Claims

1. A method for rapid image display, characterized in that, The Linux driver layer applied to the cockpit operating system includes: Create a kernel-mode thread named Fast Camera Logic Driver; The fast camera logic driver responds to a received reversing signal by acquiring the memory address corresponding to the video data storage and generating a control signal for processing the video data. The memory address and the control signal are sent to the hardware layer, so that the hardware layer reads the video data corresponding to the received memory address, generates a target image from the video data according to the control signal, and outputs the target image to the target display device.

2. The method according to claim 1, characterized in that, Also includes: The external video stream captured by at least one external camera is acquired via the high-speed image data transmission interface of the hardware layer. The video device driver in the Linux driver layer converts each external video stream into video data and stores each video data into the memory address respectively; The memory address is the address of the memory in the cache area of ​​the direct memory access method requested by the fast camera logic driver in the hardware layer.

3. A method for rapid image display, characterized in that, The hardware layer applied to the cockpit operating system includes: In response to the microcontroller of the hardware layer receiving a reversing signal, the reversing signal is forwarded to the Linux driver layer of the cockpit operating system; In response to receiving a control signal containing a memory address and video data sent by the Linux driver layer, the video data corresponding to the memory address is read. The video data is used to generate a target image according to the control signal, and the target image is output to the target display device. The memory address is the memory address corresponding to the video data storage acquired by the fast camera logic driver in the Linux driver layer in response to a received reversing signal; the fast camera logic driver is a kernel-mode thread created in the Linux driver layer.

4. The method according to claim 3, characterized in that, The step of reading the video data corresponding to the memory address includes: The display processing unit of the hardware layer reads the video data corresponding to the memory address using a direct memory read method.

5. The method according to claim 3, characterized in that, The step of generating a target image from the video data according to the control signal and outputting the target image to the target display device includes: For each processing layer in the display processing unit of the hardware layer, the video data is processed according to the control signal to determine the sub-data corresponding to the processing layer, and the sub-data is rendered to obtain grouped images. The grouped images are then input to the layout module in the display processing unit. The layout module arranges the received grouped images and generates the target image. The target image is output to the target display device through the mobile device display interface in the hardware layer.

6. The method according to claim 5, characterized in that, The step of processing the video data according to the control signal to determine the sub-data corresponding to the processing layer includes: Based on the control signal, determine the video capture parameters corresponding to the processing layer; Based on the video data and the video shooting parameters, the sub-data corresponding to the processing layer is determined.

7. The method according to claim 5, characterized in that, The layout module arranges the received grouped images and generates a target image, including: The layout module receives each group of images and determines the layout position and image processing parameters corresponding to each group of images. The layout module processes each group of images according to the corresponding image processing parameters to determine the layout sub-images. The layout module determines the target image based on the layout position of each group of images and the layout sub-images.

8. The method according to claim 3, characterized in that, Also includes: The external video stream captured by the external camera is obtained through the high-speed image data transmission interface of the hardware layer; The external video stream is sent to the video device driver in the Linux driver layer.

9. A cockpit operating system, characterized in that, The cockpit operating system includes: Linux driver layer and hardware layer; The Linux driver layer is used to perform the steps of the image fast display method as described in any one of claims 1 to 2; The hardware layer is used to perform the steps of the image fast display method as described in any one of claims 3 to 8.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a program or instructions that cause a computer to perform the steps of the image fast display method as described in any one of claims 1 to 2 or the image fast display method as described in any one of claims 3 to 8.

Images