Vehicle-mounted image display method and system and storage medium

Abstract

The invention provides a vehicle-mounted image display method and system and a storage medium, and the method comprises the steps: detecting a display screen operation state and a vehicle driving state in real time, and generating an image display instruction based on the display screen operation state and the vehicle driving state; obtaining original image data through the intelligent driving domain controller and performing primary processing to obtain initial image data; transmitting the image display instruction and the initial image data to a screening assembly of an intelligent driving domain controller or a cabin domain controller, and screening the initial image data through the screening assembly to obtain display image data; when the intelligent driving domain controller or the cabin domain controller is currently screened, transmitting the display image data to an image forwarding assembly of the cabin domain controller, and transmitting the display image data to a display screen for displaying through the image forwarding assembly. Or directly transmitting the display image data to the display screen for displaying through the cabin area controller.

Description

Technical Field

[0001] The present application belongs to the field of automotive electronic technology, and specifically relates to a vehicle-mounted image display method, system and storage medium. Background Art

[0002] AVM (Around View Monitor) is an important safety auxiliary sensor for modern smart cars. It captures images of the vehicle's surroundings and provides the vehicle with 360-degree image information without blind spots, helping to improve driving safety and convenience.

[0003] In the existing technical solution, the AVM panoramic surround view video stream is first transmitted to the intelligent driving domain controller. The deserializer chip inside the intelligent driving domain controller transmits the received video stream to the SOC chip. At the same time, the deserializer chip also needs to have a bypass function to forward the video stream to the intelligent cockpit domain controller to realize the display of the AVM panoramic function.

[0004] However, the existing technical solutions have the problem that the use of deserializer chips and serializer chips increases the complexity and cost of the system. Secondly, although the bypass function can reduce the delay of the video stream, the deserializer and serializer themselves may become potential failure points of the system, affecting the stability and reliability of the system. Summary of the invention

[0005] In order to solve the above-mentioned technical problems, the present application proposes a vehicle-mounted image display method, system and storage medium, aiming to solve the technical problems of high system complexity and increased cost brought by deserializers and serializers in the prior art, effectively reducing the complexity of vehicle-mounted image display and improving the stability and reliability of image display.

[0006] Specifically, the present application proposes a vehicle-mounted image display method, comprising: The display screen operation status and the vehicle driving status are detected in real time to generate image display instructions through the cockpit domain controller or the intelligent driving domain controller based on the display screen operation status and the vehicle driving status.

[0007] The original image data is obtained through the intelligent driving domain controller and the original image data is preliminarily processed to obtain initial image data.

[0008] The image display instruction and the initial image data are transmitted to the screening component of the intelligent driving domain controller or the cockpit domain controller, so that the initial image data is screened and processed by the screening component to obtain display image data.

[0009] Furthermore, when the intelligent driving domain controller is currently performing the screening process, the display image data is transmitted to the image forwarding component of the cockpit domain controller, so that the display image data is transmitted to the display screen through the image forwarding component for display.

[0010] When the cockpit domain controller is currently performing screening processing, the cockpit domain controller directly transmits the display image data to the display screen for display.

[0011] In the above technical solution, the image screen requirements that the driver needs to display can be obtained in real time by real-time detection of the display screen operation status and the vehicle driving status. The image data is transmitted and displayed through a wired link or a wireless link, which abandons the image data transmission method using a serializer and a deserializer, and reduces the complexity and cost of the vehicle-mounted image display process. The system instability problem caused by software and hardware failures of the deserializer and the serializer is avoided, and the stability and reliability of the vehicle-mounted image display process are improved. By performing preliminary processing and screening on the original image data, the data processing algorithm is reduced, and the efficiency of the vehicle-mounted image display process is improved. The initial image data is screened by controlling the screening component through the image display instruction, so that the image data that the driver needs to view can be accurately transmitted and displayed, which improves the driver's user experience.

[0012] As an implementation manner, the obtaining of original image data through the intelligent driving domain controller includes: The display screen operation status and vehicle driving status are transmitted to the intelligent driving domain controller so that the intelligent driving domain controller controls the sensor equipment to collect vehicle environment data.

[0013] The vehicle environment data is converted into parallel image data through a deserializer, and the parallel image data is used as the original image data.

[0014] By transmitting the display screen operation status and vehicle driving status to the intelligent driving domain controller, the intelligent driving domain controller can accurately control the sensor equipment to collect vehicle environment data, thereby improving the accuracy and effectiveness of environmental perception. The vehicle environment data can be converted into parallel image data through the deserializer, so that the data can be processed and transmitted more quickly, reducing the delay in the data transmission process and ensuring that the original image data can be transmitted and processed in a timely manner.

[0015] Furthermore, the preliminary processing includes at least image correction processing and image stitching processing.

[0016] Wherein, the image correction processing includes: The raw image data is corrected based on preset sensor device parameters.

[0017] The image stitching process comprises: The corrected original image data is stitched based on a preset image stitching algorithm to obtain the initial image data.

[0018] By correcting the original image data by using the preset sensor device parameters, errors caused by internal and external factors of the sensor itself can be eliminated, and distortion or other inaccurate areas in the image can be effectively corrected, making the image data more realistic and clear, and effectively improving the image quality. By performing a splicing operation on the corrected original image data, the image data collected by multiple sensor devices can be spliced ​​into a complete image data, improving the visual experience and environmental perception capabilities.

[0019] Furthermore, the filtering process of the initial image data by the filtering component includes: Based on the image display instruction, the screening component is controlled to screen out corresponding view data from the initial image data as final display image data.

[0020] The image display instructions at least include a front view display instruction, a rear view display instruction, a left view display instruction, a right view display instruction and a top view display instruction.

[0021] The view data at least includes front view image data, rear view image data, left view image data, right view image data and top view image data.

[0022] Through the image display instruction, the screening component can accurately screen out the image data that the user needs to display, and can accurately extract the corresponding view data from the initial image data. The image data displayed on the display screen can be switched according to the image display instruction, thereby improving the flexibility of the vehicle-mounted image display and improving the user experience.

[0023] Furthermore, after acquiring the display image data, the method further includes: Based on a preset visual recognition model, scene information is identified from the displayed image data; based on the scene information, the vehicle is planned and controlled through the intelligent driving domain controller; wherein the scene information includes at least obstacle information, lane line information and road information.

[0024] The preset visual recognition model can be used to identify scene information from the displayed image data, thereby improving the vehicle's ability to perceive the surrounding environment, improving the accuracy of the intelligent driving domain controller's vehicle planning and control, and effectively predicting potential dangers by identifying obstacle information, thereby improving driving safety. It reduces misjudgments in complex road environments and improves the accuracy and reliability of scene recognition.

[0025] Furthermore, the preset visual recognition algorithm includes: Build a visual recognition model based on deep learning algorithms to obtain historical scene information and historical display image data.

[0026] The visual recognition model is trained based on the historical scene information and the historical display image data to obtain a final visual recognition model.

[0027] By using historical scene information and historical display image data to train the visual recognition model, the visual recognition model can be learned under multiple historical scenes, thereby improving the recognition ability of scenes under different complex situations and enhancing the accuracy and robustness of the visual recognition model.

[0028] Based on the same inventive concept, the present application also proposes a system for a vehicle-mounted image display method, the system comprising: A cockpit domain control module, an intelligent driving domain control module and a display module. The cockpit domain control module includes a status detection module, a command generation module and an image transmission module. The intelligent driving domain control module includes a data acquisition module, a preliminary processing module and a data screening module.

[0029] The status detection module is used to detect the display screen operation status and vehicle driving status in real time.

[0030] The data acquisition module is used to obtain raw image data through the intelligent driving domain controller.

[0031] An instruction generation module is used to generate image display instructions through a cockpit domain controller or an intelligent driving domain controller based on the display screen operation status and the vehicle driving status.

[0032] The preliminary processing module is used to perform preliminary processing on the original image data to obtain initial image data.

[0033] A data filtering module is used to transmit the image display instruction and the initial image data to the filtering component of the intelligent driving domain controller or the cockpit domain controller, so as to filter and process the initial image data through the filtering component to obtain display image data.

[0034] An image transmission module is used to transmit the display image data to the image forwarding component of the cockpit domain controller when the intelligent driving domain controller is currently performing screening processing, so as to transmit the display image data to the display screen through the image forwarding component; when the cockpit domain controller is currently performing screening processing, the display image data is directly transmitted to the display screen through the cockpit domain controller.

[0035] And, a display module is used to display the display image data through a display screen.

[0036] Furthermore, the intelligent driving domain control module also includes at least a scene recognition module.

[0037] The scene recognition module is used to identify scene information from the displayed image data based on a preset visual recognition model, plan a vehicle's driving path based on the scene information, and control the vehicle's driving through the intelligent driving domain controller based on the driving path.

[0038] Based on the same inventive concept, the present application also proposes an electronic device, which is configured with an intelligent driving domain control module and an intelligent cockpit domain control module, and executes the vehicle-mounted image display method based on the intelligent driving domain control module and the intelligent cockpit domain control module.

[0039] Based on the same inventive concept, the present application also proposes a computer-readable storage medium, which stores computer-executable instructions. The computer-executable instructions can be read by a domain controller and execute the vehicle-mounted image display method.

[0040] Compared with the prior art, this application has at least the following beneficial effects: The vehicle-mounted image display method proposed in the present application solves the technical problems of high complexity and high cost brought by the deserializer and serializer in the prior art. By real-time detection of the display screen operation status and the vehicle driving status, the image screen requirements that the driver needs to display can be obtained in real time. The image data is transmitted and displayed through a wired link or a wireless link, and the image data transmission method using a serializer and a deserializer is abandoned, reducing the complexity and cost of the vehicle-mounted image display process. The system instability problem caused by the software and hardware failure of the deserializer and the serializer is avoided, and the stability and reliability of the vehicle-mounted image display process are improved. By performing preliminary processing and screening on the original image data, the data processing algorithm is reduced, and the efficiency of the vehicle-mounted image display process is improved. The initial image data is screened and processed by the image display instruction control screening component, so that the image data that the driver needs to view can be accurately transmitted and displayed, improving the driver's user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 It is a flow chart of the vehicle-mounted image display method shown in an embodiment of the present application.

[0042] Figure 2 It is a schematic diagram of a vehicle-mounted image display system shown in an embodiment of the present application.

[0043] Figure 3 It is an example diagram of a vehicle-mounted image display device shown in an embodiment of the present application. DETAILED DESCRIPTION

[0044] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0045] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0046] Embodiment 1: Please refer to Figure 1 The vehicle-mounted image display method mainly includes steps S1 to S5.

[0047] Wherein, step S1 includes: detecting the display screen operation state and the vehicle driving state in real time, so as to generate an image display instruction through the cockpit domain controller or the intelligent driving domain controller based on the display screen operation state and the vehicle driving state. The display screen operation state can mainly be the operation state of the driver selecting the vehicle view screen to be viewed on the display screen, and the vehicle driving state can mainly include normal driving state, reversing state and stop state. The image display instruction can mainly include front view display instruction, rear view display instruction, left and right view display instruction and top view display instruction. For example, if the driver's operation state on the display screen is to view the rear view image, the rear view display instruction can be generated according to the display screen operation state. The image display instruction can be generated by the AVM (Around View Monitor, panoramic surround monitoring system) display logic component, and the AVM display logic component can be set in the cockpit domain controller or the intelligent driving domain controller. When the AVM display logic component is set in the cockpit domain controller, the image display instruction can be transmitted to the intelligent driving domain controller through a 200 Gigabit Ethernet link.

[0048] Step S2 includes: obtaining the original image data through the intelligent driving domain controller and performing preliminary processing on the original image data to obtain the initial image data. The preliminary processing may mainly include image correction processing and image stitching processing. The original image data may be mainly collected by multiple surround view cameras. For example, the original image data may be collected by four surround view cameras. The image correction processing may mainly correct the original image data according to the sensor device parameters, for example, the original image data may be corrected according to the correction parameters pre-set in the sensor device. The image stitching processing may mainly perform a stitching operation on the corrected image data based on a preset image stitching algorithm to obtain the initial image data. Those skilled in the art may select different image stitching algorithms according to actual needs, for example, the weighted averaging method and the pyramid fusion method may be used, and the weighted averaging of the overlapping stitching areas may be performed by the weighted averaging method to smooth the stitching boundaries, and the pyramid fusion method may be used to perform layered and gradual fusion so that the details of image data of different resolutions are smoothly transitioned.

[0049] Step S3 includes: transmitting the image display instruction and the initial image data to the screening component of the intelligent driving domain controller or the cockpit domain controller, so as to filter the initial image data through the screening component to obtain display image data. For example, when the image display instruction is a rear view display instruction, the rear view image data is filtered out from the initial image data by controlling the screening component.

[0050] Step S4 includes: when the intelligent driving domain controller is currently performing screening processing, the display image data is transmitted to the image forwarding component of the cockpit domain controller, so that the display image data is transmitted to the display screen through the image forwarding component for display. The intelligent driving domain controller and the cockpit domain controller communicate based on a wired link or a wireless link. The wireless link can be a 200 Gigabit Ethernet link, and the display image data is transmitted based on the 200 Gigabit Ethernet link. Those skilled in the art can use other wireless links according to actual needs, for example, Gigabit Ethernet or Ethernet links with bandwidth rates, such as 100 Mbit Ethernet, 10 Gbit Ethernet and 10 Gbit Ethernet or above. The wired link can be HDMI (High-Definition Multimedia Interface) interface transmission, VGA (Video Graphics Array) interface transmission, and those skilled in the art can choose other transmission methods according to actual conditions, such as WiFi, Bluetooth, and UHF (Ultra High Frequency).

[0051] Step S5 includes: when the cockpit domain controller is currently performing screening processing, the cockpit domain controller directly transmits the display image data to the display screen for display.

[0052] For example, when the vehicle is reversing, the driver needs to view the reversing image data. The driver chooses to view the rear-view image data by operating on the display screen. The display screen operation status and the vehicle driving status are detected in real time in the cockpit domain controller, and a rear-view display instruction is generated based on the display screen operation status and the vehicle driving status. The surround-view camera is controlled by the intelligent driving domain controller to collect original image data, and the original image data is corrected and spliced ​​to obtain initial image data. Based on the rear-view display instruction, the rear-view image data is filtered out from the initial image data by controlling the filtering component. When the intelligent driving domain controller is currently performing the filtering process, the rear-view image data is transmitted to the image forwarding component in the cockpit domain controller via a 200 Gigabit Ethernet link, and the rear-view image data is transmitted to the display screen for display via the image forwarding component.

[0053] In some embodiments, obtaining the original image data through the intelligent driving domain controller includes: The display screen operation status and the vehicle driving status are transmitted to the intelligent driving domain controller, so that the intelligent driving domain controller controls the sensor device to collect vehicle environment data; the vehicle environment data is converted into parallel image data through a deserializer, and the parallel image data is used as the original image data.

[0054] Among them, the intelligent driving domain controller, as the brain of the vehicle's intelligent system, is responsible for coordinating and managing the vehicle's autonomous driving related hardware and software. Based on the display screen operation status and vehicle driving status, the intelligent driving domain controller can control the on-board sensor equipment to collect vehicle environmental data, such as using surround-view cameras, rear cameras, and front-view cameras to collect vehicle environmental data. Vehicle environmental data is usually collected by multiple sensors, and these data are often transmitted to the intelligent driving domain controller in a serial manner. Although serial data transmission is more efficient in hardware and bandwidth, it can be more complicated to process and parse, especially when it comes to large amounts of real-time sensor data. These serial data can be converted into parallel data through a deserializer. The parallel data transmission method can process multiple data channels at the same time, greatly improving the speed and efficiency of data processing.

[0055] Optionally, the preliminary processing includes at least image correction processing and image stitching processing.

[0056] The image correction process includes: correcting the original image data based on preset sensor device parameters.

[0057] The image stitching process includes: performing a stitching operation on the corrected original image data based on a preset image stitching algorithm to obtain the initial image data.

[0058] The purpose of the image correction processing is to eliminate image distortion caused by sensor device hardware, lens distortion and perspective changes, so that the image data is more accurate and consistent. The preset sensor device parameters can mainly be focal length, distortion coefficient, etc., and the original image data can be corrected according to the distortion coefficient. The purpose of the image stitching processing is to synthesize the image data of multiple sensor devices into a complete image, so as to obtain a wider and seamless field of view. The preset image stitching algorithm can mainly include weighted averaging and pyramid fusion. The weighted averaging method is used to weight the overlapping areas to smooth the stitching boundaries, and the pyramid fusion method is used to perform layered and gradual fusion, so that the details of image data with different resolutions are smoothly transitioned. Those skilled in the art can select other image stitching algorithms according to actual needs, and are not limited to this.

[0059] Optionally, the filtering process of the initial image data by the filtering component includes: Based on the image display instruction, the screening component is controlled to screen out corresponding view data from the initial image data as final display image data.

[0060] The image display instructions at least include a front view display instruction, a rear view display instruction, a left view display instruction, a right view display instruction and a top view display instruction.

[0061] The view data at least includes front view image data, rear view image data, left view image data, right view image data and top view image data.

[0062] For example, when the driver needs to view the overhead view, the cockpit domain controller generates the overhead view display instruction, and based on the overhead view display instruction, the filtering component is controlled to filter out the overhead view image data from the initial image data, and the overhead view image data is used as the final display image data.

[0063] Optionally, after acquiring the display image data, the method further includes: Based on a preset visual recognition model, scene information is identified from the displayed image data; based on the scene information, the vehicle is planned and controlled through the intelligent driving domain controller; wherein the scene information includes at least obstacle information, lane line information and road information.

[0064] Among them, the visual recognition model can be a deep learning model, the obstacle information can mainly include pedestrians, other vehicles, animals and roadblocks, etc., and the planning and control based on the scene information mainly includes generating a safe and effective driving route based on the scene information, and controlling the vehicle to drive automatically according to the driving route.

[0065] Optionally, the preset visual recognition algorithm includes: A visual recognition model is constructed based on a deep learning algorithm, historical scene information and historical display image data are obtained, and the visual recognition model is trained based on the historical scene information and historical display image data to obtain a final visual recognition model.

[0066] The visual recognition model may be CNN (Convolutional Neural Network), R-CNN (Region-based Convolutional Neural Network), or YOLO (You Only Look Once). The historical scene information and historical display image data may mainly include historical scene information and historical display image data under a variety of different conditions, such as historical data under different lighting conditions, different weather conditions, and different road scenes.

[0067] Embodiment 2: Please refer to Figure 2 , the present application also proposes a system using the vehicle-mounted image display method described in Example 1, mainly comprising: a cockpit domain control module, an intelligent driving domain control module and a display module, the cockpit domain control module comprising a state detection module, an instruction generation module and an image transmission module, the intelligent driving domain control module comprising a data acquisition module, a preliminary processing module and a data screening module; The state detection module is used to detect the display screen operation state and the vehicle driving state in real time. The display screen operation state mainly refers to the operation performed by the driver on the display screen according to actual needs, for example, the driver selects the rear view image function operation on the display screen. The vehicle driving state may include at least the driving state, the stopping state and the reversing state.

[0068] The data acquisition module is used to acquire raw image data through the intelligent driving domain controller. The intelligent driving domain controller can mainly acquire the raw image data through multiple sensor devices, for example, it can acquire raw image data around the vehicle through four surround view cameras.

[0069] The instruction generation module is used to generate an image display instruction through a cockpit domain controller or an intelligent driving domain controller based on the display screen operation state and the vehicle driving state. The image display instruction can be a front view display instruction, a rear view display instruction, a left view display instruction, a right view display instruction, and a top view display instruction. Those skilled in the art can add other image display instructions according to actual conditions. For example, the image display instruction can also include a left front view display instruction, a right rear view display instruction, etc.

[0070] The preliminary processing module is used to perform preliminary processing on the raw image data to obtain initial image data. The preliminary processing may mainly include image correction processing and image stitching processing. The raw image data is corrected based on sensor device parameters, such as correction parameters and distortion coefficients in the sensor device. The corrected image data is stitched to obtain the initial image data.

[0071] The data screening module is used to transmit the image display instruction and the initial image data to the screening component of the intelligent driving domain controller or the cockpit domain controller, so as to screen and process the initial image data through the screening component to obtain display image data. The display image data can mainly be front view image data, rear view image data, left view image data, right view image data and overhead view image data. For example, when the image display instruction is an overhead view display instruction, the screening component is controlled based on the overhead view display instruction to filter out the overhead view image data from the initial image data as the display image data.

[0072] The image transmission module is used to transmit the display image data to the image forwarding component of the cockpit domain controller when the intelligent driving domain controller is currently performing screening processing, so as to transmit the display image data to the display screen through the image forwarding component; when the cockpit domain controller is currently performing screening processing, the display image data is directly transmitted to the display screen through the cockpit domain controller.

[0073] And, a display module is used to display the display image data through a display screen. The display screen displays the image data that the driver needs to view, so that the driver can view the environmental information around the vehicle through the display screen, thereby improving the driver's use experience.

[0074] Optionally, the intelligent driving domain control module also includes at least a scene recognition module.

[0075] The scene recognition module is used to identify scene information from the displayed image data based on a preset visual recognition model, plan a vehicle's driving path based on the scene information, and control the vehicle's driving through the intelligent driving domain controller based on the driving path. The preset visual recognition model can mainly be a deep learning model pre-constructed by a deep learning algorithm, and the visual recognition model is obtained by training the constructed deep learning model based on historical scene information and historical displayed image data.

[0076] Embodiment three: Please refer to Figure 3 The present application also proposes an electronic device, which is equipped with an intelligent driving domain control module and an intelligent cockpit domain control module, and executes the vehicle-mounted image display method described in Example 1 based on the intelligent driving domain controller and the intelligent cockpit domain controller.

[0077] In the electronic device, the vehicle's environmental image data is mainly collected through multiple sensor devices. Since the environmental image data collected by the sensor devices is serial data, serial data may be more complicated to process and parse. Therefore, it is necessary to convert the collected environmental image data through a deserializer, and perform preliminary processing on the converted data through the intelligent driving domain controller. After filtering and processing through the filtering component, the final display image data is obtained, and the display image data is forwarded to the image forwarding component in the cockpit domain control module. The display image data is forwarded to the display screen for display through the image forwarding component.

[0078] Embodiment 4: The present application also proposes a computer-readable storage medium, the computer-readable storage medium comprising: The computer-readable storage medium stores computer-executable instructions.

[0079] When the computer executable instructions are executed by the control processor, the vehicle-mounted image display method described in Example 1 is implemented.

[0080] In the computer-readable storage medium, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk SolidState Disk (SSD)), etc.

[0081] In summary, the vehicle-mounted image display method proposed in this application solves the technical problems of high complexity and high cost brought by the deserializer and serializer in the prior art, and can obtain the image screen requirements that the driver needs to display in real time by real-time detection of the display screen operation status and the vehicle driving status. By transmitting and displaying image data through a wired link or a wireless link, the image data transmission method using a serializer and a deserializer is abandoned, and the complexity and cost of the vehicle-mounted image display process are reduced. The system instability problem caused by software and hardware failures of the deserializer and the serializer is avoided, and the stability and reliability of the vehicle-mounted image display process are improved. By performing preliminary processing and screening on the original image data, the data processing algorithm is reduced, and the efficiency of the vehicle-mounted image display process is improved. The initial image data is screened and processed by the image display instruction control screening component, so that the image data that the driver needs to view can be accurately transmitted and displayed, which improves the driver's user experience.

[0082] In several embodiments provided in the present application, it is understood that each box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, a program segment or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from that marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved.

[0083] If the function is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can essentially or in other words, the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for an electronic device to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program code.

[0084] The specific embodiments described above further describe the purpose, technical solutions and beneficial effects of the present application in detail. It should be understood that the above description is only a specific embodiment of the present application and is not intended to limit the scope of protection of the present application. It is particularly pointed out that for those skilled in the art, any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of protection of the present application.

Claims

1. A vehicle-mounted image display method, characterized in that: The intelligent driving domain controller and the cockpit domain controller communicate based on a wired link or a wireless link, and the vehicle-mounted image display method includes: Detect the display screen operation status and the vehicle driving status in real time, so as to generate an image display instruction through a cockpit domain controller or an intelligent driving domain controller based on the display screen operation status and the vehicle driving status; Acquire raw image data through the intelligent driving domain controller and perform preliminary processing on the raw image data to obtain initial image data; The image display instruction and the initial image data are transmitted to a screening component of the intelligent driving domain controller or the cockpit domain controller, so that the initial image data is screened by the screening component to obtain display image data; And, when the intelligent driving domain controller is currently performing the screening process, the display image data is transmitted to the image forwarding component of the cockpit domain controller, so that the display image data is transmitted to the display screen through the image forwarding component for display; When the cockpit domain controller is currently performing screening processing, the cockpit domain controller directly transmits the display image data to the display screen for display.

2. The vehicle-mounted image display method according to claim 1, characterized in that: The obtaining of original image data through the intelligent driving domain controller includes: Transmitting the display screen operation status and the vehicle driving status to the intelligent driving domain controller, so as to control the sensor device to collect vehicle environment data according to the intelligent driving domain controller; The vehicle environment data is converted into parallel image data through a deserializer, and the parallel image data is used as the original image data.

3. The vehicle-mounted image display method according to claim 2, characterized in that: The preliminary processing includes at least image correction processing and image stitching processing; Wherein, the image correction processing includes: Correcting the raw image data based on preset sensor device parameters; The image stitching process comprises: The corrected original image data is stitched based on a preset image stitching algorithm to obtain the initial image data.

4. The vehicle-mounted image display method according to claim 3, characterized in that: The filtering process of the initial image data by the filtering component includes: Based on the image display instruction, control the screening component to screen out corresponding view data from the initial image data as final display image data; Wherein, the image display instruction at least includes a front view display instruction, a rear view display instruction, a left view display instruction, a right view display instruction and a top view display instruction; The view data at least includes front view image data, rear view image data, left view image data, right view image data and top view image data.

5. The vehicle-mounted image display method according to claim 4, characterized in that: After acquiring the display image data, the method further includes: Recognizing scene information from the displayed image data based on a preset visual recognition model; Based on the scenario information, the vehicle is planned and controlled by the intelligent driving domain controller; The scene information includes at least obstacle information, lane line information and road information.

6. The vehicle-mounted image display method according to claim 5, characterized in that: The preset visual recognition algorithm includes: Build visual recognition models based on deep learning algorithms; Obtain historical scene information and historical display image data; The visual recognition model is trained based on the historical scene information and the historical display image data to obtain a final visual recognition model.

7. A system based on the vehicle-mounted image display method according to any one of claims 1 to 6, characterized in that: The system comprises: A cockpit domain control module, an intelligent driving domain control module and a display module. The cockpit domain control module includes a state detection module, a command generation module and an image forwarding module. The intelligent driving domain control module includes a data acquisition module, a preliminary processing module and a data screening module. A status detection module is used to detect the display screen operation status and vehicle driving status in real time; A data acquisition module is used to obtain raw image data through the intelligent driving domain controller; An instruction generation module, used to generate an image display instruction through a cockpit domain controller or an intelligent driving domain controller based on the display screen operation state and the vehicle driving state; A preliminary processing module, used for performing preliminary processing on the original image data to obtain initial image data; A data screening module, used for transmitting the image display instruction and the initial image data to a screening component of the intelligent driving domain controller or the cockpit domain controller, so as to screen and process the initial image data through the screening component to obtain display image data; An image transmission module, for transmitting the display image data to an image forwarding component of a cockpit domain controller when the intelligent driving domain controller is currently performing screening processing, so as to transmit the display image data to a display screen through the image forwarding component; and for transmitting the display image data to the display screen directly through the cockpit domain controller when the cockpit domain controller is currently performing screening processing; And, a display module is used to display the display image data through a display screen.

8. The system of the vehicle-mounted image display method according to claim 7, characterized in that: The intelligent driving domain control module also includes at least a scene recognition module; The scene recognition module is used to identify scene information from the displayed image data based on a preset visual recognition model, plan a vehicle's driving path based on the scene information, and control the vehicle's driving through the intelligent driving domain controller based on the driving path.

9. An electronic device, the electronic device is equipped with an intelligent driving domain control module and an intelligent cockpit domain control module, characterized in that: Based on the intelligent driving domain control module and the intelligent cockpit domain control module, the vehicle-mounted image display method as described in any one of claims 1-6 is executed.

10. A computer-readable storage medium storing computer-executable instructions, characterized in that: When the computer executable instructions are executed by the control processor, an in-vehicle image display method as described in any one of claims 1-6 is implemented.

Images