Vehicle-mounted image processing system and automobile

Abstract

The utility model discloses a vehicle-mounted image processing system and an automobile. The vehicle-mounted image processing system comprises a first image acquisition module, a first deserializer, a first serializer, a second serializer, a first display part, a second display part and an image processing module, wherein the output end of the first image acquisition module is connected with the input end of the first deserializer; the first deserializer is provided with two output ends, one output end of the first deserializer is connected with the input end of the first serializer, and the output end of the first serializer is connected with the input end of the first display part; the other output end of the first deserializer is connected with the input end of the image processing module, the output end of the image processing module is connected with the input end of the second serializer, and the output end of the second serializer is connected with the input end of the second display part. According to the scheme disclosed by the utility model, the cost of the driving and parking integrated domain controller can be reduced, the image processing speed is improved, the real-time performance of image display of an image output system is improved, and the driving safety is improved.

Description

Technical Field

[0001] The utility model relates to the technical field of image processing, and in particular to a vehicle-mounted image processing system for integrated driving and parking and a vehicle comprising the same. Background Art

[0002] Smart cars are modern means of transportation. With the continuous development of smart car technology and the popularization of vehicle networking, people's requirements for driving safety and the stability of smart car systems are constantly increasing. As a key part of the on-board assisted driving system, the on-board camera can provide the driver with a full range of vision and provide images for the smart on-board assisted driving system to accurately judge the vehicle's driving status, greatly improving driving safety.

[0003] In current assisted driving cars, the mainstream intelligent driving on-board camera solutions basically use a multi-channel video signal to be transmitted to the driving chip through an interface after passing through a video decoding chip for processing, and then the processed video signal is output for display. However, there are also the following problems: (1) The driving chip has to process a large amount of data, which causes overheating and performance degradation. It cannot maintain a fast image processing speed, and is prone to freezes and freezes, which affects the speed of image generation; (2) Image processing takes a certain amount of time, and the processed image data is displayed again, which has a delay, making the real-time performance of the image display poor, posing a driving safety hazard; (3) The driving chip hardware and software resources are high.

[0004] In the prior art, a patent with publication number CN108632547A discloses a multi-channel video preprocessing method. Although it provides a multi-channel video preprocessing method with good flexibility and strong real-time performance, there are still problems such as the driving chip having to process multi-channel video data, resulting in performance degradation and slow processing speed.

[0005] In the existing technology, high-end intelligent driving chips are expensive, and low-end intelligent driving chips are unable to process surround and forward-looking video images at the same time. In addition, due to limited computing power, the processing speed of huge raw image data is slow, resulting in delays in image display, which poses a safety hazard to driving. Utility Model Content

[0006] The purpose of the utility model is to solve the problems existing in the prior art that high-end intelligent driving chips are expensive, low-end intelligent driving chips are unable to simultaneously process surround and forward-looking video images, and are limited by computing power, so the speed of processing huge raw image data is slow, resulting in delays in image display, which poses a safety hazard to driving.

[0007] In order to solve the above technical problems, an embodiment of the utility model discloses a vehicle-mounted image processing system, which includes a first image acquisition module, a deserialization module, an image processing module, a serial module and a display module; wherein the deserialization module includes a first deserializer; the serial module includes a first serializer and a second serializer; the display module includes a first display unit and a second display unit; wherein the output end of the first image acquisition module is connected to the input end of the first deserializer; the first deserializer has two output ends, one of the output ends of the first deserializer is connected to the input end of the first serializer, and the output end of the first serializer is connected to the input end of the first display unit; the other output end of the first deserializer is connected to the input end of the image processing module, the output end of the image processing module is connected to the input end of the second serializer, and the output end of the second serializer is connected to the input end of the second display unit.

[0008] By adopting the above technical solution, the image acquisition module obtains image data and outputs it to the display unit for display via the deserializer and the serializer. The output is performed without any processing, which reduces the workload of the image processing module, improves the working efficiency of the image processing module, reduces power consumption, and increases the speed of processing raw image data. Furthermore, the image display time is shortened as a whole, so that the display can display the image quickly, ensuring the real-time display of the on-board image data, reducing the delay of the image display, and enabling the driver to understand the driving environment of the vehicle in real time, thereby ensuring driving safety. Therefore, through the solution disclosed in the present application, the image data processing requirements can be met by using a low-end intelligent driving chip, which can reduce the cost of the integrated driving and parking domain controller while also improving the image processing speed and the real-time performance of the image display of the image output system, thereby improving driving safety.

[0009] According to another specific embodiment of the utility model, the vehicle-mounted image processing system disclosed in the embodiment of the utility model also includes a second image acquisition module and an output switching module; and the deserialization module also includes a second deserializer; wherein the output end of the second image acquisition module is connected to the input end of the second deserializer; the output switching module includes two input ends, one of the input ends of the output switching module is connected to the output end of the first deserializer, and the other input end of the output switching module is connected to the output end of the second deserializer; the output end of the output switching module outputs the signal from the first deserializer or the signal from the second deserializer to the image processing module; the output end of the image processing module is connected to the input end of the second serializer, and the output end of the second serializer is connected to the input end of the second display.

[0010] With the above technical solution, the input end of the output switching module receives two signals from the first deserializer and the second deserializer, but the output end only sends one of the signals to the image processing module, so that the image processing module only needs to set one input interface for the output end of the output switching module, and no additional data interface is required, which reduces the cost of the image processing module, and can perform normal data processing through a low-cost image processing module. In addition, the image processing module processes this signal, which reduces the task of the image processing module, improves the working efficiency of the image processing module, reduces power consumption, and saves hardware resources of the image processing module. For example, when the output switching module receives the surround video image collected by the first image acquisition module and the forward video image collected by the second image acquisition module, the output switching module only outputs one of the image data to the image processing module, and the image processing module only processes one of the surround video images or the forward video images received by the output switching module. Therefore, the image processing module can use a low-end intelligent driving chip, and when only one video data is processed, the processing speed is also faster, which can ensure that the image is displayed in real time.

[0011] According to another specific embodiment of the present utility model, in the vehicle-mounted image processing system disclosed in the embodiment of the present utility model, the serial module also includes a third serializer, and the display module also includes a third display unit; wherein the second deserializer includes two output ends, one of the output ends of the second deserializer is connected to the input end of the output switching module, the other output end of the second deserializer is connected to the input end of the third serializer, and the output end of the third serializer is connected to the input end of the third display unit.

[0012] By adopting the above technical solution, the second image acquisition module acquires image data and sends it to the second deserializer, which then sends the image data to the third serializer. The third serializer can display the image data in real time through the third display unit, and the image data can be displayed in real time without any processing, thereby saving hardware resources and reducing overall power consumption. Different image data collected are classified and displayed, for example, surround video images and forward video images can be displayed at the same time, so that the driver can clearly view the driving environment of the vehicle, and the images are displayed on different display units with higher clarity and better display effect.

[0013] According to another specific embodiment of the present utility model, the vehicle-mounted image processing system disclosed in the embodiment of the present utility model is characterized in that it also includes a first image processor and / or a second image processor; wherein the input end of the first image processor is connected to the output end of the first deserializer, and the output end of the first image processor is connected to the input end of the output switching module; the input end of the second image processor is connected to the output end of the second deserializer, and the output end of the second image processor is connected to the input end of the output switching module.

[0014] With the above technical solution, the first image processor and / or the second image processor are arranged behind the deserializer, and the deserializer first processes the image to some extent, which reduces the workload of the image processor and improves the speed of image processing; and the first image processor and / or the second image processor can perform noise reduction and white balance processing on the received image data; the original image data can be improved by noise reduction processing, and the problem of image quality degradation caused by noise interference in the original image data is solved, which can effectively improve the image quality, increase the signal-to-noise ratio, and better reflect the signal carried by the original image data. By adjusting the white balance processing, the color temperature and color balance of the original image data can be adjusted, and the color gain of the original image can be adjusted to eliminate the influence of different light sources (such as natural light, fluorescent light, etc.) on the color, thereby avoiding the color difference problem and making the color of the original image data more real and natural.

[0015] According to another specific embodiment of the present utility model, the vehicle-mounted image processing system disclosed in the embodiment of the present utility model also includes a third image processor and / or a fourth image processor; wherein the input end of the third image processor is connected to the output end of the first image acquisition module, and the output end of the third image processor is connected to the input end of the first deserializer; the input end of the fourth image processor is connected to the output end of the second image acquisition module, and the output end of the fourth image processor is connected to the input end of the second deserializer.

[0016] By adopting the above technical solution, the third image processor and / or the fourth image processor are arranged behind the image acquisition module, and the image processor processes the most original image acquired by the image acquisition module, thereby ensuring the clarity of the image data and improving the quality of image processing; and the third image processor and / or the fourth image processor can perform noise reduction and white balance processing on the received image data; the original image data can be improved by noise reduction processing, and the problem of image quality degradation caused by noise interference in the original image data is solved, which can effectively improve the image quality, increase the signal-to-noise ratio, and better reflect the signal carried by the original image data. By adjusting the white balance processing, the color temperature and color balance of the original image data can be adjusted, and the color gain of the original image can be adjusted to eliminate the influence of different light sources (such as natural light, fluorescent light, etc.) on the color, thereby avoiding the color difference problem and making the color of the original image data more real and natural.

[0017] According to another specific embodiment of the present utility model, the vehicle-mounted image processing system disclosed in the embodiment of the present utility model also includes a fifth image processor and / or a sixth image processor; wherein the fifth image processor is integrated with the first image acquisition module, and the sixth image processor is integrated with the second image acquisition module.

[0018] By adopting the above technical solution, the fifth image processor and / or the sixth image processor are integrated with the image acquisition module, which can save hardware space. The image processor can quickly process the image data collected by the image acquisition module, thereby improving the speed of image processing; the fifth image processor and / or the sixth image processor can also perform noise reduction and white balance processing on the received image data; the original image data can be improved by noise reduction processing, and the problem of image quality degradation caused by noise interference in the original image data is solved, which can effectively improve the image quality, increase the signal-to-noise ratio, and better reflect the image signal carried by the original image data. By adjusting the white balance processing, the color temperature and color balance of the original image data can be adjusted, and the color gain of the original image can be adjusted to eliminate the influence of different light sources (such as natural light, fluorescent light, etc.) on the color, thereby avoiding the color difference problem and making the color of the original image data more real and natural.

[0019] According to another specific embodiment of the present utility model, in the vehicle-mounted image processing system disclosed in the embodiment of the present utility model, the image processing module only includes one input end and one output end; wherein the output switching module is connected to the image processing module via the input end of the image processing module; and the second serializer is connected to the image processing module via the output end of the image processing module.

[0020] By adopting the above technical solution, the image processing module only includes one input end and one output end, so that the cost of the image acquisition module is lower, thereby reducing the cost of vehicle parts; one input end of the image processing module can only receive one image data input, and when processing one image data, the processing speed is faster and the processing effect is better; and the input port and output port of the image processing module are based on data transmission, with the characteristics of high-speed transmission, low power consumption, small size, high reliability and flexibility. When video data is transmitted via the input end and the output end, the transmission speed is faster and the power consumption is lower.

[0021] According to another specific embodiment of the utility model, in the vehicle-mounted image processing system disclosed in the embodiment of the utility model, the image processing module also includes: an interface for data configuration respectively connected to the output switching module, the first deserializer, the second deserializer, the first serializer, the second serializer, the third serializer, the first image processor and the second image processor.

[0022] By adopting the above technical solution, the image processing module sets the transmission rate, interface mode, transmission channel and transmission frequency of each component via the data configuration interface, which can better coordinate the work of each component and ensure that each component can work together efficiently, thereby improving the overall performance.

[0023] According to another specific embodiment of the present utility model, in the vehicle-mounted image processing system disclosed in the embodiment of the present utility model, the first image acquisition module includes at least one surround-view camera; the second image acquisition module includes a front-view camera or a vehicle-mounted camera; the first display unit, the second display unit and the third display unit are all vehicle-mounted display screens.

[0024] By adopting the above technical solution, the surround camera collects image data around the vehicle, which can provide an ultra-wide-angle field of view and generate a panoramic image, which can help the driver see the situation around the vehicle more clearly, avoid collisions, and improve driving safety. The front-view camera or the on-board camera collects image data in front of the vehicle, which can help the driver better understand the road conditions, traffic signs and markings in front of the vehicle, so that the vehicle can drive more safely.

[0025] The embodiment of the utility model also discloses a car including a car-mounted image processing system.

[0026] The beneficial effects of the utility model are:

[0027] The vehicle-mounted image processing system disclosed by the utility model has an image acquisition module that obtains image data and outputs it to a display unit for display via a deserializer and a serializer, and outputs it without any processing, thereby reducing the task load of the image processing module, improving the working efficiency of the image processing module, and reducing power consumption; the image display time is shortened as a whole, so that the display can quickly display the image, ensuring the real-time display of the vehicle-mounted image data, reducing the delay of the image display, allowing the driver to understand the driving environment of the vehicle in real time, and ensuring driving safety; further, the input end of the output switching module receives two-way signals from the first deserializer and the second deserializer , but the output end only sends one of the signals to the image processing module. Therefore, the image processing module only needs to set up an input interface for the output end of the output switching module, and there is no need to set up an additional data interface, which reduces the cost of the image processing module and can perform normal data processing through a low-cost image processing module; and the image processing module only processes this signal, which reduces the workload of the image processing module, improves the work efficiency of the image processing module, reduces power consumption, and saves hardware resources of the image processing module; further, this solution reduces the cost of the intelligent driving chip, thereby reducing the cost of vehicle parts, so that passengers can enjoy an affordable intelligent driving experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 A schematic diagram of the structure of the vehicle-mounted image processing system provided in Example 1 of the utility model;

[0029] Figure 2 Another structural schematic diagram of the vehicle-mounted image processing system provided in Embodiment 1 of the utility model;

[0030] Figure 3 Another structural schematic diagram of the vehicle-mounted image processing system provided in Embodiment 1 of the utility model;

[0031] Figure 4 Another structural schematic diagram of the vehicle-mounted image processing system provided in Embodiment 1 of the utility model;

[0032] Figure 5 Another structural schematic diagram of the vehicle-mounted image processing system provided in Example 1 of the utility model.

[0033] Description of reference numerals:

[0034] 101. A first image acquisition module; 102. A first deserializer; 103. A first serializer; 104. A first display unit; 105. An image processing module; 106. A second serializer; 107. A second display unit; 108. A second image acquisition module; 109. A second deserializer; 110. An output switching module; 111. A third serializer; 112. A third display unit; 113. A first image processor; 114. A second image processor; 115. A third image processor; 116. A fourth image processor. DETAILED DESCRIPTION

[0035] In order to make the purpose, technical solution and advantages of the present invention more clear, the implementation mode of the present invention will be further described in detail below with reference to the accompanying drawings.

[0036] Example 1

[0037] The utility model discloses a vehicle-mounted image processing system, please refer to Figure 1 The vehicle-mounted image processing system includes a first image acquisition module 101, a first deserializer 102, an image processing module 105, a first serializer 103 and a second serializer 106, a first display unit 104 and a second display unit 107; wherein the output end of the first image acquisition module 101 is connected to the input end of the first deserializer 102; the first deserializer 102 has two output ends, one of the output ends of the first deserializer 102 is connected to the input end of the first serializer 103, and the output end of the first serializer 103 is connected to the input end of the first display unit 104; the other output end of the first deserializer 102 is connected to the input end of the image processing module 105, the output end of the image processing module 105 is connected to the input end of the second serializer 106, and the output end of the second serializer 106 is connected to the input end of the second display unit 107.

[0038] Specifically, in this embodiment, the first image acquisition module 101 is at least one camera, for example, it can be a surround-view camera located above the vehicle; it can also be four surround-view cameras, two of which are located on both sides of the rearview mirror of the vehicle, and the other two surround-view cameras are located on both sides of the rear of the vehicle, as long as it can capture the environmental images around the vehicle.

[0039] Specifically, in this embodiment, the connection mode may be a communication connection or an electrical connection, as long as the transmission of data signals can be achieved.

[0040] Specifically, in this embodiment, the first deserializer 102 is a video deserializer. In serial communication, data bits are transmitted in time sequence, and in parallel communication, data bits are transmitted simultaneously. The deserializer converts serial data into parallel data for subsequent data processing and analysis. The video deserializer has high-speed performance and stable clock synchronization capabilities, and can also adapt to different communication standards and protocols; the first serializer 103 and the second serializer 106 are video serializers. The serializer can merge multiple parallel data streams into a high-speed serial data stream, thereby reducing the number of cables required for transmission and the cost of communication media, and integrating multi-channel serializers / deserializers together can greatly improve the communication capability of this interface circuit.

[0041] Specifically, in this embodiment, the image processing module 105 is a SOC (System On Chip) processor, which has the characteristics of strong performance, low power consumption and high flexibility. The SOC processor has obvious advantages in performance and power consumption, and can meet the diversified computing needs of mobile processors. The combination of various processors can greatly improve the response speed of various functions of mobile devices; various chips can be built into the SOC processor, and the SOC processor has different external device interfaces on the external connection. The utility model does not specifically limit the model of the image processing module 105, that is, the SOC processor, but through the solution disclosed in this application, the image data processing requirements can be met by using a low-end intelligent driving chip, and the low-end intelligent driving chip processes data quickly, which can enable real-time display of images.

[0042] Specifically, in this embodiment, the first display unit 104 and the second display unit 107 are display screens of the vehicle entertainment host. The same display screen can be used to split the video data, or two different display screens can be used to display the video data respectively.

[0043] For example, in a specific embodiment, the first image acquisition module 101 is four surround view cameras, such as surround view cameras of model GMSL1 or GMSL2, wherein two surround view cameras are respectively located on both sides of the rearview mirror of the vehicle, and the other two surround view cameras are respectively located on both sides of the rear of the vehicle, for collecting video data around the vehicle, and sending the collected serial video data to the first deserializer 102 through the I2C bus; the first deserializer 102 is a video deserialization chip, such as the video deserialization chip MAX96722 of Maxim, the first deserializer 102 first converts the received serial video data into parallel video data, that is, converts the original video data collected by the surround view camera into DPHY data of MIPI CSI-2; then aggregates and replicates the converted parallel video data, aggregation is to compress the parallel video data without losing the data value as much as possible, and replication is to replicate the parallel video data into two parallel video data, one of which is transmitted through one of the MIPI CSI-2 D-PHY ports A of the first deserializer 102 via mipi The CSI-2 bus is sent to the first serializer 103, and the other parallel video data is sent to the image processing module 105 via the mipi CSI-2 bus through one of the MIPI CSI-2 D-PHY ports B of the first deserializer 102. The first serializer 103 is a video serializer, such as the video serializer DS90UB953 of TI. After receiving the parallel video data, the first serializer 103 converts the parallel video data into serial video data, and connects it to the first display unit 104 through a coaxial cable for display; the first display unit 104 is a display screen of the vehicle entertainment host in the vehicle, and the display screen displays the images around the vehicle collected by the surround camera; the image processing module 105 is an intelligent driving main chip SOC. After receiving the parallel video data, the image processing module 105 identifies the landmarks through the perception algorithm to plan and control driving and parking, and sends the processed parallel video data to the second serializer 106 via the mipi CSI-2 bus; the second serializer 106 is a video serializer, such as the video serializer DS90UB953 of TI. After receiving the parallel video data, the second serializer 106 converts the parallel video data into serial video data, and connects it to the second display unit 107 through a coaxial cable for display. The second display unit 107 is a display screen of an in-vehicle entertainment host in the vehicle, and the display screen displays video image data after driving and parking planning.

[0044] By adopting the above scheme, the image acquisition module obtains image data and outputs it to the display unit for display via the deserializer and serializer. The output is performed without any processing, which reduces the task workload of the image processing module, improves the working efficiency of the image processing module, reduces power consumption, and increases the speed of processing the original image data. Therefore, the image processing module 105 adopts a low-end driving chip to realize the processing requirements of the original image data; further, the image display time is shortened as a whole, so that the display can display the image quickly, ensuring the real-time display of the on-board image data, reducing the delay of the image display, and enabling the driver to understand the driving environment of the vehicle in real time, thereby ensuring driving safety; therefore, through the scheme disclosed in the present application, the use of a low-end intelligent driving chip can meet the image data processing requirements, while reducing the cost of the integrated driving and parking domain controller, it can also improve the image processing speed and enhance the real-time performance of the image display of the image output system, thereby improving driving safety.

[0045] Regarding the structure and connection method of the vehicle-mounted image processing system, based on the above embodiment, as a further preferred embodiment, the implementation of this embodiment also discloses a vehicle-mounted image processing system, please refer to Figure 2 The vehicle-mounted image processing system also includes a second image acquisition module 108, a second deserializer 109, and an output switching module 110; wherein the output end of the second image acquisition module 108 is connected to the input end of the second deserializer 109; the output switching module 110 includes two input ends, one of the input ends of the output switching module 110 is connected to the output end of the first deserializer 102, and the other input end of the output switching module 110 is connected to the output end of the second deserializer 109; the output end of the output switching module 110 outputs the signal from the first deserializer 102 or the signal from the second deserializer 109 to the image processing module 105; the output end of the image processing module 105 is connected to the input end of the second serializer 106, and the output end of the second serializer 106 is connected to the input end of the second display unit 107.

[0046] Specifically, in this embodiment, the second image acquisition module 108 is a front-view camera or a vehicle-mounted electronic camera, which is arranged at the front center of the vehicle and is used to collect image data directly in front of the vehicle; the output switching module 110 is a high-speed signal multiplexer, which transmits video data at a fast speed and is not prone to frame loss when transmitting high-frequency video data, so that the transmitted data is more complete; the high-speed signal multiplexer includes a certain number of data inputs and multiple address inputs, but has a separate output to output different selected signals; and the multiplexer makes full use of the capacity of the communication channel, greatly reducing the cost of the system.

[0047] With the above solution, the input end of the output switching module receives two signals from the first deserializer and the second deserializer, but the output end only sends one of the signals to the image processing module. Therefore, the image processing module only needs to set one input interface for the output end of the output switching module, and no additional data interface is required, which reduces the cost of the image processing module and can perform normal data processing through a low-cost image processing module. In addition, the image processing module only processes this signal, which reduces the task of the image processing module, improves the working efficiency of the image processing module, reduces power consumption, and saves hardware resources of the image processing module. For example, when the output switching module receives the two image data of the surround video image collected by the first image acquisition module and the front video image collected by the second image acquisition module, the output switching module only outputs one of the image data to the output switching module, and the image processing module only processes one of the surround video or front video images received by the output switching module. Therefore, the image processing module can use a low-end intelligent driving chip, and when only one video data is processed, the data processing speed is also faster, which can ensure real-time display of the image.

[0048] For example, in one specific embodiment, the second image acquisition module 108 is an electronic vehicle camera or a front-view camera, such as an electronic vehicle camera, which is located in the middle of the front of the vehicle and is used to collect video data in front of the vehicle, and send the collected serial video data to the second deserializer 109 via the I2C bus; the second deserializer 109 is a video deserialization chip, such as the video deserializer DS90UB954 of TI, and the second deserializer 109 converts the received serial video data into parallel video data, that is, converts the original video data collected by the front-view camera into DPHY data of MIPI CSI-2, and then transmits the received serial video data to the second deserializer 109 via the mipi The CSI-2 bus sends the parallel video data to the output switching module 110; the output switching module 110 is a high-speed signal multiplexer, such as a high-speed signal multiplexer of TI's TS3DV642-Q1. The output switching module 110 receives the parallel video data from the first deserializer 102 and the parallel video data from the second deserializer 109. The image processing module 105 sends instructions to the output switching module 110 via the I2C bus according to the actual scene requirements. After receiving the instructions, the output switching module 110 controls the switching of the video signals of the surround view camera and the front view camera, that is, the output switching module 110 only outputs the signal from the first deserializer 102 or the signal from the second deserializer 109 to the image processing module 105; for example, the vehicle needs to park and needs to display the environmental images around the vehicle. At this time, the image processing module 105 sends instructions to the output switching module 110 via the I2C bus. After receiving the instructions, the output switching module 110 controls the switching to the surround view camera, that is, the image processing module 105 sends instructions to the image processing module 105 via the mipi The CSI-2 bus sends video data of the vehicle's surroundings collected by the surround-view camera; for another example, the vehicle needs a driving recorder display, and needs to display the environmental image directly in front of the vehicle. At this time, the image processing module 105 sends an instruction to the output switching module 110 via the I2C bus. After receiving the instruction, the output switching module 110 controls the switching to the front-view camera, that is, sends the video data directly in front of the vehicle collected by the front-view camera to the image processing module 105 via the mipi CSI-2 bus.The image processing module 105 is a smart driving main chip SOC. After receiving the parallel video data sent from the first deserializer 102 or the parallel video data sent by the second deserializer 109, the image processing module 105 plans and controls driving and parking after identifying the markers through the perception algorithm, and sends the processed parallel video data to the second serializer 106 via the mipi CSI-2 bus; the second serializer 106 is a video serializer, such as the video serializer DS90UB953 of TI. After receiving the parallel video data, the second serializer 106 converts the parallel video data into serial video data, and connects it to the second display unit 107 through a coaxial cable for display; the second display unit 107 is a display screen of the in-vehicle entertainment host in the vehicle, and the display screen displays the video image data around the vehicle after driving and parking planning or the video data directly in front of the vehicle recorded and displayed by the driving recorder.

[0049] The embodiment of the utility model discloses a vehicle-mounted image processing system, please refer to Figure 3 , and also includes a third serializer 111 and a third display unit 112; wherein the second deserializer 109 includes two output ends, one of the output ends of the second deserializer 109 is connected to the input end of the output switching module 110, the other output end of the second deserializer 109 is connected to the input end of the third serializer 111, and the output end of the third serializer 111 is connected to the input end of the third display unit 112.

[0050] With the above scheme, the second image acquisition module acquires image data and sends it to the second deserializer, which then sends the image data to the third serializer. The third serializer can display the image data in real time through the third display unit, and the image data can be displayed in real time without any processing, thereby saving hardware resources and reducing overall power consumption. Different image data collected are classified and displayed, for example, surround video images and forward video images can be displayed at the same time, so that the driver can clearly view the driving environment of the vehicle, and the images are displayed on different display units with higher clarity and better display effect.

[0051] For example, in a specific embodiment, the second image acquisition module 108 is a front-view camera or an electronic vehicle-mounted camera, such as an electronic vehicle-mounted camera, which is located in front of the vehicle and is used to collect video data in front of the vehicle, and send the collected serial video data to the second deserializer 109 through the I2C bus; the second deserializer 109 is a video deserialization chip, such as the video deserialization chip MAX96722 of Maxim, and the second deserializer 109 first converts the received serial video data into parallel video data, that is, converts the original video data collected by the front-view camera into DPHY data of MIPI CSI-2; then aggregates and replicates the converted parallel video data, aggregation is to compress the parallel video data without losing the data value as much as possible, and replication is to replicate the parallel video data into two parallel video data, one of which is sent to the third serializer 111 through the mipiCSI-2 bus through one of the MIPI CSI-2 D-PHY ports A of the second deserializer 109, and the other is sent to the third serializer 111 through one of the MIPI The D-PHY port B of CSI-2 is sent to the output switching module 110 via the mipi CSI-2 bus. The third serializer 111 is a video serializer, such as the video serializer DS90UB953 of TI. After receiving the parallel video data, the third serializer 111 converts the parallel video data into serial video data, and connects it to the third display unit 112 through a coaxial cable for display; the third display unit 112 is the display screen of the vehicle entertainment host in the vehicle, and the display screen displays the video image directly in front of the vehicle captured by the front-view camera.

[0052] The embodiment of the utility model discloses a vehicle-mounted image processing system, please refer to Figure 4 , also includes a first image processor 113 and / or a second image processor 114; wherein the input end of the first image processor 113 is connected to the output end of the first deserializer 102, and the output end of the first image processor 113 is connected to the input end of the output switching module 110; the input end of the second image processor 114 is connected to the output end of the second deserializer 109, and the output end of the second image processor 114 is connected to the input end of the output switching module 110.

[0053] For example, in one specific embodiment, two image processors may be provided simultaneously, namely, a first image processor 113 and a second image processor 114, and the first image processor 113 and the second image processor 114 respectively perform image processing on the video data output by the first deserializer 102 and the second deserializer 109; or only one first image processor 113 may be provided, namely, the first image processor 113 performs image processing on the video data output by the first deserializer 102; or only one second image processor 114 may be provided, namely, the second image processor 114 performs image processing on the video data output by the second deserializer 109.

[0054] With the above solution, the first image processor and / or the second image processor are arranged behind the deserializer, and the deserializer first processes the image to some extent, which reduces the workload of the image processor and improves the speed of image processing; and the first image processor and / or the second image processor can perform noise reduction and white balance processing on the received image data; the original image data can be improved by noise reduction processing, and the problem of image quality degradation caused by noise interference in the original image data is solved, which can effectively improve the image quality, increase the signal-to-noise ratio, and better reflect the signal carried by the original image data. By adjusting the white balance processing, the color temperature and color balance of the original image data can be adjusted, and the color gain of the original image can be adjusted to eliminate the influence of different light sources (such as natural light, fluorescent light, etc.) on the color, thereby avoiding the color difference problem and making the color of the original image data more real and natural.

[0055] The embodiment of the utility model discloses a vehicle-mounted image processing system, please refer to Figure 5 , also includes a third image processor 115 and / or a fourth image processor 116; wherein the input end of the third image processor 115 is connected to the output end of the first image acquisition module 101, and the output end of the third image processor 115 is connected to the input end of the first deserializer 102; the input end of the fourth image processor 116 is connected to the output end of the second image acquisition module 108, and the output end of the fourth image processor 116 is connected to the input end of the second deserializer 109.

[0056] For example, in one specific embodiment, two image processors, namely, a third image processor 115 and a fourth image processor 116, may be provided at the same time, and the third image processor 115 and the fourth image processor 116 respectively perform image processing on the video data output by the first image acquisition module 101 and the second image acquisition module 108; or only one image processor, namely, the third image processor 115, may be provided, and the third image processor 115 may perform image processing on the video data output by the first image acquisition module 101; or only one image processor, namely, the fourth image processor 116, may be provided, and the fourth image processor 116 may perform image processing on the video data output by the second image acquisition module 108.

[0057] With the above scheme, the third image processor and / or the fourth image processor are arranged behind the image acquisition module, and the image processor processes the most original image acquired by the image acquisition module, thereby ensuring the clarity of the image data and improving the quality of image processing; and the third image processor and / or the fourth image processor can perform noise reduction and white balance processing on the received image data; the original image data can be improved by noise reduction processing, and the problem of image quality degradation caused by noise interference in the original image data is solved, which can effectively improve the image quality, increase the signal-to-noise ratio, and better reflect the signal carried by the original image data. By adjusting the white balance processing, the color temperature and color balance of the original image data can be adjusted, and the color gain of the original image can be adjusted to eliminate the influence of different light sources (such as natural light, fluorescent light, etc.) on the color, thereby avoiding the color difference problem and making the color of the original image data more real and natural.

[0058] An embodiment of the utility model discloses a vehicle-mounted image processing system, which also includes a fifth image processor and / or a sixth image processor; wherein the fifth image processor is integrated with the first image acquisition module set 101, and the sixth image processor is integrated with the second image acquisition module 108.

[0059] For example, in one specific embodiment, two image processors, namely, a fifth image processor and a sixth image processor, may be provided at the same time, the fifth image processor is integrated with the first image acquisition module set 101, and the sixth image processor is integrated with the second image acquisition module 108, and the fifth image processor and the sixth image processor respectively perform image processing on the video data acquired by the first image acquisition module 101 and the second image acquisition module 108; or only one image processor, namely, the fifth image processor, may be provided, the fifth image processor is integrated with the first image acquisition module set 101, and the video data acquired by the first image acquisition module 101 is image processed; or only one image processor, namely, the sixth image processor, is provided, the sixth image processor is integrated with the second image acquisition module set 108, and the video data acquired by the second image acquisition module 108 is image processed.

[0060] By adopting the above scheme, the fifth image processor and / or the sixth image processor are integrated with the image acquisition module, which can save space. The image processor can quickly process the image data collected by the image acquisition module, thereby improving the speed of image processing; the fifth image processor and / or the sixth image processor can also perform noise reduction and white balance processing on the received image data; the original image data can be improved by noise reduction processing, and the problem of image quality degradation caused by noise interference in the original image data can be solved, which can effectively improve the image quality, increase the signal-to-noise ratio, and better reflect the image signal carried by the original image data. By adjusting the white balance processing, the color temperature and color balance of the original image data can be adjusted, and the color gain of the original image can be adjusted to eliminate the influence of different light sources (such as natural light, fluorescent light, etc.) on the color, thereby avoiding the color difference problem and making the color of the original image data more real and natural.

[0061] Specifically, in this embodiment, the first image processor 113, the second image processor 114, the third image processor 115, the fourth image processor 116, the fifth image processor, and the sixth image processor are ISP (Image Signal Processor) processors, i.e., image signal processors, which are mainly used to post-process the signals output by the front-end image sensor, and their main functions include linear correction, noise removal, bad pixel removal, interpolation, white balance, automatic exposure control, etc. The utility model does not specifically limit the model of the image processor, i.e., the ISP processor, as long as it can process the image and improve the image quality.

[0062] An embodiment of the utility model discloses a vehicle-mounted image processing system, wherein the image processing module 105 includes only one input end and one output end; wherein the output switching module 110 is connected to the image processing module 105 via the input end of the image processing module 105; and the second serializer 106 is connected to the image processing module 105 via the output end of the image processing module 105.

[0063] Specifically, in this embodiment, the image processing module 105 is a SOC processor, and the external connection interface of the SOC processor includes a MIPI input terminal and a MIPI output terminal. The output switching module 110 inputs video data to the neural network processing unit inside the SOC processor through the MIPI port to process the video data; at the same time, the processed video data is output to the second serializer 106 through the MIPI port; and the MIPI port has the characteristics of high-speed transmission, low power consumption, small size, high reliability and flexibility based on data transmission.

[0064] By adopting the above scheme, the image processing module only includes one input end and one output end, so that the cost of the image acquisition module is lower, thereby reducing the cost of vehicle parts; one input end of the image processing module can only receive one image data input, and when processing one image data, the processing speed is faster and the processing effect is better; and the input port and output port of the image processing module are based on data transmission, and have the characteristics of high-speed transmission, low power consumption, small size, high reliability and flexibility. When video data is transmitted via the input end and the output end, the transmission speed is faster and the power consumption is lower.

[0065] An embodiment of the utility model discloses a vehicle-mounted image processing system, wherein the image processing module 105 also includes: an interface for respectively connecting to the output switching module 110, the first deserializer 102, the second deserializer 109, the first serializer 103, the second serializer 106, the third serializer 111, the first image processor 113 and the second image processor 114 for data configuration.

[0066] Specifically, in the present embodiment, the image processing module 105 is connected to the first output switching module 110 via the I2C bus through the data configuration interface, is connected to the first deserializer 102 via the I2C bus, is connected to the second deserializer 109 via the I2C bus, is connected to the first serializer 103 via the I2C bus, is connected to the second serializer 106 via the I2C bus, is connected to the third serializer 111 via the I2C bus, is connected to the first image processor 113 via the I2C bus, and is connected to the second image processor 114 via the I2C bus; the image processing module 105 is configured with each component via the I2C bus, and sets the data transmission rate, interface connection mode, data transmission channel, and data transmission frequency between each component.

[0067] By adopting the above scheme, the image processing module sets the transmission rate, interface mode, transmission channel and transmission frequency of each component via the data configuration interface, which can better coordinate the work of each component and ensure that each component can work together efficiently, thereby improving the overall performance.

[0068] The embodiment of the utility model discloses a vehicle-mounted image processing system, wherein the first image acquisition module 101 includes at least one surround-view camera; the second image acquisition module 108 includes a front-view camera or a vehicle-mounted camera; the first display unit 104, the second display unit 107 and the third display unit 112 are all display screens of the vehicle-mounted entertainment host.

[0069] Specifically, in this embodiment, the first image acquisition module 101 is at least one camera, which can be a surround-view camera located above the vehicle; or it can be four surround-view cameras, two of which are located on both sides of the rearview mirror of the vehicle, and the other two are located on both sides of the rear of the vehicle, as long as it can capture the environmental image around the vehicle; the second image acquisition module 108 is a front-view camera or a vehicle-mounted electronic camera, which is arranged at the front center of the vehicle and is used to capture image data directly in front of the vehicle; the first display unit 104, the second display unit 107 and the third display unit 112 can be the same display screen for split-screen display of video data, or can be three different display screens, and video data can be displayed on three different display screens respectively.

[0070] With the above solution, the surround camera collects image data around the vehicle, which can provide an ultra-wide-angle field of view and generate panoramic images, which can help the driver see the situation around the vehicle more clearly, avoid collisions, and improve driving safety. The front-view camera or the on-board camera collects image data in front of the vehicle, which can help the driver better understand the road conditions, traffic signs, markings and other information in front of the vehicle, allowing the driver to drive more safely.

[0071] Example 2

[0072] Based on the above-mentioned vehicle-mounted image processing system, this embodiment further provides a car, comprising the vehicle-mounted image processing system described in the above embodiment.

[0073] The automobile described in this embodiment includes but is not limited to a traditional fuel vehicle, a hybrid vehicle, a pure electric vehicle, etc.

[0074] It should be noted that, in addition to the implementation methods of the utility model described in the above-mentioned specific specific embodiments, those skilled in the art can easily understand other advantages and functions of the utility model from the contents disclosed in this specification. Although the description of the utility model will be introduced in conjunction with the preferred embodiment, this does not mean that the features of this utility model are limited to this implementation method. On the contrary, the purpose of introducing the utility model in conjunction with the implementation method is to cover other options or modifications that may be extended based on the claims of the utility model. In order to provide an in-depth understanding of the utility model, the above description contains many specific details, and the utility model can also be implemented without using these details. In addition, in order to avoid confusion or blurring the focus of the utility model, some specific details will be omitted in the description. It should be noted that, in the absence of conflict, the embodiments in the utility model and the features in the embodiments can be combined with each other.

[0075] It should be noted that in this specification, similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, it does not need to be further defined and explained in the subsequent drawings.

[0076] In the description of this embodiment, it should be noted that the terms "upper", "lower", "inner", "bottom", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, or are the orientations or positional relationships in which the utility model product is usually placed when in use. They are only for the convenience of describing the utility model and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the utility model.

[0077] The terms “first”, “second”, etc. are only used for distinguishing descriptions and should not be understood as indicating or implying relative importance.

[0078] In the description of this embodiment, it is also necessary to explain that, unless otherwise clearly specified and limited, the terms "set", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in this embodiment can be understood according to specific circumstances.

[0079] Although the present invention has been illustrated and described with reference to certain preferred embodiments of the present invention, it should be understood by those skilled in the art that the above contents are further detailed descriptions of the present invention in combination with specific embodiments, and it cannot be determined that the specific implementation of the present invention is limited to these descriptions. Those skilled in the art may make various changes in form and details, including making several simple deductions or substitutions, without departing from the spirit and scope of the present invention.

Claims

1. A vehicle-mounted image processing system, characterized in that: It includes a first image acquisition module, a deserialization module, an image processing module, a serialization module, and a display module; wherein The deserialization module includes a first deserializer; the serialization module includes a first serializer and a second serializer; the display module includes a first display unit and a second display unit; wherein The output end of the first image acquisition module is connected to the input end of the first deserializer; The first deserializer has two output terminals, one of the output terminals of the first deserializer is connected to the input terminal of the first serializer, and the output terminal of the first serializer is connected to the input terminal of the first display unit; Another output end of the first deserializer is connected to the input end of the image processing module, the output end of the image processing module is connected to the input end of the second serializer, and the output end of the second serializer is connected to the input end of the second display unit.

2. The vehicle-mounted image processing system according to claim 1, characterized in that: Also includes a second image acquisition module, and an output switching module; and The deserialization module also includes a second deserializer; wherein The output end of the second image acquisition module is connected to the input end of the second deserializer; The output switching module comprises two input terminals, one of the input terminals of the output switching module is connected to the output terminal of the first deserializer, and the other input terminal of the output switching module is connected to the output terminal of the second deserializer; The output end of the output switching module outputs the signal from the first deserializer or the signal from the second deserializer to the image processing module.

3. The vehicle-mounted image processing system according to claim 2, characterized in that: The serial module further includes a third serializer, and the display module further includes a third display unit; wherein The second deserializer includes two output ends, one of which is connected to the input end of the output switching module, the other output end of the second deserializer is connected to the input end of the third serializer, and the output end of the third serializer is connected to the input end of the third display unit.

4. The vehicle-mounted image processing system according to claim 3, characterized in that: Also includes a first image processor and / or a second image processor; wherein The input end of the first image processor is connected to the output end of the first deserializer, and the output end of the first image processor is connected to the input end of the output switching module; the input end of the second image processor is connected to the output end of the second deserializer, and the output end of the second image processor is connected to the input end of the output switching module.

5. The vehicle-mounted image processing system according to claim 3, characterized in that: Also comprising a third image processor and / or a fourth image processor; in The input end of the third image processor is connected to the output end of the first image acquisition module, and the output end of the third image processor is connected to the input end of the first deserializer; An input end of the fourth image processor is connected to an output end of the second image acquisition module, and an output end of the fourth image processor is connected to an input end of the second deserializer.

6. The vehicle-mounted image processing system according to claim 3, characterized in that: Also comprising a fifth image processor and / or a sixth image processor; in The fifth image processor is integrated with the first image acquisition module. The sixth image processor is integrated with the second image acquisition module.

7. The vehicle-mounted image processing system according to any one of claims 4 to 6, characterized in that: The image processing module includes only one input terminal and one output terminal; The output switching module is connected to the image processing module via the input end of the image processing module; The second serializer is connected to the image processing module via the output terminal of the image processing module.

8. The vehicle-mounted image processing system according to claim 7, characterized in that: When the vehicle-mounted image processing system further includes a first image processor and a second image processor: The image processing module also includes: an interface respectively connected to the output switching module, the first deserializer, the second deserializer, the first serializer, the second serializer, the third serializer, the first image processor and the second image processor for data configuration.

9. The vehicle-mounted image processing system according to claim 8, characterized in that: The first image acquisition module includes at least one surround-view camera; The second image acquisition module includes a front-view camera or a vehicle-mounted camera; The first display unit, the second display unit and the third display unit are all vehicle-mounted display screens.

10. An automobile, characterized in that: The vehicle-mounted image processing system comprises the vehicle-mounted image processing system as described in any one of claims 1 to 9.

Images