Multi-system shared front-view image acquisition and data distribution device and method

Abstract

The invention relates to the technical field of vehicle-mounted front-view camera image acquisition and data distribution, in particular to a multi-system shared front-view image acquisition and data distribution device and method, the device comprises an image acquisition module, a data processing module and a network communication module, and the network communication module comprises a network service module and a data distribution module. The image acquisition module is used for acquiring image data, the data processing module is used for processing the image data in real time, the network service module is used for realizing communication connection with other systems in a vehicle or an external network, and the data distribution module supports an Ethernet data transmission interface and adopts a multi-channel data distribution technology. The image data is distributed to multiple application systems needing the image data through a data distribution mechanism, the image data is collected through a single camera input channel, the image data is efficiently distributed to multiple systems, the hardware cost is effectively reduced, the installation process is simplified, and the system efficiency and compatibility are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of vehicle-mounted front-view camera image acquisition and data distribution, and in particular to a multi-system shared front-view image acquisition and data distribution device and method. Background Art

[0002] With the development of autonomous driving technology, the demand for image data in vehicle systems is increasing and becoming increasingly diverse. For example, the front-view image data of vehicles is widely used in multiple systems: the automatic intelligent driving system needs to use the front-view image data for target perception and safe driving; the dash cam needs to use the front-view image data for video recording and storage to provide evidence in accidents; the smart headlight system needs to use the front-view image data to adjust the high beam to avoid glare to oncoming vehicles. However, the current solution is to install a separate camera for each system that requires front-view image data. This practice leads to an increase in the number of cameras, a significant increase in hardware costs, and an increase in the burden on vehicle manufacturers and consumers. In addition, multiple cameras need to be installed in different locations of the vehicle, which not only increases the installation workload, but also may cause conflicts and incoordination in the installation locations. Multiple cameras may block each other's field of view, affecting the image acquisition effect, and also increasing the complexity of the vehicle's appearance.

[0003] In addition, the existing technology mainly realizes data forwarding through serial adder and deserializer, and needs to add deserializer chips to realize data reception and analysis, for example, Chinese patent application CN116033265A-Camera sharing method, system, device and computer readable storage medium. This solution not only increases the equipment cost, but also fails to meet the real-time data transmission requirements. Different domain control systems receive image data at different times, and time synchronization cannot be achieved.

[0004] Another example is Chinese patent CN218570302U - A camera sharing system and vehicle based on a regional controller, which mainly implements image data forwarding based on a domain controller. A domain controller may be connected to one or more cameras. The domain controller mainly implements its own domain control function and additionally implements data forwarding. This solution also cannot achieve high real-time and time synchronization problems, and cannot forward image data to any controller system. Summary of the invention

[0005] The technical problem to be solved by the present invention is: to solve the problems of high hardware cost, complex installation, low real-time data transmission, time asynchronization, data redundancy and resource waste existing in the prior art. The present invention provides a multi-system shared front view image acquisition and data distribution device and method, which is particularly applicable to the scenario where multiple application systems use front view images. The image data is distributed to multiple application systems that need the image data through a data distribution mechanism. The image data is acquired through a single camera input channel and efficiently distributed to multiple systems that need the image data, effectively reducing the hardware cost, simplifying the installation process, improving the system efficiency and compatibility, and bringing higher cost performance and competitive advantages to vehicle manufacturers and consumers.

[0006] The technical solution adopted by the present invention to solve its technical problems is: a multi-system shared front view image acquisition and data distribution device for vehicles, including an image acquisition module, a data processing module and a network communication module. The network communication module includes a network service module and a data distribution module.

[0007] Image acquisition module: used to acquire image data in front of the vehicle. The image acquisition module is signal-connected to the data processing module.

[0008] Data processing module: used to perform real-time processing on the image data acquired by the image acquisition module. The real-time processing includes image enhancement, data compression, optimization processing of the image data, extraction of key information, and conversion and adaptation of multiple image data formats.

[0009] Network service module: used to realize the communication connection between the device and other systems inside the vehicle or an external network, support network communication of the TCP / IP protocol of Ethernet, and ensure the high real-time performance and stability of data transmission through the TCP long connection communication mode.

[0010] Data distribution module: supports an Ethernet data transmission interface and adopts a multi-channel data distribution technology to simultaneously transmit the image data processed by the data processing module to multiple systems that need the image data.

[0011] The image acquisition module acquires image data in front of the vehicle through a front view camera. The front view camera is installed in front of the vehicle and is connected to the data processing module through a high-speed interface to ensure the rapid transmission of image data. The high-resolution and low-power front view camera has functions of automatic focusing, automatic exposure and wide dynamic range, and can stably acquire high-quality image data under different lighting conditions.

[0012] The data processing module uses an embedded processor and can perform real-time processing on the image data collected by the image acquisition module. It has functions such as image enhancement and data compression, can optimize the image data, extract key information, and improve the usability of the data. It supports the conversion and adaptation of multiple image data formats to ensure that the data can meet the requirements of different systems.

[0013] The network service module is also used to provide TCP connection management functions, monitor and manage the TCP connection status, automatically handle idle timeouts or abnormal connections, support data encryption and authentication processing, and ensure information security during the communication process.

[0014] The data distribution module is used to switch and adapt multiple video transmission protocols according to the requirements of different receivers, ensure the compatibility and stability of data transmission, and support high-performance real-time network transmission protocols: SOME / IP, DDS, RTSP through optimizing protocol selection and data encapsulation. The module can efficiently transmit image data to multiple systems, reducing transmission latency and data loss.

[0015] The data distribution module has a data encryption function to ensure the security of image data during transmission and prevent data leakage.

[0016] A method for multi-system shared forward-looking image acquisition and data distribution for vehicles uses the multi-system shared forward-looking image acquisition and data distribution device for vehicles described above.

[0017] The method for multi-system shared forward-looking image acquisition and data distribution for vehicles according to the present invention includes the following steps: Step 1, Image acquisition: The forward-looking camera of the image acquisition module automatically turns on after the vehicle starts, and acquires the image data in front of the vehicle according to the preset parameters. The camera transmits the acquired image data to the data processing module through a high-speed interface; Step 2, Data processing: After receiving the image data, the data processing module first performs preprocessing, analyzes the image using the built-in image processing algorithm, extracts key information, and optimizes the data according to different application requirements. It can provide data formats such as YUV, RGB, JPEG, and H264 / H265 according to application needs; Step 3, Network communication: It includes network service and data distribution; Network service: Realize the communication connection between the device and other systems inside the vehicle or the external network, and support network communication of the TCP / IP protocol of Ethernet; Data distribution: The data distribution module uses a central service to record the mapping relationship between the data and the subscription nodes according to the preset distribution strategy. When accessing data, it first queries the service to obtain the node where the data is located, and then directly accesses that node. The image data processed by the data processing module is broadcast and sent to multiple systems that require the image data through multi-channel transmission technology.

[0018] In step 2, the preprocessing includes denoising and enhancement to improve the image quality; after optimizing and processing the data, the processed image data is compressed into a format suitable for transmission, reducing the data transmission volume and improving the transmission efficiency. The format suitable for transmission described here can provide data formats such as YUV, RGB, JPEG, and H264 / H265 according to application requirements.

[0019] In step 3, the data distribution module monitors the data transmission status in real time during the transmission process, monitors whether each frame of data is transmitted successfully and whether the data transmission is blocked, and retransmits the data as needed, increasing the data transmission bandwidth to ensure the integrity and accuracy of the data.

[0020] The beneficial effect of the present invention is that a multi-system shared front-view image acquisition and data distribution device and method of the present invention are particularly suitable for scenarios where multiple application systems use front-view images. The image data is distributed to multiple application systems that require the image data through a data distribution mechanism, the image data is collected through a single camera input channel, and the image data is efficiently distributed to multiple systems that require the image data, effectively reducing the hardware cost, simplifying the installation process, improving the system efficiency and compatibility, and bringing higher cost performance and competitive advantages to vehicle manufacturers and consumers. Description of the Drawings

[0021] The present invention will be further described below in conjunction with the drawings and embodiments.

[0022] Figure 1 is the system framework diagram of the multi-system shared front-view image acquisition and data distribution device for vehicles of the present invention.

[0023] Figure 2 is the application scenario schematic diagram of the multi-system shared front-view image acquisition and data distribution device for vehicles of the present invention.

[0024] Figure 3 is the flow chart of the multi-system shared front-view image acquisition and data distribution device and method for vehicles of the present invention. Detailed Embodiment

[0025] The present invention will now be further described in detail in conjunction with the drawings. These drawings are all simplified schematic diagrams, only illustrating the basic structure of the present invention in a schematic manner, so they only show the components related to the present invention.

[0026] As Figure 1 shown, a multi-system shared front-view image acquisition and data distribution device for a vehicle according to the present invention includes an image acquisition module, a data processing module, and a network communication module. The network communication module includes a network service module and a data distribution module.

[0027] Image acquisition module: It is used to acquire image data in front of the vehicle, and the image acquisition module is signal-connected to the data processing module.

[0028] Data processing module: It is used to perform real-time processing on the image data acquired by the image acquisition module. The real-time processing includes image enhancement, data compression, optimizing the image data, extracting key information, and converting and adapting multiple image data formats.

[0029] Network service module: It is used to realize the communication connection between the device and other systems inside the vehicle or an external network, support network communication of the TCP / IP protocol of Ethernet, and ensure high real-time performance and stability of data transmission through the TCP long connection communication mode.

[0030] Data distribution module: It supports an Ethernet data transmission interface and uses multi-channel data distribution technology to simultaneously transmit the image data processed by the data processing module to multiple systems that require image data.

[0031] The image acquisition module acquires the image data in front of the vehicle through a high-resolution and low-power front-view camera. The front-view camera is installed in front of the vehicle and is connected to the data processing module through a high-speed interface, such as MIPI CSI (MIPI Camera Serial Interface), to ensure the fast transmission of image data. The high-resolution and low-power front-view camera has functions of automatic focusing, automatic exposure, and wide dynamic range, and can stably acquire high-quality image data under different lighting conditions.

[0032] The data processing module uses a high-performance embedded processor to be able to perform real-time processing on the image data acquired by the image acquisition module. It has functions such as image enhancement and data compression, can optimize the image data, extract key information, and improve the availability of the data. It supports the conversion and adaptation of multiple image data formats to ensure that the data can meet the requirements of different systems.

[0033] The network service module is also used to provide a TCP connection management function, monitor and manage the TCP connection status, automatically process idle timeouts or abnormal connections, and support data encryption and authentication processing to ensure information security during the communication process.

[0034] The data distribution module is used to switch and adapt multiple video transmission protocols according to the requirements of different receivers, ensuring the compatibility and stability of data transmission. By optimizing protocol selection and data encapsulation, it supports high-performance real-time network transmission protocols: SOME / IP, DDS, RTSP. The module can efficiently transmit image data to multiple systems, reducing transmission latency and data loss.

[0035] The data distribution module has a data encryption function to ensure the security of image data during transmission and prevent data leakage.

[0036] Such as Figure 3 As shown, a method for multi-system shared front view image acquisition and data distribution for vehicles uses the described multi-system shared front view image acquisition and data distribution device for vehicles.

[0037] The method for multi-system shared front view image acquisition and data distribution for vehicles according to the present invention includes the following steps: Step 1, Image acquisition: The front view camera of the image acquisition module automatically turns on after the vehicle starts, and acquires image data in front of the vehicle according to preset parameters (such as resolution, frame rate). The camera transmits the acquired image data to the data processing module through a high-speed interface; Step 2, Data processing: After receiving the image data, the data processing module first performs preprocessing, analyzes the image using built-in image processing algorithms, extracts key information such as the position and speed of target objects, and optimizes the data according to different application requirements. It can provide data formats such as YUV, RGB, JPEG, and H264 / H265 according to application needs; Step 3, Network communication: including network service and data distribution; Network service: Realize the communication connection between the device and other systems inside the vehicle or an external network, and support network communication of the TCP / IP protocol of Ethernet; Data distribution: The data distribution module uses a central service to record the mapping relationship between data and subscription nodes according to the preset distribution strategy. When accessing data, first query the service to obtain the node where the data is located, and then directly access that node, and broadcast and send the image data processed by the data processing module to multiple systems that need image data through multi-channel transmission technology.

[0038] In step 2, the preprocessing includes operations such as denoising and enhancement to improve the image quality; after optimizing and processing the data, the processed image data is compressed into a format suitable for transmission, reducing the amount of data transmission and improving the transmission efficiency.

[0039] In step 3, the data distribution module monitors the data transmission status in real time during the transmission process, monitors whether each frame of data is transmitted successfully and whether the data transmission is blocked, retransmits the data as needed, increases the data transmission bandwidth, and ensures the integrity and accuracy of the data.

[0040] The device and method of the present invention achieve efficient, low-power, and highly compatible image data sharing through an integrated image acquisition and data distribution system, and have the following advantages: (1) Significantly reduce hardware costs: Image data is collected through a single front-view camera, avoiding the need to equip each system with a separate camera. (2) Enhance system compatibility and flexibility: The present invention supports multiple video data formats and multiple network transmission protocols, making the device and method of the present invention compatible and flexible. (3) Improve data security and reliability: The problems caused by conflicts in the installation positions of multiple cameras and complex wiring are reduced, making the system safer and more reliable. (4) Improve the real-time performance of data forwarding: Corresponding high-performance SOC chips and high-performance and highly real-time network transmission protocols such as some / IP, DDS, and RTSP can be used. (5) Improve the accuracy of time synchronization: Image data is collected through the same camera and distributed to multiple systems that require image data, ensuring the accuracy of data time synchronization. (6) Improve the cost performance and market competitiveness of vehicles: The maintenance cost is reduced, the reliability is improved, and it is convenient for technology upgrading and function expansion.

[0041] The present invention collects image data through a single front-view camera and distributes it to multiple systems that require image data, avoiding the practice of equipping each system with a separate camera. For example, as Figure 2 shown, the autonomous driving system, the driving recorder, and the intelligent headlight system can share the image data of the same in-vehicle front-view camera through the distribution device and the local area network switch of the present invention, thereby reducing the number of installed cameras. The installation method of a single camera greatly simplifies the installation process, reduces the installation time and labor costs. At the same time, the maintenance costs caused by problems such as conflicts in the installation positions of multiple cameras and complex wiring are reduced, and the reliability of the system is improved.

[0042] The design concept of the device enables it to be easily integrated into existing vehicle systems and is also convenient for future technology upgrading and function expansion, such as adding new image processing algorithms or supporting more system accesses.

[0043] In summary, the multi-system shared forward-view image acquisition and data distribution device of the present invention has significant advantages in terms of reducing costs, improving efficiency, enhancing compatibility, and improving safety and reliability. It can not only meet the diverse needs of autonomous vehicles for image data, but also bring higher cost performance and market competitiveness to vehicle manufacturers and consumers, and has important application value and promotion significance.

[0044] Inspired by the ideal embodiments of the present invention described above, through the above description, relevant staff can completely make various changes and modifications without departing from the technical idea of the present invention. The technical scope of the present invention is not limited to the content in the specification, and its technical scope must be determined according to the scope of the claims.

Claims

1. A multi-system shared front view image acquisition and data distribution device for a vehicle, characterized in that It includes an image acquisition module, a data processing module, and a network communication module. The network communication module includes a network service module and a data distribution module; The image acquisition module: is used to acquire image data in front of the vehicle. The image acquisition module is signal-connected to the data processing module; The data processing module: is used to perform real-time processing on the image data acquired by the image acquisition module. The real-time processing includes image enhancement, data compression, optimizing the image data, extracting key information, and converting and adapting multiple image data formats; The network service module: is used to realize the communication connection between the device and other systems inside the vehicle or an external network, and support network communication of the TCP / IP protocol of Ethernet; The data distribution module: supports an Ethernet data transmission interface, adopts a multi-channel data distribution technology, and is used to simultaneously transmit the image data processed by the data processing module to multiple systems that need the image data.

2. The multi-system shared front view image acquisition and data distribution device for a vehicle according to claim 1, wherein The image acquisition module acquires the image data in front of the vehicle through a front-view camera. The front-view camera is installed in front of the vehicle, and the front-view camera is connected to the data processing module through a high-speed interface.

3. The multi-system shared front view image acquisition and data distribution device for a vehicle according to claim 1, characterized in that, The data processing module uses an embedded processor.

4. The multi-system shared front view image acquisition and data distribution device for a vehicle according to claim 1, characterized in that The network service module is also used to provide a TCP connection management function, monitor and manage the TCP connection status, automatically process idle timeouts or abnormal connections, support data encryption and authentication processing, and ensure information security during the communication process.

5. The multi-system shared front view image acquisition and data distribution device for a vehicle according to claim 1, characterized in that The data distribution module is used to switch and adapt multiple video transmission protocols according to the requirements of different receivers, and ensure the compatibility and stability of data transmission.

6. The multi-system shared forward view image acquisition and data distribution device for a vehicle according to claim 1, characterized in that, The data distribution module has a data encryption function to ensure the security of image data during transmission.

7. A multi-system shared forward view image acquisition and data distribution method for vehicles, characterized in that, Adopt the multi-system shared front-view image acquisition and data distribution device for vehicles described in any one of claims 1-6.

8. The multi-system shared forward view image acquisition and data distribution method for a vehicle according to claim 7, characterized in that It includes the following steps: Step 1, Image acquisition: The front-view camera of the image acquisition module is automatically turned on after the vehicle starts, and acquires the image data in front of the vehicle according to preset parameters. The camera transmits the acquired image data to the data processing module through a high-speed interface; Step 2, Data processing: After the data processing module receives the image data, it first performs preprocessing, analyzes the image using built-in image processing algorithms, extracts key information, and optimizes the data according to different application requirements; Step 3, Network communication: It includes network service and data distribution; Network service: Realize the communication connection between the device and other systems inside the vehicle or an external network, and support network communication of the TCP / IP protocol of Ethernet; Data distribution: The data distribution module uses a central service to record the mapping relationship between the data and the subscription nodes according to the preset distribution strategy. When accessing the data, first query the service to obtain the node where the data is located, and then directly access the node, and broadcast and send the image data processed by the data processing module to multiple systems that need the image data through multi-channel transmission technology.

9. The method for multi-system shared forward view image acquisition and data distribution for a vehicle according to claim 8, wherein In step 2, the preprocessing includes denoising and enhancement to improve the image quality; after optimizing the data processing, the processed image data is compressed into a format suitable for transmission.

10. The method for multi-system shared front view image acquisition and data distribution for a vehicle according to claim 8, wherein, In step 3, the data distribution module monitors the data transmission status in real time during the transmission process to ensure the integrity and accuracy of the data.

Images