Intelligent display terminal data processing system based on multi-camera input

Abstract

The utility model provides an intelligent display terminal data processing system based on multi-camera input, and belongs to the technical field of image transmission. Comprising a CCI control bus, a plurality of AHD cameras, at least one reversing camera, at least two AHD2MIPI conversion chips and at least one CVBS2MIPI conversion chip, the plurality of AHD cameras are respectively connected with the at least two AHD2MIPI conversion chips, the AHD2MIPI conversion chips are used for converting AHD camera signals into MIPI signals, and the CVBS2MIPI conversion chips are connected with the reversing camera. According to the utility model, the AHD-MIPI conversion chip, the CVBS-MIPI conversion chip and the CCI control bus are matched with each other, so that the compatibility of the conversion chips is improved, the expandability of the system is enhanced, and by means of the cooperation of the AHD-MIPI conversion chip, the CVBS-MIPI conversion chip, the CCI control bus, the ISP interface, the memory, the C-PHY module and the CSID2 module, the expandability of the system is improved. High-efficiency circulation and accurate processing of data in the whole process from camera signal acquisition to terminal display are realized.

Description

TECHNICAL FIELD

[0001] The utility model relates to image transmission technical field, especially in based on the intelligent display terminal data processing system of multi camera input. BACKGROUND

[0002] With the rapid development of science and technology, intelligent display terminal has been widely applied in many fields, such as security monitoring, intelligent transportation, industrial automation etc. ; In these application scenarios, the acquisition and processing of image information play a vital role. In order to meet the diversified demand of visual information in different scenarios, intelligent display terminal gradually develops from single camera configuration to multi camera system, aiming at obtaining more comprehensive and multi-angle image data, so as to improve the ability of system to environmental perception and information analysis.

[0003] However, in the prior art multi camera intelligent display terminal system, the signal format output by different types of cameras often has differences, such as common AHD camera and camera using CVBS signal etc. ; When integrating these different format cameras, the compatibility of the conversion chip in the traditional system is poor, and it is difficult to effectively process the conversion of multiple signal types. This leads to that in actual application, different types of cameras may not be flexibly added or replaced, which limits the scalability of the system. UTILITY MODEL CONTENT

[0004] The technical problem to be solved by the utility model is to provide an intelligent display terminal data processing system based on multi camera input, so as to solve the technical problem that the compatibility of the conversion chip in the prior art multi camera intelligent display terminal system is poor, which leads to the difficulty in flexibly integrating different types of cameras and limits the scalability of the system, and the low signal conversion efficiency, large signal loss and high delay, which further affect the reliability of the system.

[0005] The technical scheme is: in order to realize the above object, the utility model discloses a kind of intelligent display terminal data processing systems based on multiple camera inputs, comprising: CCI control bus, multiple AHD cameras, at least one reversing camera, at least two AHD_2_MIPI conversion chips and at least one CVBS_2_MIPI conversion chip, multiple AHD cameras are connected with at least two AHD_2_MIPI conversion chips respectively, AHD_2_MIPI conversion chip is used to convert AHD camera signal into MIPI signal, CVBS_2_MIPI conversion chip is used to convert reversing camera signal into MIPI signal, and both are connected with CCI control bus, CCI control bus is used to provide uniform transmission channel for the MIPI signal after conversion, to realize the compatible processing of AHD camera signal and reversing camera signal, wherein multiple AHD cameras are used to collect image data of different viewing angles, these cameras have the performance of high resolution and high frame rate, to ensure that clear, smooth image is collected;At least one reversing camera is specially used for environmental monitoring when vehicle reverses, with wide-angle view and good imaging ability under low light conditions;AHD_2_MIPI conversion chip uses advanced signal conversion technology, in the process of converting AHD camera signal into MIPI signal, can effectively reduce signal loss and noise interference, guarantee the quality of signal after conversion;CVBS_2_MIPI conversion chip converts the CVBS signal of reversing camera, and it has signal conditioning circuit inside, can pretreat input CVBS signal, improve conversion efficiency and accuracy;CCI control bus has high-speed data transmission capacity, supports multi-channel parallel transmission, can simultaneously process the MIPI signal output by multiple conversion chips, and has data priority management mechanism, ensure the priority transmission of important data, prevent data congestion and transmission error.

[0006] In a further embodiment, the ISP interface, CSI_PHY and CSID0 are connected with the CSID0 and one of the AHD_2_MIPI conversion chips respectively, and the CSID0 is connected with the CCI control bus and the ISP interface respectively, to realize the orderly processing and transmission of the AHD camera signal output from the conversion chip at the physical protocol layer and the data transmission link layer. The ISP interface has rich image processing functions, including but not limited to image enhancement, noise reduction, color correction and image scaling, etc. It can process the image in real time according to the requirements of different application scenarios, and improve the visibility and quality of the image. The CSI_PHY is an implementation module of the MIPI physical protocol layer, responsible for processing the transmission of the MIPI signal at the physical layer, including signal encoding, decoding, clock synchronization and data verification, etc. operations, to ensure the reliable transmission of data on the physical link. The CSID0 works at the data transmission link layer, and further encapsulates, decapsulates, flow controls and error detects and corrects the signal processed by the CSI_PHY, to ensure the orderly flow of data at the link layer.

[0007] In a further embodiment, at least two C-FHY and at least two CSID2 are connected with two CSID2 respectively, and one of the C-FHY is connected with the other AHD_2_MIPI conversion chip, and the two CSID2 are connected with the ISP interface, and the two CSID2 are also connected with the CCI control bus, to realize the further optimization processing and efficient transmission of the AHD camera signal. The C-FHY module adopts high-speed differential signal transmission technology, which can transmit the AHD camera signal at high speed and stability. It has signal equalization and pre-emphasis functions inside, which can effectively compensate the attenuation of the signal in the long-distance transmission process, and ensure the signal quality. The CSID2 module performs more in-depth processing at the data link layer, including data re-grouping, ordering and redundancy checking, etc. It can flexibly schedule according to the type and priority of the data, to improve the efficiency of data transmission. The connection between the two C-FHY and CSID2 adopts dedicated high-speed signal lines, and the wiring follows strict electromagnetic compatibility (EMC) design specifications, to reduce the mutual interference between signals, and ensure the integrity and accuracy of data.

[0008] In a further embodiment, another C-FHY is connected with the CVBS_2_MIPI conversion chip to realize enhancement and preprocessing of the signal from the reversing camera, wherein the C-FHY module related to the reversing camera is designed according to the characteristics of the signal from the reversing camera, and the signal enhancement function of the C-FHY module can improve the strength of the signal from the reversing camera, so that the signal can still maintain sufficient clarity after long-distance transmission and multiple conversions; in the preprocessing process, the C-FHY module can effectively filter out the noise in the signal from the reversing camera, and adjust the frequency response of the signal, so that the output signal is more suitable for subsequent processing and display.

[0009] In a further embodiment, the memory is connected with the ISP interface through an RDI channel, and is used to store the image data processed through the ISP interface, wherein the memory adopts a large-capacity, high-speed random access memory (RAM) and has a fast data read-write capability, which can meet the real-time storage requirements of the system for multi-camera image data; the RDI channel is a high-speed and reliable data transmission channel, and adopts a dedicated data transmission protocol to ensure that no data loss or transmission error occurs in the data transmission process between the ISP interface and the memory.

[0010] In a further embodiment, the display screen and the external storage are both connected with the memory, the display screen is used to obtain the image data processed through the ISP interface and stored in the memory from the memory, and the external storage is used to realize the backup and extended storage functions of data, wherein the display screen adopts a liquid crystal display (LCD) or an organic light-emitting diode display (OLED) with high resolution, high contrast and wide viewing angle, which can accurately and clearly display the image data obtained from the memory. It has a fast response time, which can effectively avoid image trailing phenomenon; the external storage device can be a large-capacity hard disk drive (HDD) or a solid state drive (SSD), which is connected with the memory through a high-speed data interface to realize fast backup and extended storage of data. When the system needs to view or analyze historical image data, the data can be quickly read from the external storage.

[0011] In a further embodiment, the two AHD_2_MIPI conversion chips are bidirectionally connected to realize data interaction and backup during the conversion of the AHD camera signal, wherein the bidirectional connection between the two AHD_2_MIPI conversion chips adopts a high-speed and reliable data bus, which has data verification and error correction functions to ensure the accuracy of the data during data interaction and backup; during the conversion of the AHD camera signal, when one conversion chip fails or has abnormal data processing, the other conversion chip can obtain the relevant data in time for supplementary processing through the bidirectional connection, thereby ensuring the continuity and reliability of the entire system for processing the AHD camera signal.

[0012] Beneficial effects: 1. Through the mutual cooperation between the AHD-MIPI conversion chip, the CVBS-MIPI conversion chip and the CCI control bus, the AHD-MIPI conversion chip accurately converts the AHD camera signal, the CVBS-MIPI conversion chip focuses on the conversion of the CVBS signal, and the CCI control bus provides a unified transmission channel for the converted MIPI signal and effectively manages it; realize compatible processing and efficient transmission of different types of camera signals, and achieve the effect of improving the compatibility of the conversion chip and enhancing the scalability of the system.

[0013] 2. With the synergistic cooperation of the AHD-MIPI conversion chip, the CVBS-MIPI conversion chip, the CCI control bus, the ISP interface, the memory, the C-PHY module and the CSID2 module, the efficient flow and accurate processing of data from camera signal acquisition to terminal display are realized; the purpose is to optimize each data processing link and reduce the loss and delay of signals in the conversion, transmission, storage and other processes. Achieve the effect of keeping the system stable and reliable in operation under high data throughput, effectively reduce the risk of image quality degradation, data loss or processing errors caused by signal problems. BRIEF DESCRIPTION OF DRAWINGS

[0014] In order to more clearly illustrate the technical solutions of the present application or prior art, the following will briefly introduce the drawings needed to be used in the embodiment or prior art description. Obviously, the drawings described below are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained without creative labor on the basis of these drawings.

[0015] Figure 1 The structural framework of the present application. DETAILED DESCRIPTION

[0016] In order to make the purpose, technical scheme and advantages of the present application more clear, the technical scheme in the present application is described clearly and completely. Obviously, the described embodiments are part of the embodiments of the present application, not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor belong to the scope of protection of the present application.

[0017] The embodiment of the application provides a kind of intelligent display terminal data processing system based on multi-camera input, solve the poor compatibility of conversion chip in the prior art multi-camera intelligent display terminal system, it is difficult to flexibly integrate different types of camera, thereby limiting the system scalability, and signal conversion efficiency is low, signal loss is large, delay is high, and further affect the system reliability technical problem.In actual use, it realizes that different types of camera can be flexibly integrated, and data transmission is fast and accurate, signal conversion is efficient and low-loss, and the system runs stably and reliably.

[0018] In order to better understand the above technical solutions, the above technical solutions will be described in detail in conjunction with the drawings and specific embodiments of the specification.

[0019] Reference Figure 1 An intelligent display terminal data processing system based on multi-camera input includes a CCI control bus, a plurality of AHD cameras, at least one reversing camera, at least two AHD_2_MIPI conversion chips and at least one CVBS_2_MIPI conversion chip, the plurality of AHD cameras are connected with the at least two AHD_2_MIPI conversion chips respectively, the AHD_2_MIPI conversion chip is used to convert the AHD camera signal into MIPI signal, the CVBS_2_MIPI conversion chip is connected with the reversing camera, the CVBS_2_MIPI conversion chip is used to convert the reversing camera signal into MIPI signal, and both are connected with the CCI control bus, the CCI control bus is used to provide a unified transmission channel for the converted MIPI signal, to realize the compatible processing of AHD camera signal and reversing camera signal.

[0020] Through AHD_2_MIPI conversion chip and CVBS_2_MIPI conversion chip, the signals of different types of cameras (AHD camera and reversing camera) are converted into unified MIPI signal, and a unified transmission channel is provided by CCI control bus, realizing the compatible processing of multiple camera signals, so that the system can integrate image data from different cameras, providing a basis for subsequent processing and display.

[0021] ISP interface, CSI_PHY and CSIDO, the CSI_PHY is connected with CSIDO and one of AHD_2_MIPI conversion chip respectively, the CSIDO is connected with CCI control bus and ISP interface respectively, to realize the ordered processing and transmission of AHD camera signal after output from conversion chip in physical protocol layer and data transmission link layer.

[0022] After the ISP interface, CSI_PHY and CSIDO are added, the AHD camera signal is orderly processed and transmitted at the physical protocol layer and the data transmission link layer. Among them, CSI_PHY guarantees the reliability of signal transmission at the physical layer, CSIDO ensures the data order of the link layer, and the ISP interface can preliminarily process the image data transmitted, thereby improving the stability and processability of the image data in the transmission process after conversion.

[0023] At least two C-FHYs and at least two CSID2s are connected to two C-FHYs and two CSID2s, respectively, and one of the C-FHYs is connected to another AHD_2_MIPI conversion chip, and the two CSID2s are connected to the ISP interface, and the two CSID2s are also connected to the CCI control bus, so as to realize further optimization processing and efficient transmission of the AHD camera signal.

[0024] Through the setting of at least two C-FHYs and at least two CSID2s, further optimization processing and efficient transmission of the AHD camera signal are realized. C-FHY performs high-speed stable transmission and attenuation compensation on the signal, and CSID2 performs in-depth link layer processing and flexible scheduling on the data, thereby effectively improving the transmission quality and efficiency of the AHD camera signal in the system, and reducing signal loss and transmission delay.

[0025] The other C-FHY is connected to the CVBS_2_MIPI conversion chip to realize enhancement and preprocessing of the signal from the reversing camera.

[0026] The other C-FHY is connected to the CVBS_2_MIPI conversion chip to realize enhancement and preprocessing of the signal from the reversing camera. This makes the reversing camera signal after conversion can be optimized, improves the signal strength, reduces noise interference, and guarantees the quality of the reversing camera image data in the subsequent processing process, and provides clearer and more accurate image support for the environment monitoring when the vehicle is reversing.

[0027] Memory, the memory is connected to the ISP interface through the RDI channel, and is used for storing image data processed by the ISP interface.

[0028] The memory is connected to the ISP interface through the RDI channel, and realizes storage of the image data processed by the ISP interface. This makes the system can temporarily save the processed image data, and facilitates further operation of the image data, such as avoiding data loss in multi-task processing, and provides data source for display and external storage backup of data.

[0029] The display screen and the external storage are connected with the memory, the display screen is used for obtaining the image data processed by the ISP interface and stored in the memory from the memory, and the external storage is used for realizing backup and extended storage functions of data.

[0030] The display screen and the external storage are connected with the memory, the display screen is used for obtaining the image data processed by the ISP interface and stored in the memory from the memory, and the external storage is used for realizing backup and extended storage functions of data.

[0031] The two AHD_2_MIPI conversion chips are bidirectionally connected, and are used for realizing data interaction and backup in the AHD camera signal conversion process.

[0032] The two AHD_2_MIPI conversion chips are bidirectionally connected, and are used for realizing data interaction and backup in the AHD camera signal conversion process; when one of the conversion chips fails or data processing is abnormal, the other conversion chip can obtain relevant data through the bidirectional connection to supplement the processing, thereby guaranteeing the reliability of the AHD camera signal conversion and the stability of the system operation, and avoiding the interruption of the entire system to the AHD camera data processing due to the problem of a single conversion chip.

[0033] In use, multiple AHD cameras collect image data of different perspectives, and at least one reversing camera is used for environmental monitoring when the vehicle is reversing; the signals of the AHD cameras are transmitted to at least two AHD_2_MIPI conversion chips respectively, and the signal of the reversing camera is transmitted to a CVBS_2_MIPI conversion chip, the AHD_2_MIPI conversion chip converts the signal of the AHD camera into a MIPI signal, the CVBS_2_MIPI conversion chip converts the signal of the reversing camera into a MIPI signal, and the converted MIPI signals are uniformly transmitted through a CCI control bus; for the converted signal of the AHD camera, one of the signals is transmitted to a CSIDO (responsible for data transmission link layer operation) after being processed by a CSI-PHY (responsible for physical protocol layer operation), and the CSIDO transmits the signal to an ISP interface; the other signal is transmitted through a C-FHY connected with the AHD_2_MIPI conversion chip, and the C-FHY transmits the signal to the ISP interface after being connected with a CSID2, and the CSID2 is also connected with the CCI control bus, so that further optimization processing and efficient transmission of the AHD camera signal are realized through the above operations; for the converted signal of the reversing camera, the signal is enhanced and preprocessed through a C-FHY connected with the CVBS_2_MIPI conversion chip, and then the signal is transmitted to the ISP interface through the CSID2, and the CSID2 is also connected with the CCI control bus, so as to ensure high-quality transmission of the reversing camera signal; the ISP interface processes the received image signal, and the processed image data is stored in the memory through an RDI channel; on one hand, the data in the memory can be transmitted to a display screen for display, so as to present the image collected by the camera to the user; on the other hand, the data in the memory can be transmitted to an external storage for backup and extended storage, so as to prevent data loss and facilitate subsequent viewing and analysis of historical data; in the whole process, the two AHD_2_MIPI conversion chips are bidirectionally connected, so as to realize data interaction and backup during the conversion of the AHD camera signal, if one conversion chip fails, the other can perform data supplement processing, so as to ensure the reliability and stability of the system operation.

[0034] The figures expressed in the drawings are example figures, and the purpose is only to more intuitively show the key structure and connection relationship of the intelligent display terminal data processing system based on multiple camera inputs; in actual application, the appearance and size of the device can be adjusted and optimized according to specific needs.

[0035] The utility model covers any alternative, modification, equivalent method and scheme which are made on the essence and range of the utility model. In order to make the public have the thorough understanding of the utility model, the specific details are explained in the above preferred embodiment of the utility model, and the utility model can also be completely understood without the description of these details for the person skilled in the art. In addition, in order to avoid unnecessary confusion to the essence of the utility model, the well-known method, process, flow, element and circuit etc. are not explained in detail.

[0036] The above is only the preferred embodiment of the utility model, and it should be pointed out that, for the ordinary skilled person in the art, a number of improvements and refinements can be made without departing from the principle of the utility model, and these improvements and refinements should also be regarded as the protection range of the utility model.

Claims

1. A multi-camera input based intelligent display terminal data processing system, characterized in that, The CCI control bus, a plurality of AHD cameras, at least one reversing camera, at least two AHD_2_MIPI conversion chips and at least one CVBS_2_MIPI conversion chip, the plurality of AHD cameras are connected with the at least two AHD_2_MIPI conversion chips respectively, the AHD_2_MIPI conversion chip is used for converting the AHD camera signal into the MIPI signal, the CVBS_2_MIPI conversion chip is connected with the reversing camera, the CVBS_2_MIPI conversion chip is used for converting the reversing camera signal into the MIPI signal, and both are connected with the CCI control bus, the CCI control bus is used for providing a unified transmission channel for the converted MIPI signal, so that the compatible processing of the AHD camera signal and the reversing camera signal is realized. Further comprising:

2. The intelligent display terminal data processing system based on multi-camera input according to claim 1, characterized in that, The ISP interface, the CSI_PHY and the CSIDO, the CSI_PHY is connected with the CSIDO and one of the AHD_2_MIPI conversion chips respectively, the CSIDO is connected with the CCI control bus and the ISP interface respectively, so that the ordered processing and transmission of the AHD camera signal after being output from the conversion chip in the physical protocol layer and the data transmission link layer are realized. Further comprising:

3. The intelligent display terminal data processing system based on multi-camera input according to claim 2, characterized in that, At least two C-FHY and at least two CSID2, two C-FHY are connected with two CSID2 respectively, one of the C-FHY is connected with the other AHD_2_MIPI conversion chip, two CSID2 are connected with the ISP interface, and two CSID2 are further connected with the CCI control bus, so that the further optimization processing and efficient transmission of the AHD camera signal are realized. The other C-FHY is connected with the CVBS_2_MIPI conversion chip, so that the enhancement and preprocessing of the reversing camera signal are realized.

4. The intelligent display terminal data processing system based on multi-camera input according to claim 3, characterized in that: Further comprising:

5. The intelligent display terminal data processing system based on multi-camera input according to claim 2, characterized in that, The memory is connected with the ISP interface through the RDI channel, and is used for storing the image data processed by the ISP interface. Further comprising:

6. The intelligent display terminal data processing system based on multi-camera input according to claim 5, characterized in that, The display screen and the external storage are connected with the memory, the display screen is used for obtaining the image data processed by the ISP interface and stored in the memory from the memory, and the external storage is used for realizing the backup and extended storage functions of data. The two AHD_2_MIPI conversion chips are bidirectionally connected, so that the data interaction and backup in the AHD camera signal conversion process are realized.

7. The intelligent display terminal data processing system based on multi-camera input according to claim 1, characterized in that: ​

Images