A method for image acquisition using a multi-channel image acquisition card

Abstract

The present invention relates to the field of machine vision technology, and in particular to a method for image acquisition using a multi-channel image acquisition card. A 10G optical port camera transmits the acquired image data to a multi-channel optical fiber communication transmission module of a multi-channel image acquisition card through optical fiber; the multi-channel optical fiber communication transmission module sends the image data transmitted by the optical module to an optical fiber data packet unpacking module of the image acquisition card; obtains image information in the data; processes the image data, and then processes it through a lossless compression algorithm; writes the compressed image data into DDR4 for caching; reads the image data cached in DDR4 and sends it. On the basis of supporting multi-camera applications, the limitations of transmission distance and transmission bandwidth are solved at the same time, and the original image can be processed to improve the image quality.

Description

Technical Field

[0001] The present invention relates to the technical field of machine vision, and in particular to a method for performing image acquisition using a multi-channel image acquisition card. Background Art

[0002] In the field of machine vision, embedded processing platforms are being used more and more widely. This platform can eliminate the need for a host computer in the system, has low cost, simpler system integration, and a compact size. With the development of chip technology, the computing power is getting smaller and smaller than that of a host computer.

[0003] The existing embedded platforms are usually combined with the following applications in the field of machine vision: directly receiving the image data output by the camera module through the MIPI D-PHY interface, receiving the image data output by the USB camera through the USB interface, and connecting the camera of the corresponding interface through the Ethernet port. Among them, directly receiving the image data output by the camera module through the MIPI D-PHY interface, one D-PHY interface can only receive one camera module. And calculated at a rate of 2.5Gbps, the transmission limit bandwidth can theoretically reach 10Gbps, but limited by the attenuation and interference of the MIPI D-PHY signal, the transmission distance is generally within 50cm, which can only be used for board-level transmission, and it is difficult to achieve long-distance transmission. Receiving the image data output by the USB camera through the USB interface, one USB port can only connect to one USB camera, and the compatibility and stability of the USB port are poor. Although the camera connected to the corresponding interface through the Ethernet port can receive multiple Gigabit / 100M network cameras at the same time through the switch, and the transmission distance can reach several meters to tens of meters, the network interface bandwidth is limited, and the highest Gigabit network can only achieve 1Gbps bandwidth, which cannot meet the application requirements of high bandwidth. Summary of the invention

[0004] The purpose of the present invention is to solve the above-mentioned related problems and design a method for image acquisition using a multi-channel image acquisition card. To achieve the above-mentioned purpose, the present invention provides the following solutions:

[0005] A method for image acquisition using a multi-channel image acquisition card, characterized in that it includes the following steps:

[0006] S1. The 10G optical port camera transmits the collected image data to the multi-channel optical fiber communication transmission module of the multi-channel image acquisition card through optical fiber; the multi-channel optical fiber communication transmission module is used to interact with the optical module of the 10G optical port camera for data, receive the information of the optical module data transmission, and send the configuration command to the corresponding camera and obtain the working status information of the camera;

[0007] S2. The multi-channel optical fiber communication transmission module of the image acquisition card sends the image data transmitted by the optical module to the optical fiber data packet unpacking module of the image acquisition card; the optical fiber data packet unpacking module is used to interact with the multi-channel optical fiber communication transmission module for data, unpack the received information of the multi-channel optical fiber communication transmission module, and obtain the image information in the data;

[0008] S3. The fiber optic data packet unpacking module of the image acquisition card obtains image information from the image data and sends it to the image signal processor processing and lossless compression module of the image acquisition card;

[0009] S4. The image signal processor processing and lossless compression module of the image acquisition card performs noise reduction, edge sharpening and color restoration correction processing on the image data, and then compresses the image data through lossless compression algorithm processing; the image signal processor processing and lossless compression module is used to interact with the optical fiber data packet unpacking module to perform image signal processing on the image information, and compress the processed image information;

[0010] S5. The multi-channel data storage read / write module of the image acquisition card writes the compressed image data to the DDR4 for cache;

[0011] S6. The multi-channel data storage read-write module of the image acquisition card reads the image data cached in DDR4 and sends it to the MIPI D-PHY multi-virtual channel data packet and sending module of the image acquisition card; the multi-channel data storage read-write module is used to interact with the image signal processor processing and lossless compression module for data, store the image information compressed by the image signal processor processing and lossless compression module into the memory, and read the image information stored in the memory and transmit it when receiving the signal; the MIPI D-PHY multi-virtual channel data packet and sending module is used to interact with the multi-channel data storage read-write module and the D-PHY protocol test module for data, encapsulate the image information received from the multi-channel data storage read-write module into a data packet and transmit it;

[0012] S7. The MIPI D-PHY multi-virtual channel data packet and sending module of the image acquisition card re-encodes, packages and merges the image information received from the multi-channel data storage and reading and writing module according to the virtual channel according to the D-PHY protocol to obtain a data packet, and sends the data in the form of a MIPI D-PHY signal.

[0013] The image acquisition card also includes an acquisition card control module, which is used to interact with the embedded platform processor for data, parse the control commands issued by the SPI communication main module of the embedded platform processor, configure other modules in the multi-channel optical fiber to MIPI D-PHY image acquisition card according to the control commands, and collect the working status of the 10 Gigabit network optical port camera and the multi-channel optical fiber to MIPI D-PHY image acquisition card.

[0014] As a further improvement of the present technical solution, the image signal processor processing and lossless compression module of the image acquisition card includes an ISP algorithm module, which uses a median filtering algorithm, a bilateral filtering algorithm and a sharpness algorithm to perform noise reduction, edge sharpening and color correction on the image information.

[0015] As a further improvement of the technical solution, the image signal processor processing and lossless compression module of the image acquisition card uses a lossless compression algorithm obtained by improving the LZ777 algorithm to compress the image information processed by the image signal processor and lossless compression module.

[0016] As a further improvement of the technical solution, the multi-channel data storage read-write module of the image acquisition card stores the image information processed by the image signal processor and compressed by the lossless compression module into a DDR4 memory.

[0017] As a further improvement of the present technical solution, the MIPI D-PHY multi-virtual channel data packet and sending module of the image acquisition card re-encodes, packages and merges the image information transmitted by the multi-channel data storage and read-write module according to the D-PHY protocol according to the virtual channel to obtain a data packet. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Various other advantages and benefits will become apparent to those skilled in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present invention;

[0019] Figure 1 A schematic diagram of a process of a method for image acquisition using a multi-channel image acquisition card according to the present invention;

[0020] Figure 2 The present invention is a schematic structural diagram of an embodiment of an image acquisition card of a method for performing image acquisition using a multi-channel image acquisition card. DETAILED DESCRIPTION

[0021] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0022] Those skilled in the art will appreciate that, unless otherwise stated, the singular forms "a", "an" and "the" used herein may also include plural forms. It should be further understood that the term "comprising" used in the specification of the present invention refers to the presence of the features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.

[0023] The present invention will be described in detail below in conjunction with the accompanying drawings.

[0024] Example 1

[0025] like Figure 1 As shown, a method for image acquisition using a multi-channel image acquisition card comprises the following steps:

[0026] The 10G optical port camera transmits the collected image data through optical fiber to the multi-channel optical fiber communication transmission module of the multi-channel optical fiber to MIPI D-PHY image acquisition card; the multi-channel optical fiber communication transmission module of the multi-channel optical fiber to MIPI D-PHY image acquisition card sends the image data transmitted by the optical module to the optical fiber data packet unpacking module;

[0027] The optical fiber data packet unpacking module unpacks the image data packet, obtains the image information in the data from the image data, and sends it to the image signal processor processing and lossless compression module;

[0028] The image signal processor processing and lossless compression module performs noise reduction, edge sharpening and color restoration correction processing on the image data through the median filtering algorithm, bilateral filtering algorithm and sharpness algorithm, and then compresses the image data through the lossless compression algorithm; the multi-channel data storage read-write module writes the compressed image data into DDR4 for cache; the multi-channel data storage read-write module reads the image data cached in DDR4 and sends it to the MIPI D-PHY multi-virtual channel data packet and sending module;

[0029] The MIPI D-PHY multi-virtual channel data packetization and transmission module re-encodes and encapsulates the received image information transmitted by the multi-channel data storage and reading and writing module according to the virtual channel to obtain a data packet according to the D-PHY protocol, and sends the data to the embedded platform via a MIPI D-PHY signal. After receiving the data, the embedded platform uses a decompression algorithm corresponding to the image data lossless compression algorithm to decompress the image data.

[0030] Example 2

[0031] like Figure 2 As shown, an image acquisition card of a method for using a multi-channel image acquisition card for image acquisition is mainly composed of the following functional modules: a multi-channel optical fiber communication transmission module S01, used to receive data information transmitted by the optical module of the 10 Gigabit network optical port camera, and send the configuration command to the corresponding camera and obtain the working status information of the camera; an optical fiber data packet unpacking module S02, used to unpack the information received from the multi-channel optical fiber communication transmission module, and obtain the image information in the data; an image signal processor processing and lossless compression module S03, used to perform image signal processing and compression on the image information; a multi-channel data storage read-write module S04, used to store the image information compressed by the image data lossless compression module into a memory, and read the stored image information when receiving a signal and transmit it; a MIPI D-PHY multi-virtual channel data packet and sending module S05, used to encapsulate the received image information transmitted by the multi-channel data storage read-write module into a data packet and transmit it; an acquisition card control module S06, used to parse the control command issued by the SPI communication main module of the embedded platform processor, and convert the multi-channel optical fiber to MIPI according to the control command The other modules in the D-PHY image acquisition card are configured, and the working status of the 10 Gigabit Ethernet optical port camera and the multi-channel optical fiber to MIPI D-PHY image acquisition card are collected.

[0032] The optical module of the camera establishes a communication connection with the 10 Gigabit Ethernet optical port camera through an optical fiber; the multi-channel optical fiber communication transmission module S01 transmits the optical fiber data packet sent by the 10 Gigabit Ethernet optical port camera to the back-end module, and sends the relevant configuration commands to the corresponding camera and obtains the working status information of the camera; the optical fiber data packet unpacking module S02 unpacks the received image data packet and parses the effective image information from the image transmission data packet; the image signal processor processing and lossless compression module S03 performs ISP processing on the image data, and uses the self-developed ISP algorithm to reduce noise, sharpen edges, and correct colors on the image using the median filter algorithm, bilateral filter algorithm, and sharpness algorithm to improve the image effect, and then compresses the image data after ISP processing by using the lossless compression algorithm improved based on the LZ777 algorithm, and then transmits the compressed image data through the back-end MIPI D-PHY; the multi-channel data storage read-write module S04 is used to write the image data processed by the image signal processor and the lossless compression module into the DDR4 memory for caching, and when the back-end needs to obtain image data, read the image data cached in DDR4 and provide it to MIPI D-PHY multi-virtual channel data packet and transmission module S05 is used; MIPI D-PHY multi-virtual channel data packet and transmission module S05 re-encodes and encapsulates multi-channel image data according to virtual channels according to the D-PHY protocol into MIPI D-PHY data packets, and performs packet processing according to the D-PHY protocol; then controls the back-end 2.5Gbps x4 Lane D-PHY TX IP core to send the packaged D-PHY data packets according to the D-PHY protocol; 2.5Gbps x4 Lane D-PHY TX IP core is a D-PHY TX hard core module provided by the FPGA device. Under the control of the MIPI D-PHY multi-virtual channel data packet and transmission module S05 transmission module, it generates corresponding MIPID-PHY signals according to the transmitted D-PHY data. This IP core can achieve 2.4Lane MIPI D-PHY signal output at 5Gbps rate; the acquisition card is also equipped with a D-PHY protocol test module, which is a test module for D-PHY transmission link and transmission protocol provided by the acquisition card. It can generate corresponding D-PHY test data packets according to the configuration commands to test the stability of the D-PHY transmission link between the acquisition card and the embedded platform, so as to facilitate the rapid debugging and positioning of D-PHY transmission problems between the acquisition card and the embedded platform; the acquisition card control module S06 is used to process and parse the communication control commands sent by the embedded platform processor through the SPI bus, and configure other functional modules in the acquisition card according to the parsed command data. At the same time, it will collect the working status information of the camera and the acquisition card for the embedded platform processor to query; the SPI communication main module of the embedded platform processor establishes an SPI communication connection with the acquisition card through the SPI bus, and the acquisition card receives the control commands sent by the SPI main module of the embedded platform processor. The embedded platform processor reads the working status information of the camera and the acquisition card through this module. After receiving the data, the embedded platform uses the decompression algorithm corresponding to the lossless compression algorithm of the image signal processor processing and lossless compression module S03 to decompress the image data. .

[0033] In summary, the present invention proposes a method for image acquisition using a multi-channel image acquisition card, which converts multi-channel image data input by multiple optical fibers into MIPI D-PHY signals and outputs them to the MIPI D-PHY interface of the embedded platform processor for reception. On the basis of supporting multi-camera applications, it solves the limitations of the embedded platform in terms of transmission distance and transmission bandwidth in image vision applications, and increases the transmission bandwidth by 50% on the basis of the original link limit bandwidth, which can simultaneously meet the application requirements of long-distance and high-bandwidth transmission of multiple cameras, and can perform noise reduction, edge sharpening, color restoration correction and other processing on the original image captured by the camera, thereby improving the image quality and expanding the application scenarios of the embedded platform in the field of machine vision.

Claims

1. A method for image acquisition using a multi-channel image acquisition card, characterized in that: The following steps are involved: S1. The 10G optical port camera transmits the collected image data to the multi-channel optical fiber communication transmission module of the multi-channel image acquisition card through optical fiber; the multi-channel optical fiber communication transmission module is used to interact with the optical module of the 10G optical port camera for data, receive the information of the optical module data transmission, and send the configuration command to the corresponding camera and obtain the working status information of the camera; S2. The multi-channel optical fiber communication transmission module of the image acquisition card sends the image data transmitted by the optical module to the optical fiber data packet unpacking module of the image acquisition card; the optical fiber data packet unpacking module is used to interact with the multi-channel optical fiber communication transmission module for data, unpack the received information of the multi-channel optical fiber communication transmission module, and obtain the image information in the data; S3. The fiber optic data packet unpacking module of the image acquisition card obtains image information from the image data and sends it to the image signal processor processing and lossless compression module of the image acquisition card; S4. The image signal processor processing and lossless compression module of the image acquisition card performs noise reduction, edge sharpening and color restoration correction processing on the image data, and then compresses the image data through lossless compression algorithm processing; the image signal processor processing and lossless compression module is used to interact with the optical fiber data packet unpacking module to perform image signal processing on the image information, and compress the processed image information; S5. The multi-channel data storage read / write module of the image acquisition card writes the compressed image data to the DDR4 for cache; S6. The multi-channel data storage read-write module of the image acquisition card reads the image data cached in DDR4 and sends it to the MIPI D-PHY multi-virtual channel data packet and sending module of the image acquisition card; the multi-channel data storage read-write module is used to interact with the image signal processor processing and lossless compression module for data, store the image information compressed by the image signal processor processing and lossless compression module into the memory, and read the image information stored in the memory and transmit it when receiving the signal; the MIPI D-PHY multi-virtual channel data packet and sending module is used to interact with the multi-channel data storage read-write module and the D-PHY protocol test module for data, encapsulate the image information received from the multi-channel data storage read-write module into a data packet and transmit it; S7. The MIPI D-PHY multi-virtual channel data packet and sending module of the image acquisition card re-encodes and encapsulates the received image information transmitted by the multi-channel data storage read-write module according to the D-PHY protocol according to the virtual channel to obtain a data packet, and sends the data as a MIPI D-PHY signal; The image acquisition card also includes an acquisition card control module, which is used to interact with the embedded platform processor for data, parse the control commands issued by the SPI communication main module of the embedded platform processor, configure other modules in the multi-channel optical fiber to MIPI D-PHY image acquisition card according to the control commands, and collect the working status of the 10 Gigabit network optical port camera and the multi-channel optical fiber to MIPI D-PHY image acquisition card.

2. The method for image acquisition using a multi-channel image acquisition card according to claim 1, characterized in that: The image signal processor processing and lossless compression module of the image acquisition card includes an ISP algorithm module, which uses a median filtering algorithm, a bilateral filtering algorithm and a sharpness algorithm to perform noise reduction, edge sharpening and color correction processing on the image information.

3. The method for image acquisition using a multi-channel image acquisition card according to claim 1, characterized in that: The image signal processor processing and lossless compression module of the image acquisition card uses a lossless compression algorithm obtained by improving the LZ777 algorithm to compress the image information processed by the image signal processor processing and lossless compression module.

4. The method for image acquisition using a multi-channel image acquisition card according to claim 1, characterized in that: The multi-channel data storage read-write module of the image acquisition card stores the image information processed by the image signal processor and compressed by the lossless compression module into the DDR4 memory.

5. The method for image acquisition using a multi-channel image acquisition card according to claim 1, characterized in that: The MIPI D-PHY multi-virtual channel data packet and sending module of the image acquisition card re-encodes, encapsulates and merges the image information received from the multi-channel data storage and reading and writing module according to the virtual channel to obtain a data packet according to the D-PHY protocol.

Images