A multi-channel low-light image acquisition system

By designing a multi-channel low-light image acquisition system, using five-channel CMOS low-light image sensors and image processing algorithms, the problem of panoramic image acquisition and processing in low-illumination environments is solved, and efficient and clear 360-degree image acquisition and display is achieved.

CN115567759BActive Publication Date: 2025-02-07BEIJING RES INST OF TELEMETRY +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210915624.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-08-01
Publication Date
2025-02-07
Estimated Expiration
2042-08-01

AI Technical Summary

Technical Problem

The prior art is difficult to effectively collect and process panoramic image information in low illumination environments, especially when there is a lot of noise in low light images.

Method used

Design a multi-channel low light image acquisition system, adopting five-channel CMOS low light image sensor, adapting to different light intensities through automatic exposure and automatic gain control, combining Gaussian filtering, mean filtering and edge processing and other image processing algorithms to achieve 360-degree no Image acquisition and processing of blind spots.

Benefits of technology

In low illumination environment, the acquisition integrity and reliability of image information is significantly improved, noise is reduced, image clarity is improved, and 360-degree image data acquisition and display is achieved without dead angles.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115567759B_ABST
    Figure CN115567759B_ABST
Patent Text Reader

Abstract

The present invention provides a multi-channel low-light image acquisition system, comprising: a multi-channel low-light image data acquisition front end, an image data processing module, an image data storage module, an interface control module and an image display and control terminal; the multi-channel low-light image data acquisition front end converts an optical signal into an electrical signal, and then outputs a digital image signal after acquisition; the image data processing module performs format conversion, filtering, noise reduction and other processing on the image signal and sends it to the image data storage module according to the label of each image sensor; the image data storage module stores the collected five-channel low-light image data in a memory according to the label of each image sensor. The present invention can configure five-channel CMOS image sensors at the same time, realize 360-degree image data acquisition and display without dead angles, can obtain the integrity and reliability of image information in low-light environment, and output the processed image data for display on the display and control terminal, greatly improving the acquisition of image information in low-light environment.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of image acquisition, and in particular to a multi-channel low-light level image acquisition system. Background Art

[0002] With the continuous development of modern image and video processing technology, images have gradually become one of the main means for people to obtain external information. Therefore, higher requirements are placed on image processing systems, as well as on the real-time performance, clarity and other performance of image processing. In order to obtain more complete environmental image information, higher requirements are also placed on the demand for panoramic images. Currently, there are relatively few low-light image acquisition devices on the market, which can hardly meet the image information acquisition requirements in environments with relatively weak light intensity. Moreover, in low-light environments, the acquisition and processing of low-light images contains more noise than images under normal light intensity. Moreover, when the illumination decreases further, the noise contained in the low-light image also increases further, which poses a higher challenge to the image processing system.

[0003] In view of the above problems, there is an urgent need for a high-definition panoramic low-light image acquisition device that can capture and process panoramic image information in a low-light environment. Summary of the invention

[0004] The present invention is to solve the problem of collecting and processing panoramic image information in a low-light environment, and provides a multi-channel low-light image collection system. The multi-channel low-light image data collection front end includes five CMOS low-light image sensors, which convert optical signals into electrical signals, and then output digital image signals after collection; the image data processing module performs format conversion, filtering, noise reduction and other processing on the image signal and sends it to the image data storage module according to the label of each image sensor; the image data storage module stores the collected five-channel low-light image data in the memory according to the label of each image sensor; the interface control module sends the image data to the image display and control terminal according to the protocol format of the corresponding interface according to the current interface protocol; the image display and control terminal can simultaneously display the image before and after algorithm processing, and can configure the five-channel CMOS image sensors at the same time to realize 360-degree image data collection and display without dead angles. The present invention can simultaneously configure the five-channel CMOS image sensors to realize 360-degree image data collection and display without dead angles, can obtain the integrity and reliability of image information in a low-light environment, and output the processed image data for display on the display and control terminal, greatly improving the collection of image information in a low-light environment.

[0005] The present invention provides a multi-channel low-light-level image acquisition system, comprising a multi-channel low-light-level image data acquisition front end and an image data processing module electrically connected in sequence, an image data storage module electrically connected to the image data processing module, an interface control module and an image display and control terminal electrically connected to the image data storage module and the interface control module;

[0006] The multi-channel low-light image data acquisition front end performs image acquisition and converts optical signals into electrical signals, which are then acquired and converted into digital image information and output to the image data processing module. After receiving the digital image information, the image data processing module performs format conversion, filtering, and noise reduction, and then outputs it to the image data storage module and the interface control module, and then outputs it to the image display and control terminal through the interface control module. The image display and control terminal displays the image information before and after processing. The image display and control terminal can select the acquisition channel of the multi-channel low-light image data acquisition front end to select different angles for image information acquisition.

[0007] The multi-channel low-light-level image acquisition system described in the present invention, as a preferred embodiment, the multi-channel low-light-level image data acquisition front end includes an optical array, an analog processing module and a digital processing module electrically connected to the optical array in sequence, a system control module electrically connected to the optical array, the analog processing module, and the digital processing module, an I2C register configuration module electrically connected to the digital processing module, and a clock unit electrically connected to the digital processing module and the system control module;

[0008] The optical array includes at least two low-light image sensors. The optical array adjusts the exposure intensity through automatic exposure and automatic gain control to adapt to different light intensity environments. The system control module outputs row and field information to the optical array to control the optical array to collect image frames. The optical array converts the collected light signal into an electrical signal containing image information and outputs it to the analog processing module. The analog processing module receives the electrical signal and outputs the analog data to the digital processing module after framing and transmitting the image data under the control of the system control module. The digital processing module converts the analog image information into digital image information after analog-to-digital conversion of the analog data and outputs it to the image data processing module. The digital image information includes digital image signals, optical array row signals, optical array field signals and a clock signal accompanying the image data. The clock unit provides clock signals to the optical array, the digital processing module and the system control module. The I2C register configuration module is electrically connected to the image data processing module.

[0009] In the multi-channel low-light image acquisition system described in the present invention, as a preferred embodiment, the digital processing module can output one channel of digital image signals or all digital image signals simultaneously;

[0010] The output format of the digital processing module is MIPI. The resolution of each digital image signal is 1920*1080@25Hz, and the resolution of the image display terminal can be 1920*1080@80fps.

[0011] In the multi-channel low-light-level image acquisition system described in the present invention, as a preferred embodiment, the optical array further includes a light sensor arranged on one side of each low-light-level image sensor, the light sensor being used to sense the light intensity of the current environment and control the exposure time and gain;

[0012] The number of low-light-level image sensors is 5, and the low-light-level image sensors are CMOS low-light-level image sensors 2M4U. The 5 low-light-level image sensors are evenly arranged in a circular structure and distributed around the environment to be collected.

[0013] In the multi-channel low-light-level image acquisition system described in the present invention, as a preferred embodiment, the low-light-level image sensor is configured through an I2C interface, and the frame rate and multi-sensor synchronization are externally controlled through an EFSYNC pin.

[0014] In a multi-channel low-light image acquisition system described in the present invention, as a preferred embodiment, the analog processing module, the digital processing module, the system control module and the image data processing module are all arranged on an FPGA processing board, and the low-light image sensor is connected to the FPGA processing board via an I2C interface and receives configuration information, wherein the configuration information includes a chip select signal, exposure time and resolution.

[0015] In the multi-channel low-light image acquisition system described in the present invention, as a preferred embodiment, the accompanying clock and working clock of the low-light image sensor are connected to the global clock pin of the FPGA processing board, and the SDA and CLK pins of the I2C register configuration module are pulled up using 3.3V;

[0016] The system clock distributes the clock to the multi-channel low-light image data acquisition front end, image data storage module, interface control module and image display and control terminal through the MMCM inside the FPGA processing board, and performs system reset and working timing configuration.

[0017] In the multi-channel low-light image acquisition system described in the present invention, as a preferred embodiment, the image data processing module filters and reduces noise on the digital image information through an image processing algorithm, and the image processing algorithm includes any one or more of the following: Gaussian filtering, mean filtering and edge processing;

[0018] The image data processing module includes a data processing control module electrically connected to the interface control module, a system clock, an acquisition control module electrically connected to the multi-channel low-light image data acquisition front end, a PROM module and a data storage module electrically connected to the image data storage module;

[0019] The data processing control module is connected to the image display and control terminal through the interface control module and receives and parses the instructions of the image display and control terminal. The data processing control module converts the format, filters and reduces the noise of the digital image information and outputs it to the data storage module. The acquisition control module receives the digital image information output by the multi-channel low-light image data acquisition front end and outputs it to the data processing control module. The data storage module and the image data storage module store and read synchronously.

[0020] In the multi-channel low-light image acquisition system described in the present invention, as a preferred embodiment, the image data storage module is three RAM chips IS66WVH8M8ALL / BLL.

[0021] In the multi-channel low-light image acquisition system described in the present invention, as a preferred embodiment, the interface control module includes a USB module, and the USB module is USB3.0.

[0022] The present invention comprises a multi-channel low-light-level image data acquisition front end, an image data processing module, an image data storage module, an interface control module, and an image display and control terminal; the multi-channel low-light-level image data acquisition front end comprises five CMOS low-light-level image sensors, which convert optical signals into electrical signals, and then output digital image signals after acquisition; the image data processing module performs format conversion, filtering, noise reduction and other processing on the image signals and sends them to the image data storage module according to the label of each image sensor; the image data storage module stores the acquired five-channel low-light-level image data in a memory according to the label of each image sensor; the interface control module sends the image data to the image display and control terminal according to the protocol format of the corresponding interface in accordance with the current interface protocol; the image display and control terminal can simultaneously display the images before and after algorithm processing, and can configure the five-channel CMOS image sensors at the same time to realize 360-degree image data acquisition and display without dead angles.

[0023] The multi-channel low-light image acquisition front end of the present invention can realize 360-degree image data acquisition without blind spots under the condition that the ambient light intensity is lower than 200Lx; the image data processing module performs filtering, noise reduction, edge processing and other processing on the acquired image data and outputs image information; the image display and control terminal can display the image information before and after processing, and can select the acquisition channel of the low-light image sensor and select different angles for image information acquisition.

[0024] The multi-channel low-light-level image acquisition front end of the present invention outputs the image signal acquired by each low-light-level image sensor in MIPI format, and can also output one channel of low-light-level image acquisition information, wherein the resolution of each channel of image signal is 1920*1080@25Hz.

[0025] Compared with the existing image acquisition devices on the market, the present invention adds an image processing algorithm, and through the integration of Gaussian filtering, mean filtering, edge processing and other algorithms, the clarity of image information is improved without changing the original image information.

[0026] For the five-channel low-light image acquisition front end, any one of the five channels can be selected for image information acquisition, and the five-channel low-light image sensors can simultaneously acquire image information of the surrounding environment, and upload the five-channel image information sequentially to the image display and control terminal for display.

[0027] The image data processing module controls the reception and storage of each frame of image information by receiving the line signal, field signal and the accompanying clock of the image data output by the low-light image acquisition front end.

[0028] The data storage module can cache the image data processed by the image processing module.

[0029] The image display and control terminal can be configured online with any image sensor of the five-way low-light image acquisition front end, which can realize image information acquisition at different angles, and can also realize 360-degree image information acquisition without blind spots at the same time, and upload it sequentially to the host computer for display.

[0030] Image data acquisition and processing are realized through FPGA. Acquisition and control are realized through the PL part of FPGA, and image processing algorithm is realized through the PS part of FPGA, which improves the processing efficiency of image data and the integration of the whole system.

[0031] The image acquisition front end can adjust the exposure intensity through automatic exposure and automatic gain control, thereby improving the adaptability of the multi-channel low-light image acquisition device under different light intensity environments.

[0032] The present invention has the following advantages:

[0033] (1) The present invention adopts five low-light image sensors to realize 360-degree image information acquisition without blind spots according to the field of view angle range of the low-light image sensor, and selects the low-light image sensor 2M4U that can adapt to low-light environments for image information acquisition. In order to enhance the reliability of the image acquisition device and the clarity of image information acquisition, each low-light image sensor is equipped with a light sensor to sense the light intensity of the current environment, so as to control the exposure time and gain size of the low-light image sensor.

[0034] (2) Since the noise of the collected low-light-level images is relatively large in an environment with low light intensity, the present invention implements noise reduction and filtering of the collected image information by fusing three processing methods, namely, Gaussian filtering, mean filtering, and edge processing. This improves the image clarity while realizing the practicality of the multi-channel low-light-level image acquisition device.

[0035] (3) In order to solve the problem of multi-channel low-light image acquisition and display, the present invention uses multiple industrial-grade data storage chips IS66WVH8M8ALL / BLL to achieve high-speed data caching, which not only meets the processing capacity of the multi-channel low-light image acquisition device, but also improves the performance of the entire device.

[0036] (4) The image display and control terminal of the present invention is connected to the multi-channel low-light image acquisition and processing device via USB3.0. In order to improve the contrast of the multi-channel low-light image acquisition device and the intuitiveness of image display, the images before and after algorithm processing are uploaded to the image display and control terminal to complete the display of image information.

[0037] (5) The image acquisition module and image processing module of the present invention are both implemented on a FPGA board. The FPGA has a fast data processing speed and a parallel processing structure, so that the real-time processing and display of five low-light images can be realized. At the same time, the input low-light image signal is digitally filtered, denoised, enhanced, etc. through the arm part of the FPGA. In an illumination environment below 200Lx, the output image is clearly visible.

[0038] (6) In the image acquisition front end of the present invention, the single-channel low-light image acquisition can achieve a maximum image resolution of 1920*1080@80Hz. Therefore, during normal system acquisition, 360-degree circular acquisition and output can be performed. When sensitive information or a target that needs to be paid attention to is found in the corresponding direction, the image display and control terminal can be configured to receive image information in the corresponding direction. This not only improves the utilization rate of the system but also can collect key information for key targets. The present invention has a high degree of integration, so that the entire device is small in size, light in weight, and low in power consumption. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 This is a block diagram of a multi-channel low-light image acquisition system;

[0040] Figure 2 It is a schematic diagram of the data flow and internal functional modules of a low-light-level image acquisition front end of a multi-channel low-light-level image acquisition system;

[0041] Figure 3 It is an overall block diagram of a multi-channel low-light image acquisition system;

[0042] Figure 4 It is a schematic diagram of the hardware part of a multi-channel low-light image acquisition system;

[0043] Figure 5 This is a logic block diagram of the internal FPGA of a multi-channel low-light image acquisition system;

[0044] Figure 6 The figure shows image information collected by a multi-channel low-light-level image acquisition system in a weak light intensity environment.

[0045] Reference numerals:

[0046] 1. Multi-channel low-light image data acquisition front end; 11. Optical array; 12. Analog processing module; 13. Digital processing module; 14. System control module; 15. I2C register configuration module; 16. Clock unit; 2. Image data processing module; 21. Data processing control module; 22. System clock; 23. Acquisition control module; 24. PROM module; 25. Data storage module; 3. Image data storage module; 4. Interface control module; 5. Image display and control terminal. DETAILED DESCRIPTION

[0047] The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments.

[0048] Example 1

[0049] like Figures 1 to 4 As shown, a multi-channel low-light image acquisition system comprises a multi-channel low-light image data acquisition front end 1, an image data processing module 2, an image data storage module 3, an interface control module 4, which are electrically connected to the image data processing module 2, and an image display and control terminal 5, which are electrically connected to the image data storage module 3 and the interface control module 4.

[0050] The multi-channel low-light image data acquisition front end 1 performs image acquisition and converts the optical signal into an electrical signal, and then acquires and converts it into digital image information and outputs it to the image data processing module 2. After receiving the digital image information, the image data processing module 2 performs format conversion, filtering, and noise reduction, and then outputs it to the image data storage module 3 and the interface control module 4, and then outputs it to the image display and control terminal 5 through the interface control module 4.

[0051] The image display and control terminal 5 displays the image information before and after processing. The image display and control terminal 5 can select the acquisition channels of the multi-channel low-light image data acquisition front end 1 to select different angles for image information acquisition;

[0052] The multi-channel low-light image data acquisition front end 1 comprises an optical array 11, an analog processing module 12 and a digital processing module 13 electrically connected to the optical array 11 in sequence, a system control module 14 electrically connected to the optical array 11, the analog processing module 12 and the digital processing module 13, an I2C register configuration module 15 electrically connected to the digital processing module 13, and a clock unit 16 electrically connected to the digital processing module 13 and the system control module 14;

[0053] The optical array 11 includes at least two low-light image sensors. The optical array 11 adjusts the exposure intensity through automatic exposure and automatic gain control to adapt to different light intensity environments. The system control module 14 outputs row and field information to the optical array 11 to control the optical array 11 to collect image frames. The optical array 11 converts the collected light signal into an electrical signal containing image information and outputs it to the analog processing module 12. The analog processing module 12 receives the electrical signal and performs frame transmission of the image data under the control of the system control module 14, and then outputs the analog data to the digital processing module 13. The digital processing module 13 performs analog-to-digital conversion on the analog data, converts the analog image information into digital image information, and outputs it to the image data processing module 2. The digital image information includes a digital image signal, an optical array row signal, an optical array field signal, and a clock signal accompanying the image data. The clock unit 16 provides a clock signal to the optical array 11, the digital processing module 13, and the system control module 14. The I2C register configuration module 15 is electrically connected to the image data processing module 2.

[0054] The digital processing module 13 can output one digital image signal or all digital image signals at the same time;

[0055] The format of the digital processing module 13 output is MIPI, the resolution of each digital image signal is 1920*1080@25Hz, and the resolution displayed by the image display and control terminal 5 can be 1920*1080@80fps;

[0056] The optical array 11 also includes a light sensor disposed on one side of each low-light image sensor, the light sensor being used to sense the light intensity of the current environment and control the exposure time and gain;

[0057] The number of low-light-level image sensors is 5, and the low-light-level image sensors are CMOS low-light-level image sensors 2M4U. The 5 low-light-level image sensors are evenly arranged in a circular structure and distributed around the environment to be collected.

[0058] The low-light image sensor is configured through the I2C interface, and the frame rate and multi-sensor synchronization are externally controlled through the EFSYNC pin;

[0059] The analog processing module 12, the digital processing module 13, the system control module 14 and the image data processing module 2 are all arranged on the FPGA processing board. The low-light image sensor is connected to the FPGA processing board through the I2C interface and receives configuration information, which includes a chip selection signal, exposure time and resolution.

[0060] The accompanying clock and working clock of the low-light image sensor are connected to the global clock pin of the FPGA processing board, and the SDA and CLK pins of the I2C register configuration module 15 are pulled up using 3.3V;

[0061] The system clock 22 distributes the clock to the multi-channel low-light image data acquisition front end 1, the image data storage module 3, the interface control module 4 and the image display and control terminal 5 through the MMCM inside the FPGA processing board, and performs system reset and working timing configuration;

[0062] The image data processing module 2 filters and reduces noise on the digital image information through an image processing algorithm, and the image processing algorithm includes any one or more of the following: Gaussian filtering, mean filtering and edge processing;

[0063] The image data processing module 2 includes a data processing control module 21 electrically connected to the interface control module 4, a system clock 22, an acquisition control module 23 electrically connected to the multi-channel low-light image data acquisition front end 1, a PROM module 24 and a data storage module 25 electrically connected to the image data storage module 3;

[0064] The data processing control module 21 is connected to the image display and control terminal 5 through the interface control module 4 and receives and analyzes the instructions of the image display and control terminal 5. The data processing control module 21 performs format conversion, filtering, and noise reduction on the digital image information and then outputs it to the data storage module 25. The acquisition control module 23 receives the digital image information output by the multi-channel low-light image data acquisition front end 1 and outputs it to the data processing control module 21. The data storage module 25 and the image data storage module 3 perform storage and reading synchronously.

[0065] Image data storage module 3 is three RAM chips IS66WVH8M8ALL / BLL;

[0066] The interface control module 4 includes a USB module, and the USB module is USB3.0.

[0067] Example 2

[0068] like Figure 1As shown, a multi-channel low-light image acquisition system includes five low-light image sensors distributed in a 360° circular structure, which are then connected to an FPGA image acquisition module through an FPCB. The image acquisition module is connected to a USB3.0 interface cable 4 and connected to an image display and control terminal 5 for displaying image information.

[0069] like Figure 2 As shown, the multi-channel low-light image data acquisition front end 1 includes an optical array 11, an analog processing module 12, a digital processing module 13, a system control module 14, an I2C register configuration module 15 and a clock unit. After power-on, the multi-channel low-light image data acquisition front end 1 performs current image data acquisition and conversion according to the configuration information after the last power-off; the system control module 14 performs image frame acquisition and processing by receiving line field information, and sends each frame of image information to the analog processing module 12; the analog processing module 12 performs framing transmission of image data, and sends the analog data to the digital processing module 13; the digital processing module 13 performs analog-to-digital conversion, converts the analog image information into digital image information, and outputs it through the MIPI interface; in the whole process, the clock unit plays a very important role, providing a working clock for each module, and playing a highly synchronized role for the entire image acquisition front end.

[0070] like Figure 3 As shown, the data processing module 2 has an independent clock unit inside, which distributes the clock to the entire module, distributes the clock to other modules through the MMCM inside the FPGA, performs system reset, and configures the working timing.

[0071] like Figure 3 As shown, the low-light image sensor outputs the captured image signal in MIPI format, with an image signal resolution of 1920*1080@25Hz, and can simultaneously capture five low-light images; when configured to capture one low-light image through the display and control terminal, the maximum resolution can reach 1920*1080@80fps.

[0072] like Figure 4 As shown, each low-light image sensor can be configured and connected to the FPGA processing board through the I2C interface to receive the configuration information sent by the display and control terminal. Then, each low-light image sensor can be configured through the single-bus I2C. The configurable information includes chip select signal, exposure time, resolution, etc. Each low-light image sensor is configured separately. When 360° circular acquisition is adopted, the image information collected by the five low-light image sensors is sequentially stored or read through the actual number of the low-light image sensor.

[0073] like Figure 4As shown, the image data storage module 3 uses three industrial-grade low-power RAM chips IS66WVH8M8ALL / BLL to achieve high-speed data caching through bit width expansion. In order to improve the data storage efficiency, a data synchronization storage processing method is added to the FPGA processing module to ensure that the storage and reading of the three RAM chips are carried out synchronously, ultimately ensuring data correctness and reading speed.

[0074] like Figure 4 As shown in the figure, the low-light image sensor uses the 2M4U low-light image sensor, which has the characteristics of high photosensitivity, high dynamic range (supporting two or three exposures between lines with wide dynamic range), high signal-to-noise ratio, support for high-speed DPC, support for external control of frame rate, multi-sensor synchronization, horizontal or vertical window adjustment, horizontal or vertical window flipping, and internal temperature sensor; pixel size is 4.0um×4.0um; lens optical size is 1 / 1.8"; sensitivity is 10800mV / Lux﹒s; signal-to-noise ratio is 43dB. At present, 2M4U is an advanced digital CMOS image sensor in the field of surveillance cameras, supporting a data transmission rate of up to 1920H×1080V@90fps. 2M4U outputs raw format images, with an effective pixel window of 1920H×1080V, and supports complex on-chip operations, such as windowing, horizontal or vertical mirroring, etc. 2M4U can be configured through a standard I2C interface, and external control of frame rate and multi-sensor synchronization can be achieved through the EFSYNC pin.

[0075] like Figure 5 As shown, five low-light image sensors are directly connected to the FPGA, and each low-light image sensor is connected to a bank, wherein the local clock and working clock of the low-light image sensor are connected to the global clock pin of the FPGA, and other pins can be connected to the common IO pins of the FPGA, and the SDA and CLK pins of I2C need to be pulled up with 3.3V; in order to improve the reliability of power supply of each module and the independence of each part of the power supply, the five-channel low-light image acquisition front end and the image data storage module 3 use independent power chips to power the modules.

[0076] like Figure 6 As shown, in order to verify that the low-light image sensor can collect and process image information in a low-light environment, the present invention uses existing conditions to build a closed and light-proof environment with an ambient light illumination of less than 200Lx. As can be seen from the figure, after the low-light image collection and processing device is used, the low-light image obtained by the present invention is clear and has low noise, which meets the requirements of further processing and recognition of the low-light image in the later stage.

[0077] like Figure 6As shown, the left side is the image information before processing, and the right side is the image information after processing. Obviously, the noise in the left picture is relatively large, while the right side is better and closer to the color of the actual object, which is conducive to further processing later. There is a clear contrast between 1, 2, and 3 marked in the figure.

[0078] The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can make equivalent replacements or changes according to the technical scheme and inventive concept of the present invention within the technical scope disclosed by the present invention, which should be covered by the protection scope of the present invention.

Claims

1. A multi-channel low-light image acquisition system, characterized by: It comprises a multi-channel low-light image data acquisition front end (1), an image data processing module (2) electrically connected in sequence, an image data storage module (3) electrically connected to the image data processing module (2), an interface control module (4), and an image display and control terminal (5) electrically connected to the image data storage module (3) and the interface control module (4); The multi-channel low-light image data acquisition front end (1) acquires images and converts optical signals into electrical signals, which are then acquired and converted into digital image information and output to the image data processing module (2). The image data processing module (2) receives the digital image information and performs format conversion, filtering and noise reduction before outputting it to the image data storage module (3) and the interface control module (4), and then outputs it to the image display and control terminal (5) via the interface control module (4). The image display and control terminal (5) displays image information before and after processing, and the image display and control terminal (5) can select the acquisition channel of the multi-channel low-light image data acquisition front end (1) to select different angles for image information acquisition; The multi-channel low-light image data acquisition front end (1) comprises an optical array (11), an analog processing module (12) and a digital processing module (13) electrically connected to the optical array (11) in sequence, a system control module (14) electrically connected to the optical array (11), the analog processing module (12) and the digital processing module (13), an I2C register configuration module (15) electrically connected to the digital processing module (13), and a clock unit (16) electrically connected to the digital processing module (13) and the system control module (14); The optical array (11) comprises at least two low-light image sensors. The optical array (11) adjusts exposure intensity through automatic exposure and automatic gain control to adapt to different light intensity environments. The system control module (14) outputs row field information to the optical array (11) to control the optical array (11) to collect image frames. The optical array (11) converts the collected light signals into electrical signals containing image information and outputs them to the analog processing module (12). The analog processing module (12) receives the electrical signals and performs frame transmission of image data under the control of the system control module (14). The analog data is output to the digital processing module (13), the digital processing module (13) performs analog-to-digital conversion on the analog data, and then converts the analog image information into the digital image information and outputs it to the image data processing module (2), the digital image information includes a digital image signal, an optical array row signal, an optical array field signal and a clock signal accompanying the image data, the clock unit (16) provides a clock signal to the optical array (11), the digital processing module (13) and the system control module (14), and the I2C register configuration module (15) is electrically connected to the image data processing module (2); The digital processing module (13) can output one digital image signal or all digital image signals simultaneously; The digital processing module (13) outputs a MIPI format, and the resolution of each digital image signal is 1920*1080@25Hz. The image display and control terminal (5) can display a resolution of 1920*1080@80fps.

2. The multi-channel low-light image acquisition system according to claim 1, characterized in that: The optical array (11) further comprises a light sensor arranged on one side of each of the low-light-level image sensors, the light sensor being used to sense the light intensity of the current environment and control the exposure time and gain; The number of the low-light-level image sensors is 5, and the low-light-level image sensors are CMOS low-light-level image sensors 2M4U. The 5 low-light-level image sensors are evenly arranged in a circular structure and distributed around the environment to be collected.

3. The multi-channel low-light image acquisition system according to claim 1, characterized in that: The low-light image sensor is configured through the I2C interface and the frame rate and multi-sensor synchronization are externally controlled through the EFSYNC pin.

4. The multi-channel low-light image acquisition system according to claim 1, characterized in that: The analog processing module (12), the digital processing module (13), the system control module (14) and the image data processing module (2) are all arranged on an FPGA processing board, and the low-light image sensor is connected to the FPGA processing board via an I2C interface and receives configuration information, wherein the configuration information includes a chip selection signal, exposure time and resolution.

5. The multi-channel low-light image acquisition system according to claim 4, characterized in that: The accompanying clock and working clock of the low-light image sensor are connected to the global clock pin of the FPGA processing board, and the SDA and CLK pins of the I2C register configuration module (15) are pulled up using 3.3V; The system clock (22) distributes the clock to the multi-channel low-light image data acquisition front end (1), the image data storage module (3), the interface control module (4) and the image display and control terminal (5) through the MMCM inside the FPGA processing board, and performs system reset and operation sequence configuration.

6. The multi-channel low-light image acquisition system according to claim 5, characterized in that: The image data processing module (2) filters and reduces noise on the digital image information by using an image processing algorithm, wherein the image processing algorithm includes any one or more of the following: Gaussian filtering, mean filtering and edge processing; The image data processing module (2) comprises a data processing control module (21) electrically connected to the interface control module (4), a system clock (22), an acquisition control module (23) electrically connected to the multi-channel low-light image data acquisition front end (1), a PROM module (24) and a data storage module (25) electrically connected to the image data storage module (3); The data processing control module (21) is connected to the image display and control terminal (5) through the interface control module (4) and receives and analyzes the instructions of the image display and control terminal (5). The data processing control module (21) performs format conversion, filtering and noise reduction on the digital image information and then outputs it to the data storage module (25). The acquisition control module (23) receives the digital image information output by the multi-channel low-light image data acquisition front end (1) and outputs it to the data processing control module (21). The data storage module (25) and the image data storage module (3) perform storage and reading synchronously.

7. The multi-channel low-light image acquisition system according to claim 1, characterized in that: The image data storage module (3) is three RAM chips IS66WVH8M8ALL / BLL.

8. The multi-channel low-light image acquisition system according to claim 1, characterized in that: The interface control module (4) comprises a USB module, and the USB module is USB 3.0.

Citation Information

Patent Citations

  • Special low-light image processing system and device thereof

    CN113422883A

  • Building video acquisition monitoring system based on CMOS image sensor

    CN211860280U