High-speed area-array camera image processing method and high-speed area-array camera
By integrating image processing functions in the camera, accumulating and averaging images of odd and even frames, the problems of slow data acquisition speed and low imaging resolution of traditional surface array cameras are solved, high-speed acquisition and image transmission are achieved, and cost is reduced , and improves the signal-to-noise ratio and imaging efficiency of optical detection.
Patent Information
- Application Number
- CN202411443280.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-16
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2044-10-16
AI Technical Summary
Traditional surface array cameras need to transmit each frame of images to the computer for processing, resulting in slow data acquisition speed, low imaging resolution, poor testing efficiency, and high cost.
The computer multi-frame image processing steps are integrated into the camera. By accumulating and averaging odd and even frame images, the processed images are calculated and image processing is performed inside the camera, which significantly improves the optical detection signal-to-noise ratio and imaging efficiency. .
It realizes high-speed acquisition and high-speed transmission of images, reduces the requirements for acquisition card and computer processing capabilities, reduces information acquisition, transmission and processing links, reduces costs and increases efficiency, and avoids the problem of image frame loss, and improves images Information accuracy and imaging resolution.
Smart Images

Figure CN118967485A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of optical detection technology, and in particular to a high-speed area array camera image processing method and a high-speed area array camera. Background Art
[0002] In the field of optical inspection, area array cameras are used to collect spectral signals. This traditional camera needs to transmit each frame of the image to the computer for calculation, and the camera cannot process and calculate the image. Traditional area array cameras have the disadvantages of slow data acquisition speed, low imaging resolution, poor testing efficiency, and easy frame loss and jamming when transmitting a large number of images. In order to improve the transmission and processing speed of images, while taking into account high speed and high resolution, other performance of area array cameras will inevitably be affected, and the cost will also be greatly increased. Summary of the invention
[0003] The present invention mainly solves the technical problem that traditional cameras need to transmit each frame of image to a computer for calculation, and the camera cannot process and calculate the image. The present invention discloses a high-speed area array camera image processing method and a high-speed area array camera, which integrate the original computer multi-frame image processing steps into the camera, accumulate and average the odd frames and even frames inside the camera, and calculate to obtain the processed image, so as to realize high-speed acquisition and high-speed transmission of images, and significantly improve the optical detection signal-to-noise ratio and imaging efficiency.
[0004] The present invention provides a high-speed area array camera image processing method, comprising the following process: Step 1: A high-speed area array camera collects original image information; Step 2: The high-speed area array camera identifies the odd-numbered frame images and the even-numbered frame images from the collected original image information; Step 3, using processing method 1 or processing method 2 to process the original image information and calculate to obtain a fused information image; The processing method 1 includes the following steps: Step 301-1: The high-speed area array camera takes all odd frames of the image according to each pixel ( x , y ) to get the average odd-numbered frame image. The formula is as follows:
[0005] In formula (1), x is the horizontal coordinate of the pixel point; y is the vertical coordinate of the pixel; 2 n is the number of continuously collected original images, where n is the number of odd frames; The odd-numbered frames of the continuously acquired images; Ais the average odd-numbered frame image collected continuously; Step 302-1: The high-speed area array camera takes all even frames of the image according to each pixel point ( x , y ) to get the average even-numbered frame image. The formula is as follows:
[0006] In formula (2), x is the horizontal coordinate of the pixel point; y is the vertical coordinate of the pixel; 2 n is the number of continuously acquired original images, where n is the number of even-numbered frames; is the even-numbered frame of the captured image; B It is the average even-numbered frame image collected continuously; Step 303-1, the high-speed area array camera transmits the processed average odd-numbered frame image and the average even-numbered frame image to the computer, and the computer performs calculations according to the following formula to obtain the final calculated and merged 1-frame fusion information image, namely:
[0007] In formula (3), To calculate the final merged 1-frame fusion information image; The second processing method comprises the following steps: Step 301-2: The high-speed array camera first fuses and calculates the adjacent odd-numbered frame images and even-numbered frame images to obtain 2n After the frame image is processed, n Frame image, then n The frame images are averaged to obtain a frame of fused information image after calculation and merging. The calculation formula is as follows: ; In formula (4), x is the horizontal coordinate of the pixel point; y is the vertical coordinate of the pixel; 2 n is the number of continuously collected original images; The odd-numbered frames of the continuously acquired images; is the even-numbered frame of the captured image; It is a frame of fused information image after calculation and merging.
[0008] Furthermore, before step 1, the method further includes: Set the working parameters of the high-speed array camera; The high-speed area array camera starts trigger waiting and begins to collect raw image information after receiving the trigger signal.
[0009] Correspondingly, the present invention also provides a high-speed area array camera, comprising: an image sensor, a DDR cache module, and an FPGA control chip; The image sensor is used to collect original image information; The DDR buffer module is used to store the original image information received by the image sensor; The FPGA control chip is used to process the original image information to obtain a fused information image; The FPGA control chip includes: an image acquisition unit, an image processing unit and an image calculation unit; The image acquisition unit is used to receive original image information acquired by the image sensor; The image processing unit is used to identify odd-numbered frame images and even-numbered frame images from the collected original image information; The image calculation unit is used to process the original image information to calculate the average odd frame image and the average even frame image, or to calculate the fused information image; wherein the image calculation unit uses processing method one to process the original image information to calculate the average odd frame image and the average even frame image; or uses processing method two to process the original image information to calculate the fused information image.
[0010] Preferably, the FPGA control chip further includes: a trigger processing unit; The trigger processing unit is set to an external trigger mode, and is used to trigger the image sensor with an electrical signal as a shooting signal during image acquisition.
[0011] Preferably, the FPGA control chip further includes: a camera setting unit and an image buffer unit; The camera setting unit is used to set the working parameters of the high-speed area array camera; The image cache unit is used to store the original image information in the DDR memory.
[0012] Preferably, it also includes: a trigger interface; The trigger interface is used to trigger the input or output of an electrical signal.
[0013] Preferably, it also includes: a USB3.0 module; The USB3.0 module is used for transmitting the average odd-numbered frame image and the average even-numbered frame image or for transmitting the fused information image.
[0014] Preferably, it also includes: a digital-to-analog conversion module; the digital-to-analog conversion module is used to convert analog signals in the form of voltage and current into binary digital signal outputs for calculation processing.
[0015] The high-speed area array camera image processing method and the high-speed area array camera provided by the present invention have the following advantages compared with the prior art: 1. The present invention overcomes the technical problem of slow imaging speed caused by the transmission of each frame of the camera to the computer for processing one by one in the prior art. The present invention collects the original image information through a high-speed camera, performs image processing calculation inside the camera to obtain a test signal with a good signal-to-noise ratio, and can achieve high-speed acquisition and high-speed transmission of images. The requirements for the image acquisition and transmission capabilities of the acquisition card and the computer processing capabilities are reduced, and high-speed acquisition and high-speed transmission of images to the computer can be achieved without relying on a high-speed acquisition card, which greatly saves costs.
[0016] 2. The present invention integrates the original computer multi-frame image processing steps into the camera. After calculating the odd and even frames, the detection light signal and the excitation light signal information can be obtained. The camera accumulates and averages the odd and even frames, and the processed odd and even images are calculated and then transmitted to the computer. The number of images transmitted from the camera to the computer is reduced from 2N to 1-2 frames. The image calculation unit integrated in the camera reduces the burden of each link of information collection, transmission, and processing, reducing costs and increasing efficiency.
[0017] 3. The present invention is compatible with cameras with various pixel bit numbers, omits the CameraLink or CXP12 interface in hardware design, reduces the integrated volume of the camera, makes the industrial design concise and convenient, further simplifies the module structure, and is conducive to miniaturization of the equipment.
[0018] 4. The present invention solves the problem of frame loss when using traditional cameras to transmit a large number of images. On the one hand, frame loss will lead to the loss of final image information. On the other hand, the program defaults to restarting the acquisition after frame loss, which will cause jamming and reduce transmission efficiency. The present invention will not cause image information loss, and the image information accuracy and imaging resolution are high.
[0019] 5. The present invention is compatible with cameras with multiple pixel counts. Only one area array camera is needed to realize information collection and imaging processing of detection light and excitation light, which improves the acquisition and transmission efficiency while improving the signal-to-noise ratio of ultrafast spectrum detection. It has broad application prospects in the fields of ultrafast spectrum testing, transient absorption spectroscopy, etc. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] Figure 1 is a flow chart of the image processing method of the high-speed area array camera provided by the present invention; Figure 2 is a flow chart of a processing method 1 provided by the present invention; Figure 3 It is a schematic diagram of the composition of the high-speed area array camera provided by the present invention. DETAILED DESCRIPTION
[0021] In order to make the technical problems solved by the present invention, the technical solutions adopted and the technical effects achieved clearer, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for the convenience of description, only the parts related to the present invention are shown in the accompanying drawings, rather than all the contents. Embodiment 1
[0022] like Figure 1 As shown, an embodiment of the present invention provides a high-speed area array camera image processing method, comprising the following process: Step 1: A high-speed area array camera collects original image information; Step 2: The high-speed area array camera identifies the odd-numbered frame images and the even-numbered frame images from the collected original image information; Step 3, using processing method 1 or processing method 2 to process the original image information and calculate to obtain a fused information image; The processing method 1 (2n→2→1), such as Figure 2 As shown, the following process is included: Step 301-1: The high-speed area array camera takes all odd frames of the image according to each pixel ( x , y ) to get the average odd-numbered frame image. The formula is as follows:
[0023] In formula (1), x is the horizontal coordinate of the pixel point; y is the vertical coordinate of the pixel; 2 n is the number of continuously acquired original images, where n is the number of odd frames; The odd-numbered frames of the continuously acquired images; A is the average odd-numbered frame image collected continuously; Step 302-1: The high-speed area array camera takes all even-numbered frames of the image according to each pixel point. (x ,y) The grayscale values of the frames are averaged to obtain the average even-numbered frame image. The formula is as follows:
[0024] In formula (2), x is the horizontal coordinate of the pixel point; y is the vertical coordinate of the pixel; 2 n is the number of continuously acquired original images, where n is the number of even-numbered frames; is the even-numbered frame of the captured image; B It is the average even-numbered frame image collected continuously; Step 303-1, the high-speed area array camera transmits the processed average odd-numbered frame image and the average even-numbered frame image to the computer, and the computer performs calculations according to the following formula to obtain the final calculated and merged 1-frame fusion information image, namely:
[0025] In formula (3), It is the final calculated merged 1-frame fusion information image.
[0026] The processing method of the present invention directly processes the original image inside the high-speed array camera to obtain an average odd-numbered frame image. A and average even-numbered frame images B , the computer calculates and merges the average odd-numbered frame images A and average even-numbered frame images B , get a frame of fusion information image ; After being processed by a high-speed array camera, the number of computer images has been reduced from 2 N Reduced to only 2 frames, improving transmission efficiency and computer processing speed.
[0027] The second processing method (2n→n→1) includes the following steps: Step 301-2: The high-speed array camera first fuses and calculates the adjacent odd-numbered frame images and even-numbered frame images to make 2 n After the frame image is processed, n Frame image, then n The frame images are averaged to obtain a frame of fused information image after calculation and merging. The calculation formula is as follows:
[0028] In formula (4), x is the horizontal coordinate of the pixel point; y is the vertical coordinate of the pixel; 2 n is the number of continuously collected original images; The odd-numbered frames of the continuously acquired images; is the even-numbered frame of the captured image; It is a frame of fused information image after calculation and merging.
[0029] The second processing method of the present invention directly processes the original image inside the high-speed array camera, and fuses and calculates the adjacent odd-numbered frame images and even-numbered frame images to obtain a fused information image after calculation and merging. The calculation is completely performed by the high-speed area array camera, and the computer does not need to calculate again, which improves the transmission efficiency and the subsequent processing capability of the computer.
[0030] In addition, before step 1, the method further includes: setting working parameters of the high-speed area array camera.
[0031] Specifically, set the number of collected images, set the external trigger mode, and set the exposure time.
[0032] The high-speed area array camera starts trigger waiting and begins to collect raw image information after receiving the trigger signal.
[0033] The following is an example of the above processing method 1 or processing method 2: Solution 1 (2n→2→1): The number of consecutively acquired original images is 2 n Take 2000 frames as an example: Step 301-1: The odd frames of the 1000 frames of images are divided into each pixel ( x , y ) is averaged, that is:
[0034] x is the horizontal coordinate of the pixel point; y is the vertical coordinate of the pixel; A is the average odd-numbered frame image collected continuously; Step 302-1: The even-numbered frames of the 1000 frames of images are divided into each pixel ( x , y ) is averaged, that is:
[0035] x is the horizontal coordinate of the pixel point; y is the vertical coordinate of the pixel; B It is the average even-numbered frame image collected continuously; Step 303-1: The processed average odd-numbered frame image A and average even-numbered frame images B The image is transmitted to the computer and calculated according to the following formula to obtain the final 2000-frame image. ,Right now:
[0036] Processing method 2 (2n→n→1): Step 301-2: First, the adjacent odd-numbered frame images and even-numbered frame images are fused and calculated. After the 2000 frames of images are processed, 1000 frames of images are processed. Then, the 1000 frames of images are averaged to obtain a fused information image after calculation and merging. .
[0037]
[0038] x is the horizontal coordinate of the pixel point; y is the vertical coordinate of the pixel.
[0039] The high-speed area array camera image processing method of the present invention uses a high-speed area array camera at a high frame rate to collect transient absorption spectrum signals, collects spectrum signals of odd frames and even frames respectively, obtains detection light signal and excitation light signal information by calculating odd frames and even frames, and then transmits all collected images to a computer for separate calculation and processing of odd frames and even frames, and collects images by a multi-frame integration and averaging method. Only one high-speed area array camera is required to realize the simultaneous collection of detection light and excitation light, and the integrated image processing function realizes the image processing of dual channels of detection light and excitation light, which improves the acquisition and transmission efficiency while improving the signal-to-noise ratio of ultrafast spectrum detection. It has broad application prospects in the fields of ultrafast spectrum testing, transient absorption spectroscopy, etc. Embodiment 2
[0040] like Figure 3 As shown, the high-speed area array camera provided by the embodiment of the present invention includes: an image sensor, a DDR cache module, and an FPGA control chip.
[0041] The image sensor is used to collect original image information; the image sensor can convert the received light signal into an electrical signal, and the image information is in the form of an electrical signal.
[0042] The DDR (Double Data Rate) memory module is used to store the original image information received by the image sensor; The FPGA (Field Programmable Gate Array) control chip is used to process the original image information to obtain a fused information image. The FPGA control chip controls the actions between its various units.
[0043] The FPGA control chip includes: an image acquisition unit, an image processing unit and an image calculation unit; The image acquisition unit is used to receive original image information acquired by the image sensor; The image recognition unit is used to recognize odd-numbered frame images and even-numbered frame images from the collected original image information; The image calculation unit is used to process the original image information to calculate the average odd frame image and the average even frame image, or to calculate the fused information image. The image calculation unit uses the first processing method to process the original image information to calculate the average odd frame image and the average even frame image; or uses the second processing method to process the original image information to calculate the fused information image.
[0044] Preferably, the FPGA control chip further comprises: a trigger processing unit; the trigger processing unit is set to an external trigger mode, and is used to trigger the image sensor with an electrical signal as a shooting signal during image acquisition; Preferably, the FPGA control chip further includes: a camera setting unit and an image buffer unit; The camera setting unit is used to set the working parameters of the high-speed area array camera; specifically, it is used to set the number of collected images, set the external trigger mode, and set the exposure time.
[0045] The image cache unit is used to store the original image information in the DDR memory.
[0046] Preferably, the high-speed area array camera further comprises: a trigger interface; the trigger interface is used to trigger the input or output of an electrical signal.
[0047] Preferably, the high-speed area array camera further includes: a USB3.0 module; the USB3.0 module is used to transmit the average odd-numbered frame image and the average even-numbered frame image or to transmit the fused information image, so as to facilitate the transmission of the average odd-numbered frame image and the average even-numbered frame image and the fused information image to the host computer.
[0048] Preferably, the high-speed area array camera further includes: a digital-to-analog conversion module; the digital-to-analog conversion module is used to convert analog signals in the form of voltage and current into binary digital signal outputs for calculation processing.
[0049] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that modifying the technical solutions described in the aforementioned embodiments, or replacing some or all of the technical features therein by equivalents, does not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.
Claims
1. A high-speed area array camera image processing method, characterized in that: The process includes: Step 1: A high-speed area array camera collects original image information; Step 2: The high-speed area array camera identifies the odd-numbered frame images and the even-numbered frame images from the collected original image information; Step 3, using processing method 1 or processing method 2 to process the original image information and calculate to obtain a fused information image; The processing method 1 includes the following steps: Step 301-1: The high-speed area array camera takes all odd frames of the image according to each pixel ( x , y ) to get the average odd-numbered frame image. The formula is as follows: ; In formula (1), x is the horizontal coordinate of the pixel point; y is the vertical coordinate of the pixel; 2 n is the number of continuously collected original images, where n is the number of odd frames; The odd-numbered frames of the continuously acquired images; A is the average odd-numbered frame image collected continuously; Step 302-1: The high-speed area array camera takes all even frames of the image according to each pixel point ( x , y ) to get the average even-numbered frame image. The formula is as follows: ; In formula (2), x is the horizontal coordinate of the pixel point; y is the vertical coordinate of the pixel; 2 n is the number of continuously collected original images, where n is the number of even-numbered frames; is the even-numbered frame of the captured image; B It is the average even-numbered frame image collected continuously; Step 303-1, the high-speed area array camera transmits the processed average odd-numbered frame image and the average even-numbered frame image to the computer, and the computer performs calculations according to the following formula to obtain the final calculated and merged 1-frame fusion information image, namely: ; In formula (3), To calculate the final merged 1-frame fusion information image; The second processing method comprises the following steps: Step 301-2: The high-speed array camera first fuses and calculates the adjacent odd-numbered frame images and even-numbered frame images to make 2 n After the frame image is processed, it is n Frame image, then n The frame images are averaged to obtain a frame of fused information image after calculation and merging. The calculation formula is as follows: ; In formula (4), x is the horizontal coordinate of the pixel point; y is the vertical coordinate of the pixel; 2 n is the number of continuously acquired original images; The odd-numbered frames of the continuously acquired images; is the even-numbered frame of the captured image; It is a frame of fused information image after calculation and merging.
2. A high-speed area array camera image processing method according to claim 1, characterized in that: Before step 1, also include: Set the working parameters of the high-speed array camera; The high-speed area array camera starts trigger waiting and begins to collect raw image information after receiving the trigger signal.
3. A high-speed area array camera, characterized in that: include: Image sensor, DDR cache module, FPGA control chip; The image sensor is used to collect original image information; The DDR buffer module is used to store the original image information received by the image sensor; The FPGA control chip is used to process the original image information to obtain a fused information image; The FPGA control chip includes: an image acquisition unit, an image processing unit and an image calculation unit; The image acquisition unit is used to receive original image information acquired by the image sensor; The image processing unit is used to identify odd-numbered frame images and even-numbered frame images from the collected original image information; The image calculation unit is used to process the original image information to calculate the average odd frame image and the average even frame image, or to calculate the fused information image; wherein the image calculation unit uses processing method one to process the original image information to calculate the average odd frame image and the average even frame image; or uses processing method two to process the original image information to calculate the fused information image.
4. The high-speed area array camera according to claim 3, characterized in that: The FPGA control chip also includes: a trigger processing unit; The trigger processing unit is set to an external trigger mode, and is used to trigger the image sensor with an electrical signal as a shooting signal during image acquisition.
5. The high-speed area array camera according to claim 4, characterized in that: The FPGA control chip also includes: a camera setting unit and an image buffer unit; The camera setting unit is used to set the working parameters of the high-speed area array camera; The image cache unit is used to store the original image information in the DDR memory.
6. The high-speed area array camera according to claim 3, characterized in that: Also includes: Trigger interface; The trigger interface is used to trigger the input or output of an electrical signal.
7. The high-speed area array camera according to claim 3, characterized in that: Also includes: USB3.0 module; The USB3.0 module is used for transmitting the average odd-numbered frame image and the average even-numbered frame image or for transmitting the fused information image.
8. The high-speed area array camera according to claim 3, characterized in that: Also includes: Digital-to-analog conversion module; The digital-to-analog conversion module is used to convert analog signals in the form of voltage and current into binary digital signal outputs for calculation processing.
Citation Information
Patent Citations
Backlight brightness processing method and system, display equipment and medium
CN110767184A
Detection signal-to-noise ratio improving method of area array staring camera
CN112529810A
Electrically induced transient absorption microscopic imaging method based on area-array camera
CN117233141A
Sub-sampling with higher display quality in image-sensing device
CN1717003A
Space debris observation method based on alternation of different exposure times of CCD camera
WO2021036565A1
