Processing method for converting area array image into linear array data by scanner

Abstract

The invention belongs to the technical field of camera imaging, and discloses a processing method for a scanner to convert an area array image into linear array data, and along with wide application of a hyperspectral camera in all walks of life, push-broom hyperspectral data and area array panchromatic data are fused into a new demand. Aiming at the phenomena of low timeliness, serious deformation, low sensitivity and the like of a technology for splicing a conveyor belt video stream by an existing area-array camera, the invention provides a processing method for converting an area-array image into linear array data by a scanner, which comprises the steps of developing an integrated conveyor belt scanning system, constructing an annular cache data receiving mechanism and setting camera parameters. The real-time working state parameters of the camera are counted, the ideal accumulated line number and the sampling line number are calculated according to the speed of the conveyor belt, finally, whether the data extraction mode is up-sampling or down-sampling is determined according to the direction of the conveyor belt, the data are output to an interface and stored locally, and the mode that the camera changes area array to linear array push-broom imaging through software is achieved. And reliable data is provided for subsequent hyperspectral data and panchromatic data fusion. And a solution is provided for subsequent projects with the same requirements.

Description

Technical Field

[0001] The present application belongs to the field of camera imaging technology and discloses a processing method for a scanner to convert a surface array image into line array data. Background Art

[0002] With the widespread use of hyperspectral cameras in various industries, the fusion of push-broom hyperspectral data and array panchromatic data has become a new demand.

[0003] To meet the above requirements, existing technologies need to be improved in both software and hardware. In terms of software, the video stream on the scanner conveyor belt needs to be processed to splice a relatively large field of view, but it has low timeliness, severe deformation, and low sensitivity. In terms of hardware, multiple array cameras need to be evenly distributed in the direction of the conveyor belt movement, and pictures are collected simultaneously through synchronous triggering, and then spliced ​​according to the pre-calibrated relative positions of the cameras. The hardware cost is high, the system is complex, and it is difficult to maintain.

[0004] To implement the technology completely from a software perspective is a good way to reduce system complexity and hardware costs, but existing technologies have problems such as the need for advance image calibration, data post-processing, and the inability to provide real-time data display. The disk data cannot be matched with the first line of the synchronously triggered hyperspectral data. Summary of the invention

[0005] The present invention provides a processing method for a scanner to convert an area array image into a line array data, realizing a mode in which a camera changes from an area array to a line array push-scan imaging through software, providing reliable data for subsequent fusion of hyperspectral data and panchromatic data, and also providing a solution for subsequent projects with the same requirements. The contents of the present invention are as follows:

[0006] The present invention provides a processing method for a scanner to convert a planar array image into line array data, and the technical point of the method is that the method specifically comprises the following steps:

[0007] Step 1: Calculate the speed-to-height ratio according to the structural position of the linear array hyperspectral camera / area array RGB camera and the conveyor belt in the scanner, set the imaging parameters of the linear array hyperspectral camera / area array RGB camera and the conveyor belt speed of the scanner, and start collecting data to obtain the push-scan image of the linear array hyperspectral camera and the area array image of the RGB camera;

[0008] Step 2: Input the RGB camera array image in step 1 into the ring buffer and count the RGB camera state parameters, including the real-time frame rate f' RGB , cumulative number of frames F RGB , according to the speed-to-height ratio, the frame rate f of the RGB camera is obtained RGB , spatial resolution R RGB , through the formula frm DesireLineCnt =FRGB ×(abs(V) / f RGB / R RGB ), calculate the ideal cumulative number of rows, and convert the ideal cumulative number of rows frm DesireLineCnt and the total number of sampled rows frm CurrLineCnt Subtract them to get the number of rows sampled this time, sample_N;

[0009] Step 3, perform mutation detection on the number of sampling rows obtained in step 2. If a mutation occurs, recalculate the camera status in step 2. If no mutation occurs, proceed to the next step.

[0010] Step 4: Determine whether the sampling direction is downsampling or upsampling based on the direction of the conveyor belt in the scanner, and then sample the area array RGB camera image and write it into the ring buffer. At this time, the RGB camera area array data is converted into RGB camera line array data.

[0011] Step 5: Fuse the spatial and spectral data of the RGB camera linear array data in step 4 and the linear array hyperspectral camera push-scan image in step 2 to obtain a fused image with research value.

[0012] In order to better implement the above technical solution, in the processing method for converting area array images into linear array data for a scanner of the present invention, the frame rate f, spatial resolution R and conveyor belt speed V of the linear array hyperspectral camera in step 1 satisfy V=f·R.

[0013] In order to better implement the above technical solution, in step 1 of the processing method for converting area array images into line array data for a scanner of the present invention, the frame rate f, spatial resolution R and conveyor belt speed V of the area array RGB camera satisfy the speed-to-height ratio: V=f·R.

[0014] In order to better implement the above technical solution, in step 1 of the processing method for converting area array images into linear array data for a scanner of the present invention, the imaging parameters of the linear array hyperspectral camera / area array RGB camera and the conveyor belt speed of the scanner are set by a push-scan imaging system.

[0015] In order to better implement the above technical scheme, the push-scan imaging system in the processing method of converting area array images into line array data for a scanner of the present invention includes host computer control software with the ability to send control instructions and receive data, the ability to control the camera, conveyor belt and light source, and the ability to display push-scan images in real time, camera driving software with the ability to receive control instructions and process data in real time, the ability to send and save data, and the ability to feedback hardware status, conveyor belt driving software and light source driving software with the ability to control switches and adjust speed and brightness.

[0016] Compared with the prior art, the processing method for converting area array images into line array data by a scanner of the present invention has the following beneficial effects:

[0017] The processing method for converting area array images into line array data by the scanner of the present invention realizes the mode of changing the camera from area array to line array push scanning imaging through software, and does not require image calibration in advance, nor does it require data post-processing. It can provide real-time data display, and the disk data can also be matched with the first line of synchronously triggered hyperspectral data, providing reliable data for subsequent fusion of hyperspectral data and panchromatic data. It also provides a solution for subsequent projects with the same requirements. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0019] Figure 1 A process flow chart of converting area array images into line array data by a scanner according to the present invention;

[0020] Figure 2 A flowchart of a processing method for converting a surface array image into line array data by a scanner according to the present invention;

[0021] Figure 3 This is a rendering of a processing method for a scanner to convert area array images into line array data according to the present invention;

[0022] Figure 4 The present invention is a schematic diagram of a conveyor belt running direction and image sampling direction in a processing method for a scanner to convert an area array image into line array data. DETAILED DESCRIPTION

[0023] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the specific embodiments of the present invention and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0024] The technical solutions provided by various embodiments of the present invention are described in detail below in conjunction with the accompanying drawings.

[0025] A processing method for converting a surface array image into line array data by a scanner specifically comprises the following steps:

[0026] Step 1, such as Figure 1As shown in the figure, the speed-to-height ratio is calculated according to the structural position of the linear array hyperspectral camera / area array RGB camera and the conveyor belt in the scanner, and the imaging parameters of the linear array hyperspectral camera / area array RGB camera and the conveyor belt speed of the scanner are set to start data collection, and the linear array hyperspectral camera push-scan image and the RGB camera area array image are obtained. Of course, in order to ensure that the push-scan image is not distorted, first ensure that each camera is installed in the common field of view. Secondly, control the stability of the light source to avoid overexposure or underexposure.

[0027] Furthermore, to ensure that the image of the linear array hyperspectral camera / area array RGB camera is not distorted, the frame rate f, spatial resolution R and conveyor belt speed V of the linear array hyperspectral camera / area array RGB camera satisfy V=f·R, and a corresponding table of the frame rate and conveyor belt speed of the linear array hyperspectral camera / area array RGB camera is obtained.

[0028] Table 1

[0029] Camera frame rate Conveyor belt speed 6Hz 1.5cm / s 12Hz 3cm / s 20Hz 5cm / s

[0030] Furthermore, the imaging parameters of the linear array hyperspectral camera / area array RGB camera and the conveyor belt speed of the scanner are set by the push-broom imaging system.

[0031] Furthermore, the push-scan imaging system includes host computer control software with the ability to send control instructions and receive data, control the camera, conveyor belt and light source, and display the push-scan image in real time, camera driver software with the ability to receive control instructions and process data in real time, the ability to send and save data, and the ability to provide hardware status feedback, conveyor belt driver software and light source driver software with the ability to control switches and adjust speed and brightness.

[0032] Step 2, such as Figure 2 As shown, the RGB camera array image in step 1 is input into the ring buffer and then the RGB camera state parameters are counted, including the real-time frame rate f' RGB (20Hz), cumulative frame number F RGB , according to the speed-to-height ratio, the frame rate f of the RGB camera is obtained RGB , spatial resolution R RGB , through the formula frm DesireLineCnt =F RGB ×(abs(V) / f RGB / R RGB ), calculate the ideal cumulative number of rows, and convert the ideal cumulative number of rows frm DesireLineCnt and the total number of sampled rows frm CurrLineCnt Subtract and get the number of sampling rows samlpe_N this time; the RGB camera array image is input into the ring buffer. Through the role of the cache, it is ensured that data will not be lost, causing frame loss and number loss problems.

[0033] For example, after the RGB camera array image in step 1 is input into the ring buffer, the RGB camera status parameters are counted, including the real-time frame rate of 20Hz and the cumulative number of frames of 100. According to the frame rate of 20Hz and the spatial resolution of 0.44mm (each pixel represents 0.44mm) of the RGB camera, the formula frm DesireLineCnt =F RGB ×(abs(V) / f RGB / R RGB ), the ideal cumulative number of rows is calculated to be 500, and the ideal cumulative number of rows 500 is subtracted from the total number of sampled rows 490 to obtain the number of rows sampled this time, 10.

[0034] Step 3, perform mutation detection on the number of sampling rows obtained in step 2. If a mutation occurs, the statistical calculation of the camera state in step 2 is performed again. If there is no mutation, the next step is executed. The mutation detection is added here to prevent the switching of the frame rate from causing data distortion.

[0035] Step 4: Determine the sampling direction based on the conveyor belt direction in the scanner, such as Figure 4 As shown in the figure, when the conveyor belt direction is the left arrow, the RGB camera field of view center is used as the reference and the sampling is to the left; when the conveyor belt direction is right, the sampling is to the right. After determining the sampling direction, the array RGB camera image is sampled and written into the ring buffer. At this time, the RGB camera array data is converted into the RGB camera line array data as shown in the figure. Figure 3 As shown;

[0036] Step 5: Fuse the spatial and spectral data of the RGB camera linear array data in step 4 and the linear array hyperspectral camera push-scan image in step 2 to obtain a fused image with research value.

[0037] The above description is only an embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent substitution, improvement, etc. made within the spirit and principle of the present invention should be included in the scope of the claims of the present invention.

Claims

1. A processing method for converting a surface array image into line array data for a scanner, characterized in that: The following steps are involved: Step 1: Calculate the speed-to-height ratio according to the structural position of the linear array hyperspectral camera / area array RGB camera and the conveyor belt in the scanner, set the imaging parameters of the linear array hyperspectral camera / area array RGB camera and the conveyor belt speed of the scanner, and start collecting data to obtain the push-scan image of the linear array hyperspectral camera and the area array image of the RGB camera; Step 2: Input the RGB camera array image in step 1 into the ring buffer and count the RGB camera state parameters, including the real-time frame rate f′ RGB , cumulative number of frames F RGB , according to the speed-to-height ratio, the frame rate f of the RGB camera is obtained RGB , spatial resolution R RGB , through the formula frm DesireLineCnt =F RGB ×(abs(V) / f RGB / R RGB ), calculate the ideal cumulative number of rows, and convert the ideal cumulative number of rows frm DesireLineCnt and the total number of sampled rows frm CurrLineCnt Subtract them to get the number of rows sampled this time, sample_N; Step 3, perform mutation detection on the number of sampling rows obtained in step 2. If a mutation occurs, recalculate the camera status in step 2. If no mutation occurs, proceed to the next step. Step 4: Determine whether the sampling direction is downsampling or upsampling based on the direction of the conveyor belt in the scanner, and then sample the area array RGB camera image and write it into the ring buffer. At this time, the RGB camera area array data is converted into RGB camera line array data. Step 5: Fuse the spatial and spectral data of the RGB camera linear array data in step 4 and the linear array hyperspectral camera push-scan image in step 2 to obtain a fused image with research value.

2. A processing method for converting area array images into line array data for a scanner according to claim 1, characterized in that: In step 1, the frame rate f, spatial resolution R and conveyor belt speed V of the linear array hyperspectral camera satisfy V=f·R.

3. The method for converting area array images into line array data for a scanner according to claim 1, characterized in that: In step 1, the frame rate f, spatial resolution R and conveyor belt speed V of the area array RGB camera satisfy the speed-to-height ratio: V=f·R.

4. The method for converting area array images into line array data for a scanner according to claim 1, characterized in that: In step 1, the imaging parameters of the linear array hyperspectral camera / area array RGB camera and the conveyor belt speed of the scanner are set by the push-broom imaging system.

5. The method for converting area array images into line array data for a scanner according to claim 4, characterized in that: The push-scan imaging system includes upper computer control software with the ability to send control instructions and receive data, control the camera, conveyor belt and light source, and display push-scan images in real time, camera driver software with the ability to receive control instructions and process data in real time, send and save data, and provide hardware status feedback, conveyor belt driver software and light source driver software with the ability to control switches and adjust speed and brightness.

Images