Camera system capable of keeping imaging illumination consistent and working method thereof

Abstract

The invention provides a camera system capable of keeping imaging illumination consistent and a working method thereof. The camera system comprises a control and data processing unit, an image acquisition module, a standard light source module and a sequence generation module, the control and data processing unit is used for controlling the image acquisition module, the standard light source module and the sequence generation module and processing image data; the control and data processing unit is used for controlling the sequence generation module to generate data sequences representing different light intensity levels; the control and data processing unit is used for reserving a storage area and setting the working state of the standard light source module according to the light intensity information of the data sequence, so as to control the image acquisition module to photograph the target object in different working states of the standard light source module; and receiving, storing and processing the image data through the reserved storage area to finally obtain illumination consistency image data, so that the image consistency under the complex illumination background is realized.

Description

Technical Field

[0001] The present invention relates to the field of imaging technology, and particularly to an imaging system for maintaining consistent imaging illumination and its working method. Background Art

[0002] In order to achieve consistent images under complex illumination backgrounds, the industry mainly uses adjustment methods to process pictures to ensure consistency at present, such as neural network algorithms based on deep learning, gray world algorithms, polynomial regression algorithms, partial least squares methods, etc. However, since the original image data itself is "contaminated", it is theoretically impossible to completely remove external "light pollution"; secondly, these algorithms often need to be based on certain conditions to achieve better effects, and there is also a possibility of "secondary pollution" of image data caused by algorithm overfitting.

[0003] In view of this, the present invention proposes an imaging system for maintaining consistent imaging illumination and its working method. Summary of the Invention

[0004] The purpose of the present invention is to propose an imaging system for maintaining consistent imaging illumination and its working method to achieve image consistency under complex illumination backgrounds.

[0005] To achieve the above purpose, the technical solution of the present invention is as follows: An imaging system for maintaining consistent imaging illumination, comprising a control and data processing unit, an image acquisition module, a standard light source module, and a sequence generation module; The control and data processing unit is used to control the image acquisition module, the standard light source module, and the sequence generation module and perform image data processing: The control and data processing unit controls the sequence generation module to generate a data sequence representing different light intensity levels, and according to the light intensity information of the data sequence, the control and data processing unit reserves a storage area and sets the working state of the standard light source module, and then controls the image acquisition module to take pictures of the target object under different working states of the standard light source module, and receives, saves, and processes the image data through the reserved storage area, and finally obtains image data with consistent illumination.

[0006] A working method of an imaging system for maintaining consistent imaging illumination specifically includes the following steps: S1. The control and data processing unit controls the sequence generation module to generate a data sequence B with a sequence length of N, and controls the sequence generation module to send the data sequence B to the control and data processing unit one by one; each data B[n] (1 < n ≤ N) in the data sequence B is used to represent any one of M light intensity levels of the standard light source module, and the frequencies of the M light intensity levels appearing in the data sequence B are equal; S2. The control and data processing unit reserves M groups of storage areas PS[1], PS[2],... PS[m],... PS[M] for receiving, saving, and processing the image data RPW. The M groups of storage areas correspond one-to-one with M light intensities. The image data RPW is the image data collected by the image acquisition module in a single acquisition. S3. When the control and data processing unit obtains a certain data B[n] in the data sequence B, first, it sets the working state of the standard light source module according to the light intensity represented by the data B[n], including whether to turn on the standard light source module and setting the light intensity level of the standard light source module. Then, it controls the image acquisition module to take a picture of the target object under the illumination of the current working state of the standard light source module, and the image acquisition module sends the unprocessed raw image data RPW[n] collected this time to the control and data processing unit. The image data RPW[n] corresponds one-to-one with the data B[n]. S4. The control and data processing unit processes the image data RPW[n] according to the data B[n], and stores the image data RPW[n] in the storage area PS[m] corresponding to the m-th light intensity represented by the data B[n]. If the storage area PS[m] is empty, the image data RPW[n] is directly saved to the storage area PS[m], that is, PS[m] = RPW[n]. If the storage area PS[m] already stores image data, the image data stored in PS[m] is added to the image data RPW[n], and the image data after the addition operation is saved to the storage area PS[m]. The addition operation is expressed as PS[m] = PS[m] + RPW[n]. S5. After the control and data processing unit receives and processes all N raw image data according to S3 and S4, let natural numbers 0 < m1 < m2 < M. Select two different groups from them, and take out the data PS[m1] saved in the m1-th reserved storage area and the data PS[m2] saved in the m2-th reserved storage area. Among them, PS[m1] and PS[m2] are the results of pixel summation of all unprocessed raw RGB format raw image data collected under the m1-th and m2-th light intensities respectively. Then, a pixel subtraction operation is performed, and the result after the subtraction operation is saved to the storage area PS[m2]. The subtraction operation is expressed as PS[m2] = PS[m2] - PS[m1]. The PS[m2] after processing all pixels will be output as the final image data of this photo or video shooting. The final RGB image is obtained by processing PS[m2], and the storage area is cleared.

[0007] Preferably, the data B[n] is binary data.

[0008] Preferably, the M types of light intensities include a case where the light intensity of the standard light source module is 0.

[0009] Preferably, the image data stored in PS[m] is added to the image data RPW[n], and the image data after the addition is saved in the storage area PS[m], specifically: Each pixel value in the image data RPW[n] is added to the pixel value of the corresponding coordinate in PS[m] one by one, and the added value is saved as the pixel value of the corresponding coordinate in PS[m].

[0010] Preferably, the subtraction operation is performed on the image data stored in PS[m2] and PS[m1], and the image data after the subtraction operation is saved in the storage area PS[m2], specifically: Subtract each pixel value in the image data PS[m2] from the pixel value of the corresponding coordinate in PS[m1] one by one, and save the subtracted value as the pixel value of the corresponding coordinate in PS[m2] Preferably, the processing of PS[m2] to obtain the final RGB image includes performing normalization, white balance and color interpolation operations on PS[m2].

[0011] Compared with the prior art, the present invention has the following beneficial effects: The present invention can take highly similar photos of the same scene or object under different background illumination or when the background illumination changes without using high-performance equipment, thereby achieving image consistency under complex illumination backgrounds, and at the same time has the advantage of a simple and easy algorithm. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 It is a schematic diagram of the camera system of the present invention; Figure 2 The figure is a flow chart of the working method of the camera system of the present invention. DETAILED DESCRIPTION

[0013] The following is combined with Figure 1-2 , the technical solution of the present invention is specifically described.

[0014] The present invention provides a camera system for maintaining consistent imaging illumination, comprising a control and data processing unit, an image acquisition module, a standard light source module and a sequence generation module; The control and data processing unit is used to control the image acquisition module, the standard light source module and the sequence generation module and perform image data processing: The control and data processing unit controls the sequence generation module to generate a data sequence representing different light intensity levels. The control and data processing unit reserves a storage area and sets the working state of the standard light source module according to the light intensity information of the data sequence, and then controls the image acquisition module to take pictures of the target object in different working states of the standard light source module, and receives, saves and processes the image data through the reserved storage area, and finally obtains image data with consistent illumination.

[0015] The present invention also proposes a working method for a camera system that maintains consistent imaging illumination. When the camera system performs a single photo shooting operation, the following steps are completed in sequence: S1. The control and data processing unit controls the sequence generation module to generate a data sequence B with a sequence length of N, and controls the sequence generation module to send the data sequence B to the control and data processing unit one by one; each data B[n] (1 < n ≤ N) in the data sequence B is used to represent any one of the M light intensity levels of the standard light source module, and the frequencies of the M light intensity levels appearing in the data sequence B are equal; that is, for a sequence of N data, the number of times each light intensity level appears must be equal to N / M; S2. The control and data processing unit reserves M groups of storage areas PS[1], PS[2],... PS[m],... PS[M] for receiving, saving and processing image data RPW; the M groups of storage areas correspond one-to-one to the M light intensity levels; the image data RPW is the image data collected by the image acquisition module in a single acquisition; S3. When the control and data processing unit obtains a certain data B[n] in the data sequence B; First, set the working state of the standard light source module according to the light intensity represented by the data B[n], including whether to turn on the standard light source module and setting the light intensity level of the standard light source module; for example, the binary data sequence B = {0x00, 0x01, 0x02, 0x01, 0x02, 0x00}, where B[1] = 0x00, B[2] = 0x01 and so on; 0x00 represents a light intensity of 0, and the larger the value, the greater the brightness, and the maximum brightness is 0x0F, Then control the image acquisition module to take pictures of the target object under the illumination of the current working state of the standard light source module, and the image acquisition module sends the unprocessed original image data RPW[n] collected this time to the control and data processing unit; the image data RPW[n] corresponds one-to-one to the data B[n]; S4. The control and data processing unit processes the image data RPW[n] according to the data B[n]; stores the image data RPW[n] in the storage area PS[m] corresponding to the m-th light intensity level represented by the data B[n]: If the storage area PS[m] is empty, the image data RPW[n] is directly saved to the storage area PS[m], i.e., PS[m]=RPW[n]; If the storage area PS[m] already stores image data, each pixel value in the image data RPW[n] is successively added to the pixel value at the corresponding coordinate in PS[m], and the added value is saved as the pixel value at the corresponding coordinate in PS[m], i.e., PS[m]=PS[m]+RPW[n]; For example, if the pixel value of RPW[n] corresponding to the image coordinate (x,y) is PX1 and the pixel value of PS[m] corresponding to it is PX2, then the pixel value at the coordinate (x,y) of PS[m] is finally updated to (PX2 + PX1).

[0016] S5. After the control and data processing unit receives and processes all N raw image data according to S3 and S4. Let natural numbers 0 < m1 < m2 < M; select two different groups from them, and take out the data PS[m1] saved in the reserved storage area of the m1-th group and the data PS[m2] saved in the reserved storage area of the m2-th group. As known above, PS[m1] and PS[m2] are respectively the pixel sums of all unprocessed raw RGB format raw image data collected under the m1-th and m2-th light intensities. Then, each pixel in the PS[m2] image is successively subtracted from the corresponding pixel in PS[m1]; then the subtracted value is saved as the pixel value at the image coordinate in PS[m2]. After all pixels are processed, at this time, PS[m2] will be output as the final image data of this photo shooting or video recording. Process PS[m2] to obtain the final RGB image and clear the storage area.

[0017] In this embodiment, the data B[n] is binary data.

[0018] In this embodiment, the M light intensities include the case where the light intensity of the standard light source module is 0.

[0019] In this embodiment, step S2 further includes clearing the M groups of storage areas.

[0020] In this embodiment, the processing of PS[m2] to obtain the final RGB image includes performing normalization, white balance, and color interpolation operations on PS[m2] The following provides a specific embodiment: In order to briefly explain the above technical content, the content of the sequence is simplified first. The sequence includes 6 8-bit numbers, specifically B={0x00,0x0F,0x00,0x0F,0x0F,0x00}, N=6. Among them, 0x00 represents the standard light source module is turned off, and 0x0F represents the standard light source module to emit maximum light. The memory space declared in the control and data processing unit includes PS[1] and PS[2]; among them, PS[1] represents the image storage space with a brightness of 0x00, and PS[2] represents the image storage space with a brightness of 0x0F.

[0021] In a brighter outdoor environment, place the image acquisition module and the standard light source module in front of the target object.

[0022] The control and data processing unit first takes out B[1] and sets the brightness of the standard unit module to 0, that is, turns it off; the image acquisition module takes a photo of the target object and returns the rawRGB format image data RPW[1] that has not been processed to the control and data processing unit and saves it in PS[1], that is, PS[1]=RPW[1]. Then, according to B[2], the brightness of the standard unit module is set to the maximum; after that, the image acquisition module takes a photo of the target object and returns the rawRGB format image data RPW[2] that has not been processed to the control and data processing unit and keeps it in PS[2], that is, PS[2]=RPW[2]. Similarly, according to B[3], the standard unit module is set, the photo is taken, and the rawRGB format image data RPW[3] is returned to the control and data processing unit; at this time, because PS[1] is not empty, PS[1]=PS[1]+RPW[3] is executed. Similarly, rawRGB format image data RPW[4] is obtained according to B[4]; since PS[2] is not empty, PS[2]=PS[2]+RPW[4] is executed. Similarly, according to the contents of B[5] and B[6], light source control, photo taking, image data transmission, processing and storage are performed. When all values ​​in the sequence have been executed, the control and data processing unit first performs a differential operation, that is, PS[2]=PS[2]-PS[1]; at this time, the value stored in PS[2] is the final illumination consistency image data. Normalization, white balance, color interpolation and other operations are performed on PS[2] to generate the final RGB image Img_rgb_1.

[0023] Then, in a dimly lit environment, the above operation is performed to obtain the RGB image Img_rgb_2. Comparing Img_rgb_1 and Img_rgb_2, it can be found that the two are very similar.

[0024] The above are preferred embodiments of the present invention. Any changes made according to the technical solution of the present invention, as long as the resulting functions do not exceed the scope of the technical solution of the present invention, belong to the protection scope of the present invention.

Claims

1. A camera system for maintaining consistent imaging illumination, characterized in that: It includes a control and data processing unit, an image acquisition module, a standard light source module, and a sequence generation module; The control and data processing unit is used to control the image acquisition module, the standard light source module, and the sequence generation module and perform image data processing: The control and data processing unit controls the sequence generation module to generate a data sequence representing different light intensity levels, and according to the light intensity information of the data sequence, the control and data processing unit reserves storage areas and sets the working state of the standard light source module, and then controls the image acquisition module to take pictures of the target object under different working states of the standard light source module, and receives, saves, and processes the image data through the reserved storage areas, and finally obtains light consistency image data.

2. The method for operating a camera system for maintaining consistent imaging illumination according to claim 1, characterized in that: Specifically, it includes the following steps: S1. The control and data processing unit controls the sequence generation module to generate a data sequence B with a sequence length of N, and controls the sequence generation module to send the data sequence B to the control and data processing unit one by one; each data B[n] (1 < n ≤ N) in the data sequence B is used to represent any one of the M light intensity levels of the standard light source module, and the M light intensity levels appear equally frequently in the data sequence B; S2. The control and data processing unit reserves M groups of storage areas PS[1], PS[2],... PS[m],... PS[M] for receiving, saving, and processing the image data RPW; the M groups of storage areas correspond one-to-one with the M light intensity levels; the image data RPW is the image data collected by the image acquisition module once; S3. When the control and data processing unit obtains a certain data B[n] in the data sequence B; first, it sets the working state of the standard light source module according to the light intensity represented by the data B[n], including whether to turn on the standard light source module and setting the light intensity level of the standard light source module; then it controls the image acquisition module to take pictures of the target object under the illumination of the current working state of the standard light source module, and the image acquisition module sends the unprocessed original image data RPW[n] collected this time to the control and data processing unit; the image data RPW[n] corresponds one-to-one with the data B[n]; S4. The control and data processing unit processes the image data RPW[n] according to the data B[n]; stores the image data RPW[n] in the storage area PS[m] corresponding to the m-th light intensity level represented by the data B[n]: If the storage area PS[m] is empty, directly save the image data RPW[n] to the storage area PS[m], that is, PS[m] = RPW[n]; If the storage area PS[m] already stores image data, perform an addition operation on the image data stored in PS[m] and the image data RPW[n], and save the image data after the addition operation to the storage area PS[m], and the addition operation is expressed as PS[m] = PS[m] + RPW[n]; After the control and data processing unit receives and processes all N original image data according to S3 and S4, let natural numbers 0 < m1 < m2 < M; select two different groups from them, and take out the data PS[m1] stored in the reserved storage area of the m1-th group and the data PS[m2] stored in the reserved storage area of the m2-th group. Among them, PS[m1] and PS[m2] are the results of pixel summation of all unprocessed raw RGB format original image data collected under the m1-th and m2-th light intensities respectively. Then, perform a pixel subtraction operation, and save the result after the subtraction operation to the storage area PS[m2]. The subtraction operation is expressed as PS[m2] = PS[m2] - PS[m1]; the PS[m2] after processing all pixels will be output as the final image data of this photo shooting; process PS[m2] to obtain the final RGB image, and clear the storage area.

3. The method for operating a camera system for maintaining consistent imaging illumination according to claim 2, characterized in that: The data B[n] is binary data.

4. The method for operating a camera system for maintaining consistent imaging illumination according to claim 2, characterized in that: The M light intensities include the case where the light intensity of the standard light source module is 0.

5. The method for operating a camera system for maintaining consistent imaging illumination according to claim 2, characterized in that: The operation of adding the image data stored in PS[m] to the image data RPW[n] and saving the image data after the addition operation to the storage area PS[m] is specifically as follows: Add each pixel value in the image data RPW[n] to the pixel value at the corresponding coordinate in PS[m] one by one, and save the added value as the pixel value at the corresponding coordinate in PS[m].

6. The method for operating a camera system for maintaining consistent imaging illumination according to claim 2, characterized in that: The operation of subtracting the image data stored in PS[m2] from the image data stored in PS[m1] and saving the image data after the subtraction operation to the storage area PS[m2] is specifically as follows: Subtract each pixel value in the image data PS[m2] from the pixel value at the corresponding coordinate in PS[m1] one by one, and save the subtracted value as the pixel value at the corresponding coordinate in PS[m2].

7. The method for operating a camera system for maintaining consistent imaging illumination according to claim 2, characterized in that: The processing of PS[m2] to obtain the final RGB image includes normalizing, white balancing, and color interpolation operations on PS[m2].

Images