Device and method for improving calibration efficiency of multi-optical path products

Abstract

The present invention discloses a device and a method for improving the calibration efficiency of multi-optical-path products, belonging to the technical field of optical imaging. It includes an optical platform, a video detection device, a PC, and a host computer. A micro dark box is arranged at the upper end of the optical platform. A light-transmitting hole is formed on one side of the micro dark box. A translation stage is arranged at the upper end of the optical platform close to one side of the micro dark box. A fixed bracket is installed on the upper end of the translation stage. A video capture card is installed on the PC. The present invention can eliminate the mechanical repetitive turntable operation, and perform single-time and non-repetitive fine-tuning of the manual adjustment of the translation stage under visual conditions. The operation is simple and can greatly improve the efficiency. In addition, the device uses digital image processing technology, and can intuitively and quantitatively reflect the entire calibration process and results, which can save the calibration time.

Description

Technical Field

[0001] The present invention relates to the field of optical imaging technology, and in particular, to a device and method for improving the calibration efficiency of multi-optical-path products. Background Art

[0002] Existing multi-optical-path products need to be calibrated manually, which is rather troublesome in operation and requires multiple calibrations, resulting in low efficiency. Therefore, we propose a device and method for improving the calibration efficiency of multi-optical-path products. Summary of the Invention

[0003] The present invention mainly aims at the problem that existing multi-optical-path products need to be calibrated manually, which is rather troublesome in operation and requires multiple calibrations, resulting in low efficiency, and provides a device and method for improving the calibration efficiency of multi-optical-path products; by reasonably setting a video detection device, a video capture card, a PC, and a host computer, the efficiency can be greatly improved, and the entire calibration process and results can be intuitively and quantitatively reflected.

[0004] A device for improving the calibration efficiency of multi-optical-path products of the present invention includes an optical platform, a video detection device, a PC, and a host computer. A micro dark box is provided at the upper end of the optical platform. A light-transmitting hole is provided on one side of the micro dark box. A translation stage is provided on the upper end of the optical platform near one side of the micro dark box. A fixed bracket is installed on the upper end of the translation stage. A video capture card is installed on the PC.

[0005] Preferably, an optical axis is formed on the side of the micro dark box away from the light-transmitting hole.

[0006] Preferably, a product is installed on the upper end of the fixed bracket. The product is located on one side of the light-transmitting hole. The translation stage is slidably connected to the upper end of the optical platform.

[0007] Preferably, the video detection device is located on one side of the optical axis. The input port of the video capture card is electrically connected to the output port of the video detection device.

[0008] Preferably, the input port of the PC is electrically connected to the output port of the video capture card. The PC is electrically connected to the host computer through an electrical signal.

[0009] Preferably, the video detection device is connected to the PC through an RS232 line.

[0010] A method for improving the calibration efficiency of multi-optical-path products, which is applied to the device for improving the calibration efficiency of multi-optical-path products in any one of the above, includes the following steps:

[0011] Step 1: Fix the product on the fixed bracket and install the translation stage on one side of the micro dark box;

[0012] Step 2: The product projects through the light-transmitting hole to form an image inside the micro-camera obscura;

[0013] Step 3: Detect the image of the product inside the micro-camera obscura through a video detection device;

[0014] Step 4: Collect the image through a video capture card, transmit the collected data into a PC, and display the image through the PC;

[0015] Step 5: Analyze the image information received by the PC through the host computer, and then send and receive relevant instructions and feedback information for optical axis adjustment and magnification calibration through the RS232 line;

[0016] Step 6: Adjust the position of the product by moving the translation stage according to the instructions of the host computer.

[0017] The present invention has the following beneficial effects: An apparatus and method for improving the calibration efficiency of multi-optical path products provided by the present invention include an optical platform, a video detection device, a PC, and a host computer. A micro-camera obscura is provided at the upper end of the optical platform. A light-transmitting hole is provided on one side of the micro-camera obscura. A translation stage is provided on the upper end of the optical platform near one side of the micro-camera obscura. A fixed bracket is installed on the upper end of the translation stage. A video capture card is installed on the PC; fix the product on the fixed bracket, install the translation stage on one side of the micro-camera obscura. The product projects through the light-transmitting hole to form an image inside the micro-camera obscura. Detect the image of the product inside the micro-camera obscura through a video detection device. Collect the image through a video capture card, transmit the collected data into a PC, and display the image through the PC. Analyze the image information received by the PC through the host computer, and then send and receive relevant instructions and feedback information for optical axis adjustment and magnification calibration through the RS232 line. Finally, adjust the position of the product by moving the translation stage according to the instructions of the host computer. This device can eliminate the mechanical and repetitive turntable operation, and perform single-time and non-repetitive fine-tuning of the translation stage manually under visual conditions. And the operation process is carried out under the visual conditions of a dedicated PC. The operation is simple and can greatly improve the efficiency. In addition, this device uses digital image processing technology, which can intuitively and quantitatively reflect the entire calibration process and results. And the relevant image processing solutions and technical routes adopted can be used as technical accumulation, inherited and extended to the development of future related products. Using this device can save half of the time compared with the prior art. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The above and / or additional aspects and advantages of the present invention will become obvious and easy to understand from the following description of the embodiments in conjunction with the accompanying drawings, where:

[0019] Figure 1It is a system erection schematic diagram of a device and method for improving the calibration efficiency of multi-optical path products according to the present invention;

[0020] Figure 2 It is a schematic diagram of the connection between the device and the upper computer for a device and method for improving the calibration efficiency of multi-optical path products according to the present invention;

[0021] Figure 3 It is a flowchart of image magnification adjustment for a device and method for improving the calibration efficiency of multi-optical path products according to the present invention;

[0022] Figure 4 It is a flowchart of image optical axis adjustment for a device and method for improving the calibration efficiency of multi-optical path products according to the present invention.

[0023] In the figure: 1. Optical platform; 2. Miniature dark box; 3. Optical axis; 4. Light-transmitting hole; 5. Translation stage; 6. Fixed bracket; 7. Video detection device; 8. Video capture card; 9. PC; 10. Upper computer. Specific embodiments

[0024] The following details the embodiments of the present invention. The examples of the embodiments are shown in the drawings, where the same or similar reference numerals represent the same or similar elements or elements with the same or similar functions from beginning to end. The embodiments described below with reference to the drawings are exemplary and are only used to explain the present invention and should not be construed as a limitation of the present invention.

[0025] The following disclosure provides many different embodiments or examples for implementing different structures of the present invention. To simplify the disclosure of the present invention, the components and settings of specific examples are described below. Of course, they are only examples and are not intended to limit the present invention. In addition, the present invention may repeat reference numerals and / or reference letters in different examples. This repetition is for the purpose of simplification and clarity and does not itself indicate the relationship between the various embodiments and / or settings discussed. In addition, the present invention provides examples of various specific processes and materials, but those of ordinary skill in the art may be aware of the application of other processes and / or the use of other materials.

[0026] Please refer to Figures 1 to 4 , an embodiment of the present invention provides a device for improving the calibration efficiency of multi-optical path products, including an optical platform 1, a video detection device 7, a PC 9, and an upper computer 10. A miniature dark box 2 is provided at the upper end of the optical platform 1. A light-transmitting hole 4 is provided on one side of the miniature dark box 2. A translation stage 5 is provided on the upper end of the optical platform 1 near the miniature dark box 2. A fixed bracket 6 is installed on the upper end of the translation stage 5. A video capture card 8 is installed on the PC 9.

[0027] On the side of the miniature dark box 2 away from the light-transmitting hole 4, an optical axis 3 is formed inside.

[0028] A product is installed at the upper end of the fixed bracket 6. The product is located on one side of the light-transmitting hole 4. The translation stage 5 is slidably connected to the upper end of the optical platform 1.

[0029] The video detection device 7 is located on one side of the optical axis 3. The input port of the video capture card 8 is electrically connected to the output port of the video detection device 7. The video detection device 7 can detect the image of the product inside the micro dark box 2, and the video capture card 8 captures the image.

[0030] The input port of the PC 9 is electrically connected to the output port of the video capture card 8. The video capture card 8 can transmit the collected data into the PC 9. The PC 9 is electrically connected to the host computer 10 through an electrical signal;

[0031] The host computer 10 is based on the MFC dialog box mode. In this mode, an "image control" for real-time image display is placed. Function buttons such as serial port opening and calculation of the field of view difference can be controlled by clicking the buttons with the mouse. For magnification calibration, mainly analyze the field of view pixel differences of the three-way horizontal target in the infrared and low-light modes. Calculate the field of view difference ΔT = |IRx3 - IR_X1| - |TW_x3 - TW_x1| according to the following formula

[0032] Where, IR_x3 and IR_x1 represent the horizontal coordinate values of the left and right two of the three targets in the infrared image, and TW_x3 and TW_x1 represent the horizontal coordinate values of the left and right two of the three targets in the low-light image. Taking the low-light image as the reference target, the above formula is the field of view difference of the infrared image relative to the low-light image. Adjust the field of view difference within a reasonable range to achieve the magnification consistency calibration of the infrared and low-light images;

[0033] The image processing flow for detecting the multi-optical path field of view difference is as Figure 3As shown, the image processing process starts from image grayscale conversion, followed by median filtering of the grayscale image to remove the noise brought by the image acquisition device. Then, through edge detection, the edges of the crosshair are extracted. To avoid discontinuous edge extraction problems, the extracted edge pixels are expanded using the dilation algorithm. To reduce the amount of data for image analysis, the detection area is demarcated, and the position of the product is fine-tuned by manually adjusting 5, thereby correcting the positions of the three-way targets in the image so that the three-way targets fall within the set detection area. For the convenience of subsequent processing, the pixels outside the detection area are set to zero. Then, connected component analysis is performed on the target to extract the contour target, especially the length and width information of the contour. To avoid interference problems caused by small-area noise, first, a quantitative analysis of the length and width of the detected target contour is performed. Those smaller than a certain value are determined as noise, and the small-area noise is deleted. Then, contour marking is carried out, and a bounding box is marked for the minimum circumscribed rectangle of the extracted target contour. Finally, based on the characteristics of the crosshair target, the center coordinates of the target are obtained through centroid marking. Then, the obtained multiple target coordinates are sorted by the bubble sort method to distinguish the left, middle, and right positions of the three coordinates, laying a foundation for calculating the field-of-view difference. According to the value of the field-of-view difference, first, horizontal adjustment is performed. If the field-of-view difference data is positive, it is adjusted towards both ends. If it is negative, it is adjusted towards the middle. If the field-of-view difference is less than 2 pixels, it is determined that the horizontal magnification correction is completed. Then, the vertical magnification is adjusted proportionally. Finally, the relevant parameters are saved, and the relevant commands are output through the serial RS232 interface.

[0034] After the magnification correction is completed, there may be a phenomenon that the crosshairs of the two-way (low-light and infrared) do not coincide. The optical axis 3 adjustment process of the image is as Figure 4 shown. Taking the crosshair of the low-light image as a template, on the basis of the initial crosshair of the infrared image, the entire infrared image is shifted horizontally left and right or vertically up and down. After the adjustment is completed, it can be checked whether the crosshairs of the infrared and low-light fusion images coincide. Otherwise, the adjustment continues. During the adjustment process, it also includes the function of resetting the infrared target. After the crosshairs are adjusted to coincide, the parameters are saved, and the optical axis adjustment is completed;

[0035] Among them: Image grayscale conversion: Most current color images adopt the RGB color model, which stores a large amount of data in three components and three bytes. Grayscale conversion is the process of converting the data of the three components into a single color component. The grayscale range is 0 - 255, and each pixel value of a grayscale image only needs to store one byte of grayscale value; Edge detection: An edge refers to those pixel combinations where the pixel grayscale has a discontinuous change. The purpose of edge detection is to significantly reduce the amount of image data, eliminate irrelevant information, and retain the important structural attributes of the image; Dilation operation: The dilation operation is a fine pixel operation on binary images, expanding the boundary pixels of the image, that is, expanding the white area. The expansion method can be specified through external parameters; Connected component analysis: A connected component usually refers to an image area in a binary image composed of pixel points with the same pixel value and adjacent positions. Connected component analysis is to extract the connected components in the image and extract geometric features such as the area and centroid of these regions; Centroid marking: It is to analyze the center of mass of the connected region, and after finding the coordinates of the center, mark it on the original image.

[0036] Bubble sort: It is a basic sorting method in the field of computer science. The basic idea is as follows: For a set of elements to be sorted, compare adjacent two numbers in turn, place the smaller number in front and the larger number behind. Continue like this until the last two numbers are compared. Repeat the above steps until all sorting is completed. This process is similar to how carbon dioxide bubbles in a carbonated beverage will eventually float to the top, hence the name "bubble sort".

[0037] The video detection device 7 is connected to the PC 9 through an RS232 line, and through the RS232 line, the video detection device 7 and the PC 9 can communicate with each other.

[0038] A method for improving the calibration efficiency of multi-optical path products, applied to the device for improving the calibration efficiency of multi-optical path products in any of the above items, includes the following steps:

[0039] Step 1: Fix the product on the fixing bracket 6, and install the translation stage 5 on one side of the micro dark box 2;

[0040] Step 2: The product projects an image inside the micro dark box 2 through the light-transmitting hole 4;

[0041] Step 3: Detect the image of the product inside the micro dark box 2 through the video detection device 7;

[0042] Step 4: Collect the image through the video capture card 8, and transmit the collected data into the PC 9, and display the image through the PC 9;

[0043] Step 5: Analyze the image information received by the PC 9 through the host computer 10, and then send and receive relevant instructions and feedback information for the adjustment of the optical axis 3 and magnification calibration through the RS232 line;

[0044] Step 6: Adjust the position of the product by moving the translation stage 5 according to the instructions of the host computer 10.

[0045] The present invention has been described in detail above in connection with specific exemplary embodiments. However, it should be understood that various modifications and variations can be made without departing from the scope of the present invention as defined by the appended claims. The detailed description and the drawings should be regarded as illustrative only and not restrictive. If there are any such modifications and variations, then they will all fall within the scope of the present invention described herein. In addition, the background art is intended to illustrate the research and development status and significance of the present technology, and is not intended to limit the present invention or the application fields of the present application and the present invention.

[0046] More specifically, although exemplary embodiments of the present invention have been described herein, the present invention is not limited to these embodiments, but includes any and all embodiments that can be recognized by those skilled in the art as being modified, omitted, for example, combinations between various embodiments, adaptively changed, and / or replaced based on the foregoing detailed description. The limitations in the claims can be broadly interpreted in accordance with the language used in the claims and are not limited to the examples described in the foregoing detailed description or during the implementation of the present application. These examples should be considered non-exclusive. Any steps recited in any method or process claim can be executed in any order and are not limited to the order set forth in the claims. Therefore, the scope of the present invention should be determined only by the appended claims and their legal equivalents, rather than by the description and examples given above.

Claims

1. A method for improving the calibration efficiency of multi-optical-path products, using a device for improving the calibration efficiency of multi-optical-path products. The device includes an optical platform (1), a video detection device (7), a PC (9), and a host computer (10), and is characterized in that, A micro dark box (2) is provided at the upper end of the optical platform (1). A light-transmitting hole (4) is provided on one side of the micro dark box (2). A translation stage (5) is provided at the upper end of the optical platform (1) near one side of the micro dark box (2). A fixed bracket (6) is installed on the upper end of the translation stage (5). A video capture card (8) is installed on the PC (9). The method comprises the following steps: Step 1: Fix the product on the fixed bracket (6) and install the translation stage (5) on one side of the micro dark box (2). Step 2: The product projects an image inside the micro dark box (2) through the light-transmitting hole (4). Step 3: Detect the image of the product inside the micro dark box (2) through the video detection device (7). Step 4: Collect the image through the video capture card (8), transmit the collected data into the PC (9), and display the image through the PC (9). Step 5: Analyze the image information received by the PC (9) through the host computer (10), and then send and receive relevant instructions and feedback information for optical axis (3) adjustment and magnification calibration through the RS232 line. Step 6: Adjust the position of the product by moving the translation stage (5) according to the instructions of the host computer (10). The host computer (10) is based on the MFC dialog box mode of an image control capable of real-time image display. In this mode, the serial port opening and the calculation of the field-of-view difference function buttons can be controlled by clicking the buttons with the mouse. Calculate the field-of-view difference ΔT = |IRx3 - IR_x1| - |TW_x3 - TW_x1| according to the following formula; where IR_x3 and IR_x1 represent the horizontal coordinate values of the left and right two of the three targets in the infrared image, and TW_x3 and TW_x1 represent the horizontal coordinate values of the left and right two of the three targets in the low-light image. Taking the low-light image as the reference target, the above formula is the field-of-view difference of the infrared image relative to the low-light image. Adjust the field-of-view difference within a reasonable range to achieve the magnification consistency calibration of the infrared and low-light images. The image processing for detecting the multi-optical-path field-of-view difference comprises the following steps: Starting from image grayscale conversion, median filtering is performed on the grayscale image to remove the noise brought by the image acquisition device. Through edge detection, the edges of the cross cursor are extracted. The dilation algorithm is used to expand the extracted edge pixels to delimit the detection area. The position of the product is finely adjusted by manually adjusting the translation stage (5), thereby correcting the positions of the three-way targets in the image so that the three-way targets fall within the set detection area. The pixels outside the detection area are set to zero. Connected component analysis is performed on the target to extract the contour target, that is, the length and width information of the contour are extracted. Quantitative analysis is carried out on the length and width of the detected target contour. Those less than a certain value are determined as noise, and small-area noise is deleted. Contour marking is performed, and a bounding box is marked for the minimum circumscribed rectangle of the extracted target contour. Based on the characteristics of the cross target, the center coordinates of the target are obtained through centroid marking. The obtained multiple target coordinates are sorted by the bubble method to distinguish the left, middle, and right positions of the three coordinates. According to the value of the field difference, horizontal adjustment is performed. If the field difference data is positive, adjust towards both ends; if it is negative, adjust towards the middle. If the field difference is less than 2 pixels, it is determined that the horizontal magnification correction is completed. The magnification in the vertical direction is adjusted proportionally, and relevant parameters are saved. The relevant commands are output through the serial RS232 interface.

2. The method for improving the calibration efficiency of a multi-optical path product according to claim 1, wherein On one side of the interior of the micro camera obscura (2) far from the light-transmitting hole (4), an optical axis (3) is formed.

3. A method for improving the calibration efficiency of a multi-optical path product according to claim 1, characterized in that, A product is installed at the upper end of the fixed bracket (6). The product is located on one side of the light-transmitting hole (4). The translation stage (5) is slidably connected to the upper end of the optical platform (1).

4. A method for improving the calibration efficiency of a multi-optical path product according to claim 1, characterized in that The video detection device (7) is located on one side of the optical axis (3). The input port of the video capture card (8) is electrically connected to the output port of the video detection device (7).

5. A method for improving the calibration efficiency of a multi-optical path product according to claim 1, characterized in that, The input port of the PC (9) is electrically connected to the output port of the video capture card (8). The PC (9) is electrically connected to the host computer (10).

6. A method for improving the calibration efficiency of a multi-optical path product according to claim 1, characterized in that, The video detection device (7) is connected to the PC (9) through an RS232 line.

Images