Imaging device and design method thereof

By building an optical compensation system and acquisition circuit module, combined with ZEMAX optical design and image processing software, the problem of image information loss of CMOS image sensor is solved, and a high-resolution imaging effect is achieved.

CN113099145BActive Publication Date: 2024-12-06SANMING UNIV
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202110471664.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-04-29
Publication Date
2024-12-06
Estimated Expiration
2041-04-29

AI Technical Summary

Technical Problem

Directly using CMOS image sensor to collect image information will lead to loss of image information or the problem of not being able to collect any image information.

Method used

Build an imaging device consisting of optical compensation system module and acquisition circuit module. The optical compensation system includes a light source, a colorimetric card, a concave lens, a convex lens, a stop, a filter and an empty lens barrel. The optical path is optimized through ZEMAX optical design software and the optical path is optimized in Image processing software is designed in computers to improve the resolution of images.

Benefits of technology

It realizes effective acquisition and processing of image photoelectric signals, improves imaging resolution, ensures no loss of image information, and achieves a higher imaging effect.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113099145B_ABST
    Figure CN113099145B_ABST
Patent Text Reader

Abstract

The present invention relates to an imaging device, comprising an optical compensation system module, a collection circuit module capable of collecting images, and a computer capable of processing images. The collection circuit module comprises an image collection circuit board on which a CMOS image sensor is installed. Light emitted by the optical compensation system module is directed to the collection circuit module, and the collection circuit module is connected to the computer. The present invention constructs an imaging device that can complete the collection of image photoelectric signals without loss of image information, thereby achieving a high-resolution imaging function.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of imaging technology, and in particular to an imaging device and a design method of the imaging device. Background Art

[0002] CMOS image sensor is a solid-state imaging sensor. CMOS image sensor usually consists of image sensitive unit array, row driver, column driver, timing control logic, AD converter, data bus output interface, control interface and other parts, which are usually integrated on the same silicon chip. Its working process can generally be divided into reset, photoelectric conversion, integration, and readout. Directly using CMOS image sensor to collect image information will result in loss of image information or no image information can be collected. Summary of the invention

[0003] In order to solve the above problem that directly using a CMOS image sensor to collect image information will result in image information loss or no image information can be collected, the present invention proposes to build an optical system composed of a circuit acquisition board and optical devices such as lenses and apertures to cooperate with the CMOS image sensor to complete the acquisition of image photoelectric signals. The details of this solution are as follows.

[0004] The present invention first proposes an imaging device, comprising an optical compensation system module, a collection circuit module capable of collecting images, and a computer capable of processing images. The collection circuit module comprises an image collection circuit board on which a CMOS image sensor is installed. The light emitted by the optical compensation system module is directed to the collection circuit module, and the collection circuit module is connected to the computer.

[0005] As a further improvement of the imaging device of the present invention, the optical compensation system module includes a light source, a colorimetric card, a concave lens, a convex lens, an aperture, a filter and an empty lens barrel; the light source emits light to the colorimetric card, and the light is reflected by the colorimetric card and passes through the concave lens, convex lens, aperture, filter and empty lens barrel in sequence.

[0006] As a further improvement of the imaging device of the present invention, the model of the CMOS image sensor is MT9M001; the light passing through the empty lens barrel is emitted to the CMOS image sensor; and the image acquisition circuit board is connected to the computer using a USB data cable.

[0007] As a further improvement of the imaging device of the present invention, the optical compensation system module also includes a dark box; the light source, colorimetric card, concave lens, convex lens, aperture, filter, empty lens barrel and image acquisition circuit board are all installed inside the dark box; the computer is installed outside the dark box.

[0008] The present invention also proposes a design method of the imaging device as described above. The design method includes the design of an acquisition circuit module and the design of an optical compensation system module. The design of the acquisition circuit module includes using the principle of extracting library functions and using Microsoft Visual C++ software to design image acquisition software, and the image acquisition software is installed in the acquisition circuit module.

[0009] As a further improvement of the design method of the imaging device of the present invention, the design of the optical compensation system module adopts ZEMAX optical design software to design the optical path, including inputting the curvature radius, light wavelength and field of view parameters of the lens into the Zemax optical design software to obtain an optical structure model, and then optimizing the optical structure model to obtain the designed optimized system parameters, and designing the optical path according to the optimized system parameters.

[0010] As a further improvement of the design method of the imaging device of the present invention, the design method also includes using the principle of extracting library functions and using Microsoft Visual C++ software to design an image processing software module, and the image processing software module is installed in the computer, and the image processing software module can sharpen the image.

[0011] As a further improvement of the design method of the imaging device of the present invention, the computer is also installed with iseetest software; the design method also includes using iseetest software to evaluate the imaging device; the evaluation includes single resolution evaluation and comparative evaluation. The single resolution evaluation takes the pixels and resolution of a single imaging of the imaging device before or after image processing as the evaluation object. The comparative evaluation takes the comparison of pixels and resolution of two imagings of the imaging device before and after image processing as the evaluation object.

[0012] As a further improvement of the design method of the imaging device of the present invention, the evaluation uses a standard resolution test card as an image acquisition object; during the evaluation, a piece of the central area of ​​the standard resolution test card is intercepted as an evaluation sample, and the image of the captured standard resolution test card is analyzed to determine the pixels and resolution of the imaging device.

[0013] As a further improvement of the imaging device design method of the present invention, the design method further includes the steps of debugging and testing the imaging device according to the evaluation results after evaluating the imaging device.

[0014] The beneficial effects of the present invention are as follows: by setting up an optical compensation system module, a collection circuit module capable of collecting images and a computer system capable of processing images, a CMOS image sensor is installed on the collection circuit module, and an imaging device is built, which can complete the collection of image photoelectric signals without losing image information, thereby achieving a higher resolution imaging function. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 Schematic diagram of the overall structure of an imaging device according to an embodiment of the present invention.

[0016] Figure 2 yes Figure 1 The structural design block diagram of the image acquisition circuit board.

[0017] Figure 3 yes Figure 1 The design schematic of the image acquisition circuit board in .

[0018] Figure 4 It is the ZEMAX optical system parameters and two-dimensional diagram of the embodiment of the present invention.

[0019] Figure 5 This is an optical system evaluation function and wavelength setting interface of an embodiment of the present invention.

[0020] Figure 6 This is the system data after the optical model is optimized according to the embodiment of the present invention.

[0021] Figure 7 It is a graph of the MTF function before optimization according to an embodiment of the present invention.

[0022] Figure 8 This is a graph of the optimized MTF function according to an embodiment of the present invention.

[0023] Fig. 9 It is a point diagram of the ZEMAX system page according to an embodiment of the present invention.

[0024] Fig.10 2 is an image distance diagram of an optical system according to an embodiment of the present invention.

[0025] Fig.11 1 is a principle diagram and calculation formula diagram of the depth of field according to an embodiment of the present invention.

[0026] Fig.12 This is a diagram of the image processing software interface of an embodiment of the present invention.

[0027] Fig.13 This is a diagram of the evaluation results before image processing according to an embodiment of the present invention.

[0028] Fig.14 This is a diagram of the evaluation results after image processing according to an embodiment of the present invention.

[0029] Fig.15 This is a physical diagram of a system according to an embodiment of the present invention.

[0030] Reference numerals: light source 1, colorimetric card 2, concave lens 3, convex lens 4, aperture 5, filter 6, empty lens barrel 7, image acquisition circuit board 8, dark box 9, computer 10. DETAILED DESCRIPTION

[0031] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work belong to the scope of protection of the present invention. Therefore, the following detailed description of the embodiments of the present invention provided in the drawings is not intended to limit the scope of protection claimed in the present invention, but merely represents the selected embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work belong to the scope of protection of the present invention.

[0032] like Figure 1 As shown, it is a schematic diagram of the structure of an imaging device of the present invention, and the imaging device includes an optical compensation system module, an acquisition circuit module capable of acquiring images, and a computer 10 capable of processing images. The acquisition circuit module includes an image acquisition circuit board 8 on which a CMOS image sensor is installed. The light emitted by the optical compensation system module is irradiated to the acquisition circuit module, and the acquisition circuit module is connected to the computer 10. Among them, the model of the CMOS image sensor is MT9M001. The pixel of the MT9M001 model CMOS image sensor is 130W. Since directly using the CMOS acquisition board to acquire image information will cause image information loss or fail to acquire any image information, it is necessary to build a circuit acquisition board and an optical system composed of optical devices such as lenses and apertures to cooperate with the CMOS image sensor to complete the acquisition of image photoelectric signals and achieve the standard.

[0033] In the imaging device, the optical compensation system module includes a light source 1, a colorimetric card 2, a concave lens 3, a convex lens 4, an aperture 5, a filter 6, an empty lens barrel 7 and a dark box 9. The light source 1, the colorimetric card 2, the concave lens 3, the convex lens 4, the aperture 5, the filter 6, the empty lens barrel 7 and the image acquisition circuit board 8 are all installed inside the dark box 9. The colorimetric card 2 is a standard colorimetric card. The light source 1 is an annular light source distributed on the same side of the colorimetric card 2. The light source 1 emits light to the colorimetric card 2, and the light is reflected by the colorimetric card 2 and passes through the concave lens 3, the convex lens 4, the aperture 5, the filter 6 and the empty lens barrel 7 in sequence. The convex lens 4 is made of K9 glass, which is crystal clear and can play a good role in light transmission, and is widely used in the field of optical design.

[0034] The light passing through the empty lens barrel 7 is emitted to the CMOS image sensor; the image acquisition circuit board 8 is connected to the computer 10 using a USB data cable. The computer 10 is installed outside the dark box 9.

[0035] The design method of the imaging device includes the design of the acquisition circuit module and the design of the optical compensation system module. The design of the acquisition circuit module includes using the principle of extracting library functions and using Microsoft Visual C++ software to design image acquisition software, and the image acquisition software is installed in the acquisition circuit module. The design process of each part is described in detail below in conjunction with the accompanying drawings.

[0036] 1. Design of image acquisition circuit board 8

[0037] Figure 2 It is a block diagram of the structural design of the image acquisition circuit board 8. Figure 2 The processor in the design uses the S3C2440 processor (ARM920T core), which was developed by Samsung Electronics of South Korea. For low-cost, low-power, high-performance handheld devices or other electronic products, this processor has an interface that is most suitable for this design, which is the camera interface. Therefore, this CMOS processor does not need to be connected to a controller like the processor of the CCD image sensor. In this processor, the protocol for controlling CMOS behavior similar to the internal function of I2C cannot be directly used, that is, the two-wire serial protocol, which is a protocol unique to the 16 / 32 RISC processor, so when passing through the processor, it must pass through the I / 0 pin of the processor to simulate control. Finally, the role of the TCP / IP protocol is to transmit the image information collected by the acquisition circuit board to the PC computer through USB. After all, the resources and functions of the embedded acquisition board are not as powerful as those of the PC, so in the end, the PC must be used to perform some complex processing, such as frequency domain transformation, etc.

[0038] Figure 3The schematic diagram of the image acquisition circuit board 8 is shown in FIG. Because the image information to be received at the receiving end (image information processing and conversion module) is 8 bits, and the data size of the image information output by this chip is 10 bits, the lower two bits of the sensor are removed in the schematic diagram.

[0039] 2. Design of Optical Compensation System Module

[0040] The optical compensation system module is designed using ZEMAX optical design software to design an optical path, including inputting the curvature radius, light wavelength and field of view parameters of the lens into the ZEMAX optical design software to obtain an optical structure model, then optimizing the optical structure model to obtain designed optimized system parameters, and designing the optical path according to the optimized system parameters.

[0041] Since the size and distance of the image obtained are limited when the CMOS image sensor is used to collect images directly, the principle of Galileo telescope is used, such as Figure 4 The two-dimensional system image in the structure of the Galileo telescope is obtained by swapping the positions of the concave and convex lenses. That is, the light first passes through the concave lens and then the convex lens. This will result in a telescoped and reduced virtual image, and a larger range and farther distance can be captured.

[0042] The optical design uses ZEMAX to design the optical path, input the lens curvature radius (the curvature radius of the concave lens is 70, the curvature radius of the convex lens is 30), wavelength (FDC hydrogen spectrum series wavelength is selected), field of view and other parameters, and K9 glass is selected. This kind of glass is crystal clear and can play a good role in light transmission. It is widely used in the field of optical design. After setting these parameters, an optical structure model is obtained, such as Figure 4 The two-dimensional graph designed for parameter setting is then optimized, i.e., the distance between lenses and other parameters, such as Figure 5 It is the interface for setting evaluation functions and wavelengths of optical systems.

[0043] After the optical model is optimized, the focal length of the designed system can be obtained, such as Figure 6 The optimized system data has a focal length of 24.29565cm.

[0044] After setting up and optimizing the optical system, it is also necessary to test whether the designed optical system achieves the best imaging effect. Use two functions in ZEMAX: MTF (optical transfer function), Spot (spot diagram), and distortion. Modulation transfer function MTF is a very objective evaluation tool for the imaging quality of an optical system, which reflects the modulation degree of each spatial frequency. T and S represent the meridian and sagittal directions respectively. The MTF function curve before optimization is as follows: Figure 7 The optimized curve is shown in Figure 8As shown in the figure, the optimized curve is overall higher. The MTF curve of the ideal model is a straight line with an MTF of 1. In practice, the MTF curve cannot be a straight line because the actual optical system is affected by aberrations. If the aberrations are large, the curve will be lowered. Therefore, the higher the MTF curve, the better the imaging effect. Figure 8 This is the MTF function curve that is optimized to the best effect.

[0045] After analyzing the MTF curve, there is also a spot diagram that can be analyzed. Select the Spt button in the ZEMAX page to enter the viewing page of the spot diagram. The spot diagram expresses the size of the diffuse spot of the designed optical system. The diffuse spot refers to the area of ​​the image formed on the IMA (imaging surface) after the light passes through the optical system. It can be viewed from multiple field angles, such as Fig. 9 The two diffuse spots shown are viewed from the 0DEG field of view and the 4DEG field of view. There is a reference standard value for diffuse spots, which is the Airy spot. The Airy spot refers to the largest bright spot in the center of the diffraction pattern. In the application of ZEMAX, it refers to 2.44 Airy Diam. The closer to this value, the better the imaging effect. Fig. 9 The obtained Airy Diam is 2.864, which is the closest to the standard value of the Airy disk after optimization.

[0046] After the optical system is built, the focal length is 24mm, the diameter of the diffuse spot is 2.864, and the aperture value is the focal length of the optical system divided by the maximum aperture. The aperture refers to the diameter of the part of the aperture that can pass light. The aperture of this system is 23.5mm, so the aperture value of the system is F1. Since the distance from the convex lens to the imaging surface is 25.554155mm after optimization, Fig.10 As shown, this data is the image distance of the optical system. According to the Gaussian imaging formula: 1 / u+1 / v=1 / f, u is the object distance, v is the image distance, and f is the focal length, it can be calculated that the object distance is 60cm.

[0047] Depth of field refers to the range of values ​​within which an imaging device (such as a lens) can obtain a clear image after focusing. This range refers to the range in front and behind the object being measured. If the object being measured is within this range, a clear image can be captured, and outside the range it will be blurred.

[0048] According to the calculation formula of depth of field, Fig.11 It can be concluded that the designed optical compensation system has a foreground depth of field of about 2 cm and a background depth of field of about 3 cm. A clear image can be obtained when the object is placed 60 cm away from the CMOS chip, 2 cm close to the CMOS chip, and 3 cm away from the CMOS chip.

[0049] 3. Design of image processing software module

[0050] The design method also includes using the principle of extracting library functions and utilizing Microsoft Visual C++ software to design an image processing software module, wherein the image processing software module is installed in the computer 10 and can perform sharpening processing on the image.

[0051] After making the acquisition circuit of the CMOS image sensor and building the optical compensation circuit, use the acquisition software to collect image information, and use Microsoft Visual C++ to design a simple window program that can process the acquired image. The process of designing the software is as follows: creating a project, project layout and function design, and writing program code.

[0052] The page of the image processing software after the design is completed is as follows Fig.12 , this image processing software can scale images, adjust brightness, correct colors, insert text, and apply filters.

[0053] The main feature of this design is the sharpness function in the software, such as Fig.12 , you can quickly focus on the blurred edges, make the part of the image that needs to be processed more granular, increase the vividness of the color, and make the part clearer. However, sharpening has its limits and must be done moderately. Over-sharpening will result in an unrealistic image.

[0054] IV. Image Evaluation

[0055] The computer 10 is also installed with iseetest software. The design method further includes using iseetest software to evaluate the imaging device, and the evaluation includes single resolution evaluation and comparative evaluation. The single resolution evaluation takes the pixels and resolution of a single imaging of the imaging device before or after image processing as the evaluation object. The comparative evaluation takes the comparison of pixels and resolution of two imagings of the imaging device before and after image processing as the evaluation object.

[0056] The evaluation uses a standard resolution test card as an image acquisition object; during the evaluation, a piece of the central area of ​​the standard resolution test card is intercepted as an evaluation sample, and the image of the captured standard resolution test card is analyzed to determine the pixels and resolution of the imaging device.

[0057] After the image processing is completed, the processed image needs to be evaluated to see whether the image processing has improved the pixels and resolution. The image evaluation uses the software iSeetest 4.0. Using the single resolution evaluation in the software, you can only evaluate the pixels and resolution of the image. After the image captured by the image acquisition system is processed by image sharpening, etc., use iSeetest 4.0 to evaluate the images before and after image processing.

[0058] After the acquisition equipment is made, the resolution card is used as the evaluation standard. When evaluating, a piece of the central area needs to be intercepted as the evaluation sample. This test card is a test card certified by the international standard ISO12233. The effective pixels of the image before evaluation image processing are 1236849. Fig.13 , the effective pixels of the image after evaluation image processing are 1580604, such as Fig.14 This means that the pixel count after image processing has increased by 343755, and the image will be clearer.

[0059] 5. Image Evaluation

[0060] The design method also includes the step of debugging and testing the imaging device according to the evaluation results after evaluating the imaging device. After the production of the CMOS image sensor acquisition circuit, the construction of the optical compensation system, the design of the image processing software and the evaluation using the image evaluation software, the actual system diagram is finally obtained as shown in the figure below. Fig.15 .

[0061] This solution is based on the MT9M001-CMOS image sensor lens imaging system. The entire system is divided into four parts:

[0062] The first part is the design of the acquisition circuit, which mainly includes the interface part of the acquisition circuit board and the bottom board circuit PCB.

[0063] The second part is the design of the optical compensation system. This part uses optical instruments such as lenses and apertures, and then makes a darkroom. These optical instruments are combined together using the principles of optical design so that the CMOS image sensor can capture images with higher resolution.

[0064] The third part is the design of image acquisition software and image processing software. This part uses the principle of extracting library functions and is designed using microsoft visual c++ software.

[0065] The fourth part is the image evaluation part. This part uses iseetest software to evaluate the processed image. By comparing the resolution of the image captured by the standard test card, it is determined whether a good imaging effect is achieved.

[0066] The present invention utilizes MT9M001-CMOS image sensor, K9 glass, development board, aperture, and ZEMAX optical design software, designs specific parameters, and builds a single-lens imaging device, which can achieve a high-resolution imaging function for a standard colorimetric card.

[0067] The above description is only a partial embodiment of the present invention, not all embodiments. The detailed description of the embodiments of the present invention is not intended to limit the scope of protection claimed in the present invention, but only represents selected embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

Claims

1. A method for designing an imaging device, characterized in that: The design method includes the design of an acquisition circuit module and the design of an optical compensation system module; the design of the acquisition circuit module includes using the principle of extracting library functions and using Microsoft Visual C++ software to design image acquisition software, and the image acquisition software is installed in the acquisition circuit module; The optical compensation system module is designed by using ZEMAX optical design software to design an optical path, including inputting the curvature radius, light wavelength and field of view parameters of the lens into the Zemax optical design software to obtain an optical structure model, optimizing the optical structure model, obtaining the designed optimized system parameters, and designing the optical path according to the optimized system parameters; The design method further comprises using the principle of extracting library functions and utilizing Microsoft Visual C++ software to design an image processing software module, wherein the image processing software module is installed in a computer (10), and the image processing software module can perform sharpening processing on an image; The computer (10) is also installed with iseetest software; the design method further comprises using the iseetest software to evaluate the imaging device; the evaluation comprises a single resolution evaluation and a comparative evaluation; The single resolution evaluation takes the pixels and resolution of a single imaging of the imaging device before or after image processing as the evaluation object; The comparative evaluation is based on the comparison of pixels and resolution of the imaging device before and after image processing. The evaluation uses a standard resolution test card as an image acquisition object; during the evaluation, a piece of the central area of ​​the standard resolution test card is intercepted as an evaluation sample, and the image of the standard resolution test card taken is analyzed to determine the pixels and resolution of the imaging device; An imaging device designed according to the design method comprises an optical compensation system module, a collection circuit module capable of collecting images, and a computer (10) capable of processing images; the collection circuit module comprises an image collection circuit board (8) on which a CMOS image sensor is installed; light emitted by the optical compensation system module is directed to the collection circuit module, and the collection circuit module is connected to the computer (10); The optical compensation system module comprises a light source (1), a colorimetric card (2), a concave lens (3), a convex lens (4), an aperture (5), a filter (6) and an empty lens barrel (7); the light source (1) emits light to the colorimetric card (2), and the light is reflected by the colorimetric card (2) and then passes through the concave lens (3), the convex lens (4), the aperture (5), the filter (6) and the empty lens barrel (7) in sequence; The model of the CMOS image sensor is MT9M001; the light passing through the empty lens barrel (7) is emitted to the CMOS image sensor; the image acquisition circuit board (8) is connected to the computer (10) using a USB data cable; The optical compensation system module also includes a dark box (9); the light source (1), the colorimetric card (2), the concave lens (3), the convex lens (4), the diaphragm (5), the filter (6), the empty lens barrel (7) and the image acquisition circuit board (8) are all installed inside the dark box (9); and the computer (10) is installed outside the dark box (9).

2. The method for designing an imaging device according to claim 1, characterized in that: The design method further comprises the step of debugging and testing the imaging device according to the evaluation result after evaluating the imaging device.