Method for manufacturing a high dynamic focal plane detector and method for acquiring a high dynamic image

By designing the optical transmittance of the substrate and the neutral density attenuation film, a four-channel neutral density attenuator array optical device was fabricated and integrated into the focal plane detector. This solved the manufacturing problem of high dynamic focal plane detectors in the prior art, achieved high-quality high dynamic image acquisition, and avoided ghosting and misalignment.

CN115423713BActive Publication Date: 2026-02-10NORTHWESTERN POLYTECHNICAL UNIV
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202211071223.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-09-02
Publication Date
2026-02-10
Estimated Expiration
2042-09-02

AI Technical Summary

Technical Problem

Existing technologies struggle to manufacture high dynamic focal plane detectors that are simple to manufacture, compact in structure, highly integrated, capable of snapshot imaging, and low in cost. Furthermore, multi-frame image fusion schemes with different exposures are prone to ghosting and misalignment in motion scenarios.

Method used

The optical transmittance of the substrate, the first type and the second type of neutral density attenuation film were designed. A four-channel neutral density attenuation film array optical device with a 2×2 grid periodic arrangement was fabricated and integrated into the focal plane detector in a suspended manner. High dynamic range images were synthesized through image super-resolution reconstruction and transmittance normalization processing.

Benefits of technology

The high dynamic range focal plane detector has achieved a simple manufacturing process, compact structure, high integration, snapshot imaging capability, and low cost, effectively eliminating ghosting and misalignment problems and obtaining high-quality high dynamic range images.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115423713B_ABST
    Figure CN115423713B_ABST
Patent Text Reader

Abstract

The application discloses a kind of high dynamic focal plane detector's manufacturing method, by the optical transmittance of design substrate, the first neutral density attenuation film and the second neutral density attenuation film, four-channel neutral density attenuation sheet array optical device of 2×2 grid period arrangement is manufactured, four-channel neutral density attenuation sheet array optical device is suspended to the focal plane of detector using integrated, high dynamic focal plane detector is formed, the original image of four types of channels output by high dynamic focal plane detector is carried out image super-resolution reconstruction and obtains four full-resolution images, the full-resolution image of four types of channels is carried out transmittance normalization processing and obtains four normalized images, finally, four normalized images are synthesized high dynamic scene image, with the advantages of simple manufacturing process, compact structure, high integration, snapshot imaging, low cost.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The application belongs to the technical field of photoelectric imaging, and particularly relates to a manufacturing method of a high-dynamic focal plane detector and a high-dynamic image acquisition method. BACKGROUND

[0002] In an outdoor high-dynamic scene, in order to obtain a high-dynamic photo, a common technical approach in the industry is a multi-frame different exposure image fusion scheme. For example, in the scheme disclosed in document (patent publication number: CN 105163047A), a plurality of frames of images with different exposure settings are first shot as inputs (usually three frames of images with short exposure, normal exposure and long exposure), then the three frames of input images are converted into three frames of real luminance images of the scene through a camera response curve, and then a registration ghost detection operation is performed to combine the three frames of images into one frame of high-dynamic range image. For example, in the scheme disclosed in document (patent publication number: CN 108391059A), different image processing modes are selected according to the judgment result of the state information and the shooting scene information of the terminal device, and a better synthesized image is obtained through different exposure values and different image fusion modes. For example, in the scheme disclosed in document (patent publication number: CN 108419023A), a first image frame sequence and a second image frame sequence for the same shooting scene are obtained, and a high-dynamic range image is obtained by synthesizing the second image frame sequence according to the first image frame sequence. The multi-frame different exposure image fusion scheme causes ghosting and misplacement in the synthesized high-dynamic image due to the motion offset between the multiple frames of images used to synthesize the high-dynamic image under a motion scene condition.

[0003] In view of the ghosting problem caused by the motion scene, the industry has given technical solutions. For example, document (patent publication number: CN 103546673B) proposes a high-dynamic range imaging method using motion vector compensation, extracts motion vectors of a motion scene in a predetermined interval at a predetermined interval, compensates for the motion of the photographed image using the motion vectors, and synthesizes a high-dynamic image using multiple motion-compensated images; the proposed method is difficult to accurately estimate the motion vectors of the scene due to the diversity of the speed and direction of the target motion in the scene, thereby failing to effectively eliminate ghosting. Document (patent publication number: CN 104702971B) proposes to use multiple cameras to optimally select different exposure times and simultaneously collect multiple frames of images to generate a high-dynamic image; the method uses multiple cameras, resulting in a large volume and high cost of the high-dynamic imaging device.

[0004] However, how to manufacture a high-dynamic focal plane detector with simple manufacturing process, compact structure, high integration, snapshot imaging and low cost has become a problem to be solved. SUMMARY

[0005] In order to solve the above problems in the prior art, the application provides a manufacturing method of a high-dynamic focal plane detector and a high-dynamic image acquisition method.

[0006] In order to achieve the above object, the application adopts the following technical scheme:

[0007] The application discloses a manufacturing method of a high-dynamic focal plane detector, comprising the following steps:

[0008] S11: designing a working waveband of a substrate, optical transmittances of a first neutral density attenuation film and a second neutral density attenuation film;

[0009] S12: manufacturing a four-channel neutral density attenuation sheet array optical device arranged in a 2*2 grid period by using the substrate, the first neutral density attenuation film and the second neutral density attenuation film, wherein the four-channel neutral density attenuation sheet array optical device comprises a plurality of four-channel neutral density attenuation sheet unit blocks arranged in an array, each of the four-channel neutral density attenuation sheet unit blocks comprises 2*2 four-channel neutral density attenuation sheet units with different optical transmittances;

[0010] S13: suspending and integrating the four-channel neutral density attenuation sheet array optical device into a focal plane of a focal plane detector to form a high-dynamic focal plane detector.

[0011] As a preferred embodiment of the application, the constraint conditions met by the working waveband of the substrate and the optical transmittances of the first neutral density attenuation film and the second neutral density attenuation film comprise:

[0012] The working waveband range of the substrate covers the working waveband range of the detector;

[0013] The optical transmittance of the first neutral density attenuation film is higher than that of the second neutral density attenuation film.

[0014] As a preferred embodiment of the application, step S12 comprises:

[0015] S121: plating a plurality of the first neutral density attenuation films arranged in a comb-shaped period on the substrate;

[0016] S122: plating the second neutral density attenuation film arranged in a comb-shaped period on the substrate along the vertical direction of the extension direction of the first neutral density attenuation film to form the four-channel neutral density attenuation sheet array optical device.

[0017] As a preferred embodiment of the present application: the four channels in any of the neutral density attenuation sheet unit blocks in the four-channel neutral density attenuation sheet array optical device have different optical transmittances.

[0018] As a preferred embodiment of the present application: the first and second neutral density attenuation films are plated on the same surface or different surfaces of the substrate.

[0019] As a preferred embodiment of the present application: a plurality of the first neutral density attenuation films are arranged in a comb-like period on the surface of the substrate, wherein the width of a single first neutral density attenuation film is equal to 1 / 2 of the arrangement period; a plurality of the second neutral density attenuation films are arranged in a comb-like period on the surface of the substrate, wherein the width of a single second neutral density attenuation film is equal to 1 / 2 of the arrangement period.

[0020] As a preferred embodiment of the present application: step S13 comprises:

[0021] S131: A boss is arranged on the periphery of the light-sensitive surface of the focal plane detector, and the four-channel neutral density attenuation sheet array optical device is arranged on the boss of the focal plane detector, so that there is an axial gap between the four-channel neutral density attenuation sheet array optical device and the pixel array of the focal plane detector, wherein the four-channel neutral density attenuation sheet array optical device is aligned with the pixel array of the focal plane detector, and each pixel of the focal plane detector is spatially aligned with a neutral density attenuation sheet unit;

[0022] S132: In the relative position alignment state of the four-channel neutral density attenuation sheet array and the pixel array of the focal plane detector, the high dynamic focal plane detector is formed by dispensing and curing on the side surface of the four-channel neutral density attenuation sheet array optical device.

[0023] As a preferred embodiment of the present application: the high dynamic focal plane detector comprises four types of channels, including the first type of channel pixel, the second type of channel pixel, the third type of channel pixel, and the fourth type of channel pixel, wherein the first type of channel pixel is a pixel that has not been affected by the first neutral density attenuation film and has not been affected by the second neutral density attenuation film, the second type of channel pixel is a pixel that has been affected by the first neutral density attenuation film and has not been affected by the second neutral density attenuation film, the third type of channel pixel is a pixel that has not been affected by the first neutral density attenuation film and has been affected by the second neutral density attenuation film, and the fourth type of channel pixel is a pixel that has been affected by the first neutral density attenuation film and has been affected by the second neutral density attenuation film.

[0024] The embodiment of the present application also provides a high dynamic image acquisition method, comprising the following steps:

[0025] S21: calibrating the relative optical transmittance of the four types of channels of the high dynamic focal plane detector prepared by the high dynamic focal plane detector manufacturing method in any of the above embodiments, wherein the relative optical transmittance τ of the cth channel pixel corresponds to c The calculation formula is:

[0026]

[0027] Wherein, m c represents the average value of all pixel values of the cth type channel under white light irradiation, m k represents the average value of all pixel values of the kth type channel under white light irradiation.

[0028] S22: acquiring the original images of the four types of channels output by the high dynamic focal plane detector, wherein all output values of the 1st type channel under the condition of keeping the spatial relative positions of all pixels unchanged constitute an original image A1, all output values of the 2nd type channel under the condition of keeping the spatial relative positions of all pixels unchanged constitute an original image A2, all output values of the 3rd type channel under the condition of keeping the spatial relative positions of all pixels unchanged constitute an original image A3, and all output values of the 4th type channel under the condition of keeping the spatial relative positions of all pixels unchanged constitute an original image A4.

[0029] S23: using an image super-resolution method to perform image super-resolution processing on the original image A1, the original image A2, the original image A3 and the original image A4 respectively, and corresponding full-resolution images B1, B2, B3 and B4 are obtained.

[0030] S24: performing transmittance normalization processing on the full-resolution images B1, B2, B3 and B4 respectively, and corresponding normalized images J1, J2, J3 and J4 are obtained, wherein the calculation formula of the normalized image J c is:

[0031] J c (i,j)=B c (i,j) / τ c , c∈{1,2,3,4}

[0032] Wherein, (i,j) represents the coordinate position of the pixel in each channel image, B c (i,j) represents the full-resolution image B cPixel value at coordinate (i,j), J c (i,j) represents a normalized image J c Pixel value at coordinate (i,j);

[0033] S25: Synthesize a high dynamic image F from the normalized image J1, the normalized image J2, the normalized image J3, and the normalized image J4, wherein the pixel value F(i,j) of the high dynamic image F is assigned as follows:

[0034]

[0035] Wherein, b represents the bit number of image brightness.

[0036] As a preferred embodiment of the present application: the bit number b of image brightness is 10.

[0037] As a preferred embodiment of the present application: the image super-resolution method is any one of the three types of methods based on image interpolation, machine learning, and deep learning.

[0038] The present application has the following advantages:

[0039] The present application designs the optical transmittance of the substrate, the first neutral density attenuation film, and the second neutral density attenuation film, manufactures a four-channel neutral density attenuation sheet array optical device arranged in a 2x2 grid period, suspends and integrates the four-channel neutral density attenuation sheet array optical device to the focal plane of the detector, forms a high dynamic focal plane detector, performs image super-resolution reconstruction on the original images of the four types of channels output by the high dynamic focal plane detector to obtain four full-resolution images, performs transmittance normalization processing on the full-resolution images of the four types of channels to obtain four normalized images, and finally synthesizes a high dynamic scene image from the four normalized images, which has the advantages of simple manufacturing process, compact structure, high integration, snapshot imaging, and low cost. BRIEF DESCRIPTION OF DRAWINGS

[0040] Figure 1 is a flowchart of a high dynamic focal plane detector manufacturing method and a high dynamic image acquisition method proposed by the present application;

[0041] Figure 2 is a layered schematic diagram of a four-channel neutral density attenuation sheet array optical device proposed by the present application;

[0042] Figure 3 is a layered schematic diagram of a high dynamic focal plane detector proposed by the present application.

[0043] BRIEF DESCRIPTION OF DRAWINGS:

[0044] 101 - substrate; 102 - first neutral density attenuation film; 103 - second neutral density attenuation film; 104 - four-channel neutral density filter array optical device; 105 - focal plane detector; 106 - pixel array of the detector; 107 - boss; 108 - high dynamic focal plane detector. DETAILED DESCRIPTION

[0045] The application will be further described below in connection with the drawings and specific embodiments.

[0046] The technical solutions in the embodiments of the application will be described clearly and completely below. The described embodiments are only some of the embodiments of the application, rather than all the embodiments. Based on the embodiments in the application, all other embodiments obtained by those skilled in the art without creative work fall within the protection scope of the application.

[0047] Embodiment one

[0048] Please refer to Figure 1 , Figure 2 and Figure 3 , Figure 1 is a flow chart of a high dynamic focal plane detector manufacturing method and a high dynamic image acquisition method proposed by the application, Figure 2 is a layered schematic diagram of a four-channel neutral density filter array optical device proposed by the application, Figure 3 is a layered schematic diagram of a high dynamic focal plane detector. The embodiment of the application proposes a high dynamic focal plane detector manufacturing method. For a low-illumination focal plane detector with a working wavelength range of 0.4-1.1 μm, a high dynamic focal plane detector is designed. The high dynamic focal plane detector manufacturing method comprises the following steps:

[0049] S11: design the working wavelength range of the substrate, the optical transmittance of the first neutral density attenuation film and the second neutral density attenuation film.

[0050] Specifically, in the embodiment, the focal plane detector 105 is a low-illumination focal plane detector with a working wavelength range of 0.4-1.1 μm. The substrate 101 can be a glass substrate with a working wavelength range of 0.4-1.1 μm. The substrate 101 is preferably K9 glass as the substrate, and K7 or F5 glass can also be selected as the substrate. The optical transmittance of the first neutral density attenuation film 102 is designed to be 0.4, and the optical transmittance of the second neutral density attenuation film 103 is designed to be 0.1.

[0051] S12: manufacture a four-channel neutral density filter array optical device arranged in a 2x2 grid period.

[0052] Specifically, as Figure 2As shown, multiple first-type neutral density attenuation films 102 arranged in a comb-like periodic pattern are deposited on the surface of a transparent glass substrate 101. On the surface on which the first-type neutral density attenuation films 102 are deposited, multiple second-type neutral density attenuation films 103 arranged in a comb-like periodic pattern are deposited in the direction perpendicular to the extension direction of the first-type neutral density attenuation films 102. The extension directions of the first-type neutral density attenuation films 102 and the second-type neutral density attenuation films 103 are perpendicular to each other, forming a four-channel neutral density attenuator array optical device 104.

[0053] S13: A suspended integrated four-channel neutral density attenuator array optics is used to the focal plane of the detector to form a high dynamic focal plane detector.

[0054] Specifically, such as Figure 3 As shown, in a preferred embodiment of the present invention, the process of using a suspended integrated four-channel neutral density attenuator array optical device 104 to the focal plane of the focal plane detector 105 to form a high dynamic range focal plane detector 108 includes the following steps:

[0055] S21: The flip-chip bonding machine is used to ensure that the four-channel neutral density attenuator array optics 104 is aligned with the pixel array 106 of the focal plane detector 105, so that each pixel of the focal plane detector is spatially aligned with a neutral density attenuator unit.

[0056] S22: A ceramic protrusion 107 is provided around the photosensitive surface of the focal plane detector so that the axial gap between the four-channel neutral density attenuator array optics 104 and the pixel array 106 of the focal plane detector is less than 20μm after integration (the axial gap is equal to the height of the protrusion).

[0057] S23: With the microfilter array and the pixel array 106 of the focal plane detector aligned in relative position, adhesive is applied and cured by dispensing on the side of the neutral density attenuator array optics 104.

[0058] In this embodiment of the invention, the working wavelength of the focal plane detector is 0.4-1.1 μm, and the working wavelength of the K9 glass substrate is 0.35-2.0 μm.

[0059] In this embodiment of the invention, multiple first-type neutral density attenuation films 102 are arranged in a comb-like periodic pattern on the surface of the substrate 101. The arrangement period of a single first-type neutral density attenuation film 102 is 24 μm, and the width of a single first-type neutral density attenuation film 102 is 12 μm. The width of a single first-type neutral density attenuation film 102 is equal to half of its arrangement period, that is, the width of a first-type neutral density attenuation film 102 is equal to the distance between two first-type neutral density attenuation films 102.

[0060] In the embodiment of the present application, the plurality of the second neutral density attenuation films 103 are arranged in a comb-like period on the surface of the substrate 101, the arrangement period of the single second neutral density attenuation film 103 is 24 μm, the width of the single second neutral density attenuation film 103 is 12 μm, and the width of the single second neutral density attenuation film 103 is equal to half of the arrangement period, that is, the width of the second neutral density attenuation film 103 is equal to the distance between two second neutral density attenuation films 103.

[0061] In the embodiment of the present application, the focal plane detector 105 can be a frame exposure CMOS focal plane detector, the working waveband is 0.4-1.1 μm, the surface array size of the frame exposure CMOS focal plane detector is 1280×1080, and the pixel size is 12 μm×12 μm.

[0062] In the embodiment of the present application, the flip chip bonder device is used to ensure that the four-channel neutral density attenuation film array optical device 104 is aligned with the pixel array 106 of the focal plane detector 105, so that each pixel of the focal plane detector is spatially aligned with a neutral density attenuation film unit.

[0063] In the embodiment of the present application, the ultraviolet glue is dotted on the side surface of the micro-filter array optical device 104, and the ultraviolet glue is cured by ultraviolet exposure.

[0064] Please refer again to Figure 1 The embodiment further proposes a high dynamic image acquisition method on the basis of the high dynamic focal plane detector manufacturing method described in the above embodiment, and the high dynamic image acquisition method comprises the following steps:

[0065] S31: Calibrating the relative optical transmittance of the four types of channels. The relative optical transmittance τc of the pixel of the cth channel corresponds to c The calculation formula is:

[0066]

[0067] Wherein, m c represents the average value of the pixel values of all pixels of the cth channel under white light irradiation, m k represents the average value of the pixel values of all pixels of the kth channel under white light irradiation.

[0068] S32: Obtain the original images of the four types of channels of the high dynamic focal plane detector output. In the high dynamic focal plane detector made by any of the above-mentioned embodiments, the output values of the first type of channel under the condition that the spatial relative positions of all the pixels remain unchanged constitute the original image A1; the output values of the second type of channel under the condition that the spatial relative positions of all the pixels remain unchanged constitute the original image A2; the output values of the third type of channel under the condition that the spatial relative positions of all the pixels remain unchanged constitute the original image A3; and the output values of the fourth type of channel under the condition that the spatial relative positions of all the pixels remain unchanged constitute the original image A4. The image resolutions of the original image A1, the original image A2, the original image A3 and the original image A4 are all 640*540.

[0069] S33: Super-resolution processing of the four types of channel images. The original image A1, the original image A2, the original image A3 and the original image A4 are respectively subjected to image super-resolution processing by using an image super-resolution method, and full-resolution images B1, B2, B3 and B4 are respectively obtained. The image resolutions of the full-resolution images B1, B2, B3 and B4 are all 1280*1080.

[0070] S34: Transmittance normalization processing of the full-resolution images of the four types of channels. The full-resolution images B1, B2, B3 and B4 are respectively subjected to transmittance normalization processing, and normalized images J1, J2, J3 and J4 are respectively obtained, wherein the normalized image J c The calculation formula of the normalized image J

[0071] J c (i,j) = B c (i,j) / τ c , c∈{1,2,3,4}

[0072] Wherein (i,j) represents the coordinate position of the pixel in each channel image, B c (i,j) represents the pixel value of the full-resolution image B c at the coordinate (i,j), and J c (i,j) represents the pixel value of the normalized image J c at the coordinate (i,j).

[0073] S35: Synthesize the high dynamic scene image from the four normalized images. The high dynamic image F is synthesized from the normalized images J1, J2, J3 and J4, wherein the assignment rule of the pixel value F(i,j) of the high dynamic image F is as follows:

[0074]

[0075] wherein the superscript b represents the number of bits of image brightness.

[0076] As a preferred embodiment of the present application: the image super-resolution method is any one of the three types of methods based on image interpolation, based on machine learning, and based on deep learning.

[0077] In the embodiments of the present application, the image super-resolution method is preferably selected to be a bicubic spline interpolation method.

[0078] The above description of disclosed embodiments enables those skilled in the art to carry out or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art. The present application will not be limited to these embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

[0079] The preferred embodiments of the present application are described in detail above in conjunction with the accompanying drawings, but the present application is not limited to the above-described embodiments, and various changes can be made within the knowledge of those skilled in the art without departing from the spirit of the present application, which involves related technologies well known to those skilled in the art, and these all fall within the scope of protection of the present application patent.

[0080] Many other changes and modifications can be made without departing from the spirit and scope of the application. It should be understood that the application is not limited to the specific embodiments described herein, but rather only limited by the scope of the appended claims.

Claims

1. A method for fabricating a high dynamic range focal plane detector, characterized in that, Includes the following steps: S11: Design the operating wavelength of the substrate, the optical transmittance of the first type of neutral density attenuation film, and the optical transmittance of the second type of neutral density attenuation film; the constraints satisfied by the operating wavelength of the substrate, the first type of neutral density attenuation film, and the second type of neutral density attenuation film include: the operating wavelength range of the substrate covers the operating wavelength range of the detector; the optical transmittance of the first type of neutral density attenuation film is higher than the optical transmittance of the second type of neutral density attenuation film; S12: Using the substrate, the first type of neutral density attenuation film, and the second type of neutral density attenuation film, a four-channel neutral density attenuator array optical device with a 2×2 grid periodic arrangement is fabricated. The four-channel neutral density attenuator array optical device includes a plurality of four-channel neutral density attenuator unit blocks arranged in an array, wherein each of the four-channel neutral density attenuator unit blocks includes 2×2 neutral density attenuator units with different optical transmittances, and the four channels in any of the neutral density attenuator unit blocks in the four-channel neutral density attenuator array optical device have different optical transmittances. S13: The four-channel neutral density attenuator array optical device is integrated into the focal plane of the focal plane detector in a suspended manner to form a high dynamic range focal plane detector. The high dynamic range focal plane detector includes four types of channel pixels, namely, a first type channel pixel, a second type channel pixel, a third type channel pixel, and a fourth type channel pixel. The first type channel pixel is a pixel that is not affected by the first type of neutral density attenuator and is not affected by the second type of neutral density attenuator. The second type channel pixel is a pixel that is affected by the first type of neutral density attenuator and is not affected by the second type of neutral density attenuator. The third type channel pixel is a pixel that is not affected by the first type of neutral density attenuator and is affected by the second type of neutral density attenuator. The fourth type channel pixel is a pixel that is affected by the first type of neutral density attenuator and is affected by the second type of neutral density attenuator.

2. The method for manufacturing a high dynamic range focal plane detector according to claim 1, characterized in that, Step S12 includes: S121: Deposit multiple layers of the first type of neutral density attenuation film arranged in a comb-like periodic pattern on a substrate; S122: A second neutral density attenuation film arranged in a comb-like periodic pattern is deposited on the substrate along the direction perpendicular to the extension direction of the first type of neutral density attenuation film to form the four-channel neutral density attenuator array optical device.

3. The method for manufacturing a high dynamic range focal plane detector according to claim 2, characterized in that, The first type of neutral density attenuation film and the second type of neutral density attenuation film, which are periodically arranged in a comb-like pattern, are distributed on the same surface or different surfaces of the substrate.

4. The method for manufacturing a high dynamic range focal plane detector according to claim 2, characterized in that, Multiple first-type neutral density attenuation films are arranged in a comb-like periodic pattern on the substrate surface, wherein the width of a single first-type neutral density attenuation film is equal to 1 / 2 of its arrangement period; multiple second-type neutral density attenuation films are arranged in a comb-like periodic pattern on the substrate surface, wherein the width of a single second-type neutral density attenuation film is equal to 1 / 2 of its arrangement period.

5. The method for manufacturing a high dynamic range focal plane detector according to claim 1, characterized in that, Step S13 includes: S131: A boss is provided around the photosensitive surface of the focal plane of the focal plane detector, and the four-channel neutral density attenuator array optical device is disposed on the boss of the focal plane detector so that there is an axial gap between the four-channel neutral density attenuator array optical device and the pixel array of the focal plane detector, wherein the four-channel neutral density attenuator array optical device is aligned with the pixel array of the focal plane detector, and each pixel of the focal plane detector is spatially aligned with a neutral density attenuator unit. S132: With the relative positions of the four-channel neutral density attenuator array and the pixel array of the focal plane detector aligned, the high dynamic range focal plane detector is formed by applying adhesive to the side of the four-channel neutral density attenuator array optics and curing it.

6. A method for acquiring high dynamic range images, characterized in that, Includes the following steps: S21: The relative optical transmittance of the four channels of the high dynamic range focal plane detector prepared by the method of manufacturing the high dynamic range focal plane detector according to any one of claims 1 to 5 is specified, wherein the relative optical transmittance τ corresponding to the c-th channel pixel is... c The calculation formula is: Where, m c m represents the average value of all pixel values ​​in the c-th channel under white light illumination. k This represents the average value of all pixel values ​​in the k-th channel under white light illumination. S22: Acquire the original images of the four channels output by the high dynamic focal plane detector, wherein the output values ​​of the first channel, while keeping the relative spatial positions of all pixels unchanged, constitute the original image A1; the output values ​​of the second channel, while keeping the relative spatial positions of all pixels unchanged, constitute the original image A2; the output values ​​of the third channel, while keeping the relative spatial positions of all pixels unchanged, constitute the original image A3; and the output values ​​of the fourth channel, while keeping the relative spatial positions of all pixels unchanged, constitute the original image A4. S23: Using an image super-resolution method, perform image super-resolution processing on the original image A1, the original image A2, the original image A3, and the original image A4 respectively to obtain full-resolution images B1, B2, B3, and B4. S24: Perform transmittance normalization processing on the full-resolution images B1, B2, B3, and B4 respectively to obtain normalized images J1, J2, J3, and J4, where normalized image J... c The calculation formula is: J c (i,j)=B c (i,j) / τ c ,c∈{1,2,3,4} Where (i,j) represents the coordinate position of the pixel in each channel image, B c (i,j) represents the full-resolution image B. c The pixel value at coordinates (i,j), J c (i,j) represents the normalized image J. c The pixel value at coordinates (i,j); S25: A high dynamic range image F is synthesized from the normalized image J1, the normalized image J2, the normalized image J3, and the normalized image J4, wherein the assignment rule for the pixel value F(i,j) of the high dynamic range image F is as follows: Where b represents the number of bits for image brightness.

7. The high dynamic range image acquisition method according to claim 6, characterized in that, The image super-resolution method can be any one of the three types of methods: image interpolation, machine learning, or deep learning.

Citation Information

Patent Citations

  • Method and device for generating high dynamic images in moving scenes

    CN103546673B

  • Camera Array High Dynamic Range Imaging Method

    CN104702971B

  • HDR (High Dynamic Range) image generation method and system based on color space conversion and shooting terminal

    CN105163047A

  • Image processing method and device

    CN108391059A

  • Method for generating high dynamic range image and related device

    CN108419023A