High-dynamic imaging system and method

Abstract

The invention provides a high-dynamic imaging system and method, the system comprises a reflective attenuation sheet, an optical lens group, a plane lens, a light splitting device and two image sensors which are sequentially arranged along a light path, and the two image sensors are respectively arranged at one side of two light-emitting surfaces of the light splitting device; the reflective attenuation sheet is used for attenuating the intensity of incident light; the optical lens group is used for focusing the light passing through the reflective attenuation sheet; the plane lens is used for reducing the rear intercept, and the rear intercept refers to the distance between the last lens of the optical lens group along the light path and the image sensor; the light splitting device is used for splitting incident light into two light with different wave bands; and the light is split into two beams of light with different wavebands by the beam splitter prism and then enters the two image sensors for imaging respectively. The high-dynamic imaging system is simple in structure, and the imaging quality of a high-dynamic scene can be improved.

Description

Technical Field

[0001] The present application relates to the technical field of high dynamic imaging, and in particular to a high dynamic imaging system and method. Background Art

[0002] High dynamic range scenes refer to scenes with extremely different brightness areas. For example, when shooting outdoors, a bright sky and a dark building shadow appear in the picture at the same time. The purpose of high dynamic range imaging is to capture and restore all the brightness information in these scenes as much as possible, so that the bright areas are not overexposed and the dark areas are not underexposed.

[0003] The rocket-borne visible light imaging system (i.e., camera device) has been widely used in various main launch vehicles and related fields at home and abroad. Such camera devices are mainly used to observe target separation, target motion trajectory, and target attitude related information, such as rocket ignition, booster separation, fairing jettison, satellite-rocket separation and other key actions. Most of the rocket-borne application environments are high-dynamic environments, so high-dynamic imaging technology is applied to aerospace rocket-borne status monitoring.

[0004] The dynamic range of actual scenes in launch vehicles and space exploration is more than 130dB. The output bit width of the onboard optoelectronic imaging system is generally 8 bits, and the maximum dynamic range that can be displayed is 48dB, which is far from meeting the needs of actual application scenarios. At the same time, high illumination environments can also cause problems such as dizziness in the imaging lens, resulting in a serious decline in image quality.

[0005] High dynamic imaging technology is divided into single-camera time-sharing multiple exposure fusion, multi-camera simultaneous exposure fusion, and single-camera large and small pixel fusion. Among them, single-camera time-sharing fusion is difficult to avoid the problem of fusion image artifacts caused by object movement when processing dynamic scenes, and the upper limit of the dynamic range is low, which cannot meet the requirements of high dynamic range observation in the sky. Single-camera large and small pixel fusion technology can solve the problem of ghosting, but the cost is high; in addition, the current maximum dynamic range of the two technologies of single-camera time-sharing multiple exposure fusion and single-camera large and small pixel fusion is 120dB, which cannot meet the requirements of aerospace detection. Although the multi-camera simultaneous exposure fusion technology solves the problem of single-camera time-sharing exposure ghosting and the dynamic range can reach more than 130dB, the system brought by multiple cameras is huge, the cost is too high, and the camera registration is also a problem; at the same time, the above technologies cannot avoid the reduction of imaging quality and dizziness under the direct exposure of high-brightness light sources.

[0006] Existing camera devices cannot meet the requirements of clear imaging in high-dynamic environments (maximum 180db) for aerospace exploration, and it is necessary to improve the camera's adaptability to high-dynamic environments; direct exposure to high-brightness emission sources will cause glare, dizziness and other phenomena, affecting the imaging quality. Summary of the invention

[0007] The purpose of the present application is to provide a high dynamic imaging system and method to simplify the high dynamic imaging system and improve the imaging quality of high dynamic scenes.

[0008] The present application provides a high dynamic imaging system, including:

[0009] A reflective attenuation sheet, an optical lens group, a plane lens, a spectroscopic device and two image sensors are sequentially arranged along the optical path, and the two image sensors are respectively arranged on one side of two light-emitting surfaces of the spectroscopic device;

[0010] The reflective attenuation sheet is used to attenuate the intensity of incident light;

[0011] The optical lens assembly is used to focus the light after passing through the reflective attenuation sheet;

[0012] The plane lens is used to reduce the back focus, where the back focus refers to the distance between the last lens of the optical lens group along the optical path and the image sensor;

[0013] The optical splitter is used to split the incident light into two lights of different wavelength bands;

[0014] The incident light irradiates the reflective attenuation sheet, and after being reflected by the reflective attenuation sheet, enters the optical lens group, the plane lens and the beam splitter prism in sequence, and is split into two beams of light with different wavelengths by the beam splitter prism and then enters the two image sensors for imaging respectively.

[0015] In a possible implementation, the reflective attenuation sheet is a reflective attenuation sheet with variable reflectivity, and the reflectivity can be adjusted according to the intensity of incident light.

[0016] In a possible implementation, the reflective attenuation sheet is an artificial intelligence reflective attenuation sheet.

[0017] In a possible implementation manner, the plane lens is a cylindrical plane lens.

[0018] In a possible implementation, the refractive index of the plane lens is in the range of 1.7 to 1.9.

[0019] In a possible implementation, the light splitting device is a light splitting prism.

[0020] In a possible implementation, filter films are disposed on both light-emitting surfaces of the beam splitter prism.

[0021] The present application also provides a high dynamic imaging method, based on the high dynamic imaging system described in the above embodiment, the method includes:

[0022] In a high dynamic scene, incident light strikes the reflective attenuation sheet;

[0023] The reflective attenuation sheet adjusts the reflectivity according to the intensity of the incident light, so that the intensity of the light entering the optical lens assembly is not greater than a preset intensity;

[0024] The light enters the optical lens group, the plane lens and the beam splitter prism in sequence, and is split into two beams of light with different wavelengths by the beam splitter prism and then enters the two image sensors for imaging respectively.

[0025] The advantages of this application compared with the prior art are:

[0026] The high dynamic imaging system provided by the present application includes: a reflective attenuation plate, an optical lens group, a plane lens, a spectrometer and two image sensors arranged in sequence along the optical path, and the two image sensors are respectively arranged on one side of the two light-emitting surfaces of the spectrometer; the reflective attenuation plate is used to attenuate the intensity of the incident light; the optical lens group is used to focus the light after passing through the reflective attenuation plate; the plane lens is used to reduce the back intercept, and the back intercept refers to the distance between the last lens of the optical lens group along the optical path and the image sensor; the spectrometer is used to decompose the incident light into two lights of different wavelengths; the incident light is irradiated to the reflective attenuation plate, and after being reflected by the reflective attenuation plate, it enters the optical lens group, the plane lens and the spectrometer in sequence, and is separated into two beams of light of different wavelengths by the spectrometer prism and then enters the two image sensors for imaging. Compared with the traditional high dynamic imaging system, the high dynamic imaging system of the present application has a simple structure, in which the reflective attenuation plate can be adjusted according to different illumination intensities, thereby avoiding the occurrence of glare; the addition of a plane lens can increase the optical path, thereby reducing the back intercept, thereby reducing the system size and increasing the application areas of the system; combined with a spectroscopic device, multi-band feature recognition can be achieved, thereby improving the imaging quality of high dynamic scenes. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present application. Also, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0028] Figure 1 A schematic diagram of the structure of a high dynamic imaging system provided by the present application is shown;

[0029] Figure 2 A schematic diagram showing the coating of the light-emitting surface of the spectrometer provided in the present application is shown;

[0030] Figure 3A flow chart of a high dynamic imaging method provided by the present application is shown. DETAILED DESCRIPTION

[0031] Hereinafter, embodiments of the present application will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present application. In addition, in the following description, descriptions of well-known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present application.

[0032] Various structural schematic diagrams according to embodiments of the present application are shown in the accompanying drawings. These figures are not drawn to scale, and some details are magnified and some details may be omitted for the purpose of clear expression. The shapes of various regions and layers shown in the figures and the relative sizes and positional relationships therebetween are only exemplary, and may deviate in practice due to manufacturing tolerances or technical limitations, and those skilled in the art may further design regions / layers with different shapes, sizes, and relative positions according to actual needs.

[0033] In the context of the present application, when a layer / element is referred to as being "on" another layer / element, the layer / element may be directly on the other layer / element or an intervening layer / element may exist between them. In addition, if a layer / element is "on" another layer / element in one orientation, the layer / element may be "under" the other layer / element when the orientation is reversed.

[0034] In order to solve the problems existing in the prior art, the embodiments of the present application provide a high dynamic imaging system and method, which are described below with reference to the accompanying drawings.

[0035] Figure 1 A schematic diagram of the structure of a high dynamic imaging system provided in an embodiment of the present application is shown. Figure 1 As shown, the high dynamic imaging system includes: a reflective attenuation plate 1, an optical lens group 2, a plane lens 3, a spectrometer 4 and two image sensors 5 arranged in sequence along the optical path. The two image sensors 5 are respectively arranged on one side of the two light emitting surfaces of the spectrometer 4.

[0036] The imaging process of the above-mentioned high dynamic imaging system is as follows: the incident light is irradiated onto the reflective attenuation plate 1, and after being reflected by the reflective attenuation plate 1, it enters the optical lens group 2, the plane lens 3 and the beam splitter prism 4 in sequence, and is split into two beams of light with different wavelengths by the beam splitter prism 4, and then enters the two image sensors 5 for imaging respectively, thereby realizing real-time high dynamic imaging based on dual beams.

[0037] Specifically, the reflective attenuation sheet 1 is used to attenuate the intensity of the incident light. Specifically, the reflective attenuation sheet is a reflective attenuation sheet with variable reflectivity, which can adjust the reflectivity according to the intensity of the incident light to attenuate the intensity of the incident light, thereby controlling the amount of light entering the subsequent components of the imaging system. In the present application, the attenuation sheet is reflective, which can avoid dizziness caused by high-brightness light sources directly hitting the lens, and can also reduce internal reflections in the optical lens group, avoid the problem of increased stray light, and further improve the imaging quality.

[0038] The reflective attenuation sheet 1 can be specifically an artificial intelligence (AI) reflective attenuation sheet. The AI ​​reflective attenuation sheet is an optical element that can intelligently adjust the light reflectivity according to the external light environment. Its main function is to attenuate the intensity of incident light, thereby controlling the amount of light entering the subsequent components of the optical system.

[0039] The principle of AI reflective attenuation film: From the perspective of optical principles, it is based on the laws of reflection and refraction of light. There are some factors in the internal structure of the material or the surface coating of the attenuation film that can change the light propagation characteristics. When light is irradiated on the attenuation film, part of the light will be reflected and part of the light will be transmitted. By changing the optical constants of the material (such as the refractive index) or the microstructure of the surface (such as changing the reflectivity by controlling the arrangement of liquid crystal molecules through electrical signals), the ratio of reflected light to transmitted light can be adjusted. On this basis, the introduction of AI sensing technology enables the attenuation film to be adaptively adjusted according to different scene requirements. The information of the external light environment, such as light intensity, contrast, color temperature, etc., is obtained through sensors, and then this information is input into the AI ​​algorithm. AI can learn the best imaging parameter settings in different scenes. After learning and training, the AI ​​algorithm can determine how to adjust the reflectivity of the attenuation film in the current light environment to achieve the best light control effect. For example, in a strong light environment, the AI ​​algorithm will control the attenuation film to increase the reflectivity and reduce the amount of transmitted light; in a weak light environment, the reflectivity is reduced to allow more light to enter the system.

[0040] AI reflective attenuation sheets can effectively adjust the amount of light over a wide range of light intensities. For example, its light reflectivity can be dynamically adjusted between 10% and 90%, thus adapting to various scenarios from the strong light environment at rocket ignition to the weak light environment after launch. Under AI control, it can quickly respond to changes in the light environment. Generally speaking, its response time can reach milliseconds or even faster, which enables it to adapt to rapid changes in light in a timely manner and ensure the stable operation of the optical system. With the precise calculation of the AI ​​algorithm, high-precision light control can be achieved, which can control the light within a very small error range, thereby ensuring the quality of the captured image.

[0041] It can be seen that this application uses AI intelligent perception technology, combined with machine learning, to achieve gradual change of attenuation sheets and adjust attenuation according to different illuminations, thereby avoiding glare. It solves the irreversible problem of traditional fixed attenuation, the inability to observe low dynamic environments and the low utilization rate, and greatly improves the dynamic range of the imaging system.

[0042] Specifically, the optical lens group 2 is used to focus the light after passing through the reflective attenuation sheet; specifically, the optical lens group 2 performs operations such as focusing, collimating, or changing the direction of the light path on the light after passing through the attenuation sheet. The optical lens group may include a plurality of lenses, which cooperate with each other to focus the light. For example, the divergent light is converged into parallel light, or the parallel light is converged to a point, so that the light can better enter the next optical element, and it helps to improve the quality of imaging and reduce aberrations and other problems.

[0043] Specifically, the plane lens 3 is used to reduce the back intercept, which refers to the distance between the last lens of the optical lens group 2 along the optical path and the image sensor 5; the plane lens 3 can be specifically a cylindrical plane lens, which has a high refractive index, and the specific refractive index range is 1.7 to 1.9. In the present application, the high refractive index characteristic of the plane lens is used to further converge or diverge the light, which can control the propagation direction of the light and increase the optical path, thereby reducing the back intercept, thereby reducing the system size, and the application fields increase after the system is miniaturized.

[0044] Specifically, the optical splitter 4 is used to split the incident light into two lights of different wavelengths. The optical splitter 4 can be a beam splitter prism, such as Figure 2 As shown, filter films are provided on both light-emitting surfaces of the beam splitter prism.

[0045] The beam splitter splits the incident light according to certain proportions or wavelengths. Depending on the design, the beam splitter can achieve different beam splitting methods, such as splitting light into different colors (for spectral analysis, etc.) or splitting light into different polarization directions. In this imaging system, it splits the light so that different components of light can be irradiated onto the image sensor in a suitable manner, which helps to achieve high-dynamic scene imaging. For example, through beam splitting, the light signals in the highlight and dark areas can be better processed, thereby improving the dynamic range of the entire scene imaging.

[0046] For example, when shooting a rocket ignition, there are both bright and dim areas in the picture. After the beam splitter separates the light into different bands, the images of the bright and dim areas in each band can be clearly presented, reducing overexposure in bright areas and loss of details in dark areas, thereby improving the contrast, clarity and color reproduction of the entire high-dynamic scene image and improving the imaging quality.

[0047] Specifically, the image sensor 5 is the core component of the imaging system, which converts the optical signal into an electrical signal, such as a COMS sensor. The COMS sensor detects and converts the optical signals at different positions through its internal photodiode array. After receiving the optical signal after the spectroscopic prism, it will generate corresponding electrical signals according to the intensity, wavelength and other information of the light. After these electrical signals are subsequently processed (such as amplification, analog-to-digital conversion, etc.), image data can be generated, and finally imaging of high dynamic scenes can be achieved.

[0048] The embodiment of the present application also provides a high dynamic imaging method based on the above high dynamic imaging system, such as Figure 3 As shown, the high dynamic imaging method comprises the following steps:

[0049] S101, in a high dynamic scene, incident light irradiates the reflective attenuation sheet;

[0050] High dynamic scenes may be, for example, rocket launch scenes, aerospace scenes, etc.

[0051] S102, the reflective attenuation sheet adjusts the reflectivity according to the intensity of the incident light, so that the intensity of the light entering the optical lens assembly is not greater than a preset intensity;

[0052] S103 , the light enters the optical lens group, the plane lens and the beam splitter prism in sequence, is split into two beams of light with different wavelengths by the beam splitter prism, and then enters the two image sensors respectively for imaging.

[0053] Traditional imaging systems usually have difficulty in achieving ideal results in high-dynamic scenes because their dynamic range is limited. However, the high-dynamic imaging system of the present application can achieve high-dynamic scene imaging with a large dynamic range through the collaborative work of AI reflective attenuation sheets, optical lens groups, high-refractive-index flat lenses, beam splitters, and image sensors.

[0054] The advantages of this application compared with the prior art are:

[0055] The high dynamic imaging system provided by the present application includes: a reflective attenuation plate, an optical lens group, a plane lens, a spectrometer and two image sensors arranged in sequence along the optical path, and the two image sensors are respectively arranged on one side of the two light-emitting surfaces of the spectrometer; the reflective attenuation plate is used to attenuate the intensity of the incident light; the optical lens group is used to focus the light after passing through the reflective attenuation plate; the plane lens is used to reduce the back intercept, and the back intercept refers to the distance between the last lens of the optical lens group along the optical path and the image sensor; the spectrometer is used to decompose the incident light into two lights of different wavelengths; the incident light is irradiated to the reflective attenuation plate, and after being reflected by the reflective attenuation plate, it enters the optical lens group, the plane lens and the spectrometer in sequence, and is separated into two beams of light of different wavelengths by the spectrometer prism and then enters the two image sensors for imaging. Compared with the traditional high dynamic imaging system, the high dynamic imaging system of the present application has a simple structure, in which the reflective attenuation plate can be adjusted according to different illumination intensities, thereby avoiding the occurrence of glare; the addition of a plane lens can increase the optical path, thereby reducing the back intercept, thereby reducing the system size and increasing the application areas of the system; combined with a spectroscopic device, multi-band feature recognition can be achieved, thereby improving the imaging quality of high dynamic scenes.

[0056] In order to form the same structure, those skilled in the art may also design a method that is not completely the same as the method described above. In addition, although the various embodiments are described above, this does not mean that the measures in the various embodiments cannot be used in combination advantageously.

[0057] The embodiments of the present application are described above. However, these embodiments are only for illustrative purposes and are not intended to limit the scope of the present application. The scope of the present application is limited by the attached claims and their equivalents. Without departing from the scope of the present application, those skilled in the art may make various substitutions and modifications, which should all fall within the scope of the present application.

Claims

1. A high dynamic imaging system, characterized in that: include: A reflective attenuation sheet, an optical lens group, a plane lens, a spectroscopic device and two image sensors are sequentially arranged along the optical path, and the two image sensors are respectively arranged on one side of two light-emitting surfaces of the spectroscopic device; The reflective attenuation sheet is used to attenuate the intensity of incident light; The optical lens assembly is used to focus the light after passing through the reflective attenuation sheet; The plane lens is used to reduce the back focus, where the back focus refers to the distance between the last lens of the optical lens group along the optical path and the image sensor; The optical splitter is used to split the incident light into two lights of different wavelength bands; The incident light irradiates the reflective attenuation sheet, and after being reflected by the reflective attenuation sheet, enters the optical lens group, the plane lens and the beam splitter prism in sequence, and is split into two beams of light with different wavelengths by the beam splitter prism and then enters the two image sensors respectively for imaging.

2. The high dynamic imaging system according to claim 1, characterized in that: The reflective attenuation sheet is a reflective attenuation sheet with variable reflectivity, and the reflectivity can be adjusted according to the intensity of incident light.

3. The high dynamic imaging system according to claim 2, characterized in that: The reflective attenuation sheet is an artificial intelligence reflective attenuation sheet.

4. The high dynamic imaging system according to claim 1, characterized in that: The plane lens is a cylindrical plane lens.

5. The high dynamic imaging system according to claim 1 or 4, characterized in that: The refractive index of the plane lens is in the range of 1.7 to 1.

9.

6. The high dynamic imaging system according to claim 1, characterized in that: The light splitting device adopts a light splitting prism.

7. The high dynamic imaging system according to claim 6, characterized in that: Filter films are arranged on the two light-emitting surfaces of the beam splitter prism.

8. A high dynamic imaging method, characterized in that: Based on the high dynamic imaging system described in any one of claims 1 to 5, the method comprises: In a high dynamic scene, incident light strikes the reflective attenuation sheet; The reflective attenuation sheet adjusts the reflectivity according to the intensity of the incident light, so that the intensity of the light entering the optical lens assembly is not greater than a preset intensity; The light enters the optical lens group, the plane lens and the beam splitter prism in sequence, and is split into two beams of light with different wavelengths by the beam splitter prism and then enters the two image sensors for imaging respectively.

Images