Graphics-based micro-optical element design method and device and electronic equipment

Abstract

The invention relates to the technical field of computer graphics rendering, in particular to a graphics-based micro-optical element design method and device and electronic equipment, and the method comprises the steps: constructing a virtual scene in a three-dimensional engine according to a real scene; determining parameters of the micro-optical system according to the design target of the micro-optical system; configuring parameters of a virtual light source of the micro-optical system according to light source characteristic requirements in the virtual scene; setting an imaging sensing plane of the micro-optical system to capture an actual imaging pattern of the target; and iteratively optimizing the parameters of the micro-optical system by regulating and controlling the parameters of the virtual scene and the virtual light source until the actual imaging pattern reaches the expected imaging pattern, and generating a micro-optical element design scheme of the micro-optical system according to the iteratively optimized parameters of the micro-optical system. Therefore, the problems that the signal acquisition efficiency is low, the imaging quality is reduced and even target information cannot be effectively acquired due to the fact that adaptation to diversified scenes is difficult to realize by means of a single structure in the prior art are solved.

Description

Technical Field

[0001] This application relates to the field of computer graphics rendering technology, and particularly to a method, apparatus, and electronic device for designing micro-optical elements based on graphics. Background Art

[0002] Currently, the design of micro-optical imaging systems mainly focuses on the performance optimization and structural innovation of optical devices themselves. However, in practical applications, the system design often ignores the special requirements of specific scenarios for optical systems. Different application scenarios, such as natural scene capture, medical image analysis, industrial inspection, and astronomical observation, have significant differences in the characteristics and acquisition requirements of optical signals. Such differences include, but are not limited to, light intensity distribution, spectral range, signal dynamic range, and background noise level. Therefore, it is difficult to achieve adaptation to diverse scenarios by relying on a single structure or a general design, which may lead to low signal acquisition efficiency, degraded imaging quality, or even inability to effectively obtain target information. Summary of the Invention

[0003] This application provides a method, apparatus, and electronic device for designing micro-optical elements based on graphics to solve the problem that it is difficult to achieve adaptation to diverse scenarios by relying on a single structure in related technologies, which may lead to low signal acquisition efficiency, degraded imaging quality, or even inability to effectively obtain target information.

[0004] The first aspect embodiment of this application provides a method for designing micro-optical elements based on graphics, including the following steps: constructing a virtual scene in a 3D engine according to a real scene; determining the parameters of the micro-optical system according to the design objectives of the micro-optical system; configuring the parameters of the virtual light source of the micro-optical system according to the light source characteristics requirements in the virtual scene; setting the imaging sensing plane of the micro-optical system to capture the actual imaging pattern of the target; iteratively optimizing the parameters of the micro-optical system by adjusting the parameters of the virtual scene and the virtual light source until the actual imaging pattern reaches the desired imaging pattern, and generating a micro-optical element design scheme for the micro-optical system according to the parameters of the micro-optical system after the iterative optimization is completed.

[0005] Optionally, a virtual scene is constructed in a 3D engine according to the real scene, including: identifying a first target surface structure in the surface structure of the real scene with a size larger than a first preset size, performing ray tracing analysis on the first target surface structure using geometric optics theory. At the scale of the first target surface structure, the wave nature effect of light is allowed to be ignored, and the light propagation path is determined by the laws of reflection and refraction to simulate the optical characteristics of the macroscopic structure; identifying a second target surface structure in the surface structure of the real scene with a size smaller than a second preset size and within the target wavelength range, and describing the optical behavior of the surface undulation of the second target surface structure using scalar optical theory. At the scale of the second target surface structure, the interaction between light waves and microstructures is modeled by scalar optics to meet the tracking requirements of the optical characteristics of the microstructures; identifying a third target surface structure in the surface structure of the real scene with a size smaller than a third preset size, and at the scale of the third target surface structure, describing the optical behavior through the vector characteristics of light waves, and establishing a virtual scene based on the results of ray tracing analysis and the description results of the optical behavior.

[0006] Optionally, the parameters of the micro-optical system are determined according to the design objectives of the micro-optical system, including: integrating refractive optical elements and diffractive optical elements in the imaging system of the micro-optical system. The refractive optical elements achieve imaging by changing the light propagation path, and the diffractive optical elements optimize the phase modulation of light waves using the diffraction effect to achieve multi-functional imaging capabilities in the system; introducing a coating technology on the surface of the imaging system of the micro-optical system to control the optical characteristics; considering the actual use conditions and possible defects of the optical elements in the imaging system of the micro-optical system, and the defects include deformation of the elements, manufacturing errors, and surface scratches.

[0007] Optionally, the coating design optimizes the optical transmittance, reduces the reflection loss, and reduces the dispersion effect.

[0008] Optionally, the parameters of the virtual light source of the micro-optical system are configured according to the light source characteristics requirements in the virtual scene, including: modeling and designing the light source system of the micro-optical system based on geometric optics principles. Among them, the light propagation path of the light source system follows the ray tracing theory, ignoring the wave effect; selecting a light source from multiple types of light sources supported by the light source system according to the scene requirements; designing the visible light band and the infrared light band in the light source system.

[0009] Optionally, the imaging sensing plane of the micro-optical system is set to capture the actual imaging pattern of the target, including: designing the imaging sensing plane according to the characteristics of the real sensing physical system. Among them, the resolution of the sensor of the imaging sensing plane is determined by the resolution of the imaging surface and the micro-optical elements.

[0010] Optionally, by adjusting the parameters of the virtual scene and the virtual light source, iteratively optimize the parameters of the micro-optical system until the actual imaging pattern reaches the desired imaging pattern, including: determining the initial design parameters of the micro-optical system, where the initial structure of the micro-optical element is set as a Fresnel lens, optimizing the propagation path and energy distribution of light; evaluating the imaging result of the micro-optical system through the peak signal-to-noise ratio.

[0011] An embodiment of the second aspect of the present application provides a graphics-based micro-optical element design device, including: a construction module for constructing a virtual scene in a 3D engine according to a real scene; a determination module for determining the parameters of the micro-optical system according to the design objective of the micro-optical system; a configuration module for configuring the parameters of the virtual light source of the micro-optical system according to the light source characteristic requirements in the virtual scene; a setting module for setting the imaging sensing plane of the micro-optical system to capture the actual imaging pattern of the target; a generation module for iteratively optimizing the parameters of the micro-optical system by adjusting the parameters of the virtual scene and the virtual light source until the actual imaging pattern reaches the desired imaging pattern, and generating a micro-optical element design scheme of the micro-optical system according to the parameters of the micro-optical system after the iterative optimization is completed.

[0012] An embodiment of the third aspect of the present application provides an electronic device, including: a memory, a processor, and a computer program stored on the memory and executable on the processor, and the processor executes the program to implement the graphics-based micro-optical element design method as described in the above embodiment.

[0013] An embodiment of the fourth aspect of the present application provides a computer-readable storage medium, on which a computer program is stored, and the program is executed by a processor to implement the graphics-based micro-optical element design method as described in the above embodiment.

[0014] Therefore, the present application includes the following beneficial effects:

[0015] The embodiment of the present application constructs a virtual scene in a 3D engine according to a real scene, determines the parameters of the micro-optical system according to the design objective of the micro-optical system, configures the parameters of the virtual light source of the micro-optical system at the same time, sets the imaging sensing plane of the micro-optical system, and iteratively optimizes the parameters of the micro-optical system by adjusting the parameters of the virtual scene and the virtual light source until the actual imaging pattern reaches the desired imaging pattern, and generates a micro-optical element design scheme of the micro-optical system according to the parameters of the micro-optical system after the iterative optimization is completed. By constructing the virtual scene of the real scene and the imaging system, the accurate simulation of the optical signal characteristics in a complex environment is realized. Thus, the problem that it is difficult to adapt to diverse scenes relying on a single structure in the related technology, which may lead to low signal acquisition efficiency, degraded imaging quality, and even inability to effectively obtain target information, is solved.

[0016] Additional aspects and advantages of the present application will be given in part in the following description, become apparent in part from the following description, or be learned through the practice of the present application. Description of the Drawings

[0017] The above and / or additional aspects and advantages of the present application will become apparent and be readily understood from the following description of embodiments in conjunction with the drawings, where:

[0018] Figure 1 FIG. is a schematic flowchart of a method for designing a micro-optical element based on graphics according to an embodiment of the present application;

[0019] Figure 2 FIG. is a schematic block diagram of a device for designing a micro-optical element based on graphics according to an embodiment of the present application;

[0020] Figure 3 FIG. is a schematic structural diagram of an electronic device according to an embodiment of the present application. Detailed Description of the Embodiments

[0021] Embodiments of the present application will be described in detail below. Examples of the embodiments are shown in the drawings, where the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the drawings are exemplary and are intended to explain the present application and should not be construed as limiting the present application.

[0022] The method, device, and electronic device for designing a micro-optical element based on graphics according to embodiments of the present application will be described below with reference to the drawings. Regarding the problem in the related art mentioned in the above background art that it is difficult to adapt to diverse scenarios relying on a single structure, which may lead to low signal acquisition efficiency, degraded imaging quality, or even inability to effectively obtain target information, the present application provides a method for designing a micro-optical element based on graphics. In this method, a virtual scene is constructed in a 3D engine according to the real scene, the parameters of the micro-optical system are determined according to the design objectives of the micro-optical system, the parameters of the virtual light source of the micro-optical system are configured at the same time, the imaging sensing plane of the micro-optical system is set, and the parameters of the micro-optical system are iteratively optimized by adjusting the parameters of the virtual scene and the virtual light source until the actual imaging pattern reaches the desired imaging pattern. A design scheme for the micro-optical element of the micro-optical system is generated according to the parameters of the micro-optical system after the iterative optimization is completed. By constructing the virtual scene of the real scene and the imaging system, the accurate simulation of the optical signal characteristics in a complex environment is realized. Thus, the problem in the related art that it is difficult to adapt to diverse scenarios relying on a single structure, which may lead to low signal acquisition efficiency, degraded imaging quality, or even inability to effectively obtain target information, is solved.

[0023] Specifically, Figure 1Schematic flowchart of a method for designing micro-optical elements based on graphics provided by embodiments of the present application.

[0024] As Figure 1 shown, the method for designing micro-optical elements based on graphics includes the following steps:

[0025] In step S101, a virtual scene is constructed in a 3D engine according to the real scene.

[0026] Among them, the 3D engine refers to a software framework or platform for developing and rendering 3D graphics, providing functions for creating, editing, and displaying 3D scenes; the virtual scene refers to a 3D scene model accurately restored and generated at a 1:1 ratio using the 3D engine.

[0027] In the embodiments of the present application, constructing a virtual scene in a 3D engine according to the real scene includes: identifying a first target surface structure in the surface structure of the real scene with a size greater than a first preset size, performing ray tracing analysis on the first target surface structure using geometric optics theory. At the scale of the first target surface structure, the wave nature effect of light is allowed to be ignored, and the light propagation path is determined by the laws of reflection and refraction to simulate the optical characteristics of the macroscopic structure; identifying a second target surface structure in the surface structure of the real scene with a size less than a second preset size and within the target wavelength range, describing the optical behavior of the surface undulation of the second target surface structure using scalar optics theory. At the scale of the second target surface structure, the interaction between light waves and microstructures is modeled by scalar optics to meet the tracking requirements of the optical characteristics of the microstructures; identifying a third target surface structure in the surface structure of the real scene with a size less than a third preset size. At the scale of the third target surface structure, the optical behavior is described by the vector characteristics of light waves, and a virtual scene is established based on the results of ray tracing analysis and the description results of the optical behavior.

[0028] Among them, the first preset size is the size limit at the micron level, which is specifically set according to the actual situation and will not be specifically limited here; the geometric optics theory is a model used to describe the behavior and propagation of light. In geometric optics, light is regarded as a beam of light rays propagating along a straight line, and its propagation path can be predicted and calculated through basic laws such as reflection and refraction, and is applicable to situations where the wavelength is much smaller than the object size; the second preset size is the size limit less than 10 microns but still within the target wavelength range, which is specifically set according to the actual situation and will not be specifically limited here; the scalar optics theory is a simplified model used to describe the behavior of light waves. In the scalar optics theory, light is regarded as a scalar wave, and the behavior of light waves is described by the wave equation, and is applicable to situations where diffraction phenomena are significant, especially at the microstructural scale; the third preset size is the size limit at the nanometer level, which is specifically set according to the actual situation and will not be specifically limited here; the vector characteristics of light waves refer to the electric and magnetic field components that light has as an electromagnetic wave. When dealing with surface microstructures at the nanometer level, when the structure size is close to or smaller than the wavelength of light, the interaction between light and matter becomes more complex, and diffraction and polarization effects are significant. The scalar optics theory cannot accurately describe these phenomena, and the vector characteristics of light waves must be considered to accurately describe the optical behavior.

[0029] It can be understood that in the process of constructing the virtual scene in the embodiments of the present application, first, the surface structure in the real scene is identified. For the first target surface structure with a size larger than the first preset size, the geometric optics theory is used for ray tracing analysis, ignoring the wave effect of light, and the optical characteristics of these macroscopic structures are simulated according to the reflection and refraction rules; for the second target surface structure with a size smaller than the second preset size, the scalar optics theory is used to describe the optical behavior of its surface undulation, and the interaction between light waves and these microstructures is modeled by scalar optics to meet the tracking requirements of the microstructural optical characteristics; for the third target surface structure with a size smaller than the third preset size, the optical behavior is described by the vector characteristics of light waves, comprehensively considering the optical characteristics under far-field conditions. Based on the ray tracing analysis results and optical behavior descriptions at the above different scales, the real optical information modeling from the macroscopic to the microscopic and then to the nanoscale is realized, ensuring the high-precision reproduction of the optical system behavior in complex scenes.

[0030] In step S102, the parameters of the micro-optical system are determined according to the design objectives of the micro-optical system.

[0031] Among them, the parameters of the micro-optical system include but are not limited to the refractive index, the curvature radius of the lens, the design parameters of the diffractive optical element (DOE), etc., which directly affect the quality and performance of the final imaging.

[0032] It can be understood that in the embodiments of the present application, the parameters of the micro-optical system are determined according to the design objectives of the micro-optical system, that is, the specific functions to be achieved or the performance indicators to be reached by the micro-optical system.

[0033] In the embodiments of the present application, determining the parameters of the micro-optical system according to the design objectives of the micro-optical system includes: integrating refractive optical elements and diffractive optical elements in the imaging system of the micro-optical system. The refractive optical elements achieve imaging by changing the light propagation path, and the diffractive optical elements utilize the diffraction effect to optimize the phase modulation of light waves, so as to achieve multi-functional imaging capabilities in the system; introducing a coating technology on the surface of the imaging system of the micro-optical system to control the optical properties; considering the actual use conditions and possible defects of the optical elements in the imaging system of the micro-optical system, and the defects include deformation of the elements, manufacturing errors, and surface scratches.

[0034] Among them, the refractive optical elements achieve the imaging function by changing the propagation path of light, such as common convex lenses or concave lenses; the diffractive optical elements utilize the diffraction effect of light to optimize the phase modulation, such as beam shaping, beam splitting, or multi-focus imaging, etc.; the coating technology is a technology for applying a specific material layer on the surface of the optical element to control the optical properties, which will be described in detail below and will not be elaborated here.

[0035] It can be understood that in the embodiments of the present application, corresponding refractive elements and diffractive elements are integrated in the imaging system according to the design objectives of the micro-optical system. The refractive elements achieve imaging by changing the propagation path of light, while the diffractive elements utilize the diffraction effect of light to optimize the phase modulation. At the same time, a coating technology is introduced on the surface of the imaging system to control and optimize the optical properties. In addition, various situations that may be encountered in the actual application of the optical elements are fully considered, including potential defects caused by deformation, manufacturing errors, or surface scratches, to prevent the degradation of the system performance or optical distortion, and ensure that the finally designed micro-optical system meets the design objectives of the micro-optical system, so as to achieve efficient, stable, and high-quality imaging effects.

[0036] In the embodiments of the present application, the coating design optimizes the optical transmittance, reduces the reflection loss, and reduces the dispersion effect.

[0037] It can be understood that by introducing the coating technology in the embodiments of the present application, the reflection loss when light enters the imaging system can be significantly reduced, the dispersion phenomenon caused by the different propagation speeds of light with different wavelengths in the same medium can be compensated, the optical properties can be controlled, the optical transmittance can be increased, and the anti-environmental interference ability can be enhanced, etc.

[0038] In step S103, the parameters of the virtual light source of the micro-optical system are configured according to the light source characteristics requirements in the virtual scene.

[0039] Among them, the light source characteristics describe various attributes of the light source, such as intensity, color, direction, type, such as point light source, parallel light source, etc., and how the light source affects the lighting effect within the scene.

[0040] In the embodiment of the present application, the parameters of the virtual light source of the micro-optical system are configured according to the requirements of the light source characteristics in the virtual scene, including: modeling and designing the light source system of the micro-optical system based on the principles of geometric optics, where the propagation path of the light in the light source system follows the ray tracing theory, ignoring the wave effect; selecting a light source from various types of light sources supported by the light source system according to the scene requirements; designing the visible light band and the infrared light band in the light source system.

[0041] Among them, the ray tracing theory is a part of geometric optics, which predicts the behavior of light by tracing the path of light when it passes through different media, including phenomena such as reflection and refraction; the visible light band refers to the range of electromagnetic waves that the human eye can perceive, usually from about 400 nanometers (blue-violet light) to 700 nanometers (red light); the infrared light band is outside the visible light band, with a longer wavelength than visible light, usually from about 700 nanometers to 3000 nanometers and above.

[0042] It can be understood that in the embodiment of the present application, the parameters of the virtual light source of the micro-optical system are configured according to the requirements of the light source characteristics in the virtual scene. First, the light source system is modeled and designed based on the principles of geometric optics, where the propagation path of light follows the ray tracing theory and the wave effect of light is ignored. Then, according to the specific application scenario requirements, a suitable light source type is selected. For example, a point light source can be selected to simulate the effect of a local light-emitting body, and a parallel light source can be selected to imitate the influence of a distant light source. In addition, the spectral range it covers needs to be considered to ensure that it includes both the visible light band to reproduce the color and brightness characteristics in the natural scene, and the infrared light band to enhance the imaging ability of the system in low-light or special environments.

[0043] In step S104, the imaging sensing plane of the micro-optical system is set to capture the actual imaging pattern of the target.

[0044] Among them, the imaging sensing plane refers to the photosensitive surface used to capture the light passing through or reflected from an object and convert it into a digital image.

[0045] It can be understood that in the embodiment of the present application, the imaging sensing plane of the micro-optical system can be set to accurately simulate the physical characteristics of a real sensor, ensure that the imaging effect in the virtual scene is consistent with the actual optical system, and be used to capture the actual imaging pattern of the target.

[0046] In the embodiments of the present application, an imaging sensing plane of the micro-optical system is set to capture the actual imaging pattern of the target, including: designing the imaging sensing plane according to the characteristics of the real sensing physical system, wherein the resolution of the sensor of the imaging sensing plane is determined by the resolution of the imaging surface and the micro-optical element.

[0047] It can be understood that when setting the imaging sensing plane of the micro-optical system in the embodiments of the present application, it is necessary to design based on the physical characteristics of the real sensor to ensure that the imaging effect in the virtual scene is consistent with the actual situation. Specifically, the design of the imaging sensing plane needs to consider the resolution of the sensor, which is jointly determined by the resolution of the sensor and the micro-optical element. By synergistically optimizing these two factors, high-precision imaging reproduction of the target scene can be achieved.

[0048] In step S105, by adjusting the parameters of the virtual scene and the virtual light source, the parameters of the micro-optical system are iteratively optimized until the actual imaging pattern reaches the desired imaging pattern, and a design scheme of the micro-optical element of the micro-optical system is generated according to the parameters of the micro-optical system after the iterative optimization is completed.

[0049] Among them, the desired imaging pattern refers to the ideal image quality or specific imaging effect defined according to the design target.

[0050] It can be understood that in the embodiments of the present application, various parameters of the virtual scene and the virtual light source are adjusted to simulate different lighting and environmental conditions, and on this basis, the parameters of the micro-optical system are iteratively optimized until the actual imaging pattern reaches the desired imaging pattern, so as to determine the optimal parameter configuration of the micro-optical system, and a specific design scheme of the micro-optical element is generated according to the parameters.

[0051] In the embodiments of the present application, by adjusting the parameters of the virtual scene and the virtual light source, the parameters of the micro-optical system are iteratively optimized until the actual imaging pattern reaches the desired imaging pattern, including: determining the initial design parameters of the micro-optical system, wherein the initial structure of the micro-optical element is set as a Fresnel lens to optimize the light propagation path and energy distribution; evaluating the imaging result of the micro-optical system through the peak signal-to-noise ratio.

[0052] Among them, the Fresnel lens is a specially designed lens, the surface of which is composed of a series of concentric rings, and each ring is equivalent to a small prism, which can efficiently focus light and optimize the light propagation path and energy distribution; the peak signal-to-noise ratio is an important index for measuring the quality of image reconstruction, used to evaluate the similarity between the target imaging pattern and the actually generated pattern, and a higher peak signal-to-noise ratio means higher image quality and less distortion.

[0053] It can be understood that in the embodiments of the present application, the initial design parameters of the micro-optical system are first determined. The initial structure of the micro-optical element is set as a Fresnel lens to optimize the light propagation path and energy distribution, providing a reasonable starting point for subsequent optimization. By adjusting the object attributes in the virtual scene and various parameters of the virtual light source, such as position, type, and intensity, various lighting conditions are simulated. Using the peak signal-to-noise ratio as the evaluation criterion, the imaging results of the micro-optical system after each adjustment are evaluated. Through continuous iterative optimization processes until the actual imaging pattern reaches the desired standard, and finally, based on the series of optimized best parameters, a specific design scheme of the micro-optical element is formed.

[0054] According to the method for designing a micro-optical element based on computer graphics proposed in the embodiments of the present application, a virtual scene can be constructed in a three-dimensional engine according to the real scene, and the parameters of the micro-optical system can be determined according to the design objectives of the micro-optical system. At the same time, the parameters of the virtual light source of the micro-optical system are configured, and the imaging sensing plane of the micro-optical system is set. By adjusting the parameters of the virtual scene and the virtual light source, the parameters of the micro-optical system are iteratively optimized until the actual imaging pattern reaches the desired imaging pattern. According to the parameters of the micro-optical system completed by iterative optimization, a design scheme of the micro-optical element of the micro-optical system is generated, and by constructing the virtual scene of the real scene and the imaging system, the accurate simulation of the optical signal characteristics in a complex environment is realized.

[0055] The method for designing a micro-optical element based on computer graphics will be further described below through a specific embodiment, including the following steps:

[0056] Step S1, virtual scene construction: According to the real scene, the virtual scene is restored in a three-dimensional engine at a 1:1 ratio, generating the corresponding three-dimensional scene model and its texture sampling coordinates (UV). The specific steps include: Step S11, the computer graphics modeling environment is an outdoor environment scene with the sun, trees, grass, and a blue sky in the outdoor scene. Among them, the tree surface has three different sizes of structures. For the undulations with surface structure sizes larger than the micron level, geometric optics theory is used for ray tracing analysis. At this scale, the wave nature effect of light can be ignored, and the light propagation path is determined by the laws of reflection and refraction, thus accurately simulating the optical characteristics of macroscopic structures. The light absorption rate of light waves follows Fresnel theory.

[0057] Step S12, when the size of the surface structure is less than 10 microns but still within the wavelength range, scalar optical theory is used to describe the optical behavior of the surface undulations. At this scale, the diffraction effect is significant, and scalar optics can effectively model the interaction between light waves and microstructures, meeting the accurate tracking requirements of the optical characteristics of microstructures.

[0058] Step S13: For surface microstructures at the nanoscale, the optical behavior is dominated by the vector properties of light waves. At this time, it is necessary to combine vector optical theory to accurately describe the amplitude, phase, and polarization state of electromagnetic waves. Meanwhile, to solve the optical properties of micro-nano structures under far-field conditions, far-field optical theory is comprehensively introduced to ensure the complete modeling of the light wave propagation characteristics in complex scenarios.

[0059] Step S2: Setting of optical system parameters: According to the set requirements, determine the parameters of the micro-optical system. This system can be a pure micro-optical system or a refractive-diffractive hybrid optical system. The specific steps are as follows:

[0060] Step S21: The imaging system of the optical system integrates refractive optical elements and diffractive optical elements to make full use of their optical properties. The refractive elements mainly achieve imaging by changing the light propagation path, while the diffractive elements use the diffraction effect to optimize the phase modulation of light waves, thus achieving efficient multi-functional imaging capabilities in the system. Among them, the wavefront is input by converting the refracted light into a phase and inputting it into the diffractive optical element.

[0061] Step S22: High-performance coating technology is introduced on the surface of the imaging system of the optical system to control the optical properties and improve the system performance. The scattering matrix theory is used to describe the transmittance between different thin films.

[0062] Step S23: The imaging system of the optical system fully considers the actual use conditions and possible defects of the optical elements, including the deformation of the elements, manufacturing errors, surface scratches, etc. These factors may lead to a decline in system performance or optical distortion.

[0063] Step S3: Setting of light source parameters: Configure the relevant parameters of the virtual light source to ensure the accurate expression of the light source characteristics in the simulation environment. The specific steps are as follows:

[0064] Step S31: The light source system is modeled and designed based on the principles of geometric optics. Under this framework, the light propagation path follows the ray tracing theory, ignoring the wave effects, and is suitable for describing the characteristics of macroscopic incoherent light sources, thus ensuring the accurate simulation of the complex light source behavior in natural scenes.

[0065] Step S32: The light source in this system is a point light source, simulating the sunlight at normal noon time.

[0066] Step S33: The design of the light source system covers the visible light and infrared light bands, thereby enhancing the system's ability to capture various spectral information. In the visible light range, the system can reproduce the color and brightness characteristics in natural scenes; while the extension in the infrared band endows the system with imaging capabilities in low-light or special scenarios, further improving its adaptability and functionality.

[0067] Step S4, Imaging Sensing Plane Setting: Define the imaging sensing plane of the micro-optical system for capturing the target imaging pattern. The specific steps are as follows:

[0068] Step S41, Design of the sensor plane: By accurately simulating the characteristics of the real sensing physical system, ensure that the imaging effect in the virtual scene is consistent with the actual optical system. The absorption rates of the three RGB colors in visible to mid-infrared lithography are all 0.8, and each pixel has a certain amount of noise, thus ensuring the physical accuracy of system modeling.

[0069] Step S42, The resolution of the sensor is 256x256 pixels.

[0070] Step S43, The optical system includes three conventional convex lenses and one DOE diffractive imaging element.

[0071] Step S44, The system evaluates the imaging result through the Peak Signal-to-Noise Ratio (PSNR). As an important indicator for measuring the quality of image reconstruction, PSNR can quantitatively evaluate the similarity between the target imaging pattern and the actual generated pattern. By maximizing the PSNR value, ensure that the imaging system can still maintain high-quality image restoration ability in a noisy environment, providing a clear optimization goal for optical design.

[0072] Step S5, Optimization Iteration: By regulating the virtual scene and light source setting, generate a large number of datasets of specific scenes in the virtual scene, and continuously optimize the parameter update iteration of the refractive-diffractive hybrid optical system in combination with deep learning to achieve the desired imaging pattern. Specifically, it includes:

[0073] Use gradient descent to solve the minimum value of the optical system and continuously optimize the parameters of the optical system. The main parameters that can be optimized are the different micro-structure heights on the DOE surface and the primary and secondary curvatures of each lens.

[0074] Next, describe the graphics-based micro-optical element design device according to an embodiment of the present application with reference to the accompanying drawings.

[0075] Figure 2 It is a block diagram of the graphics-based micro-optical element design device according to an embodiment of the present application.

[0076] As Figure 2 shown, the graphics-based micro-optical element design device 10 includes: a construction module 201, a determination module 202, a configuration module 203, a setting module 204, and a generation module 205.

[0077] Among them, the construction module 201 is used to construct a virtual scene in a 3D engine according to the real scene; the determination module 202 is used to determine the parameters of the micro-optical system according to the design objectives of the micro-optical system; the configuration module 203 is used to configure the parameters of the virtual light source of the micro-optical system according to the requirements of the light source characteristics in the virtual scene; the setting module 204 is used to set the imaging sensing plane of the micro-optical system to capture the actual imaging pattern of the target; the generation module 205 is used to iteratively optimize the parameters of the micro-optical system by adjusting the parameters of the virtual scene and the virtual light source until the actual imaging pattern reaches the desired imaging pattern, and generate the design scheme of the micro-optical elements of the micro-optical system according to the parameters of the micro-optical system after the iterative optimization is completed.

[0078] In the embodiment of the present application, the construction module 201 is further used for: identifying a first target surface structure with a size larger than a first preset size in the surface structure under the real scene, performing ray tracing analysis on the first target surface structure using geometric optics theory. At the scale of the first target surface structure, the wave nature effect of light is allowed to be ignored, and the light propagation path is determined by the laws of reflection and refraction to simulate the optical characteristics of the macroscopic structure; identifying a second target surface structure with a size smaller than a second preset size and within the target wavelength range in the surface structure under the real scene, and describing the optical behavior of the surface undulation of the second target surface structure using scalar optics theory. At the scale of the second target surface structure, the interaction between light waves and microstructures is modeled by scalar optics to meet the tracking requirements of the optical characteristics of the microstructures; identifying a third target surface structure with a size smaller than a third preset size in the surface structure under the real scene, and describing the optical behavior by the vector characteristics of light waves at the scale of the third target surface structure, and establishing a virtual scene based on the results of the ray tracing analysis and the description results of the optical behavior.

[0079] In the embodiment of the present application, the determination module 202 is further used for: integrating a refractive optical element and a diffractive optical element in the imaging system of the micro-optical system. The refractive optical element realizes imaging by changing the light propagation path, and the diffractive optical element uses the diffraction effect to optimize the phase modulation of light waves to achieve multifunctional imaging capabilities in the system; introducing a coating technology on the surface of the imaging system of the micro-optical system to control the optical characteristics; considering the actual use conditions and possible defects of the optical elements in the imaging system of the micro-optical system, and the defects include the deformation, manufacturing error and surface scratches of the elements.

[0080] In the embodiment of the present application, the coating design optimizes the optical transmittance, reduces the reflection loss and reduces the dispersion effect.

[0081] In an embodiment of the present application, the configuration module 203 is further configured to: model and design a light source system of a micro-optical system based on the principles of geometric optics, wherein the propagation path of the light in the light source system follows the ray tracing theory, ignoring the wave effect; select a light source from multiple types of light sources supported by the light source system according to the scene requirements; design the visible light band and the infrared light band in the light source system.

[0082] In an embodiment of the present application, the setting module 204 is further configured to: design an imaging sensing plane according to the characteristics of a real sensing physical system, wherein the resolution of the sensor on the imaging sensing plane is determined by the resolution of the imaging plane and the micro-optical element.

[0083] In an embodiment of the present application, the generation module 205 is further configured to: iteratively optimize the parameters of the micro-optical system by adjusting the parameters of the virtual scene and the virtual light source until the actual imaging pattern reaches the desired imaging pattern, including: determining the initial design parameters of the micro-optical system, wherein the initial structure of the micro-optical element is set as a Fresnel lens, and optimizing the propagation path and energy distribution of the light; evaluating the imaging result of the micro-optical system through the peak signal-to-noise ratio.

[0084] It should be noted that the foregoing explanation of the embodiments of the method for designing micro-optical elements based on computer graphics also applies to the device for designing micro-optical elements based on computer graphics in this embodiment, and will not be elaborated here.

[0085] The device for designing micro-optical elements based on computer graphics proposed according to the embodiments of the present application can construct a virtual scene in a three-dimensional engine according to a real scene, determine the parameters of the micro-optical system according to the design objectives of the micro-optical system, and at the same time configure the parameters of the virtual light source of the micro-optical system, set the imaging sensing plane of the micro-optical system, iteratively optimize the parameters of the micro-optical system by adjusting the parameters of the virtual scene and the virtual light source until the actual imaging pattern reaches the desired imaging pattern, generate a design scheme for the micro-optical elements of the micro-optical system according to the parameters of the micro-optical system after the iterative optimization is completed, and accurately simulate the characteristics of optical signals in a complex environment by constructing the virtual scenes of the real scene and the imaging system.

[0086] Figure 3 The following is a schematic structural diagram of an electronic device provided by an embodiment of the present application. The electronic device may include:

[0087] A memory 301, a processor 302, and a computer program stored on the memory 301 and executable on the processor 302.

[0088] When the processor 302 executes the program, it implements the method for designing micro-optical elements based on computer graphics provided in the above embodiments.

[0089] Further, the electronic device further includes:

[0090] A communication interface 303 for communication between the memory 301 and the processor 302.

[0091] A memory 301 for storing computer programs that can run on the processor 302.

[0092] The memory 301 may include a high-speed RAM (Random Access Memory) memory and may also include a non-volatile memory, such as at least one disk memory.

[0093] If the memory 301, the processor 302, and the communication interface 303 are implemented independently, the communication interface 303, the memory 301, and the processor 302 can be interconnected via a bus and communicate with each other. The bus can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus, an EISA (Extended Industry Standard Architecture) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 3 only a thick line is shown herein, but it does not mean that there is only one bus or one type of bus.

[0094] Optionally, in a specific implementation, if the memory 301, the processor 302, and the communication interface 303 are integrated on a single chip, the memory 301, the processor 302, and the communication interface 303 can communicate with each other through an internal interface.

[0095] The processor 302 may be a CPU (Central Processing Unit), or an ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement the embodiments of the present application.

[0096] The embodiments of the present application also provide a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the above-described method for designing a micro-optical element based on graphics is implemented.

[0097] In the description of this specification, the descriptions referring to terms such as "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. mean that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of this application. In this specification, the schematic expressions of the above terms are not necessarily directed to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described can be combined in a suitable manner in any one or N embodiments or examples. In addition, without contradiction, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of different embodiments or examples.

[0098] In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include at least one of such features. In the description of this application, the meaning of "N" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0099] Any process or method description shown in the flowchart or described in other ways herein can be understood to represent a module, segment, or part of code including one or N executable instructions for implementing a customized logical function or process, and the scope of the preferred embodiments of this application includes additional implementations, where the functions can be executed in a manner that is not in the order shown or discussed, including in a substantially simultaneous manner according to the involved functions or in a reverse order, which should be understood by those skilled in the art to which the embodiments of this application belong.

[0100] It should be understood that each part of this application can be implemented by hardware, software, firmware, or a combination thereof. In the above embodiments, the steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware as in another embodiment, any one of the following technologies well known in the art or a combination of them can be used: discrete logic circuits with logic gate circuits for implementing logical functions on data signals, application specific integrated circuits with appropriate combinational logic gate circuits, programmable gate arrays, field programmable gate arrays, etc.

[0101] Those of ordinary skill in the technical field of this application can understand that all or part of the steps carried by the methods for implementing the above embodiments can be completed by instructing relevant hardware through a program, and the above program can be stored in a computer-readable storage medium. When the program is executed, it includes one or a combination of the steps of the method embodiments.

[0102] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the present application. Those of ordinary skill in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present application.

Claims

1. A design method of micro-optical elements based on graphics, characterized in that, Including the following steps: Construct a virtual scene in a 3D engine according to the real scene; Determine the parameters of the micro-optical system according to the design objectives of the micro-optical system; Configure the parameters of the virtual light source of the micro-optical system according to the light source characteristics requirements in the virtual scene; Set the imaging sensing plane of the micro-optical system to capture the actual imaging pattern of the target; By adjusting the parameters of the virtual scene and the virtual light source, iteratively optimize the parameters of the micro-optical system until the actual imaging pattern reaches the desired imaging pattern, and generate the micro-optical element design scheme of the micro-optical system according to the parameters of the micro-optical system after the iterative optimization is completed.

2. The method for designing a micro-optical element based on graphics according to claim 1, wherein The constructing a virtual scene in a 3D engine according to the real scene includes: Identify the first target surface structure with a size larger than the first preset size in the surface structure under the real scene, perform ray tracing analysis on the first target surface structure using geometric optical theory. At the scale of the first target surface structure, the wave nature effect of light is allowed to be ignored, and the light propagation path is determined by the laws of reflection and refraction to simulate the optical characteristics of the macroscopic structure; Identify the second target surface structure with a size smaller than the second preset size and within the target wavelength range in the surface structure under the real scene, describe the optical behavior of the surface undulation of the second target surface structure using scalar optical theory. At the scale of the second target surface structure, the interaction between light waves and microstructures is modeled by scalar optics to meet the tracking requirements of the optical characteristics of the microstructures; Identify the third target surface structure with a size smaller than the third preset size in the surface structure under the real scene. At the scale of the third target surface structure, describe the optical behavior through the vector characteristics of light waves, and establish a virtual scene based on the results of ray tracing analysis and the description results of optical behavior.

3. The method for designing a micro-optical element based on graphics according to claim 1, characterized in that The determining the parameters of the micro-optical system according to the design objectives of the micro-optical system includes: Integrate refractive optical elements and diffractive optical elements in the imaging system of the micro-optical system. The refractive optical element realizes imaging by changing the light propagation path, and the diffractive optical element optimizes the phase modulation of light waves using the diffraction effect to achieve multi-functional imaging capabilities in the system; Introduce coating technology on the surface of the imaging system of the micro-optical system to control the optical characteristics; Consider the actual use conditions and possible defects of the optical elements in the imaging system of the micro-optical system, and the defects include deformation of the elements, manufacturing errors, and surface scratches.

4. The method for designing a micro-optical element based on graphics according to claim 3, characterized in that The coating design optimizes the optical transmittance, reduces the reflection loss, and reduces the dispersion effect.

5. The method for designing a micro-optical element based on graphics according to claim 1, characterized in that, The configuring the parameters of the virtual light source of the micro-optical system according to the light source characteristics requirements in the virtual scene includes: Model and design the light source system of the micro-optical system based on geometric optical principles. Among them, the light propagation path of the light source system follows the ray tracing theory, ignoring the wave effect; Select the light source from multiple types of light sources supported by the light source system according to the scene requirements; Design the visible light band and the infrared light band in the light source system.

6. The method for designing a micro-optical element based on graphics according to claim 1, wherein The setting the imaging sensing plane of the micro-optical system to capture the actual imaging pattern of the target includes: Design an imaging sensing plane according to the characteristics of a real sensing physical system, wherein the resolution of the sensors of the imaging sensing plane is determined by the resolution of the imaging plane and the micro-optical element.

7. The method for designing a micro-optical element based on graphics according to claim 1, characterized in that Iteratively optimize the parameters of the micro-optical system by adjusting the parameters of the virtual scene and the virtual light source until the actual imaging pattern reaches the desired imaging pattern, including: Determine the initial design parameters of the micro-optical system, wherein the initial structure of the micro-optical element is set as a Fresnel lens to optimize the propagation path and energy distribution of light. Evaluate the imaging result of the micro-optical system by peak signal-to-noise ratio.

8. An apparatus for designing micro-optical elements based on graphics, characterized in that, Include: A construction module for constructing a virtual scene in a 3D engine according to a real scene. A determination module for determining the parameters of the micro-optical system according to the design objective of the micro-optical system. A configuration module for configuring the parameters of the virtual light source of the micro-optical system according to the light source characteristics requirements in the virtual scene. A setting module for setting the imaging sensing plane of the micro-optical system to capture the actual imaging pattern of the target. A generation module for iteratively optimizing the parameters of the micro-optical system by adjusting the parameters of the virtual scene and the virtual light source until the actual imaging pattern reaches the desired imaging pattern, and generating a design scheme of the micro-optical element of the micro-optical system according to the parameters of the micro-optical system after the iterative optimization is completed.

9. An electronic device, characterized in that, Include: A memory, a processor, and a computer program stored on the memory and executable on the processor, and the processor executes the program to implement the graphics-based micro-optical element design method according to any one of claims 1-7.

10. A computer-readable storage medium having a computer program or instructions stored thereon, characterized in that, When the computer program or instruction is executed, the graphics-based micro-optical element design method according to any one of claims 1-7 is implemented.

Images