Optical system, configuration method and identification method

Abstract

The present invention discloses an optical system, a configuration method and an identification method. The optical system includes: an optical element; a processing module coupled to the optical element and used to process data information from the optical element according to a first program; the configuration method includes: obtaining sample data; inputting the first data into the optical element, executing the first program to obtain intermediate data, and determining an evaluation value according to the intermediate data and the second data; based on the evaluation value, updating the configuration of the optical element, or updating the configuration of the first program, or updating both the configuration of the optical element and the configuration of the first program, until the evaluation value meets the preset numerical condition, and obtaining the configuration information of the optical system. The configuration method of the optical system provided by the present invention can establish a relationship between the actual and the target, realize the overall configuration of the optical system, and improve the configuration efficiency and prevent error accumulation.

Description

Technical Field

[0001] The present invention relates to the field of optical imaging technology, and in particular to an optical system, a configuration method and a recognition method. Background Art

[0002] Optical systems are widely used in medical, industrial, military and other fields to form imaging systems, sensors or detection systems, or to implement laser technology, display technology or fiber optic communications.

[0003] When applying optical systems to computing and information processing, there is often a problem that the optical part and the electronic part do not work well together and cannot cooperate with each other to perform the intended tasks. In addition, since the optical part and the electronic part each have errors, errors will accumulate when the two work together, resulting in poor optimization and training results and low efficiency.

[0004] Especially when using optical systems to identify and understand the posture and movements of human bodies and objects through computer technology, or when applying them to the fields of human-computer interaction, motion analysis, security monitoring, etc., the optical part and the electrical part need to cooperate to perceive the posture state of the human body, so this field puts forward higher requirements on the performance of the optical system. Summary of the invention

[0005] One of the purposes of the present invention is to provide a configuration method for an optical system to solve the technical problems in the prior art that the optical system has poor information processing effect, error accumulation and low training efficiency.

[0006] One of the objectives of the present invention is to provide an identification method.

[0007] One of the objects of the present invention is to provide an optical system.

[0008] To achieve one of the above-mentioned purposes of the invention, an embodiment of the present invention provides a configuration method for an optical system, the optical system comprising: an optical element; a processing module, coupled to the optical element, for processing data information from the optical element according to a first program; the configuration method comprising: obtaining sample data, including first data corresponding to input information of the optical element, and second data corresponding to information output when the first program is executed; the second data is target data corresponding to the first data; inputting the first data into the optical element, executing the first program to obtain intermediate data, and determining an evaluation value based on the intermediate data and the second data; based on the evaluation value, updating the configuration of the optical element, or updating the configuration of the first program, or updating both the configuration of the optical element and the configuration of the first program, until the evaluation value meets a preset numerical condition, thereby obtaining configuration information of the optical system.

[0009] As a further improvement of an embodiment of the present invention, the first data includes a sample image, the second data includes actual recognition information corresponding to the sample image, and the intermediate data includes predicted recognition information corresponding to the sample image; the actual recognition information is represented by actual features of the target object in the sample image, and the predicted recognition information is represented by features determined by the first program based on sample image calculations.

[0010] As a further improvement of an embodiment of the present invention, the configuration method includes: inputting first data into an optical element to generate an intermediate image; determining whether the intermediate image satisfies a first preset condition; if so, executing a first program to process the intermediate image to obtain intermediate data; if not, updating the configuration of the optical element until the regenerated intermediate image satisfies the first preset condition, executing the first program to process the regenerated intermediate image to obtain intermediate data.

[0011] As a further improvement of an embodiment of the present invention, the configuration method includes: judging whether the intermediate image includes edge information according to the change of pixel channel values; the change value of the pixel channel values ​​at the edge position in the intermediate image is greater than a preset change value; if so, determining that the intermediate image satisfies the first preset condition regarding the contour.

[0012] As a further improvement of an embodiment of the present invention, the configuration method includes: identifying points where the change in pixel channel values ​​is greater than a preset change value through an edge detection operator, and determining whether the intermediate image includes edge information; the edge detection operator includes at least one of a Sobel operator, a Prewitt operator or a Canny operator.

[0013] As a further improvement of an embodiment of the present invention, the configuration method includes: determining whether the blur value of the intermediate image is greater than a preset blur value, or determining whether the difference between the blur value of the intermediate image and the preset blur value satisfies a preset error condition; if so, determining that the intermediate image satisfies a first preset condition regarding encryption.

[0014] As a further improvement of an embodiment of the present invention, the configuration method includes: determining a first pixel channel value of the intermediate image, performing a convolution operation on the first pixel channel value using a Laplace mask, and determining a blur value of the intermediate image.

[0015] As a further improvement of an embodiment of the present invention, the configuration method includes: inputting first data into an optical element, determining a point spread function value of the optical element in response to the first data; judging whether the difference between the point spread function value and the standard function value satisfies a preset threshold condition; if so, executing a first program to process an intermediate image generated by the optical element corresponding to the first data to obtain intermediate data; if not, updating the configuration of the optical element until the redetermined point spread function value satisfies the preset threshold condition, executing the first program to process the intermediate image regenerated by the optical element to obtain intermediate data.

[0016] As a further improvement of one embodiment of the present invention, the configuration method includes: determining the L2 norm of the difference between the point spread function value and the standard function value; judging whether the L2 norm falls within the blur threshold interval; the blur threshold interval is determined according to the blur degree requirement set for the optical element; if so, determining that the point spread function value meets the preset threshold condition; if not, determining that the point spread function value does not meet the preset threshold condition.

[0017] As a further improvement of an embodiment of the present invention, the standard function value is determined according to at least one of the following: according to the blur degree requirement corresponding to the optical element, the standard function value is calculated based on the scalar diffraction formula to determine the standard function value; according to the clarity requirement corresponding to the optical element, the standard function value is calculated based on the scalar diffraction formula to determine; a standard element that meets the blur degree requirement corresponding to the optical element is obtained, and the first data is used as the input of the standard element, and the point spread function value of the standard element in response to the first data is determined, and the standard function value is determined according to the point spread function value; a standard element that meets the clarity requirement corresponding to the optical element is obtained, and the first data is used as the input of the standard element, and the point spread function value of the standard element in response to the first data is determined, and the standard function value is determined according to the point spread function value.

[0018] As a further improvement of an embodiment of the present invention, the optical system includes: a first optical element; a second optical element; the processing module is coupled to the first optical element and the second optical element, respectively, and is used to process data information from the first optical element and the second optical element according to a first program; the configuration method includes: based on the evaluation value, updating the configuration of the first optical element, or updating the configuration of the second optical element, or updating the configuration of the first program, or updating both the configuration of the first optical element and the configuration of the first program, or updating the configuration of the second optical element and the configuration of the first program, or updating the configuration of the first optical element, the configuration of the second optical element and the configuration of the first program, until the evaluation value meets a preset numerical condition, and the configuration information of the optical system is obtained; the first optical element and the second optical element are set in different orientations, or the first optical element and the second optical element are used to generate different intermediate images.

[0019] As a further improvement of one embodiment of the present invention, the optical element includes at least one metasurface element; the configuration method includes: based on the evaluation value, updating the configuration of the metasurface element, or updating the configuration of the first program, or updating both the configuration of the metasurface element and the configuration of the first program, until the evaluation value meets the preset numerical condition, and the configuration information of the optical system is obtained; the configuration of the metasurface element includes at least one of the geometric structure, size or spatial arrangement of the nanostructure units used to constitute the metasurface; when the first program is executed, it is used to implement a first neural network model algorithm, and the configuration of the first program includes model parameters of the first neural network model; the evaluation value includes loss values ​​of intermediate data and second data.

[0020] As a further improvement of an embodiment of the present invention, the optical element includes at least one refractive optical element, at least one diffractive optical element and / or at least one scattering medium element; the configuration method includes: based on the evaluation value, updating the configuration of the optical element, or updating the configuration of the first program, or updating both the configuration of the optical element and the configuration of the first program, until the evaluation value meets the preset numerical condition to obtain the configuration information of the optical system; the configuration of the optical element includes at least one of the material, surface curvature, thickness, and surface shape of the refractive optical element, and / or, at least one of the surface roughness, particle distribution uniformity, frosting or acid etching depth, and thickness of the scattering medium element, and / or, at least one of the diffraction order, microstructure period, microstructure height, and refractive index of the diffractive optical element; when the first program is executed, it is used to implement a first neural network model algorithm, and the configuration of the first program includes model parameters of the first neural network model; the evaluation value includes loss values ​​of intermediate data and second data.

[0021] To achieve one of the above-mentioned purposes of the invention, an embodiment of the present invention provides an identification method, which is applied to an optical system, wherein the optical system comprises: an optical element; a processing module, coupled to the optical element, and used to process data information from the optical element according to a first program; the identification method comprises: configuring the optical system according to the configuration information obtained by the configuration method described in any of the above-mentioned technical solutions; controlling the optical element to obtain a detection image corresponding to the target object, controlling the processing module to execute the first program to process the detection image, and identifying the target object.

[0022] As a further improvement of one embodiment of the present invention, the recognition method is used to determine the posture recognition information of the target object; the recognition method also includes: outputting and displaying the posture recognition information; and / or determining the difference between the posture recognition information and the standard posture, outputting a comparison result or a posture correction indication; the recognition method is used to identify at least one of limb posture, hand gesture, object position, and object posture.

[0023] To achieve one of the above-mentioned purposes of the invention, one embodiment of the present invention provides an optical system, which is configured according to the configuration information obtained by the configuration method described in any of the above-mentioned schemes, or the optical system is used to implement the identification method described in any of the above-mentioned technical solutions.

[0024] As a further improvement of one embodiment of the present invention, the optical element includes a photosensitive element; a metasurface element is arranged on the light incident side of the photosensitive element, and a metasurface element is arranged on the light incident side of the photosensitive element.

[0025] As a further improvement of an embodiment of the present invention, a focusing lens is provided on the light incident side of the photosensitive element, at least for coupling data information to the photosensitive element.

[0026] As a further improvement of an embodiment of the present invention, the optical system includes: a first optical element; a first processing module, coupled to the first optical element, for processing data information from the first optical element according to a first program; a second optical element; a second processing module, coupled to the second optical element, for processing data information from the second optical element according to the first program; the first optical element is used to correspond to the target object and generate a first intermediate image, and the second optical element is used to correspond to the target object and generate a second intermediate image; the first intermediate image is one of a clear image, a blurred image and a contour image, and the second intermediate image is the other of a clear image, a blurred image and a contour image; or, the first intermediate image has a first degree of blur, and the second intermediate image has a second degree of blur different from the first degree of blur.

[0027] As a further improvement of one embodiment of the present invention, the optical system includes: a first optical element; a second optical element; the first optical element is arranged at a first position relative to the target object, and the second optical element is arranged at a second position relative to the target object; the first position is one of directly in front of the target object, directly to the left of the front, directly to the right of the front, directly below the front, and directly above the front, and the second position is another one of directly in front of the target object, directly to the left of the front, directly to the right of the front, directly below the front, and directly above the front.

[0028] Compared with the prior art, the configuration method of the optical system provided by the present invention determines an evaluation value for evaluating the performance of the optical system by comprehensively considering the second data as the processing target of executing the first program corresponding to the first data, and the intermediate data as the current actual processing result of executing the first program corresponding to the first data, so as to adjust the configuration of the optical system. Therefore, it is possible to establish a relationship between the actual and the target based on the first data, so that the optical system can quickly update the configuration to achieve the desired goal. Because the first data is used as the input of the optical element in the optical system, and the intermediate data is used as the output of the processing module in the optical system, the optical element and the processing module as a whole can be used as the configuration and update objects to prevent the accumulation of errors of both. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 It is a schematic structural diagram of an optical system in one embodiment of the present invention.

[0030] Figure 2 It is a schematic diagram of the structure of the optical system in the first embodiment of the present invention.

[0031] Figure 3 It is a schematic structural diagram of the first specific embodiment of the optical element in the present invention.

[0032] Figure 4 It is a schematic structural diagram of a second specific embodiment of the optical element in the present invention.

[0033] Figure 5 Schematic diagram of the structure of the optical system in the second embodiment of the present invention.

[0034] Figure 6 Schematic diagram of the structure of the optical system in the third embodiment of the present invention.

[0035] Figure 7 It is a schematic diagram of the steps of a method for configuring an optical system in one embodiment of the present invention.

[0036] Figure 8 It is a schematic diagram of the steps of the first specific embodiment of the configuration method of the optical system in the present invention.

[0037] Fig. 9 It is a schematic diagram of the steps of the second specific embodiment of the method for configuring the optical system in the present invention.

[0038] Fig.10 It is a schematic diagram of the steps of the identification method in one embodiment of the present invention.

[0039] FIG. 11( a ) is a diagram of a first target object in an embodiment of the present invention.

[0040] FIG. 11( b ) is a detection image corresponding to the first target object in one embodiment of the present invention.

[0041] Fig.12 is a detection image corresponding to the second target object in one embodiment of the present invention.

[0042] Fig.13 is a detection image corresponding to the fifth target object in one embodiment of the present invention.

[0043] Fig.14 is a detection image corresponding to the sixth target object in one embodiment of the present invention.

[0044] Fig.15 is a detection image corresponding to the seventh target object in one embodiment of the present invention.

[0045] Fig.16 is a detection image corresponding to the eighth target object in one embodiment of the present invention.

[0046] Fig.17 is a detection image corresponding to the ninth target object in one embodiment of the present invention. DETAILED DESCRIPTION

[0047] The present invention will be described in detail below in conjunction with the specific embodiments shown in the accompanying drawings. However, these embodiments do not limit the present invention, and any structural, methodological, or functional changes made by a person skilled in the art based on these embodiments are all within the scope of protection of the present invention.

[0048] It should be noted that the term "comprise" or any other variation thereof is intended to cover non-exclusive inclusion, so that a process, method, article or apparatus that includes a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or apparatus.

[0049] In addition, the terms "first", "second", etc. are used for descriptive purposes only and should not be understood as indicating or implying relative order or importance. For example, when describing "second", etc., it does not mean that the embodiment or technical solution necessarily includes "first", etc.

[0050] like Figure 1 As shown, an embodiment of the present invention provides an optical system.

[0051] The optical system may be a system for processing optical signals; the optical system may be a system comprising optical components; the optical components include but are not limited to lenses, sensors, gratings, prisms, filters, and beam splitters.

[0052] The optical system includes optical elements. Figure 2As shown, the optical element may be a metasurface element, a refractive optical element, a diffractive optical element (DOE) and / or a scattering medium element.

[0053] The optical system further includes a photosensitive element 13. The photosensitive element 13 may be a light sensor, specifically a CMOS (Complementary Metal Oxide Semiconductor) photosensitive element (CIS, CMOS Image Sensor), a CCD (Charge Coupled Device, Charge Coupled Device) photosensitive element or an array photodetector.

[0054] In one embodiment, the optical element includes at least one metasurface element 11 .

[0055] In one embodiment, the optical system includes a photosensitive element 13, and the optical element includes a metasurface element 11 disposed on the light incident side of the photosensitive element 13. In one embodiment, the optical system includes a photosensitive element 13, and a metasurface element 11 is disposed on a side of the photosensitive element 13 close to the target object 200.

[0056] In a specific embodiment, the metasurface element 11 is provided as an independent component; in a specific embodiment, the metasurface element 11 and the photosensitive element 13 are provided independently.

[0057] In a specific embodiment, the metasurface element 11 is a layer structure formed on the photosensitive element 13 ; in a specific embodiment, the metasurface element 11 and the photosensitive element 13 are integrally arranged.

[0058] The metasurface element 11 is used to at least receive an optical signal from a target object and perform optical modulation.

[0059] In one embodiment, the optical element may include multiple groups of metasurface elements. The multiple groups of metasurface elements may have the same or different configuration parameters. In a specific embodiment, the optical system may include a group of metasurface elements 11 and a photosensitive element 13; in a specific embodiment, the optical system may include multiple groups of metasurface elements 11 and a photosensitive element 13.

[0060] In one embodiment, the optical system further includes a focusing lens 14. In one embodiment, a focusing lens 14 is disposed on the light incident side of the photosensitive element 13. In one embodiment, the focusing lens 14 is at least used to couple data information to the photosensitive element 13.

[0061] The optical system may include a focusing lens; the optical system may also include multiple focusing lenses, which together constitute a lens group. The focusing lens 14 is used to focus the optical signal from the target object 200, obtain a focused optical signal corresponding to the target object 200, and inject it into one side of the optical element; for example, inject the focused optical signal into the photosensitive element 13; for example, inject the focused optical signal into the metasurface element 11 and inject it into the photosensitive element 13 through it.

[0062] When the metasurface element 11 is disposed at a point on the light incident side of the photosensitive element 13, for example, disposed on the light incident side of the photosensitive element 13 or formed on the surface of the light incident side of the photosensitive element 13, the focusing lens 14 is used to couple data information to the metasurface element 11, and the metasurface element 11 couples the data information to the photosensitive element 13, or couples the data information to the photosensitive element 13 after processing.

[0063] In one embodiment, the optical system includes at least one group of metasurface elements, at least one focusing lens 14 and a photosensitive element 13. In one embodiment, the optical system includes multiple groups of metasurface elements and / or multiple focusing lenses 14, the multiple groups of metasurface elements may have the same or different configuration parameters, and the multiple focusing lenses 14 may have the same or different configuration parameters. In a specific embodiment, the optical system includes a group of metasurface elements 11, a focusing lens 14 and a photosensitive element 13. In a specific embodiment, the optical system includes a group of metasurface elements 11, multiple focusing lenses 14 and a photosensitive element 13. In a specific embodiment, the optical system includes multiple groups of metasurface elements 11, a focusing lens 14 and a photosensitive element 13. In a specific embodiment, the optical system includes multiple groups of metasurface elements 11, multiple focusing lenses 14 and a photosensitive element 13.

[0064] like Figure 3 As shown, the metasurface element 11 and the photosensitive element 13 are independently and separately arranged.

[0065] In one embodiment, the optical system may further include a dielectric layer disposed between the metasurface element 11 and the photosensitive element 13. The material of the dielectric layer may be any material having a low refractive index and absorption coefficient in the visible light or near-infrared band, such as silicon dioxide (SiO2), spin-on glass (SOG), or polymers such as polymethyl methacrylate (PMMA), polydimethylsiloxane (PDMS), polymethylpentene (PMP), and combinations of the above materials.

[0066] like Figure 4As shown, the metasurface element 11 is integrally arranged with the photosensitive element 13. The metasurface element 11 is formed on the surface of the light incident side of the photosensitive element 13. In this way, it is convenient to adjust the wavelength and polarization of the incident light, and it is convenient to realize the accurate capture of complex three-dimensional action postures.

[0067] In one embodiment, corresponding to the photosensitive element 13, the semiconductor substrate has a photoelectric conversion unit array area, and the photoelectric conversion unit array area includes a plurality of photoelectric conversion units. In one embodiment, corresponding to the photosensitive element 13, the light-receiving surface of the semiconductor substrate is formed with a metasurface element arranged in the photoelectric conversion array area, and the metasurface element includes a plurality of nanostructure units corresponding to the plurality of photoelectric conversion units, and the nanostructure units are used to transmit the incident light signal to the corresponding photoelectric conversion unit.

[0068] In one embodiment, the nanostructure units for forming the metasurface are arranged on the light incident side of the optical element. In one embodiment, the nanostructure units for forming the metasurface are arranged on the light exiting side of the optical element. In one embodiment, the nanostructure units for forming the metasurface are arranged on both the light incident side and the light exiting side of the optical element.

[0069] In one embodiment, the metasurface element 11 and the photosensitive element 13 can be combined by thermal bonding, plasma bonding, or adhesive bonding; or, the metasurface element 11 can be directly prepared on the photosensitive element 13. For example, first, an optical film layer is formed on the light-receiving surface of the semiconductor substrate, and then the optical film layer is etched into the metasurface element 11 by a photolithography process. For example, the optical film layer can be etched into the metasurface element 11 corresponding to the photoelectric conversion unit array area by a photolithography process.

[0070] In one embodiment, the multiple groups of metasurface elements in the above-mentioned embodiment can be independently separated or integrated. When integrated, two or more groups of metasurface elements can be combined by thermal bonding, plasma bonding, adhesive bonding, etc.; or, another group of metasurface elements can be directly prepared on the substrate side or element side of a group of metasurface elements. For example: first, an optical film layer is formed on the substrate side or nanostructure side of a group of metasurface elements, and then the optical film layer is etched into another group of metasurface elements by photolithography.

[0071] In one embodiment, the functional configuration of the optical system can be achieved by updating the configuration of the metasurface element 11 .

[0072] The metasurface element described in any embodiment of the present invention refers to an artificial layered material with a size less than or approximately equal to the wavelength, which can be regarded as the two-dimensional counterpart of the metamaterial. The metasurface element can achieve the regulation of the polarization, phase, amplitude, frequency, propagation mode, angular momentum and other characteristics of the electromagnetic wave through the surface sub-wavelength super-structure unit, and realize the characteristics of beam shaping, beam deflection, super-lens, super-holography, optical rotation, anti-reflection and anti-reflection. The above-mentioned polarization, phase, amplitude, angular momentum and other characteristics can be flexibly regulated by adjusting at least one of the configuration parameters such as the geometric structure, size or spatial arrangement of the nano-structure unit.

[0073] The size includes but is not limited to radius, side length, height, etc. The spatial arrangement includes but is not limited to arrangement period, duty cycle, etc.

[0074] At the same time, metasurface elements can be sub-wavelength optical elements, which are suitable for the current micron-scale sensor architecture. At the same time, their preparation process is compatible with mature semiconductor sensor technology and has strong practicality and economy.

[0075] Specifically, the metasurface element includes a substrate and a plurality of metastructure units arranged in an array on the substrate, and a nanostructure unit is provided at the center and / or vertex position of each metastructure unit. The superstructure unit is obtained by dividing the metasurface element to obtain a structure unit centered on each nanostructure unit. The nanostructure units in each cycle constitute a superstructure unit. The superstructure unit is a densely packed figure, such as a regular quadrilateral, a regular hexagon, a fan, etc., each cycle contains a nanostructure unit, and the vertex and / or center of the superstructure unit can be provided with a nanostructure unit. In the case where the superstructure unit is a regular hexagon, at least one nanostructure unit is provided at each vertex and center position of the regular hexagon. Similarly, the same is true in the case of a fan and a square.

[0076] Among them, the substrate of the metasurface element can be selected from, for example: silicon dioxide, BF33 and other glass materials with similar refractive index, silicon, polymethyl methacrylate, etc.; the nanostructure unit can be selected from, for example: monomer silicon (c-Si), polycrystalline silicon (p-Si), amorphous silicon (a-Si), compound semiconductors (such as GaN, GaP, GaAs, SiC, etc.), TiO2, Si3N4, AlSb, AlAs, AlGaAs, AlGaInP, BP, ZnGeP2 and other suitable materials and combinations of the above materials.

[0077] Specifically, according to different usage scenarios, the nanostructure unit can be configured as a polarization-dependent structure or a polarization-independent structure. Polarization-independent structures include, for example, a cylindrical shape, a square cylindrical shape, a cross cylindrical shape, a square cylindrical shape with a round hole, etc. Polarization-dependent structures include, for example, an elliptical cylindrical shape, a rectangular cylindrical shape, a hexagonal prism, etc. The nanostructure unit can be a positive structure or a negative structure. For example, the shape of the nanostructure unit includes a cylindrical shape, a hollow cylindrical shape, a square prism, a hollow square prism, etc.

[0078] The nanostructure may also be a combination of structures of various shapes, for example, a circle, a cross, a regular polygon, a rectangle, or any combination of these shapes.

[0079] The metasurface element may also include a protective layer covering the nanostructure unit. The material of the protective layer may be any material having a low refractive index and absorption coefficient in the visible light or near-infrared band, such as silicon dioxide (SiO2), spin-on glass (SOG), or polymers such as polymethyl methacrylate (PMMA), polydimethylsiloxane (PDMS), polymethylpentene (PMP) and combinations of the above materials, or air (i.e., no protective layer is provided).

[0080] In one embodiment, the optical element may further include at least one refractive optical element, at least one diffractive optical element and / or at least one scattering medium element. The refractive optical element may include an ordinary spherical refractive optical element or an aspherical refractive optical element, specifically including but not limited to a lens or prism made of optical glass, optical plastic, optical crystal and other materials; the diffractive optical element includes but is not limited to a two-step or multi-step diffractive optical element, a grating, a Dammann grating, a metasurface, a hologram, a diffuser, a phase mask, an intensity mask, a spatial light modulator and the like; the scattering medium element includes but is not limited to frosted glass and the like.

[0081] In one embodiment, the configuration of the optical system function can be achieved by updating the configuration of the refractive optical element. In one embodiment, the configuration of the optical system function can be achieved by updating the configuration of the diffractive optical element. In one embodiment, the configuration of the optical system function can be achieved by updating the configuration of the scattering medium element.

[0082] The optical system comprises a processing module 12 .

[0083] The processing module 12 is coupled to the optical element. The processing module 12 is used to process data information from the optical element according to a first program. In one embodiment, the optical system includes a photosensitive element 13, and the processing module 12 is coupled to the photosensitive element 13, and is used to process data information from the photosensitive element 13 according to the first program.

[0084] The first program may be a set of instruction information stored in a storage unit inside the processing module 12, or may be a set of instruction information stored in an independent storage unit outside the processing module 12. In one embodiment, the first program is used to implement a first neural network model algorithm when implemented. In one embodiment, the processing module 12 works to implement the first neural network model algorithm. The first neural network model is used to process data information from an optical element (e.g., a metasurface element 11); in a specific embodiment, the first neural network is used to identify a target object 200 located on the light incident side.

[0085] The processing module 12 may be used to execute only the first program to implement the first neural network model algorithm. In one embodiment, the optical system may include multiple processing modules, each processing module executing a different program to implement a different neural network model algorithm.

[0086] The neural network model algorithm may have a one-to-one correspondence with the optical elements. In this embodiment, the optical elements are respectively coupled to the corresponding processing modules.

[0087] The processing module 12 can be used to execute various programs and implement various neural network model algorithms.

[0088] The neural network model algorithm may have a one-to-one correspondence with the optical element. In this embodiment, a plurality of optical elements are coupled to a corresponding processing module, and the processing module is used to execute a plurality of neural network model algorithms corresponding to the plurality of optical elements.

[0089] The optical system does not necessarily perform imaging and / or data processing only on the target object 200. In one embodiment, the optical system is used to perform imaging and / or data processing on the object to be detected, and the object to be detected includes the target object 200. The optical system performs optical processing on the target object 200 part of the object to be detected using the metasurface element 11, and / or processes the data information corresponding to the target object 200 using the processing module 12, so as to realize posture recognition of the target object 200.

[0090] The processing module 12 may be coupled to the optical element by electrical connection, optical coupling, or a combination of the two. In one embodiment, the optical system includes a photosensitive element 13, which converts the received optical signal into data information in the form of an electrical signal and transmits it to the processing module 12, so that the processing module 12 and the optical element are electrically connected. In one embodiment, the optical element includes a metasurface element 11, which processes the received optical signal and transmits the data information in the form of an optical signal to the processing module 12, so that the processing module 12 and the optical element are optically coupled.

[0091] The coupling between the processing module 12 and the optical element can be achieved through direct connection or indirect connection.

[0092] In one embodiment, the optical system is configured according to configuration information obtained by a configuration method.

[0093] In a specific embodiment, the configuration method of the optical system includes: obtaining sample data; inputting first data into an optical element, executing a first program to obtain intermediate data, and determining an evaluation value based on the intermediate data and second data; based on the evaluation value, updating the configuration of the optical element, or updating the configuration of the first program, or updating both the configuration of the optical element and the configuration of the first program, until the evaluation value meets a preset numerical condition, thereby obtaining configuration information of the optical system. The sample data includes first data corresponding to the input information of the optical element, and second data corresponding to the information output when the first program is executed; the second data is target data corresponding to the first data.

[0094] The first data corresponds to the input information of the optical element, and can be configured as the first data being information for inputting the optical element, or can be configured as the first data having a form, feature, format, standard, etc. corresponding to the input information of the optical element.

[0095] In other embodiments, the optical system may also be configured according to the configuration method of the optical system described in any of the following embodiments.

[0096] For example, in an embodiment where the optical element includes a metasurface element, the configuration method of the optical system includes: based on the evaluation value, updating the configuration of the metasurface element, or updating the configuration of the first program, or updating both the configuration of the metasurface element and the configuration of the first program, until the evaluation value meets a preset numerical condition, thereby obtaining the configuration information of the optical system.

[0097] For example, in an embodiment where the optical element includes at least one refractive optical element, at least one diffractive optical element and / or at least one scattering medium element, the configuration method of the optical system includes: based on the evaluation value, updating the configuration of the optical element, or updating the configuration of the first program, or updating both the configuration of the optical element and the configuration of the first program, until the evaluation value satisfies a preset numerical condition, thereby obtaining configuration information of the optical system.

[0098] In one embodiment, the optical system is used to implement a recognition method.

[0099] In a specific embodiment, the recognition method includes: configuring the optical system according to configuration information obtained by a configuration method; controlling the optical element to obtain a detection image corresponding to the target object, controlling the processing module to execute a first program to process the detection image, and determining the recognition information of the corresponding target object; for example, the recognition information includes posture recognition information.

[0100] In other embodiments, the optical system may also be configured according to the identification method described in any of the embodiments below.

[0101] In one embodiment, the optical system may be defined as including a collection module 10 for collecting data information corresponding to the target object. The data information may be in the form of an optical signal. In a specific embodiment, the collection module 10 is used to collect an image of the target object 200, and the processing module 12 identifies the target object based on the image. For example, the collection module 10 is used to collect a posture image of the target object 200, and the processing module 12 determines the posture recognition information of the target object based on the posture image.

[0102] The acquisition module 10 may include the above-mentioned optical element. In one embodiment, the optical system includes a photosensitive element 13, and the acquisition module 10 includes the photosensitive element 13. In one embodiment, the optical element includes a metasurface element 11, and the acquisition module 10 includes the metasurface element 11. In one embodiment, the acquisition module 10 includes a focusing lens 14.

[0103] like Figure 5 As shown, in one embodiment, the optical system includes a first optical element.

[0104] In one embodiment, the first optical element comprises a first metasurface element 11A. In one embodiment, the first optical element comprises at least one refractive optical element, at least one diffractive optical element and / or at least one scattering medium element.

[0105] In one embodiment, the optical system includes a first photosensitive element 13A. A first metasurface element 11A is disposed on the light incident side of the first photosensitive element 13A.

[0106] In a specific embodiment, the first metasurface element 11A is formed on the surface of the light incident side of the first photosensitive element 13A, and the two are integrally arranged. In a specific embodiment, the first metasurface element 11A is arranged on the light incident side of the first photosensitive element 13A, and the two are separately arranged.

[0107] In one embodiment, the optical system includes a second optical element.

[0108] In one embodiment, the second optical element comprises a second metasurface element 11B. In one embodiment, the second optical element comprises at least one refractive optical element, at least one diffractive optical element and / or at least one scattering medium element.

[0109] In one embodiment, the optical system includes a second photosensitive element 13B. A second metasurface element 11B is disposed on the light incident side of the second photosensitive element 13B.

[0110] In a specific embodiment, the second metasurface element 11B is formed on the surface of the light incident side of the second photosensitive element 13B, and the two are integrally arranged. In a specific embodiment, the second metasurface element 11B is arranged on the light incident side of the second photosensitive element 13B, and the two are separately arranged.

[0111] In one embodiment, the optical system includes a first processing module 12A.

[0112] In one embodiment, the first processing module 12A is coupled to the first optical element. In a specific embodiment, the first processing module 12A is coupled to the first photosensitive element 13A. In a specific embodiment, the first processing module 12A is coupled to the first metasurface element 11A.

[0113] The first processing module 12A is used to process the data information from the first optical element according to the first program. In one embodiment, the first processing module 12A is used to process the data information from the first metasurface element 11A according to the first program; the first processing module 12A is used to process the data information from the first photosensitive element 13A according to the first program.

[0114] In one embodiment, the optical system includes a second processing module 12B.

[0115] In one embodiment, the second processing module 12B is coupled to a second optical element. In a specific embodiment, the second processing module 12B is coupled to a second photosensitive element 13B. In a specific embodiment, the second processing module 12B is coupled to a second metasurface element 11B.

[0116] The second processing module 12B is used to process the data information from the second optical element according to the first program. In one embodiment, the second processing module 12B is used to process the data information from the second metasurface element 11B according to the first program; the second processing module 12B is used to process the data information from the second photosensitive element 13B according to the first program.

[0117] In one embodiment, the first metasurface element 11A and the first photosensitive element 13A can be used to form a first acquisition module 10A, and the second metasurface element 11B and the second photosensitive element 13B can be used to form a second acquisition module 10B.

[0118] In a specific embodiment, the first collection module 10A may further include a focusing lens corresponding to the first metasurface element 11A, and the second collection module 10B may further include a focusing lens corresponding to the second metasurface element 11B.

[0119] In a specific embodiment, the optical system may include two or more groups of acquisition modules.

[0120] In one embodiment, the first optical element is used to generate a first intermediate image corresponding to the target object. The first intermediate image can be imaged with only the target object, or with an imaging object including the target object; for the former, the first intermediate image only includes data information of the target object, and in particular may include identification information of the target object; for example, the identification information includes posture recognition information; for the latter, the first intermediate image includes data information of the imaging object as a whole, and at least includes identification information of the target object; for example, the identification information includes posture recognition information.

[0121] In one embodiment, the second optical element is used to generate a second intermediate image corresponding to the target object. The second intermediate image can be imaged with only the target object or with an imaging object including the target object.

[0122] In one embodiment, the first intermediate image is one of a clear image, a blurred image, and an outline image, and the second intermediate image is another of a clear image, a blurred image, and an outline image. In this way, the optical system can achieve different imaging effects and generate different types of images through the first optical element, the first processing module 12A and the second optical element, the second processing module 12B.

[0123] The type of the first intermediate image and / or the second intermediate image can be set according to user needs.

[0124] When at least one set of optical elements and processing modules are used to generate blurred images and outline images, since the specific content of the image cannot be intuitively distinguished based on such intermediate images, even if they are output and rendered, the user's privacy protection needs can be met.

[0125] In this embodiment, there may be the following specific embodiments:

[0126] The first intermediate image is a clear image, and the second intermediate image is a blurred image. In this way, a comparison between the original information and the blurred encrypted information can be formed to determine the blurred encryption effect.

[0127] The first intermediate image is a clear image, and the second intermediate image is a contour image. In this way, a comparison between the original information and the contour information can be formed, and in particular, the contour information can be used to analyze and obtain identification information, which can be compared with the original information; for example, the identification information includes gesture recognition information.

[0128] The first intermediate image is a blurred image, and the second intermediate image is a contour image. In this way, user privacy can be fully protected, and on this basis, posture recognition information can be analyzed based on the contour image to grasp the posture of the target object.

[0129] In one embodiment, when configuring or implementing the optical system, a step of determining the type of the intermediate image may be added. For example, determining whether the clarity of the first intermediate image meets a preset clarity condition; or determining whether the blurriness of the first intermediate image meets a preset blurriness condition; or determining whether the first intermediate image shows contour information. The determination step may be implemented by a corresponding processing module.

[0130] In this embodiment, since the expected first intermediate image and the second intermediate image are of different types, different judgment steps can be performed accordingly. For example, if the expected first intermediate image is a blurred image, the first processing module 12A can perform a step of judging whether the blur degree of the first intermediate image meets a preset blur degree condition; for example, if the expected second intermediate image is a contour image, the second processing module 12B can perform a step of judging whether the second intermediate image shows contour information.

[0131] The blur degree can be characterized by a blur value. The blur value can be determined by determining a first pixel channel value of the intermediate image and performing a convolution operation on the pixel channel value using a Laplace mask; the first pixel channel value can be a gray value. The blur value can be determined by a digital image blur algorithm based on gray values.

[0132] The contour information can be characterized by edge information. If the change value of the pixel channel value in the intermediate image is greater than the preset change value, this position is determined to be an edge position, and it is determined that the intermediate image includes edge information. In one embodiment, the point where the change of the pixel channel value is greater than the preset change value can be identified by an edge detection operator, and whether the intermediate image includes edge information can be determined based on this. In a specific embodiment, the edge detection operator includes at least one of a Sobel operator, a Prewitt operator, or a Canny operator. In one embodiment, the pixel channel value can be a brightness value.

[0133] In one embodiment, the first intermediate image has a first blur degree, and the second intermediate image has a second blur degree. The first blur degree is different from the second blur degree. In this way, the optical system can achieve different imaging effects and generate images with different blur degrees through the first optical element, the first processing module 12A and the second optical element, the second processing module 12B.

[0134] The blur degree of the first intermediate image and / or the second intermediate image can be set according to user needs.

[0135] In one embodiment, when configuring or implementing the optical system, a step of judging the blur degree of the intermediate image may be added. For example, judging whether the blur degree of the first intermediate image satisfies a preset first blur degree condition; judging whether the blur degree of the second intermediate image satisfies a preset second blur degree condition. Of course, the blur degree of the intermediate image may also be evaluated by judging the clarity of the intermediate image. The higher the clarity, the lower the blur degree and the worse the encryption effect.

[0136] The blur degree can be represented by a point spread function value; specifically, the blur degree can be quantified by the point spread function value.

[0137] In one embodiment, the standard function value may be calculated using a scalar diffraction formula, or determined by obtaining a standard element for simulation.

[0138] The standard function value can be used as a standard for quantitative evaluation of the degree of blur; for example, the standard function value can be compared with the actual point spread function value of the optical element in response to the data, and based on the difference between the two, it can be determined whether the intermediate image generated by the optical element or optical system meets the corresponding blur degree condition.

[0139] In a specific embodiment, the standard function value can be used to characterize a standard value of a point spread function that meets an expected blur level.

[0140] In this embodiment, the standard function value can be determined according to the expected degree of blur based on the scalar diffraction formula, or a standard element capable of achieving the expected blur processing can be obtained, data can be input into the standard element, and the standard function value corresponding to the expected degree of blur can be determined based on the point spread function value of this process.

[0141] In this embodiment, the actual point spread function value and the standard function value may be directly compared, and when the difference between the two is within the allowable error range, it is determined that the intermediate image meets the expected blur level requirement.

[0142] In a specific embodiment, the standard function value may be used to characterize a standard value of a point spread function that meets the clarity; correspondingly, the expected difference between the actual point spread function value and the standard function value may be set according to the expected blur level.

[0143] In this embodiment, the standard function value can be determined according to the clarity requirement based on the scalar diffraction formula. A standard element that can generate an intermediate image that meets the clarity requirement can also be obtained, and data can be input into the standard element to determine the point spread function value of this process, and then the standard function value corresponding to the clarity requirement can be determined.

[0144] In this embodiment, the difference between the actual point spread function value and the standard function value needs to be compared with a preset threshold condition, and the threshold condition is used to represent the expected difference. For example, the expected point spread function value can be calculated and determined based on the scalar diffraction formula according to the expected blur degree, and the threshold condition is set according to the difference between the expected point spread function value and the standard function value. Alternatively, a standard element capable of achieving the expected blur processing can be obtained, data can be input into the standard element, the point spread function value corresponding to the expected blur degree can be determined, and the threshold condition can be set according to the difference between the expected point spread function value and the standard function value.

[0145] Although two groups of optical elements and corresponding processing modules are provided in this embodiment, the present invention is not limited to setting two groups in the optical system. In other embodiments, the optical elements and the corresponding processing modules can be set to three groups or more, and different groups can be used to generate the same or different intermediate images.

[0146] Figure 5 In the illustrated embodiment, the first acquisition module 10A and the second acquisition module 10B respectively include a first processing module 12A and a second processing module 12B corresponding thereto. When implementing the configuration method of the optical system for configuration, the first acquisition module 10A and the first processing module 12A can be configured, and the second acquisition module 10B and the second processing module 12B can be configured synchronously or asynchronously.

[0147] For example, the first data can be input into the first metasurface element 11A and the first photosensitive element 13A, and the first processing module 12A executes the first program to obtain intermediate data and determine an evaluation value. At this time, the configuration of the first metasurface element 11A and / or the first program can be updated based on the evaluation value to determine the configuration information of the first acquisition module 10A and the first processing module 12A.

[0148] When the optical element is of other types, the configuration of the other types of optical elements may also be updated based on the evaluation values.

[0149] like Figure 6 As shown, in one embodiment, the optical system includes a first optical element.

[0150] In one embodiment, the first optical element includes a first metasurface element 11A. In one embodiment, the optical system includes a first photosensitive element 13A. The first metasurface element 11A is disposed on the light incident side of the first photosensitive element 13A.

[0151] In a specific embodiment, the first metasurface element 11A is formed on the surface of the light incident side of the first photosensitive element 13A, and the two are integrally arranged. In a specific embodiment, the first metasurface element 11A is arranged on the light incident side of the first photosensitive element 13A, and the two are separately arranged.

[0152] In one embodiment, the optical system includes a second optical element.

[0153] In one embodiment, the second optical element includes a second metasurface element 11B. In one embodiment, the optical system includes a second photosensitive element 13B. The second metasurface element 11B is disposed on the light incident side of the second photosensitive element 13B.

[0154] In a specific embodiment, the second metasurface element 11B is formed on the surface of the light incident side of the second photosensitive element 13B, and the two are integrally arranged. In a specific embodiment, the second metasurface element 11B is arranged on the light incident side of the second photosensitive element 13B, and the two are separately arranged.

[0155] In one embodiment, the first optical element is disposed at a first position relative to the target object 200 , and the second optical element is disposed at a second position relative to the target object 200 .

[0156] In a specific embodiment, the first orientation and the second orientation are different orientations relative to the target object 200. In this way, the optical system can collect information of the target object 200 from different orientations of the target object 200 for comprehensive analysis of data information from the first optical element and the second optical element. In particular, when the optical system is used to analyze identification information of the target object 200, the optical element is used for multi-orientation detection to obtain more accurate identification information; for example, the identification information includes posture recognition information.

[0157] In one embodiment, the first direction is one of the direction directly in front of the target object 200, the direction directly to the left of the direction directly in front, the direction directly to the right of the direction directly in front, the direction directly below the direction in front, and the direction directly above the direction in front.

[0158] In one embodiment, the second direction is another one of the direction directly in front of the target object 200, the direction directly to the left of the direction directly in front, the direction directly to the right of the direction directly in front, the direction directly below the direction in front, and the direction directly above the direction in front.

[0159] In a specific embodiment, the left side of the front may be a direction 45 degrees to the left side of the front of the target object 200; the right side of the front may be a direction 45 degrees to the right side of the front of the target object 200; the lower side of the front may be a direction 45 degrees to the lower side of the front of the target object 200; and the upper side of the front may be a direction 45 degrees to the upper side of the front of the target object 200.

[0160] In one embodiment, the first optical element includes a first metasurface element 11A, and the first metasurface element 11A is disposed at a first position relative to the target object 200. In a specific embodiment, the first metasurface element 11A is disposed on the light incident side of the first photosensitive element 13A.

[0161] The first photosensitive element 13A and the first metasurface element 11A can be used to form a first acquisition module 10A. In one embodiment, the first acquisition module 10A can be disposed as a whole at a first position relative to the target object 200. In a specific embodiment, the first acquisition module 10A further includes a focusing lens.

[0162] The second photosensitive element 13B and the second metasurface element 11B can be used to form a second acquisition module 10B. In one embodiment, the second acquisition module 10B can be disposed as a whole at a second position relative to the target object 200. In a specific embodiment, the second acquisition module 10B further includes a focusing lens.

[0163] In one embodiment, the optical system may be provided with a processing module 12 corresponding to a plurality of optical elements located at different positions.

[0164] The processing module 12 is coupled to a plurality of optical elements in the optical system, and processes data information from the plurality of optical elements according to the first program. In this way, the processing module 12 can analyze the target object 200 based on the data information collected from multiple directions.

[0165] When the configuration method of the optical system is implemented for configuration, multiple optical elements and a processing module may be configured as a whole.

[0166] For example, the first data may be input into the first optical element (e.g., the first metasurface element 11A) to obtain an intermediate image corresponding to one orientation, and the first data may be input into the second optical element (e.g., the second metasurface element 11B) to obtain an intermediate image corresponding to another orientation. The processing module 12 performs the first program processing based on the intermediate images corresponding to different orientations to obtain intermediate data and determine an evaluation value. At this time, the configuration of the first optical element (e.g., the first metasurface element 11A), the second optical element (e.g., the second metasurface element 11B) and / or the first program may be uniformly updated based on the evaluation value, thereby determining the configuration information of the first acquisition module 10A, the second acquisition module 10B and the processing module 12.

[0167] When the optical system includes more optical elements, these optical elements can also be configured together with the processing module 12 to ensure that the optical system has multi-directional information processing capabilities and obtains more accurate data processing results (for example, obtains more accurate identification information; for example, the identification information includes posture recognition information).

[0168] like Figure 7 , an embodiment of the present invention provides a method for configuring an optical system.

[0169] The method can be used to configure the structural features of components within an optical system, such as the structural features of the components themselves, or the configuration of the functions performed by the components.

[0170] This method can be used to fix the parameter configuration of the program in the optical system, such as program instructions, model parameters of the neural network model, etc.

[0171] The optical system can be configured as the technical solution provided in any of the above embodiments.

[0172] For example, an optical system includes optical elements.

[0173] Combination Figure 2 As shown, the optical element may include at least one metasurface element, a refractive optical element, a diffractive optical element and / or a scattering medium element.

[0174] The optical system further includes a photosensitive element 13 .

[0175] In one embodiment, the optical element includes at least one metasurface element 11 .

[0176] In one embodiment, the metasurface element 11 is disposed on the light incident side of the photosensitive element 13 .

[0177] In one embodiment, the optical element is used to construct a collection module 10 , and the collection module 10 includes a photosensitive element 13 and a metasurface element 11 ; in a specific embodiment, the collection module 10 may further include a focusing lens 14 .

[0178] In a specific embodiment, the optical element or acquisition module 10 is used to generate an intermediate image based on the information input thereto. For example, the intermediate image may be a posture image; the posture image is an image carrying the posture status of the target object; the posture status may be the outline of the target object (as shown in FIG. 11( b)), or nodes indicating the joints of the target object (as shown in FIG. 11( c)). Fig.12 ), or connecting lines indicating the target object's limbs (such as Fig.12 ).

[0179] The optical system includes a processing module 12. The processing module 12 is coupled to the optical element. The processing module 12 is used to process data information from the optical element according to a first program. In one embodiment, the optical element includes a metasurface element 11, and the processing module 12 is coupled to the metasurface element 11, and is used to process data information from the metasurface element 11 according to the first program. In a specific embodiment, the optical system includes a photosensitive element 13, the metasurface element 11 is coupled to the photosensitive element 13, and the processing module 12 is coupled to the metasurface element 11 through the photosensitive element 13.

[0180] In one embodiment, when the first program is executed by the processing module, a neural network model is implemented. In a specific embodiment, the neural network model is a convolutional neural network model. In other specific embodiments, the neural network model can be other deep learning models, such as a feedforward neural network model, a recursive neural network model, a generative adversarial network model, an autoencoder, etc.

[0181] In a specific embodiment, when the first program is executed by the processing module, it is used to determine the identification information of the corresponding target object according to the information input into the optical element; for example, the identification information includes gesture recognition information.

[0182] If the optical element is used to generate a gesture image as an intermediate image, the first program, when executed by the processing module, is used to determine gesture recognition information corresponding to the target object according to the gesture image.

[0183] The configuration method of the optical system specifically includes at least one of the following steps.

[0184] Step S1, obtaining sample data.

[0185] The sample data includes first data; the first data corresponds to information input to the optical element.

[0186] In one embodiment, the first data is in the form of an optical signal, and the first data can be directly input into the optical element, which modulates the first data and then outputs the first data to a subsequent stage of the optical element in the optical system.

[0187] In one embodiment, the first data is in a form such as an electrical signal, and the first data can be converted into an optical signal and then input into the optical element.

[0188] In other embodiments, the configuration process of the optical system is performed based on an optical path simulation platform, and the optical element is constructed as an electronic simulation model, so that the first data in the form of an electrical signal can be used as input data of the optical element.

[0189] The sample data includes second data; the second data corresponds to information output when the processing module executes the first program. The second data is target data corresponding to the first data.

[0190] For a target optical system that has been configured, the first data is input into an optical element in the target optical system, and a processing module of the target optical system can obtain second data corresponding to the first data by executing a first program. Therefore, the first data and the second data can be used to functionally configure the optical system to be configured in a direction close to the target optical system.

[0191] In one embodiment, the first data is an optical signal corresponding to the sample object; in one embodiment, the light from the sample object forms an optical signal, which can be used as data input to the optical element when configuring the optical system.

[0192] The optical element and the processing module are jointly trained and configured according to the sample data; in one embodiment, during the joint configuration process, the first data in the sample data can be used as input data, and the second data can be used as a training label.

[0193] In one embodiment, the first data includes a sample image. In this embodiment, when configuring the optical system, the sample image can be directly used as the input of the optical element, so that it can directly modulate the sample image to improve the efficiency of the configuration. In some embodiments, when implementing the optical system, image information can be used as the input of the optical element, and of course, light signals, electrical signals, etc. corresponding to the target object can also be used as the input of the optical element.

[0194] In one embodiment, the second data includes actual identification information. In this embodiment, the optical system is configured to analyze the characteristic of the object according to the input from one side of the optical element, so that the actual identification information is used as the target data of the optical system. In one embodiment, the actual identification information corresponds to the sample image; in a specific embodiment, the actual identification information corresponds to the portion of the sample image that represents the target object.

[0195] In a specific embodiment, the actual identification information is represented by the actual features of the target object in the sample image. In this way, the actual identification information is used as the target data corresponding to the first data, and the optical system obtained by this target configuration can accurately infer the identification information of the target object.

[0196] The identification information proposed in the present invention may include posture recognition information. The posture recognition information is used to help understand the posture and movement of the human body, and realize natural human-computer interaction and real-time monitoring of body movements. Corresponding to different application scenarios, the content of the determined posture information may be the same or different.

[0197] When the optical system is applied to the sitting posture recognition scenario, the optical system can be used to identify whether the sitting posture is standard. At this time, the determined recognition information may include: normal sitting posture, body leaning forward, body leaning backward, body leaning sideways, bending over, hunching back, bowing the head, shoulder tilted to the left, shoulder tilted to the right, one leg raised and other posture recognition information.

[0198] When the optical system is applied to a fall or tumble detection scenario, the recognition information determined by the optical system may include: posture recognition information such as tumble and fall.

[0199] When the optical system is applied to a lighting control scenario, the recognition information determined by the optical system may include: gesture recognition information. The gesture recognition information may be used to control the start and stop of lighting.

[0200] When the optical system is applied to a DMS (Driver Monitor System), the recognition information determined by the optical system may include gesture recognition information. The gesture recognition information may be used to control a vehicle function.

[0201] When the optical system is applied to factory compliance detection scenarios, the identification information determined by the optical system may include posture recognition information such as wearing, washing hands, and smoking.

[0202] When the optical system is applied to household appliances such as washing machines, refrigerators, and water purifiers, the identification information determined by the optical system can be used to control the appliances, or can include control signals for controlling the appliances.

[0203] The identification information proposed in the present invention is not limited to analyzing the posture of living bodies such as human bodies and animal bodies, but can also be used to analyze the posture of objects such as motor vehicles and non-motor vehicles.

[0204] When the optical system is applied to the intelligent street monitoring scenario, the optical system can be used to determine whether there is a non-motor vehicle illegally parked in a designated street area. At this time, the determined identification information may include: non-motor vehicle parking posture identification information.

[0205] The optical system can also be used to determine whether there is any business activity in the designated street area. In this case, the determined identification information may include: posture identification information of all objects in the designated street area.

[0206] The optical system can also be used to determine whether there are mobile vendors in the designated street area. In this case, the determined identification information may include: gesture identification information of the fixed-point movement of objects in the designated street area and the situation of objects entering and leaving the area.

[0207] The optical system can also be used to determine whether there is illegal parking of motor vehicles in a designated street area. In this case, the determined identification information may include: the posture identification information of the motor vehicle being parked.

[0208] The optical system can also be used to determine whether there is a non-motor vehicle entering a motor vehicle lane in a designated street area. At this time, the determined identification information may include: the posture identification information of the non-motor vehicle, and the identification information of the positional relationship between the non-motor vehicle and the motor vehicle lane.

[0209] The optical system can also be used to determine whether there is a road congestion in a specified street area. In this case, the determined identification information may include: posture identification information of all objects in the road.

[0210] The optical system can also be used to determine whether there is an unclean road surface in a designated street area. In this case, the determined identification information may include: posture identification information of all objects on the road surface.

[0211] The optical system can also be used to determine whether there is a construction waste problem in a specified street area. In this case, the determined identification information may include: posture identification information of the construction waste on the street.

[0212] The optical system can also be used to determine whether there is a road garbage problem in a specified street area. In this case, the determined identification information may include: posture identification information of the garbage dropped on the road surface.

[0213] The optical system can also be used to determine whether there is a problem of disorderly stacking of materials in a designated street area. In this case, the determined identification information may include: posture identification information of the materials stacked on the street.

[0214] Step S2, inputting the first data into the optical element, executing the first program to process to obtain intermediate data, and determining the evaluation value according to the intermediate data and the second data.

[0215] Compared with existing optical simulation methods:

[0216] On the one hand, in the optical system provided by the present invention, the optical response of the optical element can be determined by implementing an existing optical simulation method (for example, constructing an optical model corresponding to the optical element).

[0217] On the other hand, in the configuration method proposed by the present invention, after the first data is input into the optical element, the first program processes the output of the optical element as input, thereby obtaining intermediate data, that is, the intermediate data is obtained after the first data is processed by the optical element and the first program; based on this, the evaluation value is determined according to the intermediate data and the second data (in one embodiment, the second data can be considered to be a label value), thereby guiding the configuration of the optical system. It can be seen that both the optical element and the first program participate in the construction of the evaluation value, and the construction of the evaluation value does not rely solely on the optical element or the first program.

[0218] Furthermore, the output of the optical element can be determined by the optical response or optical model of the optical element determined by existing optical simulation methods, that is, the optical element can be a simulated optical response relationship, and its output can be determined by calculation; in addition, the output of the optical element can also be determined by constructing a physical optical element for experiment.

[0219] In one embodiment, the intermediate data includes predicted identification information. In this embodiment, the optical system may generate predicted identification information that is the same as or different from the actual identification information when configuring, and the process of configuring the optical system according to the second data and the intermediate data may be specifically the process of configuring the optical system according to the actual identification information and the predicted identification information.

[0220] In a specific embodiment, the optical system determines an evaluation value according to the actual recognition information and the predicted recognition information, and configures the optical system based on the evaluation value.

[0221] In a specific embodiment, the optical system is configured according to the difference between the actual identification information and the predicted identification information.

[0222] In one embodiment, the predicted identification information corresponds to a sample image; in a specific embodiment, the predicted identification information corresponds to a portion of the sample image that represents the target object.

[0223] In a specific embodiment, the predicted identification information is characterized by features determined by the first program based on sample image calculations. In this way, the sample image is used as the input of the optical element, the predicted identification information is determined by the first program calculation, and the actual identification information corresponding to the sample image is configured as the target, which can not only realize the unified joint configuration of the optical element and the first program, but also configure and form an optical system with the recognition function of "from image to identification information".

[0224] In other embodiments, an optical system with other recognition functions may also be configured. Other recognition functions may be constructed by adjusting the optical element, the input and output of the first program.

[0225] In one embodiment, the first program is used to implement a first neural network model algorithm when executed. In a specific embodiment, the first neural network model algorithm is used to output recognition information when implemented; for example, the recognition information includes gesture recognition information.

[0226] In one embodiment, the first program includes at least one group of program instructions, and the program instructions include multiple instruction parameters. The configuration method provided by the present invention can be specifically used to configure the instruction parameters.

[0227] In one embodiment, the first program is used to implement a first neural network model algorithm, and the first neural network model algorithm includes a plurality of model parameters. The configuration method provided by the present invention can be specifically used to configure the model parameters.

[0228] The model parameters may include at least one of the following: parameters for defining the model architecture, model weight parameters, model bias parameters, initialization parameters, hyperparameters (e.g., learning rate, optimizer, loss function, regularization parameter, batch size, training cycle, learning rate scheduling strategy), process parameters (e.g., gradient, momentum, second-order moment estimation).

[0229] In one embodiment, the evaluation value is used to evaluate the performance of the current optical system, in particular, the difference between the performance and the target task. In one embodiment, the evaluation value is represented by the difference between the intermediate data and the second data.

[0230] The evaluation value can be used to update the configuration of the optical system; specifically, a standard value or a standard interval can be set for the evaluation value, and according to the numerical relationship between the evaluation value and the standard value, or according to the numerical relationship between the evaluation value and the standard interval, it can be determined whether to update the configuration of the optical system, and / or how to update the configuration of the optical system. For example, when the evaluation value is not equal to the standard value, or the evaluation value does not fall within the standard interval, it is determined that the configuration of the optical system is adjusted.

[0231] The configuration is updated based on the evaluation value, and specifically the configuration is updated until the evaluation value converges.

[0232] The configuration of the optical system includes configuration parameters of optical elements and / or configuration parameters of the first program.

[0233] In one embodiment, the evaluation value includes loss values ​​of the intermediate data and the second data.

[0234] The loss value is used to characterize the difference between the intermediate data and the second data. The loss value can be used to reflect the gap between the currently configured optical system and the target optical system.

[0235] The loss value may be determined based on the cross entropy, KL divergence, Hinge loss, etc. of the intermediate data and the second data. In one embodiment, the loss value may be determined based on the mean square error between the intermediate data and the second data.

[0236] In one embodiment, the optical system includes a plurality of optical elements, and the plurality of optical elements are coupled to the same processing module, and the processing module executes a first program to obtain unified intermediate data.

[0237] In this embodiment, the first data can be input into a plurality of optical elements respectively, and the processing module receives and executes the first program according to the output from the plurality of optical elements to obtain the intermediate data. The plurality of optical elements can be arranged at different positions of the target object; the plurality of optical elements can be used to generate different types of intermediate images; the plurality of optical elements can be configured as in any embodiment provided by the present invention.

[0238] For example, the optical system includes a first optical element.

[0239] In one embodiment, the first optical element comprises a first metasurface element. In one embodiment, the first optical element comprises at least one refractive optical element, at least one diffractive optical element and / or at least one scattering medium element.

[0240] In one embodiment, the optical system includes a first photosensitive element. A first metasurface element is disposed on the light incident side of the first photosensitive element.

[0241] In a specific embodiment, the first metasurface element is formed on the surface of the light incident side of the first photosensitive element, and the two are integrally arranged. In a specific embodiment, the first metasurface element is arranged on the light incident side of the first photosensitive element, and the two are separately arranged.

[0242] For example, the optical system includes a second optical element.

[0243] In one embodiment, the second optical element comprises a second metasurface element. In one embodiment, the second optical element comprises at least one refractive optical element, at least one diffractive optical element and / or at least one scattering medium element.

[0244] In one embodiment, the optical system includes a second photosensitive element. A second metasurface element is disposed on the light incident side of the second photosensitive element.

[0245] In a specific embodiment, the second metasurface element is formed on the surface of the light incident side of the second photosensitive element, and the two are integrally arranged. In a specific embodiment, the second metasurface element is arranged on the light incident side of the second photosensitive element, and the two are separately arranged.

[0246] In one embodiment, the processing module is coupled to the first optical element and the second optical element respectively, and is used to process data information from the first optical element and the second optical element according to a first program.

[0247] In one embodiment, the optical system includes a plurality of optical elements, and the plurality of optical elements are coupled to different processing modules, and the different processing modules respectively execute the first program to obtain the same or different intermediate data.

[0248] In this embodiment, the first data can be input into a plurality of optical elements respectively, and different processing modules receive and execute the first program according to the output of the corresponding optical elements to obtain a plurality of sets of intermediate data. The plurality of optical elements can be set at different positions of the target object; the plurality of optical elements can be used to generate different types of intermediate images; the plurality of optical elements can be configured as in any embodiment provided by the present invention.

[0249] If the first program is used to determine the identification information, the multiple processing modules can be used to output the same or different sets of identification information corresponding to the target object according to different optical elements.

[0250] In one embodiment, the optical system includes a plurality of optical elements, and the plurality of optical elements are respectively coupled to different processing modules, and different processing modules execute different programs to obtain different intermediate data.

[0251] In this embodiment, the first data can be input into a plurality of optical elements respectively, and different processing modules receive and execute different programs according to the output of the corresponding optical elements to obtain a plurality of sets of intermediate data. The plurality of optical elements can be set at different positions of the target object; the plurality of optical elements can be used to generate different types of intermediate images; the plurality of optical elements can be configured as in any embodiment provided by the present invention.

[0252] Different programs can be used to determine different information. Different programs can be for the same target object or for different target objects; different programs can determine a variety of different types of information results such as identification information and encryption information for the target object, or different programs can be executed for the target object to determine the same type of information results, such as identification information; for example, the identification information includes gesture recognition information.

[0253] Step S3, based on the evaluation value, update the configuration of the optical element, or update the configuration of the first program, or update both the configuration of the optical element and the configuration of the first program, until the evaluation value meets the preset numerical condition, and obtain the configuration information of the optical system.

[0254] In one embodiment, the optical element includes at least one metasurface element.

[0255] In one embodiment, the optical element includes a nanostructure unit for forming a metasurface, and the nanostructure unit is arranged on the light incident side and / or the light exit side of the optical element body.

[0256] The configuration method of the optical system includes: based on the evaluation value, updating the configuration of the metasurface element, or updating the configuration of the first program, or updating both the configuration of the metasurface element and the configuration of the first program, until the evaluation value satisfies a preset numerical condition, thereby obtaining configuration information of the optical system. This step can be used to replace step S3.

[0257] In one embodiment, the optical element includes a metasurface element; updating the configuration of the optical element includes: updating the configuration of the metasurface element; specifically including: updating the configuration of the nanostructure unit.

[0258] The configuration of the metasurface element updated based on the evaluation value may specifically include at least one of the geometric structure, size or spatial arrangement of the metasurface nanostructure unit. In some embodiments, the configuration of the metasurface element may also include at least one of the arrangement period, material, shape and position coordinates of the nanostructure unit.

[0259] In one embodiment, the optical element includes at least one refractive optical element, at least one diffractive optical element and / or at least one scattering medium element.

[0260] The configuration method of the optical system includes: based on the evaluation value, updating the configuration of the optical element, or updating the configuration of the first program, or updating both the configuration of the optical element and the configuration of the first program, until the evaluation value meets a preset numerical condition, thereby obtaining the configuration information of the optical system.

[0261] In one embodiment, the optical element comprises a refractive optical element. In this embodiment, updating the configuration of the optical element comprises: updating at least one of the material, surface curvature, thickness, and surface shape of the refractive optical element.

[0262] For a spherical refractive optical element, at least one of the material, surface curvature, and glass thickness of the refractive optical element may be updated.

[0263] For aspherical refractive optical elements, in addition to the above-mentioned material, surface curvature, and glass thickness, the surface shape can also be updated.

[0264] In a specific embodiment, the configuration of the optical element is updated based on the evaluation value, and the updated configuration of the refractive optical element may specifically include a refractive index, a radius of curvature, and the like.

[0265] In one embodiment, the optical element comprises a diffractive optical element. In this embodiment, updating the configuration of the optical element comprises updating at least one of the diffraction order, the period of the microstructure, the height of the microstructure, and the refractive index of the diffractive optical element.

[0266] In a specific embodiment, the configuration of the optical element is updated based on the evaluation value, and the updated configuration of the diffraction optical element may specifically include: focal length characteristics, phase function of the diffraction surface, radial radius of each annular zone mutation point of the diffraction surface, annular zone depth of the diffraction surface, and diffraction efficiency, etc.

[0267] In one embodiment, the optical element includes a scattering medium element. In this embodiment, updating the configuration of the optical element includes updating at least one of the surface roughness, particle distribution uniformity, frosting or acid etching depth, and thickness of the diffractive optical element.

[0268] In a specific embodiment, the configuration of the optical element is updated based on the evaluation value, and the updated configuration of the scattering medium element may specifically include: scattering coefficient, absorption coefficient, phase function, scattering length, opacity or transmittance, anisotropy factor, optical thickness, scattering efficiency, and particle size distribution.

[0269] In one embodiment, a metasurface element, a photosensitive element formed with a metasurface element, or both a metasurface element and a photosensitive element are used to constitute an acquisition module. The configuration of the acquisition module can also be updated based on the evaluation value. The updated configuration of the acquisition module can specifically include the combination of elements, the spacing between elements, etc., for example, updating the spacing between metasurface elements, or updating the spacing between focusing lenses, or updating the spacing between focusing lenses and metasurface elements.

[0270] In one embodiment, the configuration of the first program updated based on the evaluation value may specifically include program instructions or parameters. In one embodiment, when the first program is executed, it is used to implement a first neural network model algorithm. The configuration of the first program includes model parameters of the first neural network model. The configuration of the first program updated based on the evaluation value may specifically include model parameters of the first neural network model.

[0271] When the optical element comprises a plurality of optical elements, the configuration method provided by the present invention can be implemented to uniformly configure the optical system.

[0272] In one embodiment, an optical system includes a first optical element.

[0273] In one embodiment, the first optical element comprises a first metasurface element. In one embodiment, the first optical element comprises at least one refractive optical element, at least one diffractive optical element and / or at least one scattering medium element.

[0274] In one embodiment, the optical system includes a second optical element.

[0275] In one embodiment, the second optical element comprises a second metasurface element. In one embodiment, the second optical element comprises at least one diffractive optical element and / or at least one scattering medium element.

[0276] In one embodiment, the processing module is coupled to the first optical element and the second optical element respectively. In one embodiment, the processing module is used to process data information from the first optical element and the second optical element according to a first program.

[0277] In one embodiment, the first optical element and the second optical element are disposed in different positions. In this way, the optical system can collect information of the target object from different positions, jointly determine the data processing result, and improve accuracy.

[0278] In one embodiment, the optical system is used to determine the posture recognition information of the target object. When the optical system includes multiple optical elements arranged at different positions, the processing module can determine the posture recognition information based on the intermediate images collected at different positions and the postures at different positions.

[0279] In one embodiment, the first optical element is in a first orientation relative to the target object, and the first orientation is one of the direction directly in front of the target object, the direction directly to the left of the front, the direction directly to the right of the front, the direction directly below the front, and the direction directly above the front. In one embodiment, the second optical element is in a second orientation relative to the target object, and the second orientation is another one of the direction directly in front of the target object, the direction directly to the left of the front, the direction directly to the right of the front, the direction directly below the front, and the direction directly above the front.

[0280] In some embodiments, the optical system may further include more optical elements located at other positions and coupled to the processing module.

[0281] In one embodiment, the first optical element and the second optical element are used to generate different intermediate images.

[0282] The optical system can be provided with a first processing module and a second processing module corresponding to the first optical element and the second optical element to construct a multi-path parallel architecture. The first optical element and the second optical element can also be coupled to the same processing module for comprehensive processing.

[0283] In a specific embodiment, the first optical element is used to generate a first intermediate image; the first intermediate image is one of a clear image, a blurred image and a contour image; the second optical element is used to generate a second intermediate image; the second intermediate image is another of a clear image, a blurred image and a contour image. In this specific embodiment, different optical elements are used to generate different types of intermediate images. In some other embodiments, the optical system may further include more optical elements that generate other types of intermediate images.

[0284] In a specific embodiment, the first optical element is used to generate a first intermediate image; the first intermediate image has a first blur degree; the second optical element is used to generate a second intermediate image; the second intermediate image has a second blur degree. In this specific embodiment, different optical elements are used to generate intermediate images with different blur degrees. In some other embodiments, the optical system may further include more optical elements that generate intermediate images with other blur degrees.

[0285] In any of the above-mentioned embodiments comprising multiple optical elements, the configuration method of the optical system may include the steps of: based on the evaluation value, updating the configuration of the first optical element, or updating the configuration of the second optical element, or updating the configuration of the first program, or updating both the configuration of the first optical element and the configuration of the first program, or updating both the configuration of the second optical element and the configuration of the first program, or updating the configuration of the first optical element, the configuration of the second optical element, and the configuration of the first program, until the evaluation value meets the preset numerical condition, thereby obtaining the configuration information of the optical system.

[0286] This step can be implemented as the aforementioned step S3 instead. This step can be implemented after the aforementioned step S2.

[0287] In this way, when faced with an optical system with multiple optical elements, any part of the optical system can be trained, or the entire optical system can be trained uniformly.

[0288] Figure 8 Some steps of a configuration method according to a specific embodiment of the present invention are provided. In this specific embodiment, the configuration method includes the following steps.

[0289] Step S211, inputting the first data into an optical element to generate an intermediate image.

[0290] Step S212, determining whether the intermediate image meets a first preset condition.

[0291] If so, jump to step S213A and execute the first program to process the intermediate image to obtain intermediate data.

[0292] If not, jump to step S213B, update the configuration of the optical element until the regenerated intermediate image meets the first preset condition, execute the first program to process the regenerated intermediate image, and obtain intermediate data.

[0293] In this way, the intermediate image can be pre-judged and the configuration of the optical element can be updated individually when necessary, which is conducive to the rapid configuration of the optical system and reduces the number of iterations of the configuration process. Since the intermediate image is judged based on preset conditions, it can ensure that the optical element generates the desired intermediate image, making the optical system highly consistent with the configuration target.

[0294] In one embodiment, the optical element includes at least one metasurface element; the configuration of the updated optical element may be the configuration of the metasurface element, which may specifically include at least one of the geometric structure, size or spatial arrangement of the nanostructure units used to constitute the metasurface.

[0295] In some embodiments, the optical element includes at least one refractive optical element, at least one diffractive optical element and / or at least one scattering medium element; the configuration of the updated optical element may be a configuration of a refractive optical element, a diffractive optical element and / or a scattering medium element.

[0296] The intermediate image may be obtained by actually generating and collecting an image using an optical element, or may be obtained by simulating light corresponding to the first data (eg, a sample image) using a light simulation platform after the light is adjusted by an optical element.

[0297] In one embodiment, the first preset condition is a condition related to the intermediate image; the first preset condition may be related to the nature, content, size, and display of the intermediate image.

[0298] In a specific embodiment, the first preset condition is related to the type of the intermediate image. The type of the intermediate image can be at least one of a clear image, a blurred image, and a contour image. The first preset condition can be defined as the intermediate image being or including a clear image, the intermediate image being or including a blurred image, or the intermediate image being or including a contour image.

[0299] For different optical elements or processing modules, the intermediate image types set by the preset conditions may be different. For example, for the first optical element, it is required to generate a contour image, so the first preset condition corresponding to the first optical element may be that the intermediate image is or includes a contour image. Based on this, the first preset condition may also be that the type of the intermediate image meets the expected target corresponding to the optical element or processing module; the expected target includes an expected type target.

[0300] In a specific embodiment, the first preset condition is related to the display effect of the intermediate image. The display effect of the intermediate image may be at least one of clarity, blur degree, and number of color channels. The first preset condition may be defined as the intermediate image being or including an image having a first blur degree; the first blur degree may be quantified according to a point spread function.

[0301] For different optical elements or processing modules, the intermediate image display effects set by the preset conditions may be different. For example, for the first optical element, it is required to generate an image with a first blur level, so the first preset condition corresponding to the first optical element may be that the intermediate image is or includes an image with a first blur level. Based on this, the first preset condition may also be that the type of the intermediate image meets the expected target corresponding to the optical element or processing module; the expected target includes the expected display target.

[0302] Regarding the expected target of the intermediate image, in some embodiments, it may also be an expected size target, an expected content target, etc.

[0303] The above steps S211 to S213B may be implemented as a separate configuration scheme to achieve separate verification and configuration of the optical element.

[0304] The above steps S211 to S213B can be implemented as part of step S2. Specifically, after the intermediate data is determined by executing steps S211 to S213A or steps S211 to S213B, the intermediate data is used as the intermediate data in step S2, and the step of "determining the evaluation value according to the intermediate data and the second data" is continued.

[0305] In one embodiment, the first preset condition may be a condition about the contour. When the intermediate image meets the first preset condition, the intermediate image is considered to be a contour image. When the intermediate image meets the first preset condition, the intermediate image is considered to include edge information.

[0306] In this embodiment, the configuration method of the optical system includes the following steps.

[0307] Step S2121, judging whether the intermediate image includes edge information according to the change of the pixel channel value.

[0308] If so, jump to step S2131A to determine whether the intermediate image meets the first preset condition regarding the contour.

[0309] The change value of the pixel channel value at the edge position in the intermediate image is greater than the preset change value. In the intermediate image, the change value of the pixel channel value at the edge position is greater than the preset change value.

[0310] The pixel channel value may be a value of a certain pixel channel in the intermediate image. For example, when the intermediate image is a grayscale image, the intermediate image has a single pixel channel, and the pixel channel value refers to the grayscale value. For another example, when the intermediate image is another image, the pixel channel value may refer to the brightness value.

[0311] In a specific embodiment, the pixel channel value refers to the brightness value. When it is determined that the intermediate image includes an area with obvious brightness changes, the change in the brightness value is greater than a preset change value. It can be determined that the area contains edge information and the area is an edge position. Therefore, it is determined that the intermediate image meets the preset conditions regarding the contour and that the intermediate image is a contour image.

[0312] The above steps S2121 to S2131A may be implemented as a separate configuration scheme to achieve separate verification and configuration of the optical element.

[0313] The above step S2121 may be included in step S212; the above step S2131A may be included in step S213A. Specifically, the first predetermined condition may include edge information; specifically, when it is determined that the intermediate image satisfies the first preset condition about the contour, it is considered that the intermediate image satisfies the first preset condition, thereby implementing the step of "executing the first program to process the intermediate image and obtain intermediate data".

[0314] When performing the above further configuration or technical feature combination, the steps not mentioned can still be implemented in the original order, such as step S213B.

[0315] In one embodiment, determining whether the intermediate image includes edge information may be implemented by an edge detection operator.

[0316] In this embodiment, the configuration method of the optical system includes the steps of: identifying points where the change in pixel channel values ​​is greater than a preset change value by an edge detection operator, and determining whether the intermediate image includes edge information.

[0317] In a specific embodiment, the edge detection operator includes at least one of a Sobel operator, a Prewitt operator or a Canny operator.

[0318] In one embodiment, the first preset condition may be a condition related to encryption. When the intermediate image meets the first preset condition, the intermediate image is considered to be an encrypted image.

[0319] In one embodiment, the first preset condition may be a condition related to blur display. When the intermediate image meets the first preset condition, the intermediate image is considered to be a blurry image.

[0320] In one embodiment, the first preset condition may be a condition related to clear display. When the intermediate image meets the first preset condition, the intermediate image is considered to be a clear image.

[0321] In one embodiment, the configuration method of the optical system includes the following steps.

[0322] Step S2122, determining whether the blur value of the intermediate image is greater than a preset blur value.

[0323] If so, jump to step S2132A to determine whether the intermediate image meets the first preset condition for encryption.

[0324] Thus, this embodiment provides a technical solution for achieving image encryption by adjusting the degree of image blur.

[0325] The blur value may be determined according to a point spread function value.

[0326] In one embodiment, the blur value of the intermediate image can be defined by calculating the difference between the point spread function value of the optical element corresponding to the intermediate image and the point spread function value of the optical element capable of generating a clear image. A preset blur value related to the difference can be set for the current optical element, and specifically by comparing the quantitative relationship between the blur value of the intermediate image and the preset blur value, it is determined whether the intermediate image meets the first preset condition for encryption.

[0327] In one embodiment, the blur value of the intermediate image may be defined by calculating the point spread function of the optical element corresponding to the intermediate image. A preset function value related to the point spread function may be set for the current optical element as the preset blur value, and specifically by comparing the point spread function value with the preset function value (that is, comparing the blur value of the current intermediate image with the preset blur value), it is determined whether the intermediate image satisfies the first preset condition for encryption.

[0328] The blur value may be determined according to a digital image blur algorithm based on grayscale values.

[0329] In one embodiment, the configuration method of the optical system further includes the steps of: determining a first pixel channel value of the intermediate image, performing a convolution operation on the first pixel channel value using a Laplace mask, and determining a blur value of the intermediate image.

[0330] This step is set before the step of using the ambiguity value in the configuration method. For example, it can be set before step S2122.

[0331] In a specific embodiment, the first pixel channel value may be a grayscale value.

[0332] Fig. 9 Some steps of a configuration method according to a specific embodiment of the present invention are provided. In this specific embodiment, the configuration method includes the following steps.

[0333] Step S221: inputting first data into an optical element, and determining a point spread function value of the optical element in response to the first data.

[0334] Step S222, determining whether the difference between the point spread function value and the standard function value satisfies a preset threshold condition.

[0335] If yes, jump to step S223A to execute the first program to process the intermediate image generated by the optical element corresponding to the first data to obtain intermediate data.

[0336] If not, jump to step S223B, update the configuration of the optical element until the re-determined point spread function value meets the preset threshold condition, execute the first program to process the intermediate image regenerated by the optical element, and obtain intermediate data.

[0337] In this way, the properties of the light signal transmission at the optical element can be judged and verified at the stage of the optical element processing the light signal to determine whether it meets the expected light field distribution effect. When the optical element and the first program are uniformly configured in combination with the above-mentioned technical solution, the light field distribution is first configured according to the target and then the system is uniformly configured, which helps to improve the convergence efficiency, realize the rapid configuration of the optical system, and ensure that the intermediate information (for example, the intermediate image) generated by the optical element can also meet expectations.

[0338] In one embodiment, the optical element includes at least one metasurface element; the configuration of the updated optical element may be the configuration of the metasurface element, which may specifically include at least one of the geometric structure, size or spatial arrangement of the nanostructure units used to constitute the metasurface.

[0339] In some embodiments, the optical element includes at least one refractive optical element, at least one diffractive optical element and / or at least one scattering medium element; the configuration of the updated optical element may be a configuration of a refractive optical element, a diffractive optical element and / or a scattering medium element.

[0340] In one embodiment, the standard function value and the preset threshold condition are determined according to the expected light field distribution. In a specific embodiment, the standard function value and the preset threshold condition are determined according to a preset blur level requirement for the intermediate image.

[0341] In one embodiment, the standard function value can be used to represent a preset blur level requirement. In one embodiment, the preset threshold condition is used to represent a preset error tolerance range.

[0342] In this embodiment, the difference between the point spread function value corresponding to the current optical element and the standard function value can be directly compared; when the difference meets the preset threshold condition, it means that the point spread function of the current optical element meets the allowable error range, and the steps of generating an intermediate image and obtaining intermediate data can continue to be executed; when the difference does not meet the preset threshold condition, it means that the point spread function of the current optical element does not meet the expected requirements, and the configuration of the optical element can be updated, that is, the optical element is first configured based on the point spread function, and then the optical element and / or the first program is configured based on the intermediate data and the second data.

[0343] In one embodiment, the standard function value can be used to characterize the performance of the optical element when performing clear imaging. In one embodiment, the preset threshold condition is used to characterize the preset blur level requirement.

[0344] In this embodiment, the difference between the point spread function value corresponding to the current optical element and the standard function value may be determined first, and the difference is used to characterize the actual blur degree corresponding to the current optical element.

[0345] When the difference meets the preset threshold condition, it means that the actual blur degree of the corresponding current optical element meets the preset blur degree requirement, and the steps of generating an intermediate image and obtaining intermediate data can be continued.

[0346] When the difference does not meet the preset threshold condition, it means that the actual blur degree corresponding to the current optical element does not meet the preset blur degree requirement, and the configuration of the optical element can be updated, that is, the optical element is first configured based on the difference between the point spread function and the standard function value, and then the optical element and / or the first program is configured based on the intermediate data and the second data.

[0347] In one embodiment, the difference between the point spread function value and the standard function value can be determined by the L2 norm, thereby judging whether the light field distribution meets expectations or judging whether the blur degree meets preset requirements.

[0348] In this embodiment, the configuration method of the optical system includes the following steps.

[0349] Step S2221, determining the L2 norm of the difference between the point spread function value and the standard function value.

[0350] Step S2222, determine whether the L2 norm falls within the fuzzy threshold range.

[0351] If so, jump to step S2231A to determine whether the point spread function value meets the preset threshold condition.

[0352] If not, jump to step S2231B to determine whether the point spread value meets the preset threshold condition.

[0353] The blur threshold interval is determined according to the blur level requirement set for the optical element.

[0354] In this way, the characteristic that the blur degree is positively correlated with the L2 norm can be utilized to determine whether the actual blur degree corresponding to the current optical element meets the requirements by judging the numerical relationship between the L2 norm and the blur threshold interval.

[0355] In one embodiment, the point spread function value corresponding to the optical element can be calculated and determined based on the scalar diffraction formula. In one embodiment, the standard function value can be calculated and determined based on the scalar diffraction formula.

[0356] In other embodiments, the point spread function value or the standard function value may also be determined by at least one of the following calculations:

[0357] (1) The wavefront aberration function based on geometric aberration is determined by calculating the wavefront expansion;

[0358] (2) Consider the optical system as a linear system and determine it using Fourier transform calculation;

[0359] (3) Determined by solving Maxwell's equations and simulating the propagation of electromagnetic waves using numerical methods in the time domain;

[0360] (4) When the boundary conditions are clear, it is determined by simulating the boundary propagation of the electromagnetic field;

[0361] (5) Use Zanik polynomials to fit the wavefront distortion and then calculate and determine based on this;

[0362] (6) The Monte Carlo method is used to calculate and determine the propagation path of light by simulating a large number of random sampling rays or wavefronts.

[0363] In one embodiment, the standard function value can be used to represent a preset blur level requirement.

[0364] In a specific embodiment, the standard function value can be determined by executing the following steps: according to the blur level requirement corresponding to the optical element, the standard function value is calculated based on the scalar diffraction formula.

[0365] In a specific embodiment, the standard function value can be determined by executing the following steps: obtaining a standard element that meets the blur degree requirements corresponding to the optical element, using first data as input of the standard element, determining the point spread function value of the standard element in response to the first data, and determining the standard function value based on the point spread function value.

[0366] In one embodiment, the standard function value can be used to characterize the performance of the optical element when performing clear imaging.

[0367] In a specific embodiment, the standard function value is determined based on the scalar diffraction formula according to the clarity requirement corresponding to the optical element.

[0368] In a specific embodiment, a standard element that meets the clarity requirements of the optical element is obtained, first data is used as input of the standard element, a point spread function value of the standard element in response to the first data is determined, and a standard function value is determined based on the point spread function value.

[0369] like Fig.10 , an embodiment of the present invention provides an identification method.

[0370] The method can be implemented by an optical system to achieve recognition of the target object.

[0371] The method can be implemented in the optical system in the form of computer instructions, control steps, operation steps, etc. For example, configuring the optical system according to the configuration information can be considered as an operation step, controlling the optical element to obtain the detection image can be considered as an operation step, controlling the processing module to process the detection image can be considered as a control step or computer instruction, and determining the detection information can be considered as a control step or computer instruction.

[0372] The optical system can be configured as the technical solution provided in any of the above embodiments.

[0373] For example, an optical system includes optical elements.

[0374] Combination Figure 2 As shown, the optical element may include at least one metasurface element, a refractive optical element, a diffractive optical element and / or a scattering medium element.

[0375] The optical system further includes a photosensitive element 13 .

[0376] In one embodiment, the optical element includes at least one metasurface element 11 .

[0377] In one embodiment, the metasurface element 11 is disposed on the light incident side of the photosensitive element 13 .

[0378] In one embodiment, the optical element is used to construct a collection module 10 , and the collection module 10 includes a photosensitive element 13 and a metasurface element 11 ; in a specific embodiment, the collection module 10 may further include a focusing lens 14 .

[0379] In a specific embodiment, the optical element or acquisition module 10 is used to generate an intermediate image according to the information input thereto. For example, the intermediate image may be a posture image; the posture image is an image carrying the posture feature of the target object; the posture feature may be a contour feature of the target object, or a node feature indicating a joint of the target object, or a connection line feature indicating a limb of the target object.

[0380] The optical system includes a processing module 12. The processing module 12 is coupled to the optical element. The processing module 12 is used to process data information from the optical element according to a first program. In one embodiment, the optical element includes a metasurface element 11, and the processing module 12 is coupled to the metasurface element 11, and is used to process data information from the metasurface element 11 according to the first program. In a specific embodiment, the optical system includes a photosensitive element 13, the metasurface element 11 is coupled to the photosensitive element 13, and the processing module 12 is coupled to the metasurface element 11 through the photosensitive element 13.

[0381] In one embodiment, when the first program is executed by the processing module, a neural network model is implemented. In a specific embodiment, the neural network model is a convolutional neural network model.

[0382] In a specific embodiment, when the first program is executed by the processing module, it is used to identify the target object according to the information input into the optical element; for example, to determine the corresponding posture recognition information of the target object.

[0383] If the optical element is used to generate a gesture image as an intermediate image, the first program, when executed by the processing module, is used to determine gesture recognition information corresponding to the target object according to the gesture image.

[0384] The identification method specifically includes at least one of the following steps.

[0385] Step P1, configuring the optical system according to configuration information obtained by a configuration method.

[0386] In one embodiment, the configuration method is implemented according to the configuration method of the optical system provided by any of the above technical solutions. The configured optical system has a more accurate and unified signal processing capability.

[0387] Step P2, controlling the optical element to obtain a detection image corresponding to the target object, and controlling the processing module to execute a first program to process the detection image and identify the target object.

[0388] The recognition method is used to recognize at least one of the body posture, gesture, object position, object posture, and gender of the target object. For related technical solutions, please refer to the description of the application scenario of the optical system above.

[0389] In one embodiment, the recognition method is used to determine the posture recognition information of the target object to achieve recognition of the target object. In this embodiment, the recognition method can be used to recognize body posture, hand gesture, object position, object posture, etc.

[0390] FIG. 11 (a) shows a target object in an embodiment, and FIG. 11 (b) shows a detection image corresponding to the target object. In this embodiment, the detection image may be a contour image; the detection image includes edge information. When a change value of a pixel channel value in the detection image is greater than a preset change value, it is determined that the position pointed to by the pixel channel is an edge position; the detection image includes edge information; the detection image is a contour image for showing the contour of the target object.

[0391] The pixel channel value may be a brightness value.

[0392] The change of the pixel channel value can be obtained by an edge detection operator, which includes at least one of a Sobel operator, a Prewitt operator or a Canny operator.

[0393] Fig.12 2 shows a detection image in an embodiment. In this embodiment, the detection image may be a posture image including nodes indicating joints of the target object; the detection image may be a posture image including connection lines indicating limbs of the target object.

[0394] In one embodiment, the head and torso of the target object may be marked with a first color, the left limb of the target object may be marked with a second color, and the right limb of the target object may be marked with a third color.

[0395] In one embodiment, Fig.12 The nodes and connecting lines in the Fig.12 The blurred image placed below is identified as the detection image. In this embodiment, the optical element is used to generate the blurred image, and the first program is used to generate information indicating limb movements and limb distribution, such as nodes and connecting lines, based on the blurred image.

[0396] In one embodiment, the recognition method provided by the present invention further includes: outputting and displaying the gesture recognition information. Fig.12 In the provided embodiment, when the gesture recognition information is the node or the connection line, the node or the connection line can be output and displayed on the detection image.

[0397] In one embodiment, the detection image may be a blurred image. The third target object in this embodiment has a normal sitting posture; the first program may determine that the sitting posture of the target object is a normal sitting posture based on the blurred image; and the information corresponding to the normal sitting posture may be the posture recognition information.

[0398] In one embodiment, the detection image may be a blurred image. Corresponding to the fourth target object in this embodiment, the target object has an abnormal sitting posture with tilted shoulders; the first program may determine that the target object's sitting posture is an abnormal sitting posture based on the blurred image; and the information corresponding to the abnormal sitting posture may be the posture recognition information.

[0399] Fig.13 FIG. 2 shows a detection image in an embodiment. In this embodiment, the detection image may be a blurred image. Fig.13 The target object has an upper body and an outstretched hand; the first program can determine the position of the human body and its hand based on the blurred image; for example, the movement of the human body's arm can be analyzed accordingly.

[0400] Fig.14FIG. 2 shows a detection image in an embodiment. In this embodiment, the detection image may be a blurred image. Fig.14 The target object has a hand showing a first gesture; the first program can determine the posture of the hand based on the blurred image; for example, information corresponding to the first gesture can be analyzed accordingly, where the first gesture is used to represent the number six.

[0401] Fig.15 FIG. 2 shows a detection image in an embodiment. In this embodiment, the detection image may be a blurred image. Fig.15 The target object has a hand showing a second gesture; the first program can determine the posture of the hand based on the blurred image; for example, the information corresponding to the second gesture can be analyzed accordingly, where the second gesture is used to express agreement (ok).

[0402] Fig.16 FIG. 2 shows a detection image in an embodiment. In this embodiment, the detection image may be a blurred image. Fig.16 The target object has a hand showing a third gesture; the first program can determine the posture of the hand based on the blurred image; for example, information corresponding to the third gesture can be analyzed accordingly, where the third gesture is used to represent a palm shape (palm).

[0403] Fig.17 FIG. 2 shows a detection image in an embodiment. In this embodiment, the detection image may be a blurred image. Fig.17 The target object has a hand showing a fourth gesture; the first program can determine the posture of the hand based on the blurred image; for example, information corresponding to the fourth gesture can be analyzed accordingly, where the fourth gesture is used to represent a fist.

[0404] The output display step may be arranged after obtaining the gesture recognition information in step P2, or may be arranged after step P2 as step P3.

[0405] In one embodiment, the recognition method provided by the present invention further includes: determining the difference between the posture recognition information and the standard posture, and outputting a comparison result or a posture correction instruction. For example, in the embodiment corresponding to the third target object and the fourth target object, by comparing the difference between the normal sitting posture and the abnormal sitting posture, the target object with the abnormal sitting posture can be instructed to adjust the shoulder posture.

[0406] The step of outputting the comparison result or the posture correction instruction may be arranged in step P2 or after step P2.

[0407] In summary, the present invention provides an evaluation value for evaluating the performance of an optical system by comprehensively considering the second data as the processing target of executing the first program corresponding to the first data, and the intermediate data as the current actual processing result of executing the first program corresponding to the first data, so as to adjust the configuration of the optical system. Therefore, it is possible to establish a relationship between the actual and the target based on the first data, so that the optical system can quickly update the configuration to achieve the desired goal. Because the first data serves as the input of the optical element in the optical system and the intermediate data serves as the output of the processing module in the optical system, the optical element and the processing module as a whole can be used as the configuration update object to prevent the accumulation of errors in each of them.

[0408] It should be understood that although this specification is described according to implementation modes, not every implementation mode contains only one independent technical solution. This description of the specification is only for the sake of clarity. Those skilled in the art should regard the specification as a whole. The technical solutions in each implementation mode may also be appropriately combined to form other implementation modes that can be understood by those skilled in the art.

[0409] The series of detailed descriptions listed above are only specific descriptions of feasible implementation methods of the present invention. They are not intended to limit the scope of protection of the present invention. Any equivalent implementation methods or changes that do not deviate from the technical spirit of the present invention should be included in the scope of protection of the present invention.

Claims

1. A method for configuring an optical system, characterized in that: The optical system comprises: Optical components; a processing module, coupled to the optical element, for processing data information from the optical element according to a first program; The configuration method comprises: Acquire sample data, including first data corresponding to input information of the optical element, and second data corresponding to information output when executing the first program; the second data is target data corresponding to the first data; wherein the first data includes a sample image, and the second data includes actual recognition information, and the actual recognition information is represented by actual features of the target object in the sample image; Inputting the first data into the optical element, executing the first program to obtain intermediate data, and determining the evaluation value based on the intermediate data and the second data; Based on the evaluation value, the configuration of the optical element is updated, or the configuration of the first program is updated, or both the configuration of the optical element and the configuration of the first program are updated, until the evaluation value meets the preset numerical condition, and the configuration information of the optical system is obtained, and the evaluation value is represented by the difference between the intermediate data and the second data.

2. The configuration method according to claim 1, characterized in that: The intermediate data includes predicted identification information corresponding to the sample image; the predicted identification information is characterized by features determined by a first program based on sample image calculations.

3. The configuration method according to claim 1, characterized in that: The configuration method comprises: inputting the first data into an optical element to generate an intermediate image; Determining whether the intermediate image meets a first preset condition; If yes, execute the first program to process the intermediate image to obtain intermediate data; If not, the configuration of the optical element is updated until the regenerated intermediate image meets the first preset condition, and the first program is executed to process the regenerated intermediate image to obtain intermediate data.

4. The configuration method according to claim 3, characterized in that: The configuration method comprises: According to the change of the pixel channel value, it is determined whether the intermediate image includes edge information; the change value of the pixel channel value at the edge position in the intermediate image is greater than the preset change value; If so, it is determined that the intermediate image meets the first preset condition about the contour.

5. The configuration method according to claim 4, characterized in that: The configuration method comprises: By using an edge detection operator to identify points where the change in pixel channel values ​​is greater than a preset change value, it is determined whether the intermediate image includes edge information; the edge detection operator includes at least one of a Sobel operator, a Prewitt operator or a Canny operator.

6. The configuration method according to claim 3, characterized in that: The configuration method comprises: Determine whether the blur value of the intermediate image is greater than a preset blur value, or determine whether the difference between the blur value of the intermediate image and the preset blur value satisfies a preset error condition; If so, it is determined that the intermediate image meets the first preset condition regarding encryption.

7. The configuration method according to claim 6, characterized in that: The configuration method comprises: A first pixel channel value of the intermediate image is determined, and a convolution operation is performed on the first pixel channel value using a Laplace mask to determine a blur value of the intermediate image.

8. The configuration method according to claim 1, characterized in that: The configuration method comprises: Inputting first data into the optical element, and determining a point spread function value of the optical element in response to the first data; Determine whether the difference between the point spread function value and the standard function value meets a preset threshold condition; If yes, executing the first program to process the intermediate image generated by the optical element corresponding to the first data to obtain the intermediate data; If not, the configuration of the optical element is updated until the re-determined point spread function value meets the preset threshold condition, and the first program is executed to process the intermediate image regenerated by the optical element to obtain intermediate data.

9. The configuration method according to claim 8, characterized in that: The configuration method comprises: Determine the L2 norm of the difference between the point spread function value and the standard function value; Determining whether the L2 norm falls within a blur threshold interval; the blur threshold interval is determined according to a blur degree requirement set for the optical element; If so, it is determined that the point spread function value satisfies a preset threshold condition; If not, it is determined that the point spread function value does not meet the preset threshold condition.

10. The configuration method according to claim 8, characterized in that: The standard function value is determined according to at least one of the following: According to the blur degree requirement corresponding to the optical element, the standard function value is determined based on the scalar diffraction formula; According to the clarity requirement corresponding to the optical element, the standard function value is determined based on the scalar diffraction formula; Obtaining a standard element that meets the blur level requirement corresponding to the optical element, using first data as input of the standard element, determining a point spread function value of the standard element in response to the first data, and determining a standard function value according to the point spread function value; A standard element that meets the definition requirement of the optical element is obtained, first data is used as input of the standard element, a point spread function value of the standard element in response to the first data is determined, and a standard function value is determined according to the point spread function value.

11. The configuration method according to claim 1, characterized in that: The optical system comprises: a first optical element; a second optical element; The processing module is coupled to the first optical element and the second optical element respectively, and is used to process data information from the first optical element and the second optical element according to a first program; The configuration method comprises: Based on the evaluation value, update the configuration of the first optical element, or update the configuration of the second optical element, or update the configuration of the first program, or update both the configuration of the first optical element and the configuration of the first program, or update both the configuration of the second optical element and the configuration of the first program, or update the configuration of the first optical element, the configuration of the second optical element, and the configuration of the first program, until the evaluation value meets a preset numerical condition, thereby obtaining configuration information of the optical system; The first optical element and the second optical element are arranged in different positions, or the first optical element and the second optical element are used to generate different intermediate images.

12. The configuration method according to claim 1, characterized in that: The optical element includes at least one metasurface element; The configuration method includes: based on the evaluation value, updating the configuration of the metasurface element, or updating the configuration of the first program, or updating both the configuration of the metasurface element and the configuration of the first program, until the evaluation value satisfies a preset numerical condition, thereby obtaining configuration information of the optical system; The configuration of the metasurface element includes at least one of the geometric structure, size or spatial arrangement of the nanostructure units constituting the metasurface; When the first program is executed, it is used to implement a first neural network model algorithm, and the configuration of the first program includes model parameters of the first neural network model; The evaluation value includes the loss value of the intermediate data and the second data.

13. The configuration method according to claim 1, characterized in that: The optical element comprises at least one refractive optical element, at least one diffractive optical element and / or at least one scattering medium element; The configuration method includes: based on the evaluation value, updating the configuration of the optical element, or updating the configuration of the first program, or updating both the configuration of the optical element and the configuration of the first program, until the evaluation value satisfies a preset numerical condition, thereby obtaining configuration information of the optical system; The configuration of the optical element includes at least one of the material, surface curvature, thickness, and surface shape of the refractive optical element. and / or, At least one of the surface roughness, particle distribution uniformity, frosting or acid etching depth, and thickness of the scattering medium element, and / or, at least one of the diffraction order of the diffractive optical element, the period of the microstructure, the height of the microstructure, and the refractive index; When the first program is executed, it is used to implement a first neural network model algorithm, and the configuration of the first program includes model parameters of the first neural network model; The evaluation value includes the loss value of the intermediate data and the second data.

14. A recognition method, characterized in that: Applied in an optical system, the optical system comprising: Optical components; a processing module, coupled to the optical element, for processing data information from the optical element according to a first program; The identification method comprises: configuring the optical system according to the configuration information obtained by the configuration method according to any one of claims 1 to 13; The optical element is controlled to obtain a detection image corresponding to the target object, and the processing module is controlled to execute a first program to process the detection image and identify the target object.

15. The identification method according to claim 14, characterized in that: The recognition method is used to determine the posture recognition information of the target object; the recognition method also includes: Outputting and displaying the gesture recognition information; and / or, Determine the difference between the posture recognition information and the standard posture, and output a comparison result or a posture correction instruction; The recognition method is used to recognize at least one of body posture, hand gesture, object position, and object posture.

16. An optical system, characterized in that: The optical system is configured according to the configuration information obtained by the configuration method according to any one of claims 1 to 13, or the optical system is used to implement the identification method according to any one of claims 14 to 15.

17. The optical system according to claim 16, characterized in that The optical system includes a photosensitive element; The optical element includes a metasurface element arranged on the light incident side of the photosensitive element.

18. The optical system according to claim 17, characterized in that A focusing lens is provided on the light incident side of the photosensitive element, at least for coupling data information to the photosensitive element.

19. The optical system according to claim 16, characterized in that The optical system comprises: a first optical element; A first processing module, coupled to the first optical element, for processing data information from the first optical element according to a first program; a second optical element; a second processing module, coupled to the second optical element, for processing data information from the second optical element according to the first program; The first optical element is used to generate a first intermediate image corresponding to the target object, and the second optical element is used to generate a second intermediate image corresponding to the target object; The first intermediate image is one of a clear image, a blurred image and a contour image, and the second intermediate image is another of a clear image, a blurred image and a contour image; or, the first intermediate image has a first degree of blur, and the second intermediate image has a second degree of blur different from the first degree of blur.

20. The optical system according to claim 16, characterized in that The optical system comprises: a first optical element; a second optical element; The first optical element is disposed at a first position relative to the target object, and the second optical element is disposed at a second position relative to the target object; The first direction is one of directly in front of the target object, directly to the left, directly to the right, directly below, and directly above. The second direction is another one of directly in front of the target object, directly to the left, directly to the right, directly below, and directly above.

Images