A four-dimensional imaging device and method based on a binocular polarization-sensitive superlens

Abstract

The present disclosure relates to a four-dimensional imaging device and method based on binocular polarization-sensitive superlens, wherein the device can include: a binocular polarization-sensitive superlens device including two monocular polarization-sensitive superlenses; a monocular polarization-sensitive superlens is a monocular superlens capable of separating different polarization components in incident light; wherein each monocular polarization-sensitive superlens includes a substrate and an array of unit structures distributed on the substrate, the array of unit structures includes a plurality of unit structures with anisotropy, and the distance between any two unit structures is less than a predetermined working wavelength; an image sensor for receiving transmitted light through the binocular polarization-sensitive superlens device and generating a target image, the target image being used to simultaneously extract three-dimensional spatial information and polarization information. The device in the present disclosure is small in size, light in weight, low in complexity, convenient to integrate into various application scenarios, and can simultaneously realize depth perception and polarization detection.

Description

Technical Field

[0001] This disclosure relates to the field of metalens technology, and in particular to a four-dimensional imaging device and method based on binocular polarization-sensitive metalens. Background Technology

[0002] With the ever-increasing demand for visual information in modern society, multidimensional optical imaging technology has gradually become an important research direction in the field of optics. Traditional two-dimensional imaging technology can only capture planar image information of objects and cannot fully describe the material composition, three-dimensional shape, surface morphology, and other features of objects. However, multidimensional imaging technology, by capturing additional information such as phase, depth, polarization, and spectrum, greatly improves the perception capability of optical imaging systems in complex environments.

[0003] Currently, traditional multidimensional optical imaging systems suffer from several significant drawbacks. First, their high complexity typically requires numerous optoelectronic components (such as lenses, filters, modulators, mechanical rotors, and image sensors), resulting in bulky size, high cost, difficulty in expansion, and low portability, making them unsuitable for complex real-world applications. Second, multidimensional optical imaging systems involve trade-offs between spatial resolution, temporal resolution, and the acquisition of multidimensional information (such as depth and polarization), hindering their application in real-time or high-resolution imaging. Furthermore, multidimensional optical imaging systems generally only perceive one additional dimension of information beyond the two-dimensional image; integrating multiple dimension perception capabilities into a single, compact, and efficient platform remains a challenge, further limiting the widespread practical application of multidimensional imaging systems.

[0004] With the development of nano-optics technology, metalenses have been introduced into the field of multidimensional imaging as a novel optical element. Metalenses are composed of subwavelength unit structures; by designing the geometry and planar distribution of these unit structures, the phase, amplitude, and polarization state of light can be controlled at subwavelength resolution. The main technological advantages of metalenses lie in their ultra-thin and ultra-lightweight nature, compatibility with semiconductor processes, and high degree of design freedom, making them highly promising for realizing high-performance and compact multidimensional imaging systems. In recent years, multidimensional imaging technology based on metalenses has gradually gained attention; however, existing metalens-based multidimensional imaging technologies cannot simultaneously perceive polarization and depth information. Summary of the Invention

[0005] In view of this, this disclosure proposes a four-dimensional imaging device based on a binocular polarization-sensitive meta-lens, a multi-dimensional information processing method, an electronic device, a storage medium, and a computer program product.

[0006] According to one aspect of this disclosure, a four-dimensional imaging device based on a binocular polarization-sensitive metalens is provided, the device comprising:

[0007] A binocular polarization-sensitive metalens device includes two monocular polarization-sensitive metalenses; each monocular polarization-sensitive metalens represents a monocular metalens capable of separating different polarization components in incident light; wherein each monocular polarization-sensitive metalens includes a substrate and an array of unit structures distributed on the substrate, the array of unit structures including multiple anisotropic unit structures, and the distance between any two unit structures is less than a preset operating wavelength.

[0008] An image sensor is used to receive transmitted light passing through the binocular polarization-sensitive metalens device and generate a target image, which is used to simultaneously extract three-dimensional spatial information and polarization information.

[0009] In one possible implementation, the two monocular polarization-sensitive metalenses in the binocular polarization-sensitive metalens device have identical structures and their optical axes are parallel to each other.

[0010] In one possible implementation, the substrate is fused silica glass, and the unit structure is an amorphous silicon rectangular pillar; wherein, any two unit structures in each monocular polarization-sensitive metalens have the same height, and at least one of the length, width, and rotation angle of any two unit structures is different; the height-corresponding direction is parallel to the optical axis of the monocular polarization-sensitive metalens, the length-corresponding direction and the width-corresponding direction are both perpendicular to the optical axis of the monocular polarization-sensitive metalens, and the rotation angle is the angle between the length-corresponding direction of the unit structure and a preset direction.

[0011] In one possible implementation, the rotation angle of the target unit structure satisfies:

[0012]

[0013] Where θ represents the rotation angle of the target unit structure, and (x,y) are the position coordinates of the target unit structure. The phase of the left-handed circularly polarized light in the target unit structure. The phase of right-hand circularly polarized light in the target unit structure; the target unit structure is any unit structure in the unit structure array;

[0014] The length and width of the target unit structure satisfy the following:

[0015]

[0016] in, The initial phase is the incident light of the circularly polarized light onto the target unit structure, and the initial phase is related to the length and width of the target unit structure.

[0017] In one possible implementation, the phase distributions of left-handed and right-handed circularly polarized light corresponding to any monocular polarization-sensitive metalens are as follows:

[0018]

[0019] Where (x, y) are the position coordinates of the target unit structure. The phase of left-handed circularly polarized light in the target unit structure, The phase of the right-hand circularly polarized light in the target unit structure is λ, where λ is the preset working wavelength. f ,y f ,z f (x) represents the preset position coordinates of the focal point of a monocular polarization-sensitive metalens for left-handed circularly polarized light. f ,-y f ,z f ) represents the preset position coordinates of the focal point of a monocular polarization-sensitive metalens for right-handed circularly polarized light.

[0020] In one possible implementation, the target image includes: a first sub-image corresponding to left-handed circularly polarized light, a second sub-image corresponding to right-handed circularly polarized light, a third sub-image corresponding to left-handed circularly polarized light, and a fourth sub-image corresponding to right-handed circularly polarized light; wherein the first sub-image and the second sub-image are generated by the same monocular polarization-sensitive metalens, and the third sub-image and the fourth sub-image are generated by the same monocular polarization-sensitive metalens.

[0021] In one possible implementation, the device further includes: an aperture and / or a displacement structure;

[0022] The aperture is used to control the light transmission range of the light beam entering the binocular polarization-sensitive metalens device;

[0023] The displacement structure is used to adjust the distance between the binocular polarization-sensitive metalens device and the image sensor.

[0024] According to another aspect of this disclosure, a multi-dimensional information processing method based on a binocular polarization-sensitive metalens is provided, the method comprising:

[0025] Acquire a target image, wherein the target image is a target image of the object under test acquired by the above-mentioned four-dimensional imaging device based on binocular polarization-sensitive metalens; the target image includes four sub-images;

[0026] The depth information of the measured object is determined by calculating the disparity value between the four sub-images;

[0027] The polarization information of the object under test is determined by calculating the light intensity differences between the four sub-images.

[0028] According to another aspect of this disclosure, a multi-dimensional information processing device based on a binocular polarization-sensitive metalens is provided, the device comprising:

[0029] The acquisition module is used to acquire a target image, wherein the target image is a target image of the object under test acquired by the above-mentioned four-dimensional imaging device based on binocular polarization-sensitive meta-lens; the target image includes four sub-images;

[0030] The calculation module is used to determine the depth information of the object under test by calculating the disparity value between the four sub-images; and to determine the polarization information of the object under test by calculating the light intensity difference between the four sub-images.

[0031] According to another aspect of this disclosure, an electronic device is provided, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the above-described method when executing instructions stored in the memory.

[0032] According to another aspect of this disclosure, a non-volatile computer-readable storage medium is provided that stores computer program instructions thereon, wherein the computer program instructions, when executed by a processor, implement the above-described method.

[0033] According to another aspect of this disclosure, a computer program product is provided, including computer-readable code, or a non-volatile computer-readable storage medium carrying computer-readable code, wherein when the computer-readable code is run in a processor of an electronic device, the processor in the electronic device performs the above-described method.

[0034] This disclosure discloses a four-dimensional imaging device based on a binocular polarization-sensitive metalens, comprising: a binocular polarization-sensitive metalens device and an image sensor; the binocular polarization-sensitive metalens device includes two monocular polarization-sensitive metalenses; each monocular polarization-sensitive metalens represents a monocular metalens capable of separating different polarization components in incident light; wherein each monocular polarization-sensitive metalens includes a substrate and an array of unit structures distributed on the substrate, the unit structure array including multiple anisotropic unit structures, and the distance between any two unit structures is less than a preset operating wavelength, thereby enabling the binocular polarization-sensitive metalens device to have polarization sensitivity. Simultaneously, the binocular polarization-sensitive metalens device is small in size and lightweight, facilitating integration into various application scenarios, especially in space-constrained scenarios, thus meeting the requirements for high integration and compactness. The image sensor is used to receive the transmitted light passing through the binocular polarization-sensitive metalens device and generate a target image, the target image being used to simultaneously extract three-dimensional spatial information and polarization information. Experimental results show that the four-dimensional imaging device based on binocular polarization-sensitive metalenses can accurately sense depth information even when the baseline distance between the two monocular polarization-sensitive metalenses is small, thus making it effective for dynamic sensing tasks in complex environments. At the same time, the sensitivity of the binocular polarization-sensitive metalenses to polarization enables the precise separation and detection of different polarization components in the incident light, providing an important basis for the analysis of the surface features and physicochemical properties of the object under test.

[0035] Other features and aspects of this disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0036] The accompanying drawings, which are included in and form part of this specification, illustrate exemplary embodiments, features, and aspects of this disclosure together with the specification and serve to explain the principles of this disclosure.

[0037] Figure 1 A structural diagram of a four-dimensional imaging device based on a binocular polarization-sensitive metalens according to an embodiment of the present disclosure is shown.

[0038] Figure 2 A schematic diagram showing a target image according to an embodiment of the present disclosure is provided.

[0039] Figure 3 A schematic diagram of the structure of a binocular polarization-sensitive metalens device according to an embodiment of the present disclosure is shown.

[0040] Figure 4 A structural diagram of a unit structure in a binocular polarization-sensitive metalens device according to an embodiment of the present disclosure is shown.

[0041] Figure 5A structural diagram of a four-dimensional imaging device based on a binocular polarization-sensitive metalens according to an embodiment of the present disclosure is shown.

[0042] Figure 6 A flowchart is shown for a multi-dimensional information processing method based on a binocular polarization-sensitive metalens according to an embodiment of the present disclosure.

[0043] Figure 7 A structural diagram of a multi-dimensional information processing device based on a binocular polarization-sensitive metalens according to an embodiment of the present disclosure is shown.

[0044] Figure 8 A block diagram of an electronic device 1900 according to an embodiment of the present disclosure is shown. Detailed Implementation

[0045] Various exemplary embodiments, features, and aspects of this disclosure will now be described in detail with reference to the accompanying drawings. The same reference numerals in the drawings denote elements that have the same or similar functions. Although various aspects of the embodiments are shown in the drawings, they are not necessarily drawn to scale unless specifically indicated otherwise.

[0046] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this disclosure include a particular feature, structure, or characteristic described in connection with that embodiment. Therefore, the terms "exemplary," "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in various parts of this specification, do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including, but not limited to," unless otherwise specifically emphasized.

[0047] In this disclosure, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can mean: A alone, A and B simultaneously, and B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.

[0048] Furthermore, to better illustrate this disclosure, numerous specific details are set forth in the following detailed description. Those skilled in the art will understand that this disclosure can be practiced without certain specific details. In some instances, methods, means, components, and circuits well known to those skilled in the art have not been described in detail in order to highlight the main points of this disclosure.

[0049] In multidimensional imaging technology, polarization and depth are two important information dimensions. The polarization state of light is significant in analyzing the material properties, surface roughness, and microstructure of objects; in complex scenes, polarization information is crucial for improving the accuracy of target detection and recognition. Depth information helps imaging systems understand the three-dimensional spatial structure of objects, supporting target localization and scene reconstruction in complex environments. Utilizing polarization and depth information to assist traditional imaging improves the applicability and robustness of imaging systems in complex environments, reduces the complexity of post-processing algorithms, and the comprehensive analysis of multidimensional information may also generate new useful information. In related technologies, simultaneously acquiring depth and polarization information often requires the cooperation of multiple complex optical devices, leading to increased complexity and cost of the imaging system. However, multidimensional imaging technology based on metalenses cannot achieve simultaneous perception of polarization and depth information. For example, polarization sensing or depth imaging based on a single metalens can only achieve three-dimensional imaging based on a planar image.

[0050] This disclosure proposes a four-dimensional imaging scheme based on binocular polarization-sensitive metalenses. By utilizing the unique advantages of metalenses and combining them with binocular polarization-sensitive metalens configuration, it enables the simultaneous acquisition of three-dimensional spatial and polarization information of the object under test. This satisfies the need for efficient acquisition of multi-dimensional information in complex application scenarios and solves the problems of large size, high complexity, high cost, and low imaging dimensionality of existing multi-dimensional imaging systems.

[0051] Figure 1 A structural diagram of a four-dimensional imaging device based on a binocular polarization-sensitive metalens according to an embodiment of the present disclosure is shown. Figure 1 As shown, the device may include: a binocular polarization-sensitive metalens device, comprising two monocular polarization-sensitive metalenses; each monocular polarization-sensitive metalens represents a monocular metalens capable of separating different polarization components in incident light; wherein each monocular polarization-sensitive metalens includes a substrate and an array of unit structures distributed on the substrate, the array of unit structures including multiple anisotropic unit structures, and the distance between any two unit structures being less than a preset operating wavelength; and an image sensor for receiving transmitted light through the binocular polarization-sensitive metalens device and generating a target image, the target image being used to simultaneously extract three-dimensional spatial information and polarization information.

[0052] In this design, two monocular polarization-sensitive metalenses are located on the same plane and have the same focal length. This allows the image sensor to simultaneously image the transmitted light passing through both monocular polarization-sensitive metalenses, resulting in a target image that includes the imaging area corresponding to each monocular polarization-sensitive metalens. The baseline distance between the two monocular polarization-sensitive metalenses can be set as needed; this baseline distance is the distance between the centers of the two monocular polarization-sensitive metalenses. For example, while ensuring clear and complete imaging of the imaging area corresponding to each monocular polarization-sensitive metalens, the baseline distance can be designed to be as short as possible to minimize the size of the binocular polarization-sensitive metalens device.

[0053] In one possible implementation, the two monocular polarization-sensitive metalenses in the binocular polarization-sensitive metalens device have identical structures and their optical axes are parallel. By combining two structurally identical monocular polarization-sensitive metalenses into a binocular polarization-sensitive metalens device, the image size within the imaging region corresponding to each monocular polarization-sensitive metalens in the target image generated by the image sensor is the same, thereby reducing the difficulty of subsequent image processing and improving the efficiency and accuracy of image processing. For example, high-precision semiconductor micro / nano fabrication processes can be used in the fabrication of the binocular polarization-sensitive metalens device to ensure the consistency of the two monocular polarization-sensitive metalenses, the parallelism of their optical axes, and that the baseline distance between the two monocular polarization-sensitive metalenses is the same as or has a small error compared to the design value.

[0054] For example, the two monocular polarization-sensitive metalenses are symmetrically distributed about the center of the binocular polarization-sensitive metalens device; in this way, the imaging areas corresponding to the two monocular polarization-sensitive metalenses are symmetrically distributed, which further reduces the difficulty of subsequent image processing and improves the efficiency and accuracy of image processing.

[0055] For example, the image sensor and the binocular polarization-sensitive metalens device are spaced apart, and the distance between them can be set according to requirements. Each monocular polarization-sensitive metalens can focus different polarized light onto different focal points. Thus, the incident light from the object under test in the external environment, after being transmitted through the binocular polarization-sensitive metalens device, can generate four independent sub-images on the image sensor, each containing a complete image of the object under test. Furthermore, by analyzing and processing the target images generated by the image sensor, multi-dimensional information such as the three-dimensional spatial information (including depth information and two-dimensional position information) and polarization information of the object under test can be extracted. The specific analysis and processing procedures are described in the relevant sections below.

[0056] In one possible implementation, the target image includes: a first sub-image corresponding to left-handed circularly polarized light, a second sub-image corresponding to right-handed circularly polarized light, a third sub-image corresponding to left-handed circularly polarized light, and a fourth sub-image corresponding to right-handed circularly polarized light; wherein the first sub-image and the second sub-image are generated by the same monocular polarization-sensitive metalens, and the third sub-image and the fourth sub-image are generated by the same monocular polarization-sensitive metalens. Figure 2 A schematic diagram showing a target image according to an embodiment of the present disclosure is shown, such as... Figure 2 As shown, with the direction of the incident light as a reference, the first and second sub-images are located in the imaging area corresponding to the monocular polarization-sensitive metalens on the left, and the third and fourth sub-images are located in the imaging area corresponding to the monocular polarization-sensitive metalens on the right. Among them, the first and third sub-images are both left-handed circularly polarized light imaging, and the second and fourth sub-images are both right-handed circularly polarized light imaging. In this way, each monocular polarization-sensitive metalens can separate the left-handed and right-handed circularly polarized light in the incident light and converge them to different focal points to generate sub-images corresponding to the left-handed and right-handed circularly polarized light, thereby forming a target image including four sub-images.

[0057] For example, the shape of the unit structure array, the arrangement of each unit structure in the unit structure array, the number of unit structures, and the material of the substrate in any monocular polarization-sensitive metalens can be set as required and are not limited thereto. For instance, the number of unit structures included in the unit structure array can be maximized while ensuring that the distance between any two unit structures is less than the preset working wavelength, thereby improving the imaging effect. Here, the working wavelength represents the specific wavelength or wavelength range of light beam that the binocular polarization-sensitive metalens device can effectively focus or control. The working wavelength determines the applicable range of the binocular polarization-sensitive metalens device. The working wavelength is usually closely related to the structural design of the binocular polarization-sensitive metalens device. Different structural designs can enable the binocular polarization-sensitive metalens device to work at different working wavelengths. Therefore, a suitable working wavelength can be predetermined according to specific application requirements, and then the structural parameters (such as width, length, height, rotation angle, etc.) of the binocular polarization-sensitive metalens device can be determined based on the preset working wavelength, thereby further fabricating the binocular polarization-sensitive metalens device. For example, the preset operating wavelength can be a single wavelength or a wavelength range, such as the visible light band, ultraviolet band, or infrared band.

[0058] For example, the shape, size, and material of each unit structure can be set according to requirements; for example, the shape of each unit structure can be rectangular, cross-shaped, cylindrical, etc. In one possible implementation, the substrate is fused silica glass, and the unit structure is an amorphous silicon rectangular pillar; wherein, any two unit structures in each monocular polarization-sensitive metalens have the same height, and at least one of the length, width, and rotation angle of any two unit structures is different; the height-corresponding direction is parallel to the optical axis of the monocular polarization-sensitive metalens, the length-corresponding direction and the width-corresponding direction are both perpendicular to the optical axis of the monocular polarization-sensitive metalens, and the rotation angle is the angle between the length-corresponding direction of the unit structure and a preset direction. In this way, any two unit structures have the same height, and the unit structures distributed in a two-dimensional array on the substrate form a monocular polarization-sensitive metalens; at the same time, at least one of the length, width, and rotation angle of any two unit structures is different, and the monocular polarization-sensitive metalens formed can provide different phase delays for left-handed and right-handed circularly polarized light, thereby achieving the separation of different polarization components in the incident light.

[0059] Figure 3 A schematic diagram of a binocular polarization-sensitive metalens device according to an embodiment of the present disclosure is shown. Figure 3 The image shows a front view (i.e., a view along the incident light direction) of a binocular polarization-sensitive superlens device. The device includes a substrate made of fused silica glass. Two identical monocular polarization-sensitive superlenses are symmetrically distributed on the substrate. Each monocular polarization-sensitive superlens comprises multiple amorphous silicon rectangular pillars (i.e., unit structures), with varying lengths, widths, and rotation angles. An independent coordinate system is established for each monocular polarization-sensitive superlens. The coordinate system for any monocular polarization-sensitive superlens has its origin at the center of that lens, its Z-axis along the optical axis, its X-axis along the line connecting the centers of the two lenses, and its Y-axis perpendicular to the line connecting the centers. The plane containing the X and Y axes is parallel to the plane of the substrate.

[0060] For example, the substrate portion corresponding to each monocular polarization-sensitive metalens can be divided into multiple substrate units of equal size and shape; wherein, each substrate unit corresponds to a unit structure. Taking an amorphous silicon rectangular pillar as an example, for any substrate unit at any position, after designing the length, width, height, and rotation angle corresponding to that position, a unit structure fixed to that substrate unit can be fabricated; wherein, the height corresponding to each position is the same, and the length, width, and rotation angle corresponding to each position are not exactly the same. Figure 4 This diagram illustrates a structural diagram of a unit structure in a binocular polarization-sensitive metalens device according to an embodiment of the present disclosure, as shown below. Figure 4 As shown, for any monocular polarization-sensitive metalens, the substrate unit is a hexagonal prism, and the unit structure is an amorphous silicon rectangular prism. The amorphous silicon rectangular prism is fixed on the hexagonal prism in a shape perpendicular to the substrate. The direction corresponding to the height (H) of the amorphous silicon rectangular prism is consistent with the direction of the Z-axis of the coordinate system of the monocular polarization-sensitive metalens. In the front view of the amorphous silicon rectangular prism, the lengths of the two intersecting sides of the rectangle are the length (Lx) and width (Ly). The angle between the direction corresponding to the length of the amorphous silicon rectangular prism and the positive direction of the X-axis (i.e., the preset direction) of the coordinate system of the monocular polarization-sensitive metalens is the rotation angle θ.

[0061] Taking an amorphous silicon rectangular pillar as an example, the length and width of the amorphous silicon rectangular pillar determine the transmission amplitude and initial phase of the incident circularly polarized light by the unit structure. The rotation angle of the amorphous silicon rectangular pillar determines the geometric phase of the incident circularly polarized light for this unit structure; the geometric phase can provide different phase delays for left-handed and right-handed circularly polarized light, thereby enabling the focusing of light with different polarizations. By designing the rotation angle of each unit structure, left-handed and right-handed polarized light can be focused to different positions on the imaging plane of the image sensor.

[0062] In one possible implementation, the rotation angle of the target unit structure satisfies:

[0063]

[0064] Where θ represents the rotation angle of the target unit structure, and (x,y) are the position coordinates of the target unit structure. The phase (i.e., geometric phase) of the left-handed circularly polarized light in the target unit structure. The phase of right-hand circularly polarized light in the target unit structure; the target unit structure is any unit structure in the unit structure array;

[0065] The length and width of the target unit structure satisfy the following:

[0066]

[0067] in, The initial phase is the incident light of the circularly polarized light onto the target unit structure, and the initial phase is related to the length and width of the target unit structure.

[0068] Thus, for any unit structure at any position, after determining the phases of left-handed and right-handed circularly polarized light at that unit structure, the rotation angle and the initial phase of the unit structure can be obtained. Furthermore, the length and width of the unit structure can be determined based on the initial phase, and the height of the unit structure can be preset. With the length, width, height, and rotation angle of the unit structure designed, an amorphous silicon rectangular pillar can be fabricated, thereby completing the design and fabrication of the unit structure at that position.

[0069] Since metalenses are composed of subwavelength unit structures, where a subwavelength unit structure refers to a structure whose structural parameters are equivalent to or smaller than the operating wavelength, taking an amorphous silicon rectangular pillar as an example, the length, width, and height of the amorphous silicon rectangular pillar need to be smaller than the preset operating wavelength. Therefore, after setting the operating wavelength in advance, a specific value smaller than the preset operating wavelength can be used as the height of each unit structure. Furthermore, after obtaining the initial phase of the unit structure, the length and width of each unit structure can be determined within a specific range smaller than the preset operating wavelength. For example, if the preset operating wavelength is 500nm, the length and width values ​​of the unit structure can be optimized and calculated within the range of 50-450nm to obtain the corresponding transmission amplitude and initial phase for different values. Then, the length and width values ​​that meet the initial phase can be selected to determine the length and width of each unit structure. For example, when the initial phase is satisfied, the length and width values ​​with higher transmission amplitude can be selected to improve the imaging effect.

[0070] In one possible implementation, the phase distributions of left-handed and right-handed circularly polarized light corresponding to any monocular polarization-sensitive metalens are as follows:

[0071]

[0072] Where (x, y) are the position coordinates of the target unit structure. The phase of left-handed circularly polarized light in the target unit structure, The phase of the right-hand circularly polarized light in the target unit structure is λ, where λ is the preset working wavelength. f ,y f ,z f (x) represents the preset position coordinates of the focal point of a monocular polarization-sensitive metalens for left-handed circularly polarized light. f ,-y f ,z f ) represents the preset position coordinates of the focal point of a monocular polarization-sensitive metalens for right-handed circularly polarized light.

[0073] For example, given a predetermined operating wavelength and focal coordinates, for any monocular polarization-sensitive metalens, the phases of left-handed and right-handed circularly polarized light at different positions of the unit structure are determined, thus obtaining a phase distribution. In this way, the monocular polarization-sensitive metalens can assign independent phase distributions to left-handed and right-handed circularly polarized light respectively. After determining the phase distribution, based on the phase distribution, the initial phase corresponding to the incident circularly polarized light on the unit structure at different positions is determined. Then, by adjusting the length and width of the unit structure until the initial phase is reached, the length and width at this point are taken as the length and width of the unit structure at that position. As an example, for a specific material, shape, and position, the initial phase of different structural parameters of the unit structure at a preset operating wavelength can be numerically simulated or experimentally measured. For example, the width can be kept constant while the length and / or width can be adjusted to obtain the length and width of the unit structure corresponding to the initial phase at the preset operating wavelength. In this way, for each working wavelength and focal point, the initial phase of the incident light at that working wavelength in each unit structure and the rotation angle of each unit structure can be determined. Then, by configuring the length and width of the unit structure through the initial phase, the structural parameters of each unit structure can be obtained.

[0074] This embodiment of the four-dimensional imaging device based on a binocular polarization-sensitive metalens includes: a binocular polarization-sensitive metalens device and an image sensor; the binocular polarization-sensitive metalens device includes two monocular polarization-sensitive metalenses; each monocular polarization-sensitive metalens represents a monocular metalens capable of separating different polarization components (such as left-handed circularly polarized light and right-handed circularly polarized light) in incident light; wherein, each monocular polarization-sensitive metalens includes a substrate and an array of unit structures distributed on the substrate, the array of unit structures includes multiple anisotropic unit structures, and the distance between any two unit structures is less than a preset working wavelength, thereby enabling the binocular polarization-sensitive metalens device to have polarization sensitivity. Simultaneously, the binocular polarization-sensitive metalens device is small in size and lightweight, facilitating integration into various application scenarios, especially in space-constrained scenarios, thus meeting the requirements of high integration and compactness. The image sensor is used to receive the transmitted light passing through the binocular polarization-sensitive metalens device and generate a target image, the target image being used to simultaneously extract three-dimensional spatial information and polarization information. Experimental results show that the four-dimensional imaging device based on binocular polarization-sensitive metalenses has an average relative error of less than 5% in 3D reconstruction. Even when the baseline distance between the two monocular polarization-sensitive metalenses is small, it can still perceive depth information with high precision, thus making it effective for dynamic perception tasks in complex environments. At the same time, the sensitivity of the binocular polarization-sensitive metalenses to polarization enables the precise separation and detection of different polarization components in the incident light, providing an important basis for the analysis of the surface features and physicochemical properties of the measured object.

[0075] Figure 5 A structural diagram of a four-dimensional imaging device based on a binocular polarization-sensitive metalens according to an embodiment of the present disclosure is shown. Figure 5 As shown, the device may include: a binocular polarization-sensitive metalens device, an image sensor, an aperture stop, and / or a displacement structure; wherein, the aperture stop is used to control the light transmission range of the light beam entering the binocular polarization-sensitive metalens device; and the displacement structure is used to adjust the distance between the binocular polarization-sensitive metalens device and the image sensor.

[0076] For example, the position of the aperture can be adjusted to optimize the depth of field of the optical system and reduce aberration effects, ensuring that only the effective beam from the object under test enters the binocular polarization-sensitive metalens device.

[0077] Among them, the binocular polarization-sensitive meta-lens device, the image sensor and the above-mentioned Figure 1 The binocular polarization-sensitive meta-lens device and image sensor are the same, so they will not be described again here.

[0078] Understandable, Figure 5 The device shown can be configured with other components as needed; for example, it can be configured with... Figure 5 The device casing shown.

[0079] In this embodiment, based on the configuration of a binocular polarization-sensitive metalens device and an image sensor, the light transmission range of the beam entering the binocular polarization-sensitive metalens device is controlled by an aperture stop, thereby improving the imaging quality; the relative position between the binocular polarization-sensitive metalens device and the image sensor is adjusted by a displacement structure to achieve optimal optical alignment and focus control, so as to adapt to the imaging requirements of different scenarios and working distances.

[0080] This disclosure also provides a multi-dimensional information processing method based on a binocular polarization-sensitive metalens. Exemplarily, this method can be executed by a processor, such as the central processing unit of an electronic device, or by a server or a cluster of servers.

[0081] Figure 6 A flowchart illustrating a multi-dimensional information processing method based on a binocular polarization-sensitive metalens according to an embodiment of the present disclosure is shown, such as... Figure 6 As shown, the method may include:

[0082] Step 601: Acquire the target image, wherein the target image is the target image of the object under test acquired by the above-mentioned four-dimensional imaging device based on binocular polarization-sensitive meta-lens; the target image includes four sub-images.

[0083] For example, the target image can be obtained through the above... Figure 1 or Figure 5 The image shown is acquired by a four-dimensional imaging device based on a binocular polarization-sensitive metalens.

[0084] For example, a four-dimensional imaging device with a pre-fabricated binocular polarization-sensitive metalens and the object under test can be placed in the experimental optical path. The object under test is illuminated by a light source, causing the object to emit incident light of a preset working wavelength of the binocular polarization-sensitive metalens. After the incident light is transmitted through the binocular polarization-sensitive metalens, the transmitted light is imaged in the image sensor to generate a target image.

[0085] In one possible implementation, the target image can be preprocessed; for example, the acquired target image can be denoised and corrected to facilitate subsequent depth reconstruction and polarization detection. As an example, the target image can first be denoised as a whole using Gaussian filtering, and then geometric distortion correction can be performed using calibration parameters.

[0086] Step 602: Determine the depth information of the object under test by calculating the disparity value between the four sub-images.

[0087] The disparity value represents the positional difference between corresponding points on the sub-images of two monocular polarization-sensitive metalenses corresponding to the same polarization state. For example, existing stereo matching algorithms can be used to calculate the disparity value.

[0088] For example, for two monocular polarization-sensitive metalenses corresponding to the same polarization state, feature point matching is performed in the same horizontal direction in the two sub-images to determine the corresponding feature points in the two sub-images, and then the disparity value is determined based on the coordinate values ​​of these two feature points.

[0089] For example, as mentioned above Figure 2 Taking the target image shown as an example, for the sub-images corresponding to the same polarization state by two monocular polarization-sensitive metalenses, the disparity value of these two sub-images can be calculated. For example, based on the sub-images corresponding to left-handed circular polarization by two monocular polarization-sensitive metalenses (i.e., the first sub-image and the third sub-image), the disparity value between these two sub-images can be calculated, thereby obtaining the depth of three-dimensional space.

[0090] In this way, the depth information of the measured object can be reconstructed by analyzing the disparity between different sub-images in the target image.

[0091] Step 603: Determine the polarization information of the object under test by calculating the light intensity difference between the four sub-images.

[0092] For example, the difference in light intensity between corresponding pixels in two sub-images in the imaging region corresponding to a monocular polarization-sensitive metalens can be calculated, and this difference in light intensity is the difference in polarization state of the corresponding pixels.

[0093] For example, as mentioned above Figure 2 Taking the target image shown as an example, for two sub-images in the imaging region corresponding to any monocular polarization-sensitive metalens, the light intensity difference between the two sub-images can be calculated, thereby determining the components of each circularly polarized light in the incident ray. For example, the light intensity difference between the first sub-image and the third sub-image can be calculated. If the intensity of left-handed circularly polarized light in the first sub-image is greater than that of right-handed circularly polarized light in the third sub-image, it indicates that the component of left-handed circularly polarized light in the incident ray is greater than that of right-handed circularly polarized light.

[0094] In this way, by comparing the light intensity differences between different sub-images, the polarization state of the surface of the object under test can be determined, thereby realizing polarization detection. The polarization information can then be used to analyze the surface features of the object under test and obtain the physical and chemical properties such as the material composition of the object under test.

[0095] In this embodiment, by processing the target image obtained from the binocular polarization-sensitive superlens four-dimensional imaging device, the simultaneous acquisition and comprehensive analysis of multi-dimensional information such as three-dimensional reconstruction and polarization information of the object under test are achieved, greatly improving the multidimensionality and information richness of the imaging. Furthermore, based on the multi-dimensional information, the material composition, three-dimensional shape, surface morphology, and other characteristics of the object under test can be further determined, thereby meeting different needs.

[0096] Based on the same inventive concept in the above method embodiments, the present disclosure also provides a multi-dimensional information processing device based on a binocular polarization-sensitive metalens, which can be used to execute the technical solutions described in the above method embodiments.

[0097] Figure 7 This diagram illustrates a structural diagram of a multi-dimensional information processing device based on a binocular polarization-sensitive metalens according to an embodiment of the present disclosure, such as... Figure 7 As shown, the device may include:

[0098] The acquisition module 701 is used to acquire a target image, wherein the target image is a target image of the object under test acquired by the above-mentioned four-dimensional imaging device based on binocular polarization-sensitive meta-lens; the target image includes four sub-images;

[0099] The calculation module 702 is used to determine the depth information of the object under test by calculating the disparity value between the four sub-images; and to determine the polarization information of the object under test by calculating the light intensity difference between the four sub-images.

[0100] In this embodiment, by processing the target image obtained from the binocular polarization-sensitive superlens four-dimensional imaging device, the simultaneous acquisition and comprehensive analysis of multi-dimensional information such as three-dimensional reconstruction and polarization information of the object under test are achieved, greatly improving the multidimensionality and information richness of the imaging. Furthermore, based on the multi-dimensional information, the material composition, three-dimensional shape, surface morphology, and other characteristics of the object under test can be further determined, thereby meeting different needs.

[0101] In some embodiments, the functions or modules of the apparatus provided in this disclosure can be used to perform the methods described in the above method embodiments. The specific implementation can be referred to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0102] This disclosure also proposes a computer-readable storage medium storing computer program instructions that, when executed by a processor, implement the above-described method. The computer-readable storage medium can be volatile or non-volatile.

[0103] This disclosure also proposes an electronic device, including: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to implement the above method when executing the instructions stored in the memory.

[0104] This disclosure also provides a computer program product, including computer-readable code, or a non-volatile computer-readable storage medium carrying computer-readable code, wherein when the computer-readable code is run in a processor of an electronic device, the processor in the electronic device performs the above-described method.

[0105] Figure 8 A block diagram of an electronic device 1900 according to an embodiment of the present disclosure is shown. For example, the electronic device 1900 may be provided as a server or a terminal device. (Refer to...) Figure 8 The electronic device 1900 includes a processing component 1922, which further includes one or more processors, and memory resources represented by memory 1932 for storing instructions, such as application programs, that can be executed by the processing component 1922. The application programs stored in memory 1932 may include one or more modules, each corresponding to a set of instructions. Furthermore, the processing component 1922 is configured to execute instructions to perform the methods described above.

[0106] Electronic device 1900 may also include a power supply component 1926 configured to perform power management of electronic device 1900, a wired or wireless network interface 1950 configured to connect electronic device 1900 to a network, and an input / output interface 1958 (I / O interface). Electronic device 1900 can operate on an operating system, such as Windows Server, stored in memory 1932. TM Mac OS X TM Unix TM Linux TM FreeBSD TM Or similar.

[0107] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 1932 including computer program instructions that can be executed by a processing component 1922 of an electronic device 1900 to perform the above-described method.

[0108] This disclosure can be a system, method, and / or computer program product. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of this disclosure.

[0109] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination thereof. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0110] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0111] Computer program instructions used to perform the operations of this disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), is personalized by utilizing the status information of the computer-readable program instructions to implement various aspects of this disclosure.

[0112] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0113] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0114] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0115] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0116] The various embodiments of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or technical improvements to the embodiments in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. A four-dimensional imaging device based on a binocular polarization-sensitive metalens, characterized in that, The device includes: A binocular polarization-sensitive metalens device includes two monocular polarization-sensitive metalenses; each monocular polarization-sensitive metalens represents a monocular metalens capable of separating different polarization components in incident light; wherein each monocular polarization-sensitive metalens includes a substrate and an array of unit structures distributed on the substrate, the array of unit structures including multiple anisotropic unit structures, and the distance between any two unit structures is less than a preset operating wavelength. An image sensor is used to receive transmitted light through the binocular polarization-sensitive meta-lens device and generate a target image, which is used to simultaneously extract three-dimensional spatial information and polarization information. The substrate is fused silica glass, and the unit structure is an amorphous silicon rectangular pillar. In each monocular polarization-sensitive metalens, any two unit structures have the same height, and at least one of the length, width, or rotation angle of any two unit structures is different. The height-corresponding direction is parallel to the optical axis of the monocular polarization-sensitive metalens, the length-corresponding direction and the width-corresponding direction are both perpendicular to the optical axis of the monocular polarization-sensitive metalens, and the rotation angle is the angle between the length-corresponding direction of the unit structure and a preset direction. The rotation angle of the target unit structure satisfies: in, This indicates the rotation angle of the target unit structure. The coordinates are the position coordinates of the target unit structure. The phase of the left-handed circularly polarized light in the target unit structure. The phase of right-hand circularly polarized light in the target unit structure; the target unit structure is any unit structure in the unit structure array; The length and width of the target unit structure satisfy the following: in, The initial phase is the incident light of circularly polarized light onto the target unit structure, and the initial phase is related to the length and width of the target unit structure. The phase distributions of left-handed and right-handed circularly polarized light corresponding to any monocular polarization-sensitive metalens are as follows: in, The coordinates are the position coordinates of the target unit structure. The phase of left-handed circularly polarized light in the target unit structure, The phase of right-handed circularly polarized light in the target unit structure. For the preset working wavelength, (x f , y f , z f (x) represents the preset position coordinates of the focal point of a monocular polarization-sensitive metalens for left-handed circularly polarized light. f ,-y f , z f ) represents the preset position coordinates of the focal point of a monocular polarization-sensitive metalens for right-handed circularly polarized light.

2. The apparatus according to claim 1, characterized in that, The two monocular polarization-sensitive metalenses in the binocular polarization-sensitive metalens device have the same structure and their optical axes are parallel to each other.

3. The apparatus according to claim 1, characterized in that, The target image includes: a first sub-image corresponding to left-handed circularly polarized light, a second sub-image corresponding to right-handed circularly polarized light, a third sub-image corresponding to left-handed circularly polarized light, and a fourth sub-image corresponding to right-handed circularly polarized light; wherein the first sub-image and the second sub-image are generated by the same monocular polarization-sensitive metalens, and the third sub-image and the fourth sub-image are generated by the same monocular polarization-sensitive metalens.

4. The apparatus according to claim 1, characterized in that, The device further includes: an aperture and / or a displacement structure; The aperture is used to control the light transmission range of the light beam entering the binocular polarization-sensitive metalens device; The displacement structure is used to adjust the distance between the binocular polarization-sensitive metalens device and the image sensor.

5. A multi-dimensional information processing method based on a binocular polarization-sensitive metalens, characterized in that, The method includes: Acquire a target image, wherein the target image is a target image of the object under test acquired by the four-dimensional imaging device based on a binocular polarization-sensitive metalens according to any one of claims 1-4; the target image includes four sub-images; The depth information of the measured object is determined by calculating the disparity value between the four sub-images; The polarization information of the object under test is determined by calculating the light intensity differences between the four sub-images.

6. An electronic device, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to implement the method of claim 5 when executing instructions stored in the memory.

7. A non-volatile computer-readable storage medium storing computer program instructions thereon, characterized in that, When the computer program instructions are executed by the processor, they implement the method of claim 5.

Images