Pinhole compound eye system, manufacturing method thereof and method for detecting object

By adopting a honeycomb hemispherical structure combining pinhole arrays and nanowire arrays in lensless artificial compound eyes, the problems of limited imaging capabilities and poor deformation stability in the prior art are solved, and an efficient robot vision system is realized, supporting Ultra-wide-angle field of view and stereo vision applications.

CN119002083APending Publication Date: 2024-11-22THE HONG KONG UNIV OF SCI & TECH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410618001.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-05-18
Filing Date
2024-05-17
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

During the manufacturing process of the existing lensless artificial compound eye system, there is a complex transfer process that is limited by difficult to control uniformity, resulting in the three-dimensional optical structure not matching the planar imager and poor deformation stability, which affects the functional display of the robot vision system.

Method used

Using a honeycomb hemispherical structure combining pinhole arrays and nanowire arrays, pinhole arrays are manufactured by 3D printing, and perovskite and metal nanowires are grown in the hemispherical membrane template to form a high-density nanowire array to realize pinholes Assembly and function of compound eye system.

Benefits of technology

It realizes ultra-wide-angle panoramic image acquisition with a 140° field of view, supports binocular stereo vision, and successfully realizes motion tracking and target positioning on the drone, demonstrating its stable and effective application in the robot system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119002083A_ABST
    Figure CN119002083A_ABST
Patent Text Reader

Abstract

Pinhole compound eye (PHCE) systems, methods of making the same, and methods for detecting an object are provided. A pinhole compound eye (PHCE) system includes: a pinhole array including a plurality of pinholes, where the pinhole array is configured to receive light from different angles of incidence; and a detector array including a plurality of nanowires, where the detector array is located at the concave surface of the pinhole array and is configured to detect light passing through the pinhole array.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the benefit of U.S. Provisional Application No. 63 / 502,922, filed on May 18, 2023, entitled “ULTRA-WIDE FIELD-OF-VIEWPINHOLE COMPOUND EYE USING HEMISPHERICAL NANOWIRE ARRAY FOR ROBOTIC VISION,” the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present disclosure relates generally to vision technology, and more particularly, to a lensless artificial compound eye system. Background Art

[0004] There are different biological visual systems in nature. Natural compound eyes (CEs) with extraordinary visual capabilities, such as wide field of view (FOV) and fast motion tracking, offer great appeal for practical applications, especially robotic system applications. Inspired by this, a large number of artificial CEs have been extensively explored, which are mainly fabricated by transferring microlens arrays (MLAs) onto curved substrates and further integrated with commercial planar image sensors. In this case, the imaging capability of CEs is highly limited by the complex transfer process, which is difficult to control uniformity. Moreover, it inevitably leads to a mismatch between the three-dimensional (3D) optical structure and the underlying commercial planar imager.

[0005] To improve this problem, two promising preparation strategies have been explored based on advanced micro-nano manufacturing and soft electronics technologies. In one approach, an optical structure with MLA is precisely formed on a curved surface by photopolymerization, laser writing, laser-assisted etching, microfluidic-assisted molding or 3D printing. The optical structure is further assembled on a planar imager with the help of complex waveguide units and expensive lens systems. In another approach, deformable electronics enable the entire composite system to be transformed into a curved shape via elastic transfer, origami or paper cutting. This partially solves the mismatch problem, but still brings the following challenges: deformation stability, limited number of pixels, and large unused space between imaging pixels for stress release. For example, direct deformation into a hemispherical structure produces large residual stress, which is considered to be a source of mechanical instability for a working CE. Limited by the above bottlenecks, there are very few reports on the functional demonstration of autonomous platforms (such as robots or drones) integrated with compact CE systems. Summary of the invention

[0006] A first aspect of the present disclosure provides a pinhole compound eye (PHCE) system, which includes: a pinhole array, including a plurality of pinholes, wherein the pinhole array is configured to receive light from different incident angles; and a detector array, including a plurality of nanowires, wherein the detector array is located at a concave surface of the pinhole array and is configured to detect light passing through the pinhole array.

[0007] According to an embodiment of the first aspect, the array of pinholes is defined within a honeycomb hemispherical structure.

[0008] According to an embodiment of the first aspect, a honeycomb hemispherical structure having an array of pinholes is 3D printed.

[0009] According to an embodiment of the first aspect, the plurality of nanowires are within the plurality of holes within the hemispherical membrane template.

[0010] According to an embodiment of the first aspect, the hemispherical membrane template is a hemispherical porous alumina membrane (PAM), and each hole in the plurality of holes corresponds to a subset of nanowires in the plurality of nanowires.

[0011] According to an embodiment of the first aspect, each nanowire of the plurality of nanowires comprises a perovskite nanowire portion and a metal nanowire portion.

[0012] According to an embodiment of the first aspect, the perovskite nanowire portion is located near the pinhole array and the metal nanowire portion is connected to a control circuit.

[0013] According to an embodiment of the first aspect, each nanowire of the plurality of nanowires is aligned with a corresponding pinhole of the plurality of pinholes, and each pinhole is associated with a pixel of the detector array.

[0014] According to an embodiment of the first aspect, the detector array comprises a plurality of pixels corresponding to a plurality of pinholes in the pinhole array, the plurality of pixels being connected to the control circuit via a plurality of contact points, and each pixel of the plurality of pixels corresponding to a contact point of the plurality of contact points.

[0015] According to an embodiment of the first aspect, each nanowire is arranged to receive light from the corresponding pinhole and one or more adjacent pinholes of the plurality of pinholes.

[0016] According to an embodiment of the first aspect, the PHCE system further comprises: a control circuit connected to the detector array and configured to obtain detection results from the detector array, wherein the control circuit comprises a readout circuit configured to read current response values ​​generated from the plurality of nanowires in the detector array based on light detected by the plurality of nanowires.

[0017] According to an embodiment of the first aspect, the pinhole array is a first pinhole array and the detector array is a first detector array, and the PHCE system further comprises: a second pinhole array comprising a plurality of distributed pinholes, wherein the second pinhole array is configured to receive light from different incident angles; a second detector array comprising a plurality of nanowires, wherein the second detector array is located at a concave surface of the second pinhole array and is configured to detect light passing through the second pinhole array; and a frame, wherein the first pinhole array having the corresponding first detector array mounted thereon and the second pinhole array having the corresponding second detector array mounted thereon are mounted on the frame.

[0018] According to an embodiment of the first aspect, a first pinhole array with a corresponding first detector array installed corresponds to a first field of view, a second pinhole array with a corresponding second detector array installed corresponds to a second field of view, and the first field of view and the second field of view have an overlapping area.

[0019] A second aspect of the present disclosure provides a method for manufacturing a pinhole compound eye (PHCE) system, the method comprising: manufacturing a hemispherical structure including a pinhole array, the pinhole array having a plurality of pinholes distributed along the surface of the hemispherical structure; manufacturing a hemispherical membrane template, the hemispherical membrane template including a plurality of holes distributed along the surface of the hemispherical membrane template; growing nanowires inside the plurality of holes of the hemispherical membrane template to form a nanowire array; assembling the hemispherical structure and the hemispherical membrane template by aligning the pinhole array with the nanowire array; and manufacturing a plurality of contact points in the hemispherical membrane template connected to the nanowire array.

[0020] According to an embodiment of the second aspect, the hemispherical structure is a honeycomb hemispherical structure, and the hemispherical structure having the pinhole array is 3D printed.

[0021] According to an embodiment of the second aspect, growing nanowires inside multiple holes of a hemispherical film template to form a nanowire array includes: growing metal nanowires inside multiple holes of the hemispherical film template; and growing perovskite nanowires on the metal nanowires inside the multiple holes of the hemispherical film template.

[0022] According to an embodiment of the second aspect, the method further comprises fabricating a common electrode layer on the perovskite nanowires within the hemispherical film template, wherein a plurality of contact points are coupled to the remaining metal nanowires within the hemispherical film template.

[0023] According to an embodiment of the second aspect, the common electrode layer comprises indium tin oxide (ITO), and the plurality of contact points are made of indium.

[0024] A third aspect of the present disclosure provides a method for detecting an object, the method comprising: receiving light via a pinhole array (PHA) of a pinhole compound eye (PHCE) system, wherein corresponding pinholes of the pinhole array receive light corresponding to different incident angles; detecting a light intensity distribution across multiple pixels associated with the PHA through a nanowire array of the PHCE system; and constructing an image frame based on the detected light intensity distribution across the multiple pixels.

[0025] According to an embodiment of the third aspect, one or more nanowires in the nanowire array are aligned with corresponding pinholes of the PHA, and wherein each pinhole of the PHA is associated with one or more pixels of the plurality of pixels. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1A is a block diagram of an exemplary visual system according to one or more exemplary embodiments of the present disclosure.

[0027] Figure 1B is a block diagram of an exemplary pinhole compound eye (PHCE) system according to one or more exemplary embodiments of the present disclosure.

[0028] Figure 1C is a block diagram of an exemplary computing system in accordance with one or more exemplary embodiments of the present disclosure.

[0029] Figure 1D is a block diagram of an exemplary user interface (UI) according to one or more exemplary embodiments of the present disclosure.

[0030] Figure 2A An exemplary PHCE device is shown in accordance with one or more exemplary embodiments of the present disclosure.

[0031] Figure 2B According to one or more exemplary embodiments of the present disclosure Figure 2A Exploded view of an exemplary PHCE device.

[0032] Figure 2C According to one or more exemplary embodiments of the present disclosure, Figure 2A An enlarged cross-sectional view of the framed portion shown in FIG.

[0033] Figure 2D is a side view image of a PHCE system mounted on a printed circuit board according to one or more exemplary embodiments of the present disclosure.

[0034] Figure 3 is a scanning electron microscope (SEM) image of a hemispherical porous alumina membrane (PAM) having nanowires grown therein according to one or more exemplary embodiments of the present disclosure.

[0035] Figure 4 is a process flow for fabricating a nanowire (NW) array detector according to one or more exemplary embodiments of the present disclosure.

[0036] FIG. 5A to FIG. 5F It is a characteristic of various perovskite materials.

[0037] Figure 6 is an exemplary layout of pinholes in a pinhole array (PHA) according to one or more exemplary embodiments of the present disclosure.

[0038] Fig. 7A and Figure 7B is a characteristic of a PHA according to one or more exemplary embodiments of the present disclosure.

[0039] Fig. 8A An exemplary measuring device of a monocular vision system according to one or more exemplary embodiments of the present disclosure is shown.

[0040] Figure 8B is an exemplary visualization of measurement results of a field of view according to one or more exemplary embodiments of the present disclosure.

[0041] Figure 8C and Fig.8D Is caused by Fig. 8A Visualization of an exemplary pattern captured by a monocular vision system with a measuring device shown in FIG.

[0042] Fig.9A An exemplary binocular vision system according to one or more exemplary embodiments of the present disclosure is shown.

[0043] Fig. 9B The working principle of a binocular vision system according to one or more exemplary embodiments of the present disclosure is shown.

[0044] Fig. 9C The calculated spatial position and resulting movement path based on the measurements made by the binocular vision system are shown.

[0045] Fig.9D The working principle of motion tracking on a drone according to one or more exemplary embodiments of the present disclosure is shown.

[0046] Fig. 10A is an image of a drone integrated with a PHCE system according to one or more exemplary embodiments of the present disclosure.

[0047] FIG. 10B to FIG. 10D The digital image is combined with Fig. 10A The current map shown in the figure is taken by a drone with a PHCE system at different times for comparison.

[0048] Fig.11Ais an image of a PHCE system with exemplary control circuits according to one or more exemplary embodiments of the present disclosure.

[0049] Fig. 11B is a block diagram illustrating various components in a control circuit according to one or more exemplary embodiments of the present disclosure. DETAILED DESCRIPTION

[0050] An exemplary embodiment of the present application provides a lensless artificial compound eye (CE) vision system, which includes a pinhole array (PHA) optical component and an internal convex hemispherical image sensor, which includes a high-density perovskite nanowire array (PNA). The PHA is formed into a honeycomb profile and forms a conformal contact with the hemispherical imaging subsystem below. The imager with PNA is further combined and designed to cover the visible and near-infrared spectral ranges with good performance. The integrated pinhole compound eye (PHCE) system can acquire ultra-wide-angle panoramic images with a field of view (FOV) of 140°.

[0051] In addition, the present application provides a binocular PHCE system that provides a widened FOV of 220° and achieves stereoscopic vision. The binocular PHCE system has successfully achieved target positioning in three-dimensional (3D) space. In an embodiment, the functional integration of the PHCE system on a flying drone has been demonstrated, enabling motion tracking of a quadruped robot on the ground. This unique air-ground collaborative robot interaction demonstrates the potential for the future use of the compound eye system disclosed in the present invention to develop multi-robot collaboration and robot swarming technology.

[0052] Figure 1A is a block diagram of an exemplary visual system according to one or more exemplary embodiments of the present disclosure. Figure 1A As shown in , the visual system 100 includes various hardware components and software components, such as one or more compound eye systems 110, a computing system 150, and a user interface (UI) 180. As shown in FIG. Figure 1B As further described, the compound eye system 110 includes various optical and electronic components to detect visual information of a scene and transmit the acquired data. Figure 1C, describes in more detail an exemplary computing system 150 configured to process visual data (e.g., captured images) from the compound eye system 110. The computing system 150 may employ various algorithms to implement appropriate data processing. For example, the computing system 150 may construct an image of a scene based on visual information acquired within the field of view of the compound eye system 110. In some examples, the constructed image may be a panoramic image. In a further example, the computing system 150 may detect the motion / position of a target object based on the constructed image. This may enable tracking of a target object in a scene. For example, the computing system 150 may generate one or more instructions to control the posture / position of the compound eye system 110 (e.g., via a mobile platform such as a drone, a robotic arm, etc.) to follow the movement of a target object. Reference Figure 1D An exemplary UI 180 that enables interaction between a user and vision system 100 is described.

[0053] By way of example and not limitation, vision system 100 and / or computing system 150 may include or be implemented as a personal computer (“PC”), a laptop computer, a mobile device, a smart phone, a tablet computer, a virtual reality headset, a video player, a camera, a vehicle, a virtual machine, a drone, a robot, a handheld communication device, an onboard computer system, an embedded system controller, a workstation, an edge device, any combination of the illustrated devices, or any other suitable device.

[0054] The visual system 100 can operate in a suitable network environment. Components of the network environment can communicate with each other via a network, which can be wired, wireless, or both. As an example, the network can include one or more wide area networks ("WANs"), one or more local area networks ("LANs"), one or more public networks (such as the Internet), and / or one or more private networks. In the case where the network includes a wireless telecommunications network, components such as base stations, communication towers, access points, or other components can provide wireless connections.

[0055] Compatible network environments may include one or more peer-to-peer network environments and one or more client-server network environments, wherein in the case of a peer-to-peer network environment, a server may not be included in the network environment; in the case of a client-server network environment, one or more servers may be included in the network environment. In a peer-to-peer network environment, the functions described herein for the server may be implemented on any number of client devices. In at least one embodiment, the network environment may include one or more cloud-based network environments, distributed computing environments, combinations thereof, and the like.

[0056] A cloud-based network environment can provide cloud computing and / or cloud storage that performs any combination of the computing and / or data storage functions (or a portion or more thereof) described herein. Any of these various functions can be distributed across multiple locations from a central or core server (e.g., one or more data centers that can be distributed across states, regions, countries, the world, etc.). A cloud-based network environment can be private (e.g., limited to a single organization), public (e.g., available to many organizations), and / or a combination thereof (e.g., a hybrid cloud environment).

[0057] Figure 1B is a block diagram of an exemplary pinhole compound eye (PHCE) system according to one or more exemplary embodiments of the present disclosure. Figure 1B The PHCE system is implemented as follows Figure 1A The exemplary compound eye system 110 shown in FIG. PHCE system 110 includes various hardware and software components (such as optical and electrical components and codes and instructions) to implement the functions described in the present disclosure. Figure 1B As shown in FIG. 1 , the PHCE system 110 includes a pinhole array (PHA) 120, a nanowire (NW) array imager 130, and a control circuit 140, as well as other suitable components.

[0058] The PHA 120 includes a plurality of pinholes distributed along a curved surface. In an optical system, pinholes are used to control the amount and direction of light entering the system. For example, the pinhole can be used as a spatial filter, allowing only light that passes through the pinhole to continue to reach the image plane or the sensing element of the detector. This helps to improve image sharpness, reduce aberrations, and control the depth of field of the resulting image. That is, the PHA 120 is used to control the incident light entering the PHCE system 110. In some embodiments, the curved surface is the surface of a hemispherical structure. The incident light enters the PHCE system 110 from the convex surface, while the sensing element (e.g., a nanowire (NW) array imager 130) receives light output from the concave surface of the hemispherical structure.

[0059] As will be further described in detail below, the NW array imager 130 includes a plurality of perovskite nanowires for detecting optical signals passing through the PHA 120. The perovskite nanowires in the NW array imager 130 serve as photoreceptors 132. The photoreceptors 132 are connected to a plurality of visual nerves 134. The perovskite nanowires as photoreceptors 132 are made of a suitable semiconductor material that allows detection of a predetermined range of light. For example, the band gap of the perovskite nanowires can be customized by selecting different materials, doping conditions (e.g., dopant type or concentration), or other factors. This enables control of the spectral range detected by the photoreceptors 132 of the NW array imager 130. When light within a detectable wavelength is received, the photoreceptor 132 converts the optical signal into an electrical signal (e.g., into electrical carriers such as electrons and holes). The visual nerves 134 made of a suitable metal material are connected to the metal wires so that the electrical signal generated by the corresponding photoreceptor 132 can be transmitted to the control circuit 140.

[0060] In some embodiments, a plurality of nanowires of the NW array imager 130 are fabricated along a curved surface conforming to a hemispherical structure corresponding to the PHA 120. The nanowires are aligned with the pinholes in the PHA 120, ensuring that incident light passing through the PHA 120 is efficiently and effectively detected by the NW array imager 130. For example, each nanowire may be aligned with the center of a pinhole within a pinhole array. Alternatively, a subset of the nanowires may be aligned with a pinhole within a pinhole array. In this configuration, the subset of nanowires may effectively detect light passing through the corresponding pinhole and possibly through one or more adjacent pinholes.

[0061] The control circuit 140 includes various hardware components and software components configured to obtain and / or process signals generated from the NW array imager 130 based on light passing through the PHA 120. In this example, the control circuit 140 includes a readout circuit 142, an emitter 144, and a processor 146. The readout circuit 142 is connected to the NW array imager 130 and is configured to read out signals generated by a plurality of nanowires in the NW array imager 130. For example, incident light may induce carriers (e.g., electrons / holes) in the plurality of nanowires, which may be read out by the readout circuit 142 in the form of current values. The emitter 144 may include a suitable chip, electronic module, or semiconductor device among other components to enable data transmission from the PHCE system 110 to the computing system 150 in a suitable network environment. The processor 146 may execute instructions stored in a memory to facilitate control of signal readout, data transmission, or other suitable operations (e.g., filtering, noise elimination, etc.).

[0062] Figure 1Cis a block diagram of an exemplary computing system 150 configured to implement various functions according to one or more exemplary embodiments of the present disclosure. In some embodiments, the computing system 150 is integrated into a robotic system or an autonomous system (e.g., a drone or an autonomous vehicle) together with the vision system 100 (or the PHCE system 110). In these scenarios, the computing system 150 processes data received from the vision system 100 (or the PHCE system 110) to generate instructions to control the robotic system or the autonomous system. For example, the computing system 150 can construct an image based on the received data and perform positioning / tracking of a target object by controlling the movement of the robotic system or the autonomous system. For example, the computing system 150 can determine the subsequent movement of the robotic system or the autonomous system based on the movement of the detected target object according to the data from the vision system 100 or the PHCE system 110.

[0063] like Figure 1C As shown in , the computing system 150 may include one or more processors 160, a memory 162, a communication interface 164, and a display 166. The processor 160 may be configured to perform operations according to instructions stored in the memory 162. The processor 160 may include any suitable type of general or special purpose microprocessor (e.g., a CPU or GPU, respectively), a digital signal processor, a microcontroller, etc. The memory 162 may be configured to store computer-readable instructions that, when executed by the processor 160, may cause the processor 160 to perform various operations discussed herein. The memory 162 may be any non-transitory type of mass storage, such as volatile or non-volatile, magnetic, semiconductor-based, tape-based, optical, removable, non-removable, or other type of storage device, or a tangible computer-readable medium, including but not limited to read-only memory ("ROM"), flash memory, dynamic random access memory ("RAM"), and / or static RAM. When the instructions stored in the memory 162 are executed by the processor 160, the various processes / flowcharts described mathematically in the present disclosure may be implemented in the instructions.

[0064] The communication interface 164 may be configured as follows: Figures 1A to 1C150 and the PHCE system 110 shown in . In one example, the communication interface 164 may include an integrated services digital network ("ISDN") card, a cable modem, a satellite modem, or a modem to provide a data communication connection. In another example, the communication interface 164 may include a local area network ("LAN") card to provide a data communication connection with a compatible LAN. In yet another example, the communication interface 164 may include a high-speed network adapter, such as a fiber optic network adapter, a 10G Ethernet adapter, etc. A wireless link may also be implemented by the communication interface 164. In such an embodiment, the communication interface 164 may send and receive electrical, electromagnetic, or optical signals carrying digital data streams representing various types of information via a network. The network may typically include a cellular communication network, a wireless local area network ("WLAN"), a wide area network ("WAN"), etc.

[0065] The communication interface 164 may also include various I / O devices such as a keyboard, a mouse, a touch pad, a touch screen, a microphone, a camera, a biosensor, etc. A user may input data to the computing system 150 (eg, a terminal device) through the communication interface 164 .

[0066] Display 166 may be integrated as part of computing system 150, or may be provided as a separate device communicatively coupled to computing system 150. Display 166 may include a display device such as a liquid crystal display ("LCD"), a light emitting diode display ("LED"), a plasma display, or any other type of display, and provide a graphical user interface ("GUI") presented on the display for user input and data description. In some embodiments, display 166 may be integrated as part of communication interface 164.

[0067] Figure 1D 1 is a block diagram of an exemplary user interface (UI) 180 configured to implement various functions according to one or more exemplary embodiments of the present disclosure. Figure 1D As shown in , UI 180 includes various functional modules, such as a control interface 182 , a data processing interface 184 , a visualization interface 186 , and the like.

[0068] The control interface 182 enables a user to configure various parameters to control the operation of the vision system 100 and / or a robotic system (or other type of system) in which the vision system 100 is integrated. For example, the control interface 182 may allow a user to select from predefined configurations, and / or enter customized values, such as data collection periods, detection thresholds, and other parameters.

[0069] The data processing interface 184 allows a user to execute various algorithms / techniques to process data obtained by the control circuit 140 of the PHCE system 110. For example, a user may select from image processing algorithms to construct an image based on detected visual information and / or suppress background noise.

[0070] The visualization interface 186 displays various visualization effects based on the output from the control interface 182 and / or the data processing interface 184. In one example, the visualization interface 186 may display a configuration selected from the control interface 182 and / or the data processing interface 184. In another example, the visualization interface 186 may display a constructed image frame output from the data processing interface 184.

[0071] Figure 2A An exemplary PHCE device 200 is shown in accordance with one or more exemplary embodiments of the present disclosure. Figure 2B yes Figure 2A FIG. 2 is an exploded view of a PHCE device 200. The PHCE device 200 is as follows Figure 1B The exemplary embodiment of the PHCE system 110 shown in FIG. 1 may be further integrated in Figure 1A In the visual system 100 shown in .

[0072] The PHCE device 200 includes two main components, namely a pinhole array (PHA) and a NW array. The PHA includes a plurality of pinholes (e.g., 202a) distributed along a curved surface. Figure 2A and Figure 2B As shown in FIG. 1 , the outermost layer of the PHCE device 200 is a hemispherical structure 202 having an array of pinholes distributed therein. In some embodiments, the hemispherical structure 202 having the PHA can be 3D printed. However, it will be noted that other techniques can be used to manufacture the hemispherical structure 202 having the PHA for suitable applications. In this example, the PHA serves as a lensless optical channel, allowing controlled light to pass through a small hole (e.g., a pinhole) to advance to a sensing element of a detector (e.g., a NW array imager 130).

[0073] The NW array, together with other components, forms an imager (e.g., NW array imager 130) that is located at or near the output of the PHA. The PHA is aligned with the NW array imager so that light output from the PHA is detected by the nanowires within the NW array imager. In this configuration, the NW array is used to efficiently and effectively detect light entering the PHCE device 200.

[0074] In some embodiments, the NW array comprises a perovskite nanowire (PNA) array. Figure 2B, PNA is grown inside a hemispherical porous alumina membrane (PAM) template 210. The PAM template 210 includes an array of holes, each of which is used to grow a corresponding perovskite nanowire. In other words, the perovskite nanowire is grown inside the holes of the PAM template 210. PNA is used as a photoreceptor (e.g., Figure 1B 132). In yet another embodiment, in each hole, a corresponding perovskite nanowire is grown on a metal nanowire. The metal nanowire is made of a suitable material, such as lead (Pb). Similarly, the nanowire array includes an array of PNAs and corresponding heterostructured Pb nanowires. The Pb nanowires are connected to metal wires, such as copper wires, to facilitate the transmission of the generated signals from the NW array imager 130 to the control circuit 140. In this way, the visual information detected by the PHCE device 200 can be processed and visualized by a processor (e.g., within the control circuit 140 of the PHCE system 110 and / or the computing system 150 of the visual system 100). Therefore, the function of the Pb nanowire is similar to that of a visual nerve. In some embodiments, each metal nanowire can be connected to one or more metal wires. Additionally and / or alternatively, multiple metal nanowires can be connected to a single metal wire. Therefore, the PNA can be connected to the metal wire in a one-to-one, one-to-many and / or many-to-one correspondence through the metal nanowires.

[0075] The nanowires in the PAM template 210 are connected to electrodes at both ends to form a closed circuit, thereby facilitating signal transmission to the control circuit 140. Figure 2BAs shown in FIG, an indium tin oxide (ITO) thin film layer 212 can be fabricated on the convex surface of the PAM template 210 to serve as a common electrode. However, it should be noted that an alternative material (similar to ITO) having high conductivity and optical transparency can be used as an electrode disposed between the hemispherical structure 202 having the PHA and the PAM template 210. On the other hand, a plurality of metal contacts (such as indium contacts 214) can be arranged on the concave surface of the PAM template 210. For example, the indium contacts 214 can be fabricated on the concave surface of the PAM template 210 or attached to the concave surface of the PAM template 210. The indium contacts 214 on the concave surface of the PAM template 210 can be paired with metal contacts (e.g., gallium contacts 222) on one end of the copper wire 220. In this configuration, the copper wire 220 is connected to the PNA through the pair of indium contacts 214 and gallium contacts 222. In some examples, one pinhole in the hemispherical structure 202 with PHA is aligned with one indium contact 214, which is referred to as an indium electrode pixel 214. In addition, each indium electrode pixel 214 is aligned with a group of nanowires in the PAM template 210. In some cases, one pinhole in the hemispherical structure 202 with PHA is aligned with a group of indium electrode pixels 214, and each indium electrode pixel 214 is aligned with one or more nanowires in the PAM template 210.

[0076] Figure 2C Provided Figure 2A 280 is an enlarged cross-sectional view of the framed portion 280 shown in FIG. Figure 2C As shown in , starting from the outer layer and moving inward (e.g., from top to bottom), the PHCE device 200 includes a hemispherical structure 202 with a PHA, a common electrode 212, perovskite and Pb nanowires within a PAM template 210, an indium contact 214, a gallium contact 222, and a copper wire 220, and the gallium contact 222 is located around the respective ends of the copper wire 220. In addition, a passivation layer 216 can be formed between the common electrode 212 and the PNA within the PAM template 210. The passivation layer 216 can be used to prevent or inhibit undesirable chemical reactions or degradation at the interface between the common electrode 212 and the perovskite nanowire. The passivation material can include silicon nitride (Si3N4), silicon dioxide (SiO2), various organic polymers, etc. As shown in this example, a single pinhole 202a can be aligned with multiple nanowires (e.g., in the PAM template 210). However, it should be noted that other configurations can also be used in various use cases. For example, each pinhole 202a can be aligned with a single nanowire. Alternatively, each pinhole 202a can be aligned with a specific number of nanowires. The number of nanowires aligned with different pinholes can vary or remain consistent.

[0077] Figure 2DFIG. 2 is a side view of a PHCE system mounted on a printed circuit board 254. The PHCE system may include, for example, FIG. 2A to FIG. 2C PHCE device 200 shown in FIG. 25. Scale bar 252 is 1 cm. The 121 ommatidia in the system 250 are designed from the pinholes in the PHA of the PHCE device 200. In this example, the ommatidia and pinholes in the PHA are in a one-to-one correspondence, wherein each pinhole corresponds to one or more receptors and visual nerves (e.g., one or more nanowires in the nanowire array).

[0078] Figure 3 FIG. 3 is a scanning electron microscope (SEM) image 300 of a hemispherical PAM 310 having nanowires 320 grown thereon. The PAM 310 having nanowires 320 can be used as FIG. 2A to FIG. 2D 3. The PAM template 210 with nanowires grown thereon in the PHCE device 200 shown in FIG. 3, or as an intermediate product during the manufacturing process of the PAM template 210 of the PHCE device 200. The scale bar 322 of the SEM image 300 is 1 micron. The inset shows a SEM image of a hemispherical PAM 310, where the scale bar 312 is 5 millimeters.

[0079] like Figure 3 As shown in FIG, nanowire 320 includes different parts, such as a perovskite nanowire part and a metal nanowire part. With this design, the perovskite nanowires inside PAM 310 have a pitch of about 500 nm and a diameter of about 300 nm, indicating uniform alignment with high density.

[0080] Figure 4 4 is a process flow 400 for manufacturing a NW array detector according to one or more exemplary embodiments of the present disclosure. By executing the process flow 400, a NW array detector having a spherical structure can be manufactured. The resulting NW array detector can be located at a PHA (e.g., Figure 1B The PHCE system 110 shown in FIG. 1 and / or FIG. 2A to FIG. 2D 1) below the PHA 120 in the PHCE device 200 shown in FIG. 1 to serve as the NW array imager 130 of the PHCE system 110. The NW array detector may be connected to and controlled by the control circuit 140 of the PHCE system 110.

[0081] At 402, an aluminum (Al) shell is deformed to form a hemispherical substrate.

[0082] At 404, a hemispherical porous alumina membrane (PAM) template is fabricated on the Al shell deformed from process 402. For example, alumina can be grown on the Al shell by anodization to form a honeycomb structure along the normal direction of the hemispherical surface of the Al shell. However, it will be noted that various alternative techniques (including molding, drilling, mechanical or laser cutting, etc.) can be applied to create the PAM template. The honeycomb structure provides an array of vertical nanowire structures (e.g., holes) along the hemispherical surface corresponding to the Al shell. In this way, the PAM template provides a natural encapsulation for the perovskite material, improving the operating performance.

[0083] At 406, a Pb layer is deposited on the Al shell and within the nanowire structure of the PAM. The Pb layer within the pores of the PAM template is used as the metal nanowire array of the optic nerve 134 described above. Additionally and / or alternatively, the Pb nanowires on the Al shell can be used as a seed layer for the subsequent growth of perovskite nanowires within the PAM template.

[0084] At 408, a perovskite nanowire array (PNA) is grown on the Pb nanowire array within the pores of the PAM. The Pb nanowires and / or perovskite nanowires may be grown using various techniques such as chemical vapor deposition (CVD), molecular beam epitaxy (MBE), atomic layer deposition (ALD), thermal evaporation, liquid phase synthesis, or other techniques.

[0085] At 410, ion milling is applied to expose the top surface of the PAM template, thereby revealing the nanowires grown spaced apart along the vertical walls of the honeycomb structure of the PAM template.

[0086] In addition, a regrowth process can be applied to further repair the properties of the grown nanowires that may have been damaged during the ion milling process. In the regrowth process, the already synthesized nanowires are used as a substrate or template for further growth. The same perovskite material or precursor is then deposited on the surface of these nanowires using various techniques such as chemical vapor deposition (CVD), molecular beam epitaxy (MBE), liquid phase synthesis, etc.

[0087] At 412, a passivation layer and a common electrode are fabricated on top of the PNA. For example, a passivation material and an electrode material may be deposited on the surface exposed from 410. The passivation material and the electrode material may be TAPC (which stands for Di-[4-(N,N-dimethylphenyl-amino)-phenyl]cyclohexane) and ITO.

[0088] At 414, a protective coating for ultraviolet (UV) epoxy protection is applied, such as by using a UV curable epoxy.

[0089] At 416, the Al shell is removed from the bottom of the PAM template. The Al substrate can be removed by various techniques such as wet etching, dry etching, milling, grinding, laser ablation, etc. As a result, the bottom surface of the PAM template and the Pb nanowires within the pores of the PAM template are exposed.

[0090] At 418, indium may be deposited on the exposed bottom surface of the PAM template according to a predetermined pattern. Similarly, a plurality of indium contacts may be made on the Pb nanowires. The deposition of indium may be performed by evaporating an indium source. The deposited indium may form a plurality of indium contacts according to a predetermined pattern (e.g., by applying a suitable mask).

[0091] In some embodiments, the perovskite nanowires grown in 408 and / or regrown in 410 can be designed to achieve different detection ranges. For example, the components of the perovskite nanowires include halides and metal elements. During the deposition process (e.g., CVD), the halides and metal elements in the perovskite nanowires, such as their concentrations, can be controlled. The resulting PNA can exhibit sensitivity to different ranges of the spectrum.

[0092] FIG. 5A to FIG. 5F is a property of various perovskite materials. This property shows that the PNA photodetector made of PNA can sense light from the visible light region to the near-infrared region. Figure 5A As shown in Figure 5 , different perovskite materials show different peaks (e.g., peaks 502, 504, 506, and 508) in the photoluminescence spectrum 500. For example, methylammonium lead chloride (MAPbCl3) (e.g., peak 502) and methylammonium lead bromide (MAPbBr3) (e.g., peak 504) show sensitivity to different segments within the visible spectrum that roughly spans 400 nanometers to 700 nanometers. Methylammonium lead triiodide (MAPbI3) (e.g., peak 506) shows sensitivity to both the visible segment and the infrared segment, while methylammonium tin iodide (MASnI3) (e.g., peak 508) shows sensitivity to a segment within the infrared spectrum. The infrared spectrum extends beyond about 700 nanometers.

[0093] Figure 5B 520 are X-ray diffraction (XRD) spectra of different perovskite nanowires within a PAM template. Perovskite nanowires were grown within a PAM template made of anodized aluminum. The x-axis represents the diffraction angle, where 2θ is the angle between the incident X-ray beam and the diffracted X-ray beam. The peak marked with "100" is associated with diffraction from the (100) crystal plane, while the peak marked with "200" is associated with diffraction from the (200) crystal plane. Figure 5BAs shown in , the diffraction peaks of well-crystallized perovskites change with the substitution elements. Diffraction peaks 522, 524, 526, and 528 correspond to MAPbCl3 nanowires, MAPbBr3 nanowires, MAPbI3 nanowires, and MASnI3 nanowires, respectively.

[0094] Figure 5C and Figure 5D 550 and 560 are curves of elemental analysis of perovskite nanowires. These characteristics show the growth results of the nanowires, such as morphology, composition, and filling ratio. The scale 552 in curves 550 and 560 is 1 micron. Figure 5C and Figure 5D The elemental analysis shown in confirmed the uniform growth of PNA.

[0095] In the present disclosure, MAPbI3 is used as the photosensitive material of PNA in the devices / systems to show the structure and / or operation of these devices / systems for illustrative purposes only. Figure 5A and Figure 5B As shown in , MAPbI3 can include the entire visible wavelength range. However, it should be noted that other suitable perovskite materials can be used in these devices / systems for other suitable applications.

[0096] By adjusting the thickness of the PAM and the growth conditions, well-crystallized MAPbI3 nanowires with a high filling fraction (>95%) inside the PAM can be obtained. Figure 5E and Fig. 5F 570 and 580 are SEM images of MAPbI3 nanowires grown inside PAM. SEM images 570 and 580 are side and top views, respectively, where scale bar 572 is 3 microns.

[0097] Figure 6 600 is an exemplary layout of pinholes in a PHA according to one or more exemplary embodiments of the present disclosure. The layout of pinholes 600 can be applied to a PHA in any device / system provided in the present disclosure. For example, pinholes (such as pinholes 602, 604, and 606) can be as follows: Figure 2D A portion of a PHA within a PHCE system is shown in FIG.

[0098] As described above, the PHA is designed as a honeycomb structure such that the pinholes 602, 604, and 606 are distributed along the curved structure. Figure 6 A set of parameters corresponding to the design of the pinholes is shown, including the critical acceptance angle of each pinhole Interocular angle (ΔΦ), diameter (D), and length (L) (in dashed box 620). This set of parameters is related to various optical aspects of the optical system, such as FOV, blind spots, and other characteristics.

[0099] like Figure 6 As shown in FIG. , light passing through pinholes 602, 604, and 606 can illuminate a point under the PHA, which is below the central pinhole 604. Likewise, the pinholes can correspond to pixels of the NW array imager. Light passing through the PHA can be detected by one or more nanowires (e.g., photoreceptors) in the PNA. To this end, light passing through the PHA can be detected by multiple pixels of the NW array imager.

[0100] For each pinhole, the critical acceptance angle It refers to the angle range over which the corresponding pinhole can effectively receive incident light or radiation. In other words, the critical acceptance angle represents the acceptance angle of incident light / radiation for a particular pinhole. The interocular angle (ΔΦ) refers to the angle between adjacent ommatidia (e.g., pinholes). For example, the interocular angle (ΔΦ) indicates the angular deviation between the central axes of two adjacent pinholes. In some embodiments, Slightly larger than ΔΦ, it makes it possible to optimize the blind area of ​​the optical system.

[0101] Fig. 7A and Figure 7B is a characteristic of a PHA according to one or more exemplary embodiments of the present disclosure. Fig. 7A Curve 700 in FIG. 7 shows a simulation of the total FOV as a function of the number of pinhole pixels with different inter-ommatidia angles (ΔΦ). The simulation was performed on a PHCE system optimized with 121 ommatidia, an L / D ratio of 5, and a critical acceptance angle of 11.3°. As shown by curve 700, when When ΔΦ and ΔΦ are equal to 11.3° and 10°, respectively, the PHCE system with 121 ommatidia can achieve a total FOV of about 143°.

[0102] Figure 7B The curve 750 in FIG. 1 shows the measurement result of the light intensity distribution. In this example, the dashed curve 752 represents the light intensity distribution relative to the corresponding pinhole (e.g., Figure 6 Curve 754 represents the measurement angle selection function (ASF) based on the measurement position indicated by the dashed curve 752. The ASF indicates the light distribution after the light passes through a single pinhole. Figure 7B As shown in FIG. 7 , the critical acceptance angle can be defined based on the half-intensity point according to the ASF measured for the corresponding pinhole (e.g., curve 754). Curve 756 represents the total intensity distribution measured at a location according to dashed curve 752 (eg, with light contributions from three pinholes). Curve 756 indicates the FOV of the PHA at the corresponding pinhole. In some examples, a light absorbing resin may be used for printing to prevent light scattering between adjacent pixels.

[0103] Fig. 8A An exemplary measurement device 800 of a monocular vision system 810 according to one or more exemplary embodiments of the present disclosure is shown. The measurement device 800 connects the monocular vision system 810 to a computing system 830 and a source meter 840 via a switch device 820. It should be noted that other arrangements may be implemented, for example, some or all of the functional modules within the switch device 820, the source meter 840, and / or the computing system 830 may be integrated into the monocular vision system 810.

[0104] The monocular vision system 810 includes a compound eye (CE) having a pinhole array (PHA). Fig. 8A As shown in , the PHA of the monocular vision system 810 is exposed and positioned to capture incident light. The NW array imager and appropriate circuitry can be located within an enclosed space defined by the spherical PHA structure and a housing attached thereto. The monocular vision system 810 is powered by a source meter 840 to facilitate the acquisition of signals generated from the monocular vision system 810. The switch device 820 may include a multiplexer, a switch network, and / or other suitable switch devices so that signals associated with multiple pixels from the monocular vision system 810 can be recorded by the source meter 840 and further sent to the computing system 830 sequentially, in parallel, or by a combination thereof. In this example, the monocular vision system 810 includes a total of 121 ommatidia to collect visual information. The 121 ommatidia (e.g., corresponding photoreceptors and optic nerves) are connected to a computer-controlled multiplexer (e.g., switch device 820) via a printed circuit board (within the monocular vision system 810).

[0105] The computing system 830 is as follows Figure 1C The computing system 830 implements the following example: Figure 1D The computing system 830 may process signals associated with the light acquired by the monocular vision system 810 to reconstruct a photographed pattern and display it in the UI 180 .

[0106] Figure 8B is an exemplary visualization of the measurement results 850 of the field of view according to one or more exemplary embodiments of the present disclosure. Fig. 8AThe measurement device 800 shown in FIG. 8 obtains a pattern of measurement results 850 based on the signal from the monocular vision system 810. The measurement results 850 show the intensity distribution across the hemispherical imaging system. Based on the measurement results 850, the area containing the pinholes shows a higher light intensity, while the area between the pinholes shows a lower light intensity. The hemispherical geometry gives the entire system a large FOV. Figure 8B As shown in FIG, the total field of view of a hemispherical PHCE (eg, monocular vision system 810) is approximately 140°, which is consistent with Fig. 7A The above simulation results shown in are in good agreement.

[0107] Figure 8C and Fig.8D The monocular vision system 810 uses Fig. 8A Visualization of an exemplary pattern captured by the measurement device 800 shown in FIG. 882 and FIG. 892 provide optical photographs of the pattern. The light source used for imaging is converging light.

[0108] like Figure 8C As shown in , display 880 shows a circular pattern captured by monocular vision system 810 that is aligned with the pattern shown in inset 882. Fig.8D As shown in , display 890 shows a cross and triangle pattern captured by monocular vision system 810 that is aligned with the pattern shown in inset 892.

[0109] In these visualizations, pixels are represented by hexagonal units. The pattern projected onto the surface of the monocular vision system 810 can form a corresponding light intensity distribution on a detector (e.g., a NW array imager). The resulting visualization pattern reflects the shape of the projected pattern and the distribution of light intensity. In some examples, the light intensity of each pixel can be associated with the current value read out from the corresponding pixel.

[0110] Fig.9A FIG. 9 shows an exemplary binocular vision system 900 according to one or more exemplary embodiments of the present disclosure. The size of the binocular vision system 900 may be on the order of several centimeters. Fig.9A As shown in FIG. 1 , the binocular vision system 900 includes a pair of PHCE systems 904 mounted on a frame 902. The PHCE system 904 can utilize Figure 1B The PHCE system 110 shown in FIG. 1 may be Figure 1A An example of a visual system 100 is shown in FIG. Fig.9A As shown in FIG. 9 , the pair of PHCE systems 904 are fixed to a frame 902, wherein the two PHCE systems 904 are configured to detect visual information from different angles. The binocular vision system 900 can be integrated with integrated circuits for onboard signal acquisition, processing, and wireless communication.

[0111] In this embodiment, each PHCE system 904 in the binocular vision system 900 is designed to have 37 ommatidia corresponding to 37 pixels. The pinhole in the PHA is designed to have an L / D ratio of 2.5, and the angle ΔΦ is designed to be 20°. A point light source is used as an object. For a single PHCE, when the point light source moves away from the PHCE, the illumination area on the corresponding PHCE will increase, and more pixels will be activated; and vice versa. In addition, when the point light source moves toward other directions, pixels in the same direction will respond. Pixels in the same direction refer to pixels along the same moving direction on a curved surface. In order to accurately locate the 3D moving trajectory of a point light source, a binocular system such as Fig.9A Binocular vision system 900 shown in .

[0112] Fig. 9B The working principle of the binocular vision system according to one or more exemplary embodiments of the present disclosure is shown. The binocular vision system can be embodied as Fig.9A Binocular vision system 900.

[0113] As described above, each PHCE system 904 has an ultra-wide FOV, which is approximately a near-panoramic field of view. A single compound eye uses motion parallax technology to determine the position of an object in its surrounding environment. Motion parallax relies on the movement of the observer to provide depth perception. As the observer (e.g., CE) moves, objects at different distances will move across the compound eye at different speeds. Objects closer to the observer will move across the compound eye faster, while objects farther away will apparently move slower. By comparing the relative movement of objects across the compound eyes, the distance and position of the object can be determined.

[0114] A pair of compound eyes has binocular vision, enabling the perception of depth and distance through stereoscopic vision (i.e. slight differences in the images taken by each eye). This allows for more precise depth perception and spatial perception.

[0115] In this example, the entire area 910 of the binocular vision system 900 is divided into three parts, namely, a blind area 918, motion detection areas 912, 914 and a precise positioning area 916. Fig. 9B As shown in FIG. 1 , the FOV of each PHCE system 904 is associated with a corresponding motion detection zone 912 or 914, and the overlapping portion of the FOVs of the two PHCE systems 904 constitutes a precise positioning zone 916. The area outside the FOVs of the two PHCE systems 904 constitutes a blind zone 918.

[0116] In the exemplary arrangement, the angle between the two PHCEs of the binocular vision system 900 is fixed to 60°, which increases the total FOV of the binocular vision system 900 to 220°. The binocular vision system 900 is connected to a computer-controlled multiplexer (e.g., a switch device) and is programmed to collect real-time data. Measurements are made by randomly moving the binocular vision system 900 to locate point sources and record nodes in the area.

[0117] Fig. 9C The calculated spatial position and resulting movement path are shown based on the measurements made by the binocular vision system 900. This verifies the target localization capability of the PHCE system.

[0118] In an embodiment, a monocular vision system with integrated circuits (eg, integrated with a single PHCE) is used for onboard signal acquisition, processing, and wireless communication. Fig.9D The working principle of motion tracking on a drone according to one or more exemplary embodiments of the present disclosure is shown. Fig.9D As shown in FIG. , a single PHCE 952 (e.g., FIG. 2A to FIG. 2D PHCE device 200, or Fig. 8A The monocular vision system 810 in FIG. 1 is mounted on the drone 950. The drone 950 is integrated with a control unit (e.g., a processor) for signal processing. In some examples, the control unit can be integrated into a computing system (e.g., Figure 1C ) is in or in communication with a computing system 150 shown in , which is configured to process data acquired by the PHCE system and generate instructions to control the operation of the drone 950. However, it should be noted that other configurations may be employed. For example, a binocular system (e.g., FIG. 9A to FIG. 9B The binocular vision system 900 in FIG. 1 can be installed on the drone 950. Fig. 9B As shown in FIG, the FOV of a single PHCE 952 constitutes a motion detection area.

[0119] like Fig.9D As shown in , light from a target 954 is detected by a PHCE 952. For example, the target 954 can be considered as a light source. The target 954 moves along a trajectory as shown by a dashed line 956. The PHCE 952 senses optical signals in the FOV of the PHCE 952, as shown by arrow 958. The PHCE 952 sends the detected signals to a control unit on the drone for signal processing. The control unit processes the data from the PHCE 952, as shown by arrow 960. For example, the control unit processes the data in a suitable visualization unit (e.g., in Figure 1D950). The position of the target 954 may be indicated by a light spot 964, which indicates a high intensity of light. The reconstructed image indicates the position and / or movement of the target relative to the PHCE 952 (or the drone 950). Subsequently, the control unit provides one or more movement instructions to the drone 950, as indicated by arrow 962. For example, one or more instructions may cause the drone 950 to track the target 954 during its movement and / or adjust the posture / position of the drone 950 to capture additional images from other angles. The system exhibits excellent angular selectivity.

[0120] In yet another embodiment, the target 954 is a quadruped robot equipped with a point light source. Fig.9D According to the process shown in , the control unit gives movement instructions to the drone 950 according to the relative position change between the drone 950 in the air and the quadruped robot 954 on the ground. The PHCE 952 takes images at a frame rate of about 25 Hz according to the response time of the PNA detector. The flight of the drone 950 is controlled by an adjustable proportional-integral-derivative (PID) algorithm.

[0121] Fig. 10A 1000 is a photo of a drone 1010 integrated with a PHCE system 1020 according to one or more exemplary embodiments of the present disclosure. The PHCE system 1020 is fixed by a 3D printed bracket. The drone 1010 with the integrated PHCE system 1020 has successfully tracked the continuous motion of a quadruped robot 1012 (mounted with a white light source 1014) along a square path. FIG. 10B to FIG. 10D 1030, 1040, and 1050 are graphs comparing digital images (respectively shown by line graphs 1030a, 1040a, and 1050a) with current images taken by the drone 1010 with the PHCE system 1020 at different times. The dotted lines in the line graphs 1030a, 1040a, and 1050a indicate the relative spatial relationship between the drone 1010 and the quadruped robot 1012. Fig. 10B As shown in , when the drone 1010 is hovering above the quadruped robot 1012, the reconstructed image 1032 (e.g., the current map) indicates that the target (e.g., the light source mounted on the quadruped robot 1012) is located at the center of the FOV of the PHCE system 1020. Similarly, Fig. 10C and Fig. 10D The reconstructed images 1042 and 1052 in FIG. 1 respectively indicate the location of the target in the FOV of the PHCE system 1020 mounted on the drone 1010. The inset icon 1022 indicates the forward direction of the drone 1010. F, B, R, and L represent front, back, right, and left, respectively. Again, the excellent consistency strongly demonstrates the tracking accuracy and repeatability of the fully integrated system.

[0122] Fig.11A is a photograph of a PHCE system 1100 having an exemplary control circuit 1110. Fig. 10A As shown in , the PHCE system 1100 can be integrated into a drone system. For example, the control circuit 1110 can communicate with the control unit of the drone 1010. Fig.11A As shown in FIG, the control circuit 1110 includes various electronic components and peripheral circuits integrated on an integrated circuit board (PCB). The PCB integrated with the control circuit 1110 is connected to the PHCE via a flexible connector. However, it should be noted that other types of electrical connections may also be used.

[0123] Fig. 11B 11 is a block diagram illustrating various components in the control circuit 1110. For example, the control circuit 1110 may include a microcontroller unit (MCU) 1112, a signal amplifier and filter circuit 1114, a switch circuit 1116, and a connector 1118.

[0124] The MCU 1112 is configured to process the received signals and generate one or more instructions to implement any operation / function disclosed herein.

[0125] The signal amplifier and filter circuit 1114 includes selecting appropriate amplifiers and filters to enhance the signal received from the PHCE. For example, the amplifier can boost the input signal, while the filter can attenuate the noise signal.

[0126] The switch circuit 1116 is controlled by the MCU 1112 to selectively acquire signals corresponding to specific pixels in a predetermined order. The switch circuit 1116 may include various components such as a multiplexer, a crossbar switch, an analog / digital switch, and the like.

[0127] Connector 1118 facilitates connection with the PHCE. For example, connector 1118 can be connected to a wire extending from the optic nerve of the PHCE, thereby establishing a data transmission channel between control circuit 1110 and the PHCE.

[0128] It should be noted that the techniques described herein can be implemented with executable instructions stored in a computer-readable medium for use by a processor-based instruction execution machine, system, device or equipment or used in combination therewith. Those skilled in the art will appreciate that for certain embodiments, various types of computer-readable media may be included for storing data. As used herein, "computer-readable media" includes one or more of any suitable media for storing executable instructions of a computer program, so that an instruction execution machine, system, device or equipment can read (or extract) instructions from a computer-readable medium and execute the instructions for executing an embodiment. Suitable storage formats include one or more of electronic, magnetic, optical and electromagnetic formats. A non-exhaustive list of conventional exemplary computer-readable media includes portable computer disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM), flash memory devices, and optical storage devices including portable compact disks (CDs), portable digital video disks (DVDs), etc.

[0129] It should be understood that the arrangement of the parts shown in the accompanying drawings is for illustrative purposes, and other arrangements are also possible.For example, one or more of the elements described herein can be implemented as electronic hardware components in whole or in part.Other elements can be realized with a combination of software, hardware or software and hardware.In addition, some or all of these other elements can be combined, and some can be omitted completely, and other parts can be added while still realizing the function described herein.Therefore, the subject matter described herein can be realized with many different variations, and all such variations are considered to be within the scope of the claims.

[0130] For ease of understanding of the subject matter described herein, many aspects are described according to action series. It will be appreciated by those skilled in the art that various actions can be performed by dedicated circuits or circuit systems, by executing program instructions by one or more processors or by a combination of the two. The description of any action series herein is not intended to imply that the described specific order for performing the series must be followed. Unless otherwise indicated herein or clearly contradictory to the context, all methods / processes described herein can be performed in any suitable order.

[0131] In the context of describing the subject matter (particularly in the context of the attached claims), unless otherwise indicated herein or clearly contradictory to the context, the use of the terms "one" and "an" and "the" or similar references will be interpreted as covering both the singular and the plural. The term "at least one" is used after a list of one or more items (e.g., "at least one of A and B") and should be interpreted as meaning any combination of one item selected from the listed items (A or B) or two or more of the listed items (A and B), unless otherwise indicated herein or clearly contradictory to the context. In addition, the above description is only for the purpose of illustration and not for the purpose of limitation, because the scope of protection sought is limited by those set forth in the attached claims and any equivalent thereof. The use of any and all examples or exemplary language (e.g., "such as") provided herein is intended only to better illustrate the subject matter, and unless otherwise stated, does not limit the scope of the subject matter. The use of the term "based on" and other similar phrases in both the claims and the written specification to indicate the conditions for producing a result is not intended to exclude any other conditions for producing the result. No statement in the specification should be construed as indicating any non-claimed element as essential to the practice of the claimed invention.

Claims

1. Pinhole compound eye PHCE system, including: A pinhole array comprising a plurality of pinholes, wherein the pinhole array is configured to receive light from different incident angles; and A detector array includes a plurality of nanowires, wherein the detector array is located at a concave surface of the pinhole array and is configured to detect light passing through the pinhole array.

2. The PHCE system according to claim 1, wherein: The pinhole array is defined within a honeycomb hemispherical structure.

3. The PHCE system according to claim 2, wherein: The honeycomb hemispherical structure with the pinhole array is 3D printed.

4. The PHCE system according to claim 1, wherein: The plurality of nanowires are within a plurality of holes within the hemispherical membrane template.

5. The PHCE system according to claim 4, wherein: The hemispherical membrane template is a hemispherical porous alumina membrane (PAM), and wherein each of the plurality of pores corresponds to a subset of nanowires of the plurality of nanowires.

6. The PHCE system according to claim 1, wherein: Each nanowire of the plurality of nanowires includes a perovskite nanowire portion and a metal nanowire portion.

7. The PHCE system according to claim 6, wherein: The perovskite nanowire portion is located near the pinhole array, and the metal nanowire portion is connected to a control circuit.

8. The PHCE system according to claim 1, wherein: Each nanowire of the plurality of nanowires is aligned with a corresponding pinhole of the plurality of pinholes, and wherein each pinhole is associated with a pixel of the detector array.

9. The PHCE system according to claim 8, wherein: The detector array includes a plurality of pixels corresponding to the plurality of pinholes in the pinhole array, wherein the plurality of pixels are connected to a control circuit via a plurality of contact points, and wherein each pixel of the plurality of pixels corresponds to a contact point of the plurality of contact points.

10. The PHCE system according to claim 8, wherein: Each nanowire is arranged to receive light from the corresponding pinhole and one or more adjacent pinholes of the plurality of pinholes.

11. The PHCE system according to claim 1, further comprising: A control circuit is connected to the detector array and configured to obtain detection results from the detector array, wherein the control circuit includes a readout circuit configured to read current response values ​​generated from the multiple nanowires in the detector array based on the light detected by the multiple nanowires.

12. The PHCE system according to claim 1, wherein: The pinhole array is a first pinhole array and the detector array is a first detector array, and The PHCE system further comprises: a second pinhole array, comprising a plurality of distributed pinholes, wherein the second pinhole array is configured to receive light from different incident angles; a second detector array comprising a plurality of nanowires, wherein the second detector array is located at a concave surface of the second pinhole array and is configured to detect light passing through the second pinhole array; and A frame, wherein the first pinhole array with a corresponding first detector array mounted thereon and the second pinhole array with a corresponding second detector array mounted thereon are mounted thereon.

13. The PHCE system according to claim 12, wherein: The first pinhole array with the corresponding first detector array mounted thereon corresponds to a first field of view, the second pinhole array with the corresponding second detector array mounted thereon corresponds to a second field of view, and the first field of view and the second field of view have an overlapping area.

14. A method for manufacturing a pinhole compound eye PHCE system, comprising: manufacturing a hemispherical structure including a pinhole array having a plurality of pinholes distributed along a surface of the hemispherical structure; manufacturing a hemispherical membrane template, the hemispherical membrane template comprising a plurality of holes distributed along a surface of the hemispherical membrane template; growing nanowires inside the plurality of holes of the hemispherical membrane template to form a nanowire array; assembling the hemispherical structure and the hemispherical film template by aligning the pinhole array with the nanowire array; as well as A plurality of contact points coupled to the nanowire array are fabricated in the hemispherical film template.

15. The method according to claim 14, wherein: The hemispherical structure is a honeycomb hemispherical structure, and the hemispherical structure having the pinhole array is 3D printed.

16. The method according to claim 14, wherein: Growing the nanowires inside the plurality of holes of the hemispherical film template to form the nanowire array comprises: growing metal nanowires inside the plurality of pores of the hemispherical film template; and Perovskite nanowires are grown on the metal nanowires inside the plurality of pores of the hemispherical film template.

17. The method according to claim 16, further comprising: fabricating a common electrode layer on the perovskite nanowires within the hemispherical film template, Wherein, the plurality of contact points are coupled to the remaining metal nanowires within the hemispherical film template.

18. The method according to claim 17, wherein: The common electrode layer includes indium tin oxide (ITO), and the plurality of contact points are made of indium.

19. A method for detecting an object, the method comprising: Receiving light via a pinhole array PHA of a pinhole compound eye PHCE system, wherein corresponding pinholes of the PHA receive light corresponding to different incident angles; detecting, by a nanowire array of the PHCE system, a light intensity distribution across a plurality of pixels associated with the PHA; and An image frame is constructed based on the detected light intensity distribution across the plurality of pixels.

20. The method according to claim 19, wherein: One or more nanowires in the nanowire array are aligned with corresponding pinholes of the PHA, and wherein each pinhole of the PHA is associated with one or more pixels of the plurality of pixels.