Neural interface device
By in situ genetically modified cells or inoculated with gene-modified cells in cell support, retinal ganglion cells are directly stimulated, solving the problem of difficulty in restoring and enhancing user sensory functions in the prior art, and achieving efficient visual input recovery and Feature enhancement.
Patent Information
- Application Number
- CN202380048346.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-01-13
- Filing Date
- 2023-07-07
- Publication Date
- 2025-02-07
AI Technical Summary
Existing neural interface technologies are difficult to efficiently restore and enhance the user's sensory function, especially in the case of damaged photoreceptor cells.
Initial cells modified in situ or genetically modified cells inoculated in cell support are directly stimulated by optogenetic visual prosthesis to restore visual input to the brain.
It realizes the recovery of visual input to the brain without changing photoreceptor cells, enhances the user's visual function, and provides a neural interface with higher resolution and more signaling elements.
Smart Images

Figure CN119403521A_ABST
Abstract
Description
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims the benefit of U.S. Provisional Application No. 63 / 359,100 filed on July 7, 2022, U.S. Provisional Application No. 63 / 433,130 filed on December 16, 2022, and U.S. Provisional Application No. 63 / 438,947 filed on January 13, 2023, each of which is incorporated herein by this reference in its entirety. Technical Field
[0003] The present invention relates generally to the field of neural interfaces, and more particularly to a new and useful system and method in the field of neural interfaces. BRIEF DESCRIPTION OF THE DRAWINGS
[0005] Figure 1 is a schematic representation of a variation of the system.
[0006] Figure 2 is a schematic representation of an illustrative example of data transfer between components of the system.
[0007] Figure 3A , Figure 3B and Figure 3C Depicted are examples of systems in which the display-brain interface includes native cells that are genetically modified in situ.
[0008] Figure 3D , Figure 3E and Figure 3F An illustrative example of a system is depicted in which the display-brain interface includes in situ genetically modified naive cells.
[0009] Figure 4A , Figure 4B and Figure 4C An example of a system is depicted in which a display-brain interface includes genetically modified cells seeded in a cell support.
[0010] Figure 4D , Figure 4E and Figure 4F An illustrative example of a system is depicted in which a display-brain interface includes genetically modified cells seeded in a cell support.
[0011] Figure 5A Depicted are examples of systems in which the display-brain interface includes naive, unmodified cells.
[0012] Figure 5B An illustrative example of a system is depicted in which a display-brain interface includes naive, unmodified cells.
[0013] Figure 6 is a schematic representation of an example of a system.
[0014] Fig. 7A , Figure 7B and Figure 7C An example of a display unit is depicted.
[0015] Fig. 8A and Figure 8B An example of multiple groups of display units is depicted.
[0016] Fig. 9 An illustrative example of a display "super pixel" is depicted.
[0017] Fig.10 An example of a system including a drive is depicted.
[0018] Fig.11 is a schematic representation of an illustrative example of a system.
[0019] Fig.12 Illustrative examples of displays and display-brain interfaces are depicted.
[0020] Fig.13A Illustrative examples of systems that do not include a cell support are depicted.
[0021] Fig. 13B Illustrative examples of systems including cell supports are depicted.
[0022] Fig.14 An illustrative example of a display aligned with a cell matrix is depicted.
[0023] Fig.15 Illustrative examples of implantable displays are depicted.
[0024] Fig.16 A first illustrative example of a system is depicted.
[0025] Fig.17 A second illustrative example of a system is depicted.
[0026] Fig.18 A third illustrative example of a system is depicted.
[0027] Fig.19 An example of an implanted display and controller is depicted.
[0028] Fig. 20A Illustrative examples of external devices are depicted.
[0029] Fig. 20B An exploded view of an illustrative example of an external device is depicted.
[0030] FIG. 21A to FIG. 21B An example of manufacturing system components is depicted.
[0031] Fig. 22 An example of a tack hole is depicted.
[0032] Fig.23A and Fig. 23B Examples of optical components are depicted.
[0033] Fig.24A and Fig. 24B is an example image of a system having a "hinge-style" display-controller connector configuration.
[0034] Fig.24C is an example image of a system having a "u-turn" display-controller connector configuration.
[0035] Fig.25 is an image of the system's film layers with a display-controller connector configuration having a "u-turn" prior to bonding to the controller component.
[0036] Fig.26 is a scanning electron microscope image of the display.
[0037] Fig. 27 The emission spectra of an example display at 1 μA and 10 μA are depicted.
[0038] Fig.28 is an image of a system implantation procedure in which a system (e.g., a retinal implant) is attached to a surgical carrier device.
[0039] Fig.29 is an image of the implantation process after removal of the surgical carrier device.
[0040] Fig.30 Depicted are example spectrograms showing power as a function of frequency over time following presentation of optogenetic stimulation via an example retinal implant system; power was measured using an implanted electrocorticography grid.
[0041] Fig.31 Depicted are examples of raw local field potential (LFP) versus time and normalized gamma power versus time resulting from stimulus presentation from an example retinal implant system; power was measured using an implanted electrocorticogram grid.
[0042] Fig.32Depicted is an example series of heat maps measured using an implanted electrocorticogram grid, showing peak gamma power (20 Hz to 80 Hz, mV2) versus position on the grid (ML: medial, lateral; AP: anterior, posterior) as a function of time from the onset of stimulation for an example retinal implant system (top, green bars).
[0043] Fig.33 Depicted are example histograms showing the number of significantly responding electrocorticogram channels per trial for optogenetic stimulation using an example retinal implant system compared to extraocular optogenetic stimulation and high-contrast 10 degree visual stimulation (implanted electrocorticogram grid; up to 32 response channels).
[0044] Detailed Description
[0045] The following description of the embodiments of the invention is not intended to limit the invention to those embodiments, but rather to enable any person skilled in the art to make and use the invention.
[0046] 1. Overview
[0047] like Figure 1 As shown, the system may include: a display 100, a controller 300, and a power supply 500. The system may be used with an external device 400, a display-brain interface 200, and / or other components. However, the system may additionally or alternatively include any other suitable components.
[0048] In variations, the system can be used to send information to the user's brain. In a first example, the system (e.g., a retinal implant) can be used as a visual prosthesis to restore vision to a user who has lost all or some function of their photoreceptor cells (e.g., degenerated and / or otherwise damaged photoreceptor cells), ganglia, and / or other sensory cells. In a second example, the system (e.g., a neural implant) can be used to provide stimulation to the brain to restore and / or enhance one or more senses of the user.
[0049] 2. Example
[0050] In an example, a display is embedded in situ (e.g., in an eye, brain, ear, brainstem, muscle, arm, etc.). The display emits an excitation signal (e.g., one or more wavelengths of light), wherein the receptor cells generate biochemical signals in response to detecting the excitation signal. The biochemical signal can be interpreted as data (e.g., by the brain). The data presented by the display (via the excitation signal) can be determined based on an input sent to a controller (e.g., an image sampled by a camera, an artificial reality engine, etc.), wherein the controller is connected to the display. Preferably, the receptor cells are genetically modified to express a transgenic protein that is sensitive to the excitation signal emitted by the display (e.g., sensitive to the wavelength of light), wherein the modified cells stimulate neurons in the brain in response to light activation. The brain can then interpret the stimulation to enable the user to "see" the content. Alternatively, the cells can be unmodified or genetically modified in other ways. The receptor cells can be eye cells (e.g., retinal ganglion cells, etc.), neurons, somatic cells, and / or any other cell type.
[0051] 3.Technological advantages
[0052] Variations of this technique may impart one or more advantages over conventional techniques.
[0053] First, variations of the technology can restore and / or enhance one or more senses of a user (e.g., restore vision to a blind user). In some diseases, such as retinitis pigmentosa and macular degeneration, photoreceptor cells are damaged while the cells of the optic nerve, the retinal ganglion cells (RGCs), remain functional. Variations of the technology can directly stimulate ganglion cells, thereby restoring visual input to the brain without replacing photoreceptor cells. In a specific example, the system includes an optogenetic visual prosthesis that stimulates genetically modified cells transfected with genes for light-sensitive proteins (e.g., opsins).
[0054] Second, conventional methods of interfacing with neurons require large capacitive electrode systems with bulky sealed feedthroughs (to seal the implanted electrodes). In variations, the technology can provide content to the brain using display implants (e.g., via RGCs, via neurons, etc.) with higher resolution (e.g., 1:1 mapping of cells to light emitting systems on the display), a greater number of signal elements, and / or a smaller form factor with fewer or no sealed feedthroughs. In examples, variations of the technology can be scalable (e.g., scalable to thousands of pixels, scalable to hundreds of thousands of pixels, etc.), thereby enabling implantable visual prostheses that can generate vision by stimulating RGCs at or near cellular resolution.
[0055] Third, variations of the technology can include manufacturing an implantable neural interface device (e.g., including a display, a display-controller connector, and a controller) that can better fit the eye, thereby reducing mechanical stress during and after implantation. In a first example, the neural interface device can be manufactured using monolithic integration on a multilayer film, which can increase flexibility. In a second example, the neural interface device can be manufactured to have a three-dimensional (3D) geometry. In a specific example, the device is manufactured using a multilayer film with a sacrificial layer that is dissolved to reveal a 3D geometry that includes a first wing implantable on the outer surface of the eye (housing a controller) and a second wing implantable on the retina inside the eye (housing a display). In a third example, a wing may not be required and the device bends into the eye.
[0056] Fourth, the diversity of coding schemes present in different RGC subtypes may pose problems for visual prostheses. Many classes of RGCs may exist in the retina, and each class of RGCs may carry different information, such as ON RGCs and OFF RGCs that increase firing rate with increasing or decreasing brightness, respectively. Each RGC type can contribute to the reconstruction of visual stimuli, and adjacent RGCs may encode different aspects of visual stimuli. Variations of this technology may provide the following advantages: addressing RGCs at or near cellular resolution using advanced visual prostheses for photoreceptor cell degeneration. In a specific example, a method of visual restoration may include optogenetic stimulation of RGCs using an implantable thin-film μLED display having pixels approximately the size of an RGC soma, such that the display (e.g., used as an implantable optogenetic therapy) operates at or near cellular resolution.
[0057] Fifth, variations of the technology may use an active driver for the display (e.g., including a thin film transistor backplane), which, when used in conjunction with a minimum time at which an optogenetically evoked action potential can be reliably elicited at one or more light levels (e.g., light levels below a safety threshold), can increase the frame rate. In an example, the driver electronics may be placed inside the eye (e.g., for an active display with more pixels). This may allow for a significant reduction in the number of wires passing through the sclera, which in turn may allow for more flexible positioning of the device. This may also allow for less power to be consumed and / or less power to be transmitted through the eye between the controller 300 and the display 100, since the controller only needs to signal a change in state rather than constantly driving the display. Additional examples include integrating thin film transistors directly on each pixel, and / or CMOS devices with micro-LEDs bonded directly thereto.
[0058] Sixth, increasing coverage on the retina can allow more visual field to be accessed. In an example, a larger display can be deployed inside the eye during surgery (e.g., to account for surgical limitations on the size of the scleral incision).
[0059] Seventh, a variation of the system could enable optogenetic control of the peripheral retina using a display with stimulation pixels that roughly match the density of RGCs in size and spacing. Achieving single-cell resolution for single-photon optogenetic excitation in vivo can be extremely challenging without complex optics due to significant axial light propagation. This problem of axial resolution can be eliminated in the peripheral retina where RGCs can be arranged in a single layer. In the perifoval region, where RGCs can be stacked in layers up to 10 cells deep, axial light propagation may reduce resolution, but sparse viral transfection can limit the number of off-target RGCs activated.
[0060] Eighth, in a variation, implanted retinal displays have several advantages over optical stimulation from outside the eye. Stimulation from goggles can cope with macroscopic and microscopic movements of goggles relative to the eye, rapid changes in eye position, and variable pupil diameters that affect the numerical aperture of the system. Stimulating RGCs with equal to or close to single-cell accuracy and millisecond resolution from outside the eye may require extremely low-latency closed-loop tracking and calculation, which may be difficult to achieve. In contrast, implanted displays can be characterized by a fixed mapping between a given pixel and a specific RGC or RGC set. In a variation, the display can move with the eye, thereby eliminating the need for dynamically correcting the stimulus pattern. For example, while eye tracking can be used to render scenes on an implant, the stimulus pattern does not need to dynamically track a moving target.
[0061] Ninth, in a variation, implanted displays can be more efficient in pixel usage: for augmented reality displays, the visual scene can be rendered in high definition across the entire field of view, because the eye can saccade to any part of the visual scene. In contrast, the resolution of an implanted display can be concentrically reduced away from the fovea to match the density of RGCs. This distinction can be used to design implants that exploit the principles of retinal coding: a display presenting an entire visual scene may not know which RGCs it will address before saccade, so the coding potential of the prosthesis may be limited. Finally, even in the case of poor encoding, the use of an implanted display to stably map pixels to cells can also facilitate plasticity, because downstream structures can receive consistently patterned inputs.
[0062] However, the systems and methods disclosed herein may provide additional advantages.
[0063] 4. System
[0064] like Figure 1As shown, the system may include: a display 100, a controller 300, and a power supply 500. Optionally, the system may include a display-controller connector, a display-brain interface 200, and / or any other suitable components. The system may be used with an external device 400. Figure 6 An example is shown in FIG.
[0065] One or more components of the system (e.g., one or more components of display 100) are preferably partially or completely transparent, but may alternatively be translucent, opaque, or have any other suitable optical properties. One or more components of the system are biocompatible and / or encapsulated in a biocompatible material, but may alternatively be non-biocompatible and / or configured in other ways.
[0066] The system is preferably an implant, but can additionally or alternatively include non-implantable devices and / or be configured in other ways. In an example, one or more components of the system are implanted in or on the following body area of the user: eyes (e.g., retina, sclera, etc.), brain, brain stem, spinal cord, ear, muscle, skin, nerve or near nerve and / or any other body area. The user can be a human, an animal (e.g., a rabbit) and / or any other organism. When the system is an implant, one or more components of the system can be maintained in situ in the following ways: tissue adhesive, via an extrusion (e.g., "spikes") acting as an anchor, tacks (e.g., through a tack hole in the device), sutures, by inducing fibrosis growth around or through a component (e.g., a fenestration in a component can enable fibrosis growth to fix a component) and / or using any other method.
[0067] The display 100 (e.g., a photonic interconnect) is used to transmit an excitation signal received by a cell (e.g., a cell within the display-brain interface 200), wherein the signal can encode content (e.g., visual data, sensory data, other external information, artificial data, any other data, etc.). Additionally or alternatively, the display 100 can be used to measure the state of the cell. The cell can be a genetically modified cell (e.g., a cell with an optogenetic actuator and / or an optogenetic sensor, a hypoimmune cell, etc.) and / or a genetically unmodified cell.
[0068] The display 100 may be implanted at an implantation location. Examples of implantation locations include: the retina (e.g., the macula, the peripheral retina, all or a portion of both the macula and the peripheral retina, etc.; on the internal limiting membrane on the surface of the retina), the optic nerve (e.g., aligned with the optic nerve), the brain (e.g., the visual cortex, the motor cortex, etc.; inside the brain, on the surface of the brain, combinations thereof, etc.), the brainstem, the spinal cord, the ear (e.g., the ear canal), a muscle, the skin, at or near a nerve, and / or any other location associated with the user. In a specific example, the display 100 (and optionally the display-controller connector) may be an intraocular component of the system. In Fig.15 An example is shown in FIG.
[0069] The display 100 can be connected to a display-controller connector, a controller 300 (e.g., wirelessly connected, connected via a display-controller connector, etc.), and / or any other system component. The display 100 may include one or more excitation signal emission systems (e.g., light emission systems), which include circuits and / or components configured to emit signals (e.g., light) based on controls received from the controller 300 (e.g., via a display-controller connector). Control instructions (e.g., display instructions) may include emission parameters and / or any other display instructions. The display 100 may optionally include one or more signal sensor systems configured to measure cell states, wherein the cell states may be optionally sent to the controller 300 (e.g., via a display-controller connector). In a specific instance, the signal sensor system includes a sensor for measuring signals emitted by cells (e.g., protein fluorescence spatiotemporal parameters, intensity, ions, voltage, current, etc.). The display may optionally include one or more integrated circuits, optical components, and / or any other suitable components.
[0070] The display 100 may include a set of display units. The display units may be pixels (eg, having one signal element), super pixels (eg, having multiple signal elements), and / or configured in other ways. Fig. 7A , Figure 7B , Figure 7C and Fig. 9 An example is shown in FIG. The signal element may be an excitation signal transmitting system, a signal sensor system, and / or any other signal component. The mapping between display units and cells may be 1:1 (e.g., one display unit per cell with an optogenetic actuator; one display unit per cell with both an optogenetic actuator and an optogenetic sensor; etc.); Fig.14Examples are shown in ), 1:2 (e.g., two cells per display unit: one cell has an optogenetic actuator and one cell has an optogenetic sensor), randomly determined, unconstrained, variable mapping across the display (e.g., the ratio between display units and cells farther from the fovea increases), and / or having any other mapping. In specific examples, the display 100 can operate at or near cellular resolution (e.g., one display unit and / or its signal element can excite less than 20 cells, less than 10 cells, less than 5 cells, less than 2 cells, 1 cell, etc.). The display units in the group of display units can be the same or different from each other. In a first example, the display units are substantially the same (e.g., the same size, each display unit has the same signal element or group of signal elements); Fig. 8A An example is shown in . In a second example, the group of display units may include a first subset of display units (e.g., each display unit has only an excitation signal transmitting system), the first subset of display units being different from a second subset of display units (e.g., each display unit has a signal sensor system; each display unit has a signal sensor system and an excitation signal transmitting system; etc.); the number of display units in the first subset may be greater than, less than, or equal to the number of display units in the second subset. Figure 8B An example is shown in FIG.
[0071] The number of display units can be between 100 and 50,000 or any range or value therebetween (e.g., at least 1000; at least 2000; at least 5000; at least 10000; 2048; 4096; 8192; 16000; etc.), but can alternatively be less than 100 or greater than 50,000. All or a portion of the display units can be active (e.g., connected to the controller via a display-controller connector). In an example, only a portion of the display units are connected to the controller to reduce the number of connections in the display-controller connector. The percentage of active display units in the set of display units can be between 20% and 100% or any range or value therebetween (40% to 90%, 50%, less than 90%, less than 80%, less than 70%, etc.), but can alternatively be less than 20%. In a first illustrative example, 8,192 display units are active out of a total of 16,000 display units. In a second illustrative example, 2,048 of the 4,096 display elements are active. The resolution of this set of display elements may be 100 display elements / mm 2 Up to 5,000 display units / mm 2 or any range or value therebetween (greater than 500 display units / mm 2 , greater than 1000 display units / mm 2, more than 2000 display units / mm 2 etc.), but may alternatively be less than 100 display units / mm 2 or more than 5,000 display units / mm 2 . The resolution of the display unit may be the same across the display or vary across the display (e.g., the resolution of the display unit or the active display unit increases towards the fovea of the retina). The diameter of the display unit and / or its signal element may be between 1 μm and 10 cm or any other range or value therebetween (e.g., less than 500 μm, less than 100 μm, less than 50 μm, less than 20 μm, less than 10 μm, less than 5 μm, 5 μm to 100 μm, 10 μm to 20 μm, 15 μm, etc.), but may alternatively be less than 1 μm or greater than 10 cm. Fig.26 An example is shown in FIG. The emission area of each excitation signal emitting element can be 10 μm 2 Up to 10,000 μm 2 or any other range or value therebetween (e.g., less than 1000 μm 2 , less than 500μm 2 , less than 100μm 2 , 50μm 2 Up to 100 μm 2 、66μm 2 、285μm 2 Up to 680μm 2 etc.), but may alternatively be less than 10 μm 2 or greater than 10,000 μm 2 The display cell pitch (e.g., the center-to-center distance between display cells) may be between 5 μm and 10 cm, or any range or value therebetween (e.g., less than 500 μm, less than 100 μm, less than 50 μm, 5 μm to 100 μm, 20 μm, 42 μm, etc.), but may alternatively be less than 5 μm or greater than 10 cm.
[0072] The surface area of the display 100 (eg, the surface area of the entire display and / or the active area of the display including the set of display cells) may be within 0.5 mm 2 Up to 50cm 2 or any range or value therebetween (e.g., 2 mm 2 Up to 10mm 2 , 5mm 2 Up to 10mm 2 、7.29mm 2 、6.55mm 2 etc.), but may alternatively be less than 0.5 mm 2 or larger than 50cm 2. The thickness of display 100 (e.g., including optional sealant, backing, and / or any other auxiliary materials) can be between 2μm and 150μm, or any range or value therebetween (e.g., 20μm to 60μm, 10μm to 30μm, 20μm, 22μm, 30μm, 40μm, 50μm, 60μm, etc.), but may alternatively be less than 2μm or greater than 150μm. The surface geometry of the display may be square, rectangular, circular, oval, and / or any other shape. Display 100 is preferably flexible, but may alternatively be rigid and / or have both flexible and rigid components.
[0073] The excitation signal emission system can be a light emission system, an electrical emission system (e.g., emitting current signals and / or voltage signals), and / or any other signal conduction system. The light emission system preferably includes a μLED, but may additionally or alternatively include a laser diode (e.g., a vertical cavity surface emitting laser, a laser cavity, etc.), a phosphor, and / or any other light emission system. In a specific example, the phosphor can achieve a wavelength shift and / or emission lifetime change of the light emission system (e.g., to better match the time constant of cells in the display-brain interface 200). In an example, the light emission system may include a μLED (e.g., the display includes an array of μLEDs), wherein a driver for the μLED can be juxtaposed with the μLED on the display 100 (e.g., within a corresponding display unit, adjacent to a corresponding display unit, adjacent to the group of display units, etc.), adjacent to the display, located at a display-controller connector, located at the controller 300, and / or positioned in other ways. Fig.10 An example is shown in . In a first specific example, the driver can be a passive driver. In a second specific example, the driver can be an active driver (e.g., including integrated circuits, transistors, other logic components, etc.) that enables the display 100 to include an active array of display cells (e.g., a μLED active array). μLED materials can include indium gallium nitride, gallium nitride (e.g., biocompatible gallium nitride), indium gallium phosphide, organic emitters, and / or any other light emitting material. The μLEDs can be manufactured directly with the display (e.g., with the same traces; on the same wafer; etc.), assembled to a display backing and / or encapsulant after circuit fabrication, and / or manufactured in other ways.
[0074] The light emitting system can emit light of one or more wavelengths at one or more light flux levels. The light flux is preferably greater than or equal to the light activation threshold of an optogenetic actuator (e.g., an opsin) associated with a cell in the display-brain interface 200, but may alternatively be less than the light activation threshold of the optogenetic actuator and / or have any other value. In an example, the light flux (and / or the irradiance received by the cell in the display-brain interface 200) is between 0.01 mW / cm 2 Up to 100mW / cm 2 or any range or value therebetween (e.g., 0.1 mW / cm 2 Up to 20mW / cm 2 , greater than 5mW / cm 2 , greater than 10mW / cm 2 , greater than 20mW / cm 2 , greater than 30mW / cm 2 , greater than 50mW / cm 2 , less than 70mW / cm 2 , etc.), but may alternatively be less than 0.01 mW / cm 2 Or greater than 100mW / cm 2. The wavelength preferably corresponds to the excitation wavelength of an optogenetic actuator (e.g., an opsin) associated with a cell in the display-brain interface 200, but may alternatively not be associated with an optogenetic actuator (e.g., when the display 100 emits light onto healthy photoreceptor cells). The wavelength (e.g., spectral peak) may be between 400nm and 800nm or any range or value therebetween (e.g., 510nm to 550nm, between 530nm and 540nm, 530nm, 540nm, 545nm, 550nm, 560nm, 450nm to 485nm, 500nm to 570nm, 625nm to 750nm, etc.), but may alternatively be less than 400nm or greater than 800nm. In a first example, the wavelength value corresponds only to red light (e.g., between 625nm and 750nm). In a second example, the wavelength value corresponds only to blue light (e.g., between 450nm and 485nm). In a third example, the wavelength values correspond to green light only (e.g., between 500nm and 570nm). In a fourth example, the wavelength values correspond to red light, blue light, and / or green light (e.g., an RBG light display). In a particular example, the wavelengths may not include red light (e.g., using blue and / or green wavelengths) to reduce the photochemical hazards of the display 100. The full width at half maximum of the light emitting system may be between 5nm and 50nm or any range or value therebetween (e.g., 20nm), but may alternatively be less than 5nm or greater than 50nm. However, the display may emit light having any other wavelength, frequency, photon energy, intensity, flux, amplitude, and / or other parameters. In Fig. 27 An example is shown in Additionally or alternatively, the display may emit non-optical signals (eg, tactile signals, acoustic signals, electrical signals, etc.).
[0075] The excitation signal transmission system can operate according to the transmission parameters (e.g., transmission instructions) received from the controller 300, wherein the transmission parameters encode the content. The transmission parameters may include spatial parameters (e.g., which display units to operate), temporal parameters (e.g., when to start the signal transmission, the length of the signal transmission, etc.), intensity and / or amplitude parameters (e.g., the intensity and / or amplitude of the light), light wavelength, and / or any other parameters that define the signal transmitted by the excitation signal transmission system. For example, the transmission parameters may specify a time sequence of light array patterns (e.g., including the wavelength, intensity, spatial information, etc. of each excitation signal transmission system), wherein each light array pattern encodes a content frame. The frame rate of the time sequence may be between 50 FPS and 500 FPS (e.g., greater than 50 FPS, greater than 80 FPS, 90 FPS, etc.), but may alternatively be less than 50 FPS or greater than 500 FPS. The pulse duration of the excitation signal (e.g., when the display includes a passive array of μLEDs, defining a frame rate) can be between 0.1 ms and 100 ms (e.g., 1 ms to 5 ms), but can alternatively be less than 0.1 ms or greater than 100 ms. In a specific example, the emission parameters can include state change instructions for the excitation signal emission system (e.g., when the display 100 includes an array of μLEDs driven by an active driver at the display 100). In variations, one or more emission parameters can be fixed (e.g., fixed wavelength, fixed intensity, etc.) or variable.
[0076] Control instructions ("controls") for implant control (e.g., including emission parameters) can be determined and / or adjusted by the external device 400, the controller 300, the display 100, a combination thereof, and / or any other system component. In a first example, the control can be determined at the processing system of the external device 400 based on content (e.g., received from the sensor 450), cell state information (e.g., measured at the display 100 and sent to the external device 400 via a communication element of the controller 300), display information (e.g., current μLED state), controller state information (e.g., measured by the controller sensor), and / or any other information. In a second example, the control can be determined at the processing system of the controller 300 based on content (e.g., unprocessed and / or processed) received from the external device 400, cell state information (e.g., measured at the display 100 and sent to the controller 300 via a display-controller connector), display information, controller state information, and / or any other information. In a third example, the control may be determined at the processing system of the external device 400 and at the processing system of the controller 300 (eg, adjusted by the controller 300 ).
[0077] The emission parameters are preferably determined based on the content (e.g., visual data, sensory data, other external information, artificial data, any other data, etc.), but may additionally or alternatively be determined based on: cell state, display information (e.g., the current state of each excitation signal emission system, where the emission parameters include state changes of all or part of the excitation signal emission system), controller state information, calibration information, and / or any other information. For example, the emission parameters may be determined so that the resulting excitation signals collectively encode the content (e.g., the emission parameters specify a temporal sequence of light array patterns, where each light array pattern encodes a content frame). In a specific example, the emission parameters may be determined and / or adjusted so that the display 100 emits a signal corresponding to an image (e.g., so that the signal relayed to the brain based on the excitation signal can be interpreted by the brain as an image); in this example, the content may be a video, and the image may be a frame of the video. In an illustrative example, the intensity of the light emitted by each display unit may be controlled so that the display collectively projects a grayscale (e.g., single channel) or color (e.g., multi-channel) version of the image.
[0078] The emission parameters may optionally be adjusted based on a retinal coding scheme (e.g., a mapping of the classification of retinal ganglion cell types in the retina), emission intensity calibration, manual feedback, and / or other calibration information. In a first embodiment, the emission parameters may be adjusted based on a cell state (e.g., measured by one or more signal sensor systems). In a first example, when a protein (e.g., a cell receptor) is considered saturated, the signal intensity decreases. In a second example, when the protein is not activated in response to a signal emission, the signal intensity increases. In a third example, the display 100 may include a signal sensor system (e.g., an optical sensor and / or an electrical sensor) that may be used to determine a retinal coding scheme (e.g., based on a mapping of in vivo cell responses) that may be used to calibrate the emission parameters. In a second embodiment, the emission parameters may be manually adjusted. For example, feedback from a user (e.g., a patient report of the perceived results of the stimulus) may be used to determine a retinal coding scheme for adjusting the emission parameters. In an illustrative example, since cones often strike single dwarf ganglion cells and humans can detect single cone stimulation, a user may consciously perceive a single retinal ganglion cell (RGC) stimulation and report the location and effect of the perception.
[0079] However, the transmit parameters may be determined in other ways.
[0080] Optionally, the display 100 may include one or more signal sensor systems (e.g., the optical sensor system includes an imaging sensor, a voltage sensor, a current sensor, etc. having a recording electrode and a detector circuit). The signal sensor system is used to detect cell state information. The signal sensor system can measure: the presence and / or concentration of one or more cell molecules (e.g., calcium ions), the response of proteins (e.g., cell receptors) to excitation signals (e.g., fluorescence spatial distribution, intensity, attenuation, etc.), the response of proteins to secondary signals (e.g., light of different wavelengths, signals from another cell, etc.), protein mechanical responses, and / or any other cell state metrics. In a first variant, the signal sensor system can be associated with an excitation signal emission system. For example, the excitation signal emission system emits a first signal (e.g., light of a first wavelength emitted from the display 100 and received by the cell), which stimulates the optogenetic sensor in the cell to emit a second signal (e.g., light of a second wavelength emitted by the cell and received by the display 100), wherein the second signal is detected by the signal sensor system. In a specific example, the intensity of the second signal indicates the intensity of a cell event (e.g., an activation potential emission from a cell), wherein the cell event is caused by an optogenetic actuator that receives an initial signal emitted by an excitation signal emission system. In an example, an optogenetic sensor can be a protein different from an optogenetic actuator, wherein a single cell can include both an optogenetic sensor and an optogenetic actuator, or only one of the two. In a second variation, the signal sensor system can receive electrical signals (e.g., biopotentials, currents, their changes, etc.). Electrical signals can be emitted by the same cell associated with the excitation signal emission system, by different cells, and / or any other biological and / or electrical components. For example, a feedthrough can be used to connect an electrical sensor (e.g., a voltage sensor and / or a current sensor) in a signal sensor system to a cell. In an illustrative example, an electrical sensor is inserted (e.g., via a tip, a nail, other protrusions, etc.) into the retinal surface (e.g., 10 μm to 200 μm, 50 μm, 100 μm, any range or value therebetween, less than 10 μm, greater than 200 μm, etc.). In certain examples, directly recording electrical signals from cells can reduce crosstalk (e.g., optical signals from an excitation signal transmitting system minimally excite electrical sensors in a signal sensor system), which can be particularly important in low signal-to-noise ratio situations such as neural recordings.
[0081] In a first example, a signal sensor system can be used for calibration. In a specific example, the signal sensor system can ensure that the intensity of light emitted by the light emission system is calibrated to be above an activation threshold (e.g., an activation threshold of a cell protein) and / or below a saturation threshold. In a second example, the signal sensor system can be used to determine cell activity, wherein the stimulus that excites the signal emission system can optionally be adjusted based on cell activity. In a specific example, when the display 100 is used directly in the brain and the cells in the display-brain interface 200 are receiving additional signals from neurons, the emission parameters can depend on cell activity. Optionally, the display 100 can send cell state information to: a controller 300 (e.g., to calibrate emission parameters), a display processing circuit (e.g., to directly calibrate the light emission system), an external device 400, and / or any other system.
[0082] In an illustrative example, a display unit includes: a first signal element having a light emitting system that emits light of a first wavelength, the light of the first wavelength being configured to stimulate a first cell having an optogenetic actuator (e.g., for neuronal signaling; by activating the optogenetic actuator of the first cell); a second signal element having a light emitting system that emits light of a second wavelength, the light of the second wavelength being configured to stimulate a second cell having an optogenetic sensor (e.g., where the light of the second wavelength stimulates the optogenetic sensor to emit light of a third wavelength based on a cell state); and a third signal element having a light sensor system that detects light of a third wavelength from the second cell. In this example, the first cell may be the second cell (e.g., where a single cell has an optogenetic actuator and an optogenetic sensor) or the first cell may be different from the second cell (e.g., where the first cell is associated with the first signal element, and the second cell is associated with the second signal element and the third signal element).
[0083] The display 100 may optionally include and / or be coupled (e.g., adhered, mounted, etc.) to one or more optical components (e.g., micro-optical components). The optical components may be used to collimate light, homogenize light, focus light (e.g., onto a smaller number of cells), reduce light reflected back through the lens of the eye, and / or otherwise modify light emitted to or from the display 100. The optical components may be located in front of the display 100 (facing the display-brain interface 200) and / or behind the display 100; Fig.23AAn example is shown in . In a first variation, the optical component includes a lens (e.g., a microlens, a diffractive lens, a superlens, etc.). In a specific example, the lens can be positioned in front of each μLED (e.g., on the emission side) to collimate the light from the μLED toward one or more cells in the display-brain interface 200. In a second variation, the optical component includes a back reflector (e.g., located on the back side of the display 100, on the back side of each μLED, etc.). In an example, the back reflector can be a metal (e.g., aluminum, silver, etc.), a Bragg reflector, and / or any other reflector. In a third variation, the optical component can include a designed μLED, wherein the designed μLED is the μLED of the excitation signal transmission system. Fig. 23B An example is shown in . In a first example, the designed μLED has a smaller emitter, which can have an improved emission distribution (e.g., including collimated light). In a first specific example, the entire μLED can be designed to be smaller. In a second specific example, the pumping area of the quantum well of the μLED can be designed to be smaller. In the second example, the μLED can have a modified shape. In a specific example, the μLED can have a parabolic shape on the back side of the μLED (e.g., forming a parabolic back reflector). In a third example, an optical component can be coupled to the μLED (on the emission side and / or the front side). In a fourth example, the μLED can include a buffer layer (e.g., gallium nitride) on the emission side, which can be patterned to serve as an optical component. In a fourth variation, the optical component can be a combination of the first variation, the second variation, and / or the third variation. The mapping between the optical component and the light emitting system can be: 1:1 (e.g., one optical component per μLED), 2:1, 1 optical component for a whole set of display units (e.g., across the back reflector of the display 100), and / or any ratio between optical components and signal elements.
[0084] However, display 100 may be configured in other ways.
[0085] The system may optionally include a display-controller connector that can be used to connect the display 100 to the controller 300. The display-controller connector preferably includes an electronic connection (e.g., a wire, a metal line, a trace, etc.) that physically connects the display 100 to the controller 300, but may alternatively include a wireless connection (e.g., Bluetooth, BLE, NFC, IR, RF, etc.). The number of connections on the display-controller connector can be between 1 and 10,000 or any range or value therebetween (e.g., 5 to 1000, 5 to 20, 100 to 1000, 10 to 500, greater than 100, greater than 200, greater than 500, greater than 1000, etc.), but may alternatively be greater than 10,000. Each connection can be between 0.5 μm and 100 μm or any range or value therebetween (e.g., 2 μm to 10 μm, 5 μm, etc.), but may alternatively be less than 0.5 μm or greater than 100 μm. The display-controller connector may include a single row of connections, multiple rows of connections (e.g., stacked), and / or any other configuration of one or more connections. The connections may be adhered to a backing, encapsulated within a sealant, and / or otherwise supported. The thickness of the display-controller connector may be between 5 μm and 150 μm, or any range or value therebetween (e.g., 10 μm to 30 μm, less than 30 μm, less than 20 μm, etc.), but may alternatively be less than 5 μm or greater than 150 μm. The width of the display-controller connector may be between 0.5 mm and 100 mm, or any range or value therebetween (e.g., 1 mm to 5 mm, 2 mm, less than 50 mm, less than 20 mm, less than 10 mm, less than 5 mm, etc.), but may alternatively be less than 0.5 mm or greater than 100 mm. The length of the display-controller connector (e.g., the length of each connection) can be between 1 mm and 1 cm or any range or value therebetween (e.g., 5 mm to 100 mm, 10 mm to 40 mm, etc.), but can alternatively be less than 1 mm or greater than 1 cm. The display 100 and the display-controller connector can be manufactured on the same wafer, assembled together after the display 100 is manufactured, and / or manufactured in other ways.
[0086] In a first example, the display 100 includes an active driver (e.g., having logic located at the display 100). In this example, the display-controller connector may optionally include fewer wires than the number of pixels. In a second example, the display 100 includes a passive driver. In this example, the display-controller connector may include multiple wires (e.g., one wire for each pixel or set of pixels; one for each pixel-color channel combination, etc.); alternatively, the display-controller connector may include fewer wires (e.g., having a lower cardinality relative to the display unit).
[0087] However, the display-controller connection may be configured in other ways.
[0088] The system may optionally include a display-brain interface 200 for converting stimulus signals from the display 100 into neural signals that are interpretable by the brain.
[0089] The display-brain interface 200 preferably includes a group of cells connected to the brain (e.g., directly or indirectly), but can be configured in other ways. The display-brain interface 200 is preferably located in the signal conduction path between the display 100 and the nervous system (e.g., the brain), but can be arranged in other ways. In a specific example, when activated by an excitation signal from the display 100, the cells can induce activity in the visual cortex (e.g., induce focal visual evoked potentials in the visual cortex). Fig.30 and Fig.31 In the illustrative example, a display 100 corresponding to a human's ~10 degree visual space (e.g., with an active area of 2.56 mm x 2.56 mm) can stimulate evoked activity patterns similar to visual evoked potentials elicited by high-contrast 10 degree stimulation, much more than evoked activity patterns from full-field optogenetic stimulation outside the eye (e.g., Fig.32 and Fig.33 ).
[0090] In a first variation, the display-brain interface 200 includes original, unmodified cells. For example, the display-brain interface 200 may include photoreceptor cells (e.g., where the display 100 emits light that is detected by the photoreceptor cells), plexiform cells, retinal ganglion cells, neurons, and / or any other cells that directly or indirectly interface with the nervous system.
[0091] In a second variation, the display-brain interface 200 includes, creates, and / or utilizes genetically modified cells. The genetically modified cells may include optogenetically modified cells having light-sensitive biochemical signaling pathways (e.g., such that the cells produce a biochemical signal in response to detecting certain wavelengths of light), hypoimmune cells genetically modified to include a small molecule kill switch (e.g., transfected with a kill switch gene) (e.g., genetically modified to reduce immune responses caused by implantation of the display 100), combinations thereof, and / or other genetically modified cells. Examples of cells that may be genetically modified include: organoids (e.g., having multiple retinal cell types), cells selected from organoids (e.g., specific cell types), retinal ganglion cells, plexiform layer cells (e.g., where plexiform layer cells can signal to naive retinal ganglion cells), photoreceptor cells, any cell used for vision, neurons, stem cells (e.g., where stem cells are genetically modified prior to differentiation), any animal cell (e.g., a human cell), and / or any other cell. In certain examples, the cells may include neurons, retinal ganglion cells, and / or other cells derived from pluripotent stem cells. The cells may be native to the implant site of the display 100 (e.g., cells modified in situ) and / or developed outside the implant site (e.g., modified and / or grown in vitro; extracted and optionally differentiated user stem cells; etc.).
[0092] In a variation utilizing modified cells, cells can be genetically modified by transfecting cells with a light-sensitive protein that acts as an optogenetic actuator (e.g., an optogenetic effector) and / or an optogenetic sensor (e.g., using a virus with a plasmid and a capsid). Optogenetic actuators produce a biochemical signal (e.g., an action potential) in response to receiving light of a specific wavelength; optogenetic sensors produce light of a specific wavelength based on (e.g., proportional to) the state of the cell (e.g., the concentration of a given molecule). However, optogenetic actuators and optogenetic sensors can be defined in other ways. In a variation, an optogenetic sensor can be coupled to an optogenetic actuator in a cell (e.g., a fusion construct) such that when the optogenetic actuator receives light of a first wavelength, the optogenetic sensor is activated so that it can emit light of a second wavelength based on the state of the cell.
[0093] In an example, cells (e.g., primary retinal ganglion cells) can be transfected using the following methods: intravitreal injection, peripheral retinal injection, injection under the internal limiting membrane (e.g., guided by optical coherence tomography), injection after vitrectomy and internal limiting membrane peeling, injection through a hole created in the internal limiting membrane using a NdYAG laser, and / or any other transfection method. Cells can be transfected in situ (e.g., in the eye), ex situ (e.g., outside the eye and subsequently implanted in the eye), and / or in any other suitable location. The virus used to transfect cells can optionally target specific cell types (e.g., general somatic cells, neurons, retinal ganglion cells, retinal ganglion cell types, stem cells, etc.). The capsid can be an adeno-associated virus capsid (e.g., AAV2.7M8) and / or any other suitable capsid. The plasmid can be an opsin, a fluorescent biosensor protein, and / or any other suitable plasmid. Examples of visual proteins include: CheRiff, ChroMD, ChroME, ChroME2S, ChRmine (e.g., ChRmine-mScarlet), ChrimsonR (e.g., including red-shifted variants), ReachR, and / or any other visual protein. In an illustrative example, cells can be transfected using: AAV2.7m8hSyn1-ChRmine-Kv2.1-WPRE. Examples of fluorescent biosensor proteins include: GCaMP8s, GCaMP8m, jRGeco1a, YCaMP, iGECI, and / or any other suitable protein. Visual proteins can be activated by blue light, green light, red light, and / or any other wavelength. Different plasmids (e.g., with different wavelength sensitivities) can optionally be used for content delivery (e.g., input), sensing (e.g., cell monitoring), and / or sensor activation. Different plasmids can optionally be used for different types of content (e.g., different communication modes). Different plasmids may optionally be used for different types of cells (eg, different types of ganglion cells), wherein the wavelength of light emitted by the excitation signal emitting system is appropriate for the cell type. However, any optogenetic method may be implemented.
[0094] In a variation, the number of cells expressing the opsin can be reduced. In a first example, cell type specific expression can be encoded by a promoter. In a first specific example, the promoter can be a CAG promoter, which can express the opsin in most infected cells. In a second specific example, the promoter can be a human synapsin promoter, which can limit opsin expression to neuronal cells. In a second example, the virus can be spatially confined (e.g., spatially confined within the retina). In an illustrative example, the virus can be embedded on a display surface (e.g., using a silk fibroin hydrogel), which can significantly reduce the number of cells expressing the opsin in the eye without changing the function of the device.
[0095] The cells (e.g., unmodified cells or modified cells) are preferably positioned so that they can send signals to and / or receive signals from the display signal element, but may additionally or alternatively be positioned separately from the display signal element. In variations, the modified cells may be sparse (e.g., spaced a minimum distance apart, such as or larger), densely (e.g., spaced no more than a threshold distance apart), and / or otherwise arranged.
[0096] In a first variation, the cells are located in a cell support that is connected to (e.g., adhered to) and / or part of the display 100 (e.g., wherein the cells can be genetically modified prior to and / or after being seeded into the cell support). Fig. 13B An example is shown in . In the example, the cell support can be adhered to the display 100 using an adhesive (e.g., epoxy), polymerization, and / or any other suitable method. The cell support is preferably adhered to the display 100 in a manner that has a gap between the cell support and the display 100 (e.g., to improve optics), but may alternatively be adhered directly to the display 100. The gap may be between 10 nm and 20 μm or any range or value therebetween, but may alternatively be less than 10 nm or greater than 20 μm. Preferably, the cell body is captured by the cell support while the cell projects axons and / or dendrites out of the cell support to dock with the initial cell. Alternatively, the cell may be completely captured (e.g., without axonal or dendritic projections) or not captured (e.g., the cell body may move out of the cell support). Examples of methods for capturing cells include: swelling hydrogels, covering layers that adhere to the cell support after seeding (e.g., sealing the cell support micropores), chemical functionalization of the surface of the cell support (e.g., via surface treatments) that can promote cell growth and / or inhibit cell growth, and / or any other capture method.
[0097] In a first example, a cell support is a device that defines a set of cell holding units (e.g., microwells; Fig.12 and Fig.14The cell holding unit may be open, closed and / or have any other geometric shape. The matrix material may be a flexible polymer, a substantially rigid material and / or any other suitable material. The pattern of the cell holding unit and / or the cell pattern (e.g., the spacing between cells, the frequency of cells, etc.) is preferably equivalent to or based on the display unit pattern (e.g., each signal element corresponds to a cell), but may alternatively be any other pattern. In the illustrative example, each display unit and / or its signal element (e.g., each μLED) corresponds to a single cell holding unit, where the single cell holding unit is configured to hold a single cell. Figure 4A , Figure 4B , Figure 4C , Figure 4D , Figure 4E and Figure 4F An example is shown in . In a second example, the cell support is a gel (eg, a hydrogel). However, any other suitable cell support may be used.
[0098] In a first embodiment, the cells in the cell support function as photoreceptor cells (e.g., the cells interface with retinal ganglion cells, optionally replacing non-functional photoreceptor cells). In a second embodiment, the cells function as retinal ganglion cells (e.g., the cells interface with neurons in the brain). In a third embodiment, the cells function as neurons (e.g., located in the brain, interface directly with other neurons). However, the cells may interface with the nervous system in other ways.
[0099] In a second variation, the cell is in its native location (e.g., a retinal ganglion cell, a neuron in the visual cortex, a cell in the brainstem, etc.). In a first example, the initial cell is genetically modified in situ (e.g., the initial, unmodified cell is converted into a genetically modified cell); Figure 3A , Figure 3B , Figure 3C , Figure 3D , Figure 3E and Figure 3F Examples are shown in . In the second example, the initial cells remain unmodified; Figure 5A and Figure 5B An example is shown in . However, the cells may be located at any location and / or multiple locations.
[0100] However, the display-brain interface 200 may be configured in other ways.
[0101] The controller 300 is used to communicate with the external device 400 and control system operation (e.g., operation of the display 100) based on the communication (e.g., based on emission parameters determined according to the communication and / or received via the communication). The controller 300 can optionally be used to power the display 100, wherein the controller 300 itself can be powered by an external power source or an onboard power source (e.g., a battery). The controller 300 is preferably not physically connected to the external device 400, but can alternatively be physically connected. The controller 300 is preferably physically connected to the display 100 (e.g., via physical wires in a display-controller connector), but can alternatively not be physically connected to the display 100 (e.g., wherein the emission parameters are sent wirelessly to the display 100). The controller can optionally be coupled to multiple displays (e.g., to increase the total display surface area without increasing the implant incision). The power supply 500 and / or its components can optionally be within the controller 300, coupled to the controller 300 (e.g., outside the controller volume) and / or connected to the controller in other ways.
[0102] The controller 300 is preferably flexible, but may also be rigid and / or have both flexible and rigid components. The controller thickness may be between 0.1 mm and 20 mm or any range or value therebetween (e.g., 0.5 mm to 2 mm, less than 10 mm, less than 5 mm, less than 2 mm, etc.), but may alternatively be less than 0.1 mm or greater than 20 mm. The volume of the controller 300 may be between 50 μL and 500 μL or any range or value therebetween (e.g., 100 μL to 200 μL, 130 μL to 150 μL, etc.), but may alternatively be less than 50 μL or greater than 500 μL. The controller 300 is preferably mounted within the footprint of the glaucoma tube drainage device (e.g., 50 mm 2 Up to 500mm 2 ), but may alternatively be larger or smaller than the footprint of a glaucoma tube drainage device (e.g., a conventional glaucoma drainage implant). In a particular example, the controller may have a form factor of a glaucoma tube drainage device. Fig.18 An example is shown in FIG.
[0103] The controller 300 may optionally include one or more of the following: a communication element, a power supply 500 and / or components thereof (e.g., a power receiver component, a power rectification and / or regulation component, etc.), a processing system (e.g., a processor, a memory, a data processing circuit, etc.), a filter, a controller sensor, a memory (e.g., a flash memory for storing instructions), an analog-to-digital converter, additional security features, and / or any other system components. In an example, the processing system includes an integrated circuit (e.g., a field programmable gate array (FPGA), a microcontroller, a system on a chip, etc.). Fig.11 An example is shown in FIG.
[0104] The controller sensor can be used to measure the controller state, and can additionally or alternatively determine the implant state (e.g., including the controller state, the display state, etc.). The controller 300, the external device 400, and / or the display 100 can be optionally controlled based on the controller state. In a first example, in response to the detection or occurrence of a predetermined controller state (e.g., indicating water ingress, temperature above a threshold, etc.), power can be stopped to one or more components. In a second example, the content and / or emission parameters from it can be adjusted based on the controller state (e.g., processing content based on the posture and / or movement of the controller). The controller state can include: temperature, humidity, movement, posture (e.g., including position and / or orientation), electrical short circuit (in the controller 300, in the display 100 connected to the controller 300, etc.), and / or any other information associated with the controller, wherein the controller can include one or more sensors that measure the corresponding parameters. In a first example, the controller 300 may include a motion sensor (e.g., an inertial measurement unit, a retroreflector, other optical components, etc.) for tracking the position, orientation, and / or movement of the eye (e.g., the gaze of the eye) and / or the position, orientation, and / or movement of one or more components of the system. The motion sensor preferably tracks motion at 3DoF to 6DoF or any range or value therebetween, but may alternatively track motion at less than 3DoF or greater than 6DoF. In a second example, the controller 300 may include a temperature sensor for detecting overheating. In a third example, the controller 300 may include a moisture sensor (e.g., a humidity sensor) for detecting water entering the controller 300. In a fourth example, the controller 300 may include a current measurement sensor for detecting a short circuit (e.g., in the display 100).
[0105] The communication elements of the controller 300 may include: a receiver, a transmitter, a wired connection, and / or any other component. The communication between the controller and the display 100 may be through: a display-controller connector and / or any other connection. The communication between the controller and the external device may be through: wireless communication (e.g., radio frequency (RF), infrared (IR), Bluetooth, BLE, NFC, another transmission frequency, a wavelength that is the same or different from the wavelength used to stimulate the display-brain interface 200, etc.), wired communication, and / or any other connection. In a specific example, the controller includes an IR diode and an associated integrated circuit. The information received by the communication elements of the controller 300 may include: content (e.g., where the controller calculates emission parameters based on the received content), emission parameters (e.g., calculated by the external device 400), cell measurements (e.g., cell states measured by the display 100), and / or any other information. The information sent by the communication elements of the controller 300 may include: emission parameters (e.g., sent to the display 100), controller measurements (e.g., controller states measured by controller sensors), controller gesture signals (e.g., emitted light received by a tracking sensor of the external device 400), and / or any other information. Information transmitted between the external device 400 and the controller 300, between the controller 300 and the display 100, and / or between any other system components may be transmitted in real time (e.g., in response to a request, in response to sampling of measurements by the sensor 450, etc.), iteratively, asynchronously, periodically, and / or at any other suitable time. Figure 2 An illustrative example of information transmission is shown in .
[0106] The controller 300 can be: implanted with the display 100, juxtaposed with the display 100, non-situ positioned, and / or positioned in other ways. In an example, the controller can be located: on the eye, inside the eye, in the eye socket, on or near the brain (e.g., brain surface, brain stem, etc.), on or near the spine (e.g., spinal cord), any subcutaneous location, on or near the ear (e.g., ear canal), and / or any other location. In a first embodiment, the controller 300 is an extraocular component of the system located on the eyeball (e.g., having a form factor and / or position similar to a glaucoma tube drainage device). In this embodiment, the controller 300 is preferably located on the sclera below the conjunctiva of the eye so that the implanted system components (e.g., display 100 and controller 300) do not destroy the immune barrier (e.g., without using percutaneous wires). In a second embodiment, the controller 300 is located on or near the brainstem (e.g., so that the controller 300 can be physically connected to the display 100 implanted on the brainstem without using percutaneous wires). However, the controller 300 may be located elsewhere.
[0107] The controller 300 may optionally include an ocular attachment mechanism for attaching the controller 300 to the outer surface of the eye (e.g., beneath the conjunctiva of the eye). In a particular example, the ocular attachment mechanism includes one or more suture attachments (e.g., suture holes, tabs, etc.). The ocular attachment mechanism may optionally include a mechanism for use in glaucoma tube drainage implants. The controller 300 may optionally include a carrier attachment mechanism for docking with a surgical carrier device for facilitating implantation. The carrier attachment mechanism may include holes in the controller 300, ridges on the controller 300 (e.g., to dock with a clip), suture attachments, and / or any other securing mechanism. The carrier attachment mechanism may optionally include all or a subset of the ocular attachment mechanisms (e.g., a subset of ocular attachment suture holes). Fig.17 An example is shown in FIG.
[0108] However, the controller 300 may be configured in other ways.
[0109] The display 100, the display-controller connector, the controller 300, and / or any other implantable system component can be manufactured using a membrane (e.g., a film) and optional auxiliary materials (e.g., a backing and / or a sealant), but may alternatively be manufactured in other ways. The membrane material may include titanium, platinum, gold, palladium, silicon, and / or any other metal. The film thickness may be between 50 nm and 50 μm or any range or value therebetween (e.g., 100 nm to 5 μm), but may alternatively be less than 50 nm or greater than 50 μm.
[0110] In a first variation, manufacturing an implantable system component includes integrated manufacturing of a monolithic film containing an excitation signal emission system array (e.g., a μLED array) and a display-controller connector (e.g., wiring). The monolithic film may additionally or alternatively include one or more electronic components of the controller 300 and / or their connections. In an example, the excitation signal emission system array and the display-controller connector may be manufactured using the same wafer. In an example, integrated manufacturing may achieve fewer interfaces, improved component alignment, reduced thickness, increased component density (e.g., including wiring between μLEDs), reduced tolerances, and / or provide other advantages.
[0111] In a particular example, implantable system components can be monolithically fabricated on an epitaxially grown GaN-on-sapphire substrate using polyimide and / or any other backing material as a flexible backbone for vias for multi-layer (e.g., 4-6 layers), trace (e.g., gold trace) wiring. Electronic components can optionally be assembled directly onto the polyimide-metal structure prior to substrate release. A single μLED can optionally be buried in a monolithic polyimide package (e.g., as opposed to being transferred to an existing wiring layer). In a variation, this can provide the advantage of high-resolution alignment on an inherently flexible substrate by building flexible components onto the μLEDs and subsequently releasing them. Additionally or alternatively, this can provide the advantages of denser wiring and more tightly integrated packaging layers.
[0112] In a first example, the display 100 is manufactured using a monolithic multilayer film (e.g., adhered to a substrate). In an illustrative example, the multilayer film can be embodied as a single laminated film. In a first specific example, the display-controller connector can include connections routed in a substantially straight configuration (e.g., the μLED array is manufactured so that the emission side is located below a layer including the display-controller connection, with the controller components being assembled above the layer); Fig.21A An example is shown in . In this example, the display-controller connector can be flexible so that the display-controller connector can be bent when implanted (e.g., bend greater than 60°, greater than 90°, greater than 120°, greater than 150°, etc.); Fig.16 An example is shown in In a second specific example, the display-controller connector may include connections routed in a "u-turn" configuration (e.g., the μLED array is fabricated with the emitting side located above a layer including the display-controller connections, wherein the controller components are assembled above that layer); Fig.24C and Fig.25 Examples are shown in In a second example, the display 100 is manufactured using a multilayer film (e.g., adhered to a substrate) that includes a sacrificial layer (e.g., a portion or all of a layer) that is dissolved after tracking and / or other manufacturing processes are completed; Fig. 21B An example is shown in . The sacrificial layer can enable the use of two-dimensional manufacturing techniques to produce a 3D geometry, where the 3D geometry can better fit the eye. The 3D geometry (e.g., a "hinged" configuration) can include a first wing implantable on the outer surface of the eye (supporting the controller 300) and a second wing implantable inside the eye on the retina (supporting the display 100). Fig.17 , Fig.24A and Fig. 24B An example is shown in .
[0113] In a second variation, manufacturing the display 100 includes separately (e.g., on a thin film) manufacturing the excitation signal emission system array and the display-controller connector. The excitation signal emission system array can optionally be assembled adjacent to additional electronic components (e.g., manufactured separately and then assembled on a film supporting the excitation signal emission system array using an interconnect layer). The additional electronic components can include drivers, transistors and / or other logic components, filters, signal sensor system wiring between display components, and / or any other electronic devices. In an example, arranging additional electronic components adjacent to the excitation signal emission system can reduce the number of wires (channel count) in the display-controller connector (e.g., less than 20, less than 10, etc.), increase the flexibility of the display-controller connector, increase the wire diameter, increase the data bandwidth, reduce current loss, increase efficiency, and / or provide other advantages.
[0114] The display 100, the display-controller connector, the controller 300, and / or any other system components can optionally be attached to a backing (e.g., located on a backing, adhered to a backing, etc.) and / or encapsulated in an encapsulant (e.g., all implantable components are encapsulated in an encapsulant; the controller 300 is encapsulated in an encapsulant, while the display 100 and the display-controller connector are adhered to the backing; the μLEDs remain unencapsulated when the driver and / or other system components are encapsulated; etc.). In a first example, the backing and / or encapsulant is rigid (e.g., sapphire). In a second example, the backing and / or encapsulant is flexible (e.g., a flexible polymer). Examples of backing and / or encapsulant materials include polyimide, liquid crystal polymer, polyparaxylene, elastomeric polyurethane, and / or any other suitable material. The backing and / or encapsulant material can be biocompatible, flexible (e.g., at a relevant thickness), waterproof, rugged for surgical manipulation, have high adhesion strength for adhesion to other displays and / or backing and / or encapsulant materials, and / or have any other properties. The backing and / or sealant are preferably transparent or translucent (e.g., so that when the display 100 is implanted on the retina, the display 100 does not block any remaining photoreceptor cell function), but may alternatively be opaque (e.g., when the display 100 is implanted in the brain). The backing and / or sealant may optionally include an insulating material. For example, the insulating material may include a ceramic insulating material (e.g., siliconized carbon, aluminum oxide, hafnium, etc.). The backing and / or sealant may optionally include an auxiliary buffer material (e.g., epoxy resin underfill); Fig.13A and Fig. 13BExamples are shown in . For example, when the backing and / or sealant include a rigid material, a soft polymer can be used to interface with the implantation site (e.g., the retina). The cushioning material can optionally promote adhesion of the display 100 to the implantation site. The backing and / or sealant can optionally include a tab, where the surgeon can use the tab to position the display 100 at or near the implantation site (e.g., by gripping the tab with forceps).
[0115] Fabricating optical components (e.g., microlenses, back reflectors, etc.) on the display 100 may optionally include: fabricating the optical components simultaneously during fabrication of the excitation signal emission system array (e.g., the designed μLEDs are constructed to have a parabolic geometry for use as optical components); adhering the optical components and / or an array of optical components (e.g., a microlens array) to the display 100, a backing, and / or an encapsulant; fabricating the optical components on a (shared) substrate (e.g., a wafer) with the excitation signal emission system (e.g., where the optical components can be fabricated on the substrate before or after the μLEDs are fabricated on the substrate); and / or using any other fabrication techniques.
[0116] In a variation, the backing and / or sealant can be manufactured to have a designed tension to facilitate implantation. For example, manufacturing the backing and / or sealant can include forming the backing and / or sealant material with a 3D geometry so that when implanted, the backing and / or sealant material applies a spring force (e.g., a radially outward biased force) to press the display 100 onto the implantation location (e.g., the retina). In a specific example, manufacturing the sealant can include encapsulating the display 100, the display-controller connector, and / or any other system components within the sealant material, with the system components arranged in a specified 3D geometry. However, the backing and / or sealant can be manufactured in other ways.
[0117] However, the display 100, display-controller connector, controller 300, and / or other system components may be manufactured in other ways.
[0118] The display 100, display-brain interface 200, and / or display-controller connector can be anchored (e.g., adhered, fixed, etc.) to the implantation site. Anchoring methods can include: tissue adhesive, extrusions on the backing and / or sealant that serve as anchors (e.g., "spikes" of material), padding, pressing the device against the implantation site (e.g., exchanging fluid in the eye for pressurized gas), nails and / or pins inserted through nail holes in the backing and / or sealant, inducing fibrotic growth around the device (e.g., via a laser), cell growth into or out of the display-brain interface, supporting the device on other tissue (e.g., connective tissue that forms the eyeball), combinations of the above, and / or any other method. For example, the number of nails can be between 1 and 5 or any range or value therebetween (e.g., 2 to 4), but can alternatively be greater than 5. In a particular example, the nail hole can be located on the display-controller connector (e.g., where the connection is routed around the nail hole; in Fig. 22 In an illustrative example, implanting the display 100 and controller 300 includes: forming an incision in the eye (e.g., sclerotomy), inserting the display 100 and display-controller connector into the eye through the incision (e.g., using a surgical carrier device), anchoring the display 100 to the retina, and anchoring the controller 300 to the exterior of the eye. Fig.19 , Fig.28 and Fig.29 An example is shown in .
[0119] The system can be used with one or more external devices that can be used to: receive cell measurements (e.g., from the system), determine controls for display 100 (e.g., emission parameters), determine the posture of one or more implanted system components, and / or perform any other set of functions. Examples of external devices that can be used include: glasses, contact lenses, hats, personal computing devices (e.g., smart phones, laptops, etc.), televisions, combinations of the above, and / or any other suitable external device. Fig. 20A and Fig. 20B An example is shown in .
[0120] The external device 400 may optionally include: a communication element 420 configured to communicate with the system (e.g., to communicate with a communication element of the controller 300), a processing system (e.g., a processor, memory, etc.), a sensor 450, a power supply 500 and / or components thereof, a tracking sensor, and / or any other collection of components.
[0121] The communication element 420 of the external device is preferably complementary to the communication element of the controller (e.g., communicating using the same wavelength (such as IR, RF, etc.)), but may be configured in other ways. The communication element 420 may include a transmitter, a receiver, a wired connection, and / or any other collection of components. The communication element 420 is preferably not implanted in the user's body, but may be implanted in the user's body instead. The communication element 420 can be statically positioned relative to the controller 300 (e.g., the communication element 420 moves with the controller 300) or can move relative to the controller 300 (e.g., using beam steering and / or other methods to send data from a transmitter to the controller 300; wherein the controller moves with the eye movement, while the communication element 420 remains stationary, etc.). The information sent by the communication element 420 may include: content (e.g., processed content or unprocessed content), transmission parameters (e.g., parameters calculated based on the content), and / or any other information. The information received by the communication element 420 may include: cell measurements (e.g., cell states measured by the display 100), controller measurements (e.g., controller states measured by controller sensors), controller gesture signals, display gesture signals, and / or any other information.
[0122] An optional tracking sensor can be used to determine the pose of one or more components of the system (e.g., controller 300, display 100, etc.) and / or the eye (e.g., the gaze of the eye). In a first variation, the tracking sensor includes a camera that tracks the eye (e.g., the pupil of the eye, unique eye features, transfected cells, etc.) and / or system components (e.g., the display 100 and / or controller 300 viewed by the eye; light backscattered by the display 100; etc.). In a second variation, the tracking sensor includes a receiver that is configured to receive: light emitted and / or reflected from one or more system components, a controller pose signal (e.g., a tracking signal or pose estimate emitted via a controller communication element), a display pose signal (e.g., emitted via one or more excitation signal emission systems), and / or any other signal. In an example, the receiver includes a set of photodiodes (e.g., at least two photodiodes, at least three photodiodes, etc.), wherein the set of photodiodes can track the light intensity of the signal. External device 400 may optionally use a light propagation model (e.g., modeling light from system components passing through an eye pupil) to locate system components and / or the eye (e.g., eye pupil) based on tracking sensor measurements.
[0123] The external device 400 may optionally determine the content displayed. The content is preferably visual content, but may alternatively be any other content (e.g., content for other senses, such as temperature, other information not related to senses, etc.). Examples of content include: measurements of a real-world scene (e.g., adjacent to the user, in front of the user or external device 400, in the direction of eye gaze, etc.); artificial reality (AR) overlays (e.g., AR overlays only); AR overlaid onto measurements of adjacent real-world scenes; virtual reality (VR); and / or any other information.
[0124] In a first variant, the content is measured using a sensor 450. Examples of sensor 450 include: a camera (or any optical sensor), a temperature sensor, a motion sensor, a pressure or force sensor, and / or any other sensor. The sensor 450 is preferably statically positioned relative to the external device 400 and / or its components (e.g., statically maintained within a shared external device housing), but may alternatively be moved relative to the external device 400 (e.g., separated from the external device 400 or moved relative to the external device 400). In a first example, the sensor 450 is mounted to the user (e.g., via glasses, contact lenses, hats, etc.), wherein the sensor may optionally move with the user's eye movements. In a second example, the sensor 450 is mounted separately from the user (e.g., on a drone, on a second user, on a fixed camera in an auxiliary position, etc.). In a second variant, content is generated using an AR engine, a VR engine, and / or any other content simulation method. In a third variant, content is generated in other ways (e.g., retrieving content from a database, from another device, etc.).
[0125] The content may optionally be processed by the external device 400 (e.g., as part of generating emission parameters based on the content). For example, the content may be processed (e.g., temporally adjusted, spatially adjusted, intensity adjusted, etc.) so that the synthesized signal received by the user from the display 100 is more natural (e.g., mapping an image to display the excitation signal emission so that the brain can better interpret the signal in response to the light emission). The content processing may depend on the implantation location of the display 100 (e.g., processing images for retinal displays may be different from processing images for direct neural stimulation), cell state, and / or other parameters. In a first embodiment, processing the content includes adjusting the resolution. In a first specific example, the image may be compressed (e.g., downsampled) based on the number of cells in the display-brain interface 200 (e.g., optionally simulating the natural compression between photoreceptor cells and retinal ganglion cells). In a second specific example, the content may be adjusted for variable resolution within the display 100 (e.g., a lower resolution at a location on the display 100 away from the fovea). In a second embodiment, the content may be processed based on eye and / or eyelid movement. In a first example, the content can be based on an image sampled by a first sensor and an eye trajectory determined using a second sensor (e.g., a motion sensor on the controller 300, a tracking sensor on the external device 400, a combination thereof, etc.), where the content is associated with the field of view of the eye based on the eye orientation. In a second example, the content can be paused or otherwise adjusted when the user's eyelids are closed. In a third embodiment, the content can be processed to take into account image depth (e.g., thereby enabling the brain to process a 2D image as a 3D image). In a third embodiment, the content can be adjusted based on cell state (e.g., brightness increases when less than a threshold number of cells are stimulated; brightness decreases when more than a threshold number of cells are saturated; etc.).
[0126] However, the external device 400 may be configured in other ways.
[0127] The power supply 500 is used to power one or more implanted system components (e.g., the controller 300 and / or the display 100). In a first variation, the power supply 500 (or components of the power supply 500) are remote from the implanted system components. The power supply 500 may include a power transmitter component remote from the implanted system components (e.g., coupled to the external device 400, coupled to a separate device, etc.) and a power receiver component connected to one or more implanted system components (e.g., coupled to the controller 300). For example, the power receiver component may be coupled to the controller 300 via a flexible tether (e.g., allowing free positioning). In a specific example, the power receiver component may include: a magnetic coil, a magnetoresistive film, and / or other power receiver components that can interface with an external inductive power supply. The power supply 500 can power the implanted system components via induction, IR, RF, and / or any other remote power supply method. The power supply 500 and / or its components may be located in the same or different external device as the communication element 420 (e.g., the power supply 500 is located on a pair of glasses having the communication element 420). The implanted system components preferably do not have substantial power storage components, such that the implanted system components cannot fully operate without power from the power source 500 (e.g., when the power source 500 is located on a pair of glasses, when the glasses are removed from the user, power to the (implanted) controller 300 and / or display 100 ceases), but may instead have power storage. In a second variation, the power source 500 is implanted with the system components (e.g., a battery implant).
[0128] The power consumption of the implantable system components may be between 10 mW and 100 mW or any range or value therebetween (eg, 30 mW to 35 mW, less than 50 mW, etc.), but may alternatively be greater than 10 mW or less than 100 mW.
[0129] However, power supply 500 may be configured in other ways.
[0130] In a variation, the system can use the systems and methods disclosed in: "Athin-film optogenetic visual prosthesis" (Knudsen EB, Zappitelli K, Brown J, Reeder J, Smith KS, Rostov M, Choi J, Rochford A, Slager N, Miura SK, Rodgers K, Reed A, Israeli YRL, Shiraga S, Seo KJ, Wolin C, Dawson P, Eltaeb M, Dasgupta A, Chong P, Charles S, Stewart JM, Silva RA, Kim T, Kong Y, Mardinly AR, Hodak M, 2023 bioRxiv doi:10.1101 / 2023.01.31.526482), which is incorporated by reference in its entirety.
[0131] Illustrative examples
[0132] In a first illustrative example, the system can be used as a visual prosthesis for a user who has lost the function of their photoreceptor cells but still has functioning retinal ganglion cells. The external device 400 sends an image (e.g., sampled by a camera) and / or emission parameters determined based on the image to the controller 300, where the controller 300 controls the display 100 based on the received information. The light emission system in the display 100 emits light based on the emission parameters and / or other control information. The light is received by the user's original retinal ganglion cells (display-brain interface 200), where the retinal ganglion cells are genetically modified to express transgenic proteins that are sensitive to the wavelength of light emission. The retinal ganglion cells stimulate neurons in the brain in response to receiving the light, where the brain can interpret the stimulation (e.g., enabling the user to "see" the image).
[0133] In a second illustrative example, the system can be used as a visual prosthesis for a user who has lost the function of their photoreceptor cells and / or retinal ganglion cells. The controller 300 provides emission parameters determined based on the received image to the display 100, wherein the light emission system in the display 100 emits light based on the emission parameters. The light is received by genetically modified cells (e.g., genetically modified to express a transgenic protein sensitive to the wavelength of light emission) seeded into a cell support connected to the display 100. The genetically modified cells dock with the initial cells (e.g., using axons and / or dendrites) to provide signals to the initial cells, which ultimately provide signals to the brain. In a specific example, the genetically modified cells in the cell support stimulate the initial retinal ganglion cells (e.g., where the initial retinal ganglion cells function normally). In a second specific example, the genetically modified cells in the cell support act as retinal ganglion cells and directly stimulate the brain.
[0134] In a third illustrative example, the system can be used as a retinal display for a user having functional photoreceptors and retinal ganglion cells (e.g., for an artificial reality system). The controller 300 provides emission parameters determined based on the generated image to the display 100, wherein a light emission system in the display 100 emits light based on the emission parameters. The light emission includes multiple wavelengths of light (e.g., RBG wavelengths) and is received by the user's original retinal ganglion cells (display-brain interface 200), wherein the retinal ganglion cells are not genetically modified. The retinal ganglion cells stimulate neurons in the brain in response to receiving the light, wherein the brain can interpret the stimulation.
[0135] In a fourth illustrative example, the system can be used to directly stimulate neurons so that the brain can receive and interpret any type of content (e.g., visual and / or non-visual content, simulated and / or measured information, etc.). The controller 300 provides emission parameters determined based on the received content to the display 100 (implanted in the brain, brainstem, spinal cord, or other nervous system component), where the light emission system in the display 100 emits light based on the emission parameters. The light is received by genetically modified cells (e.g., genetically modified to express a transgenic protein sensitive to the light emission wavelength) seeded into a cell support connected to the display 100. The genetically modified cells interface with the original neurons (e.g., using axons and / or dendrites) to provide signals directly to the brain.
[0136] The different subsystems and / or modules discussed above may be operated and controlled by the same or different entities. In later variations, the different subsystems may communicate via an API (e.g., using an API request and response, an API key, etc.), a request, and / or other communication channels.
[0137] Alternative embodiments implement the above methods and / or processing modules in a non-transitory computer-readable medium, which stores computer-readable instructions that, when executed by a processing system, cause the processing system to perform the methods discussed herein. Instructions can be executed by a computer-executable component integrated with a computer-readable medium and / or a processing system. The computer-readable medium may include any suitable computer-readable medium, such as RAM, ROM, flash memory, EEPROM, optical device (CD or DVD), hard drive, floppy disk drive, non-transitory computer-readable medium, or any suitable device. The computer-executable component may include a computing system and / or a processing system (e.g., including one or more collocated or distributed, remote or local processors) connected to a non-transitory computer-readable medium such as a CPU, GPU, TPU, microprocessor, or ASIC, but the instructions may be executed alternatively or additionally by any suitable dedicated hardware device.
[0138] Embodiments of the systems and / or methods may include every combination and permutation of the various system components and various method processes, wherein one or more instances of the methods and / or processes described herein may be performed asynchronously (e.g., sequentially), simultaneously (e.g., together, in parallel, etc.), or in any other suitable order by and / or using one or more instances of the systems, elements, and / or entities described herein. The components and / or processes of the accompanying systems and / or methods may be used with, supplement, replace, or otherwise integrated with all or part of the systems and / or methods disclosed in the above-mentioned applications, each of which is incorporated in its entirety by this reference.
[0139] As those skilled in the art will recognize from the previous detailed description and from the accompanying drawings and claims, modifications and variations may be made to the preferred embodiments of the invention without departing from the scope of the invention defined in the appended claims.
Claims
1. A system comprising: A controller, wherein the controller is configured to be coupled to an outer surface of an eye of a user, the controller comprising: a receiver configured to receive content from an external device; and a processor configured to determine display instructions based on the content; a connector comprising a plurality of electronic connections configured to transmit the display instructions from the controller to a display; and The display, wherein the display is configured to be coupled to a retina of the user, the display comprising: A μLED array is configured to emit a light signal according to the display instruction, wherein the light signal is received by the genetically modified cells in the retina.
2. The system according to claim 1, wherein: The genetically modified cells are transfected with a gene for a light-sensitive protein, wherein the genetically modified cells produce a biochemical signal in response to receiving the light signal.
3. The system according to claim 2, wherein: The genetically modified cells include retinal ganglion cells.
4. The system according to claim 1, wherein: The display instructions include a temporal sequence of light array patterns, wherein each light array pattern includes a light intensity parameter, wherein each light array pattern encodes a frame of the content.
5. The system according to claim 1, wherein: The display further comprises a logic component, wherein the display instructions comprise μLED state change instructions.
6. The system according to claim 1, wherein: The system is fabricated using monolithic integration on thin films.
7. The system according to claim 1, wherein: The μLED array is configured to emit a light signal having a fixed wavelength.
8. The system according to claim 7, wherein: The fixed wavelength is between 510 nm and 550 nm.
9. The system according to claim 1, wherein: The display also includes micro-optics configured to collimate the light signal.
10. The system according to claim 9, wherein: The micro-optical component includes at least one of the following: a microlens, a superlens, or a back reflector.
11. The system according to claim 1, wherein: The μLED array is configured to emit the light signal with substantially cellular resolution.
12. The system of claim 1, wherein: The content includes an image, wherein the external device includes glasses and a camera configured to sample the image.
13. A system comprising: a cell support comprising a set of microwells configured to hold a set of cells transfected with a gene for a light-sensitive protein; a μLED array coupled to the cell support, wherein the μLED array is configured to emit a light signal based on the display instructions, wherein the light signal is received by the group of cells; a receiver configured to receive content from an external device; and A processor is configured to determine the display instructions based on the content.
14. The system according to claim 13, wherein: The population of cells includes neurons derived from pluripotent stem cells, wherein the cell support is configured to couple to a brain of a user.
15. The system of claim 13, wherein: The μLED array includes at least 1000 μLEDs.
16. The system of claim 13, wherein: The group of cells includes low immune cells, wherein the group of cells are further transfected with a self-destruct switch gene.
17. The system of claim 13, wherein: Each μLED in the μLED array corresponds to a single microwell in the set of microwells, wherein the single microwell is configured to hold a single cell in the set of cells.
18. The system of claim 13, wherein: The system also includes a sensor configured to be implanted in a user, wherein the displayed instructions are adjusted based on measurements from the sensor.
19. The system of claim 18, wherein: The sensor includes at least one of the following: a temperature sensor or a humidity sensor.
20. The system of claim 18, wherein: The sensor is configured to measure a cell state of an initial cell of the user, wherein the cell state includes at least one of a current or a voltage, and wherein the display instruction is adjusted based on the cell state.