Information compression and delivery device and method for fine regulation and control of large-scale neurons

Abstract

The present invention relates to the field of information delivery and relates to spatial information compression and delivery. The present invention provides a device for delivering event information to a nervous system after spatial compression and a method for fine regulation and control of large-scale neurons. The device comprises an imaging system for respectively coding event information into a plurality of patterns, a plurality of optic nervous systems for using a minimum information unit coded in the patterns to regulate and control the activity of single neurons in a nervous system, and a pattern projection system for respectively projecting the plurality of patterns coded by the imaging system to the optic nerve systems. The device and method solve the problems of low information transmission efficiency of existing neural electrodes, and foreign body response between the neural electrodes and a nervous system which causes mechanical damage to nervous tissues, achieve fine regulation and control of neurons in a large-scale neuron cluster, and achieve high-bandwidth input of multi-dimensional event information to a whole brain region of the nervous system.

Description

Devices for information compression and delivery and methods for large-scale fine-tuning of neurons Technical Field

[0001] This invention relates to a method and apparatus for delivering information to the nervous system, and more particularly to an apparatus for delivering spatially compressed event information to the nervous system and a method for large-scale fine-tuning of neurons. Background Technology

[0002] In existing technologies, neural electrodes are often used to deliver information to the nervous system, such as Utah electrodes and flexible neural electrodes. However, these types of neural electrodes have many insurmountable drawbacks:

[0003] 1. Due to the limited channel density of neural electrodes, information cannot be delivered to the nervous system efficiently;

[0004] 2. Due to the limited refresh rate of neural electrode signals, the frame rate at which neural electrodes deliver electrical signals to the nervous system is relatively low.

[0005] 3. Neural electrodes need to be implanted into the nervous system to function. This can lead to immune rejection between the neural electrodes and the nervous system, or the neural electrodes may fall off or shift during animal movement, causing mechanical damage to the nervous system. It also affects the stable use of the neural electrodes and reduces the efficiency and accuracy of nerve signal transmission.

[0006] Therefore, existing technologies for delivering information to the nervous system at high density and achieving large-scale, precise, and stable control of neurons face many insurmountable difficulties, which limit the development of related industries in the field of brain science. Summary of the Invention

[0007] The technical problem to be solved by the present invention is to provide a device for delivering event information to the nervous system after spatial compression and a method for fine control of large-scale neurons. The device and method solve the problems of low information transmission efficiency of existing neural electrodes, immune rejection with the nervous system, and mechanical damage to nerve tissue. At the same time, it realizes the transmission of information to multiple brain regions of the nervous system with high density and low latency, and achieves the beneficial effect of fine control of each neuron in a large-scale neuronal cluster.

[0008] The first aspect of this application provides an apparatus for delivering spatially compressed event information to a nervous system, comprising an imaging system that encodes event information into several patterns, several optic nerve systems that use the smallest information units encoded within the patterns to regulate the activity of one or more neurons within the nervous system, and a pattern projection system that projects the several patterns encoded by the imaging system onto each optic nerve system.

[0009] Furthermore, the imaging system receives event information and divides the various representation parameters of the event information into different dimensions according to the type of information. The information of each dimension is encoded by the imaging system to form an independent pattern; the event information is encoded into several sets of patterns.

[0010] Furthermore, the pattern projection system projects several patterns encoding event information onto the optic nerve system.

[0011] Furthermore, the pattern projection system includes several sub-projection systems, each of which projects a pattern onto a corresponding optic nerve system.

[0012] Furthermore, the optic nerve system is selected from:

[0013] A first photosensitive element, independent of the neuron, generates nerve impulses under light and transmits these nerve impulses to the neuron; or,

[0014] The optic nerve system is selected from neurons with photosensitive points on their surface or inside. The photosensitive points activate the neurons they contain under the action of light signals. These neurons are defined as photoreceptor neurons, i.e., the second photosensitive element.

[0015] Furthermore, each pattern formed by the imaging system includes several image blocks. The brightness and darkness of a single image block represent the smallest information unit. The event information to be projected is encoded in the projected pattern by using the brightness and darkness of each image block within the projected pattern.

[0016] Furthermore, the brightness and darkness of the image block encoding the information control the activation and deactivation of the first photosensitive element at the projection location of the image block, or the brightness and darkness of the image block encoding the information control the activation and deactivation of the second photosensitive element at the projection location of the image block, thereby achieving the regulation of a single neuron.

[0017] Furthermore, the sub-projection system reduces the size of the pattern formed by the imaging system and projects it onto the corresponding optic nerve system;

[0018] Furthermore, the sub-projection system also includes an optical path system for adjusting the position of the projected pattern, enabling the same sub-projection system to project different patterns onto different regions of a certain brain region, thereby expanding the range of brain regions regulated by the projection system.

[0019] Furthermore, the sub-projection system includes an image deflection optical path system for adjusting the projection position, enabling field scanning of the projected image in different regions of the same brain region. The same sub-projection system projects different patterns into different regions of a large brain region, thereby expanding the brain region area regulated by the projection system.

[0020] Furthermore, the sub-projection system reduces a single image block encoding information in the pattern formed by the imaging system to a size smaller than that of the first or second photosensitive element that receives the information. The system independently projects information to each of the first or second photosensitive elements through one or more image blocks encoding information in the projected pattern. Thus, by controlling a single neuron through a single image block, the system achieves fine control of the activity state of each neuron in a large-scale neuronal cluster through the projected image.

[0021] Furthermore, the maximum inner diameter of a single image block in the pattern projected by the projection system is selected from 20 nm to 10 μm.

[0022] Furthermore, when the optic nerve system is selected from a first photosensitive element independently of neurons, the optic nerve system includes a layer of photoreceptor cells for receiving patterns projected by the sub-projection system and receiving pattern light signals; after receiving the pattern light signals, the photoreceptor cells activate neural interneurons, which further activate retinal ganglion cells, which project to the nervous system through axons, converting the pattern information into nerve impulses and projecting them to neurons in the nervous system; the optic nerve system is selected from neurons with photosensitive points on their surface or inside, and the photosensitive points are selected from photosensitive proteins.

[0023] Furthermore, the nervous system is selected from biological brain, cerebellum, spinal cord, peripheral nerves, or brain organoids cultured in vitro.

[0024] Furthermore, the events include frame events and sequential events; the frame events refer to static events; the sequential events are dynamic events formed by a combination of multiple consecutive and related frame events.

[0025] Furthermore, the dimensions for classifying event information include: mechanical, gustatory, tactile, olfactory, temperature, and light stimulation dimensions of the event. Each dimension also includes the coordinate information of that dimension.

[0026] The second aspect of this application provides a method for fine-tuning large-scale neurons: neurons in the nervous system are equipped with photosensitive points or connected to a first photosensitive element; the neurons equipped with photosensitive points are defined as second photosensitive elements; after encoding the information to be delivered into a pattern, the spatial size of the pattern is compressed by re-imaging to increase the information density in the space where the compressed pattern is located and reduce the size of the image block of the smallest encoded information unit in the compressed pattern; the compressed pattern is projected onto the first photosensitive element or the second photosensitive element to achieve fine-tuning of each neuron in a large-scale neuronal cluster and high-density transmission of information to the nervous system.

[0027] The third aspect of this application provides a method for fine-tuning large-scale neurons, which involves setting photosensitive elements on neurons; encoding the information to be delivered into pattern information; compressing the spatial size of the pattern to shrink a single image block containing the smallest information unit in the pattern to a size smaller than that of a neuron, thereby obtaining a compressed pattern; projecting the compressed pattern onto a nervous system including a set of such neurons; controlling a single neuron through a single or multiple image blocks containing encoded information within the projected pattern; and finally, fine-tuning of each neuron within a large-scale neuron cluster by controlling the encoded information content of each image block within the pattern.

[0028] In another preferred embodiment, the information includes multiple categories;

[0029] In another preferred embodiment, the information includes one or more dimensions such as mechanics, taste, touch, smell, temperature, and light stimulation.

[0030] Furthermore, the photosensitive element includes photosensitive proteins disposed on neurons.

[0031] A third aspect of this application provides a method for fine-tuning large-scale neurons, in which photosensitive elements are connected to the outside of neurons; after encoding information into pattern information, the spatial size of the pattern is compressed, reducing the size of a single image block containing the smallest encoded information unit in the pattern to below the size of the photosensitive element, thereby obtaining a compressed pattern; the compressed pattern is projected onto an array of photosensitive elements; control of the photosensitive element connected to a single neuron is achieved through one or more image blocks containing encoded information within the projected pattern, thereby controlling a single neuron; finally, fine-tuning of each neuron within a large-scale neuron cluster is achieved by controlling the encoded information content of each image block within the pattern.

[0032] In another preferred embodiment, the information includes multiple categories;

[0033] In another preferred embodiment, the information includes one or more dimensions such as mechanics, taste, touch, smell, temperature, and light stimulation.

[0034] Furthermore, the photosensitive element includes connecting neurons to retinal ganglion cells provided with photoreceptor cells.

[0035] Furthermore, by compressing the pattern through a lens imaging system, the spatial size of the pattern is compressed, thereby increasing the information density within the space containing the compressed pattern.

[0036] Furthermore, the method for large-scale fine-tuning of neurons further includes the following steps:

[0037] Step 1: Divide the event information into several dimensions;

[0038] Step II: Encode the information of each dimension to form a corresponding pattern, and obtain several patterns corresponding to all event information;

[0039] Step III: Project several pattern information separately. The different projected patterns activate neurons in different areas of the nervous system. All event information is projected to the nervous system, forming and activating a neural network corresponding to the projected event information between multiple brain regions within the nervous system.

[0040] In another preferred embodiment, in step I, the event information is divided into different dimensions according to the types of representation parameters;

[0041] In another preferred embodiment, within the same dimension, similar information is encoded according to intensity and coordinate information to form a pattern corresponding to the information in that dimension.

[0042] In another preferred embodiment, the process of encoding event information into a pattern realizes the correspondence between event information and pattern; then, through the pattern projection process, the event information is associated with the first photosensitive element or the second photosensitive element; finally, the neurons are activated, ultimately realizing the projection of event information to the corresponding neurons in the nervous system;

[0043] In another preferred embodiment, the process of encoding event information into a pattern involves each dimension of event information independently employing a coding language, coding information density, and coding information sorting scheme.

[0044] The fourth aspect of this application provides an artificial bio-electro-mechanical intelligent agent, including an imaging system that receives external event information and encodes the event information into pattern information, a pattern projection system that projects the pattern information, a photosensitive element that uses the pattern information to activate corresponding neurons in the nervous system, a nervous system for information processing, and a support system.

[0045] Furthermore, the event information comes from the detector's detection of the real physical world; or the event information comes from information generated or output by the electronic computer system; or the event information comes from mixed reality information, which is a combination of the detector's detection of the real physical world and information generated or output by the electronic computer system.

[0046] Furthermore, the nervous system is also connected to the execution system for outputting the results information obtained from the processing of the nervous system.

[0047] Furthermore, the artificial bio-electro-mechanical intelligent agent was trained using methods similar to those used for raising infants in humans. Attached Figure Description

[0048] Figure 1 is a schematic diagram of the device for spatial compression of event information and delivery to the nervous system according to the present invention;

[0049] Figure 2 is a schematic diagram of the device for delivering spatially compressed event information to the nervous system according to the present invention. Detailed Implementation

[0050] The present invention will be further described below with reference to specific embodiments and Figures 1 and 2.

[0051] This invention proposes a device for delivering spatially compressed event information to the nervous system and a method for fine-tuning large-scale neurons. This method employs a non-contact approach, projecting information at high density into the nervous system, including the brain, spinal cord, brain-like organs, and peripheral nerves, achieving the beneficial effect of fine-tuning individual neurons within a large-scale neuronal cluster. In particular, projecting information into complex neural system regions such as the brain enables the input of multimodal information from the brain, thus avoiding the problems of low data transmission efficiency, mechanical damage to nerve tissue from neural electrodes, inaccurate information delivery, and the inability to precisely deliver information to individual neurons, as seen in previous methods.

[0052] Specifically, the device in this embodiment includes an imaging system that encodes event information into several patterns, several optic nerve systems that use the smallest information units encoded within the patterns to regulate the activity of one or more neurons in the nervous system, and a pattern projection system that projects the several patterns encoded by the imaging system onto each optic nerve system.

[0053] In this embodiment, event information refers to event information input to the brain. Event information can come from various sources. In this embodiment, event information can originate from a combination of information obtained from the detection of the physical world by several detectors, or from virtual events generated by a computer system. It can also be a virtual reality hybrid event combining physical world events and computer-generated virtual events. Describing an event often requires information in multiple dimensions, such as temperature, taste, touch, smell, vision, acceleration, etc., as well as the coordinate information of this information. In this embodiment, event information is categorized; the overall event information is divided into information in different dimensions, and each item within each dimension contains the corresponding coordinate information.

[0054] In this embodiment, information from each dimension of the event is encoded into a specific pattern. The intensity, location, and attributes of the information are converted into coordinate values, brightness, and color information of image blocks within the pattern. In this embodiment, the encoding method and corresponding encoding algorithm for each dimension can be independent, allowing for the design of unique encoding languages ​​based on the different information densities and attributes of each dimension, thus achieving highly efficient information input. Details of the information-to-image encoding method are provided in subsequent embodiments of this specification.

[0055] The optic nerve system is selected from: a first photosensitive element independently of the neurons, which generates nerve impulses under the action of light and transmits the generated nerve impulses to the neurons; or the optic nerve system is selected from neurons with photosensitive points on the surface or inside, which activate the neurons under the action of light signals, and the neurons are defined as photosensitive neurons, i.e., second photosensitive elements.

[0056] In this embodiment, a first photosensitive element independent of neurons is employed. Specifically, each optic nerve system includes a photoreceptor cell layer, where photoreceptor cells are connected to neural interneurons, which in turn are connected to retinal ganglion cells. Photoreceptor cells activated by light stimulation transmit light information to neural interneurons. Once activated, these interneurons transmit the information to the retinal ganglion cells, activating them. The activated retinal ganglion cells then transmit signals via axons to neurons connected to them within the brain, thus stimulating specific neurons within the brain by stimulating a cell in the photoreceptor layer. In this embodiment, the optic nerve system projecting information to the brain employs an organoid culture approach. Several independent culture areas are established on the brain surface, where supporting substances, nutrients, and stem cells necessary for the development of the optic nerve system are provided. This promotes the differentiation of stem cells into the desired optic nerve system, which then grows neural axons in selected brain regions to project information.

[0057] In this embodiment, there should be several pattern projection systems, each projecting a pattern formed by encoding event information in one dimension onto a visual nervous system. In this embodiment, the pattern projection system utilizes the principle of optical imaging to pass the pattern displayed by the imaging system through optical devices, such as an optical lens group, to reduce the smallest information unit in the image, i.e., the image block, to below the size of the first or second photosensitive element that receives the information carried by the image block. For example, by shrinking the smallest information unit in an image, i.e., the image patch, to below the size of the first photosensitive element that receives the information carried by that image patch, each byte of information in the image is projected onto a single photoreceptor cell. The photoreceptor cell connects with an intermediate cell, transmitting the byte of information to the intermediate cell. The intermediate cell further activates retinal ganglion cells, thereby transmitting the byte of information through the axons of the retinal ganglion cells to specific neurons inside the brain. Ultimately, this achieves the transmission of each byte of information in the pattern to specific neurons in the brain, enabling independent regulation of each neuron in the brain. Alternatively, by shrinking the smallest information unit in an image, i.e., the image patch, to below the size of the second photosensitive element that receives the information carried by that image patch, the information carried by each image patch in the image is projected onto a single photosensitive neuron. This byte of information is then transmitted through the axons of the retinal ganglion cells to specific neurons inside the brain, ultimately achieving the transmission of each byte of information in the pattern to specific neurons in the brain, enabling independent regulation of each neuron in the brain.

[0058] The description of encoding information into a pattern in this embodiment should be considered a functional statement; that is, any technique that encodes information into a pattern should be considered a protected solution of this patent. Considering that the purpose of projecting a pattern is to apply the information in the pattern to the regulation of neurons, the preferred information is encoded into image blocks. The brightness and darkness of a single image block represent the smallest information unit, and the brightness and darkness of the image block correspond to the activation and deactivation of the photosensitive element at the projection location of the image block. For example, the temperature information of a target object in event information is set in an XY coordinate system in the pattern. The position information of each point on the object is represented by the (x, y) coordinate value of the central image block of a set of image block matrices (i.e., an array of image blocks, or a set of image blocks). The temperature gradient value of that point on the object's surface is represented by the number of lit image blocks in the image block matrix. When a large amount of image block matrix information is projected onto the nervous system through the photosensitive element, the nervous system is projected with the event information of the two-dimensional projected shape of the target object and the temperature distribution of the target object's surface, namely, the frame event of "the current temperature of the target object's surface"; when the surface temperature information of the target object is dynamically projected in real time, the nervous system is projected with the temporal event of "the temperature change process of the target object's surface", that is, multiple related frame events are projected continuously, thus completing the projection of the temporal event.

[0059] Furthermore, since projected event information prompts the nervous system to recombine event information of different dimensions at the neural network level, in this embodiment, the encoding method of information does not affect the nervous system's "understanding or processing" of events. It is important to use a stable encoding method for information of a certain dimension, while different encoding methods can be used for information of different dimensions. Information such as mechanics, acceleration, and pressure can all be encoded using the above or other information encoding methods. The ways of information encoding are endless, and specific information encoding methods should not be considered a limitation of the scope of this patent. The above examples of encoding methods are merely used to promote the demonstration of encoding information into patterns.

[0060] Furthermore, the above embodiment uses a symmetric matrix of image blocks to encode information. The brightness or darkness of each image block in the image block matrix changes the temperature gradient value transmitted by the image block matrix. Therefore, each image block is the smallest unit of encoded information in the image. That is, the carrier of the smallest information unit is an image block. Therefore, when the image block is smaller than the diameter of the projected photosensitive element, the image block is only projected onto the photosensitive element. The image block can only activate one or two adjacent photosensitive elements and their connected neurons. Therefore, the image block matrix regulates the corresponding number of neurons through the image blocks contained inside. The activated neuron group is input with the temperature and coordinate information recorded by the image block matrix. Furthermore, all the image blocks in the matrix in an image project the event information of the two-dimensional projection shape of the target object and the temperature distribution of the target object surface to the nervous system.

[0061] Therefore, when the shape of the image patch is a circle or other regular polygon or a slight deformation of a similar regular polygon, such an image patch is advantageous for projecting information onto a single neuron equipped with a photosensitive element. This is especially true when the maximum diameter of the image patch is smaller than the diameter of the neuron and the size of the interneuronal space. In this case, a single image patch can achieve, and can only achieve, the control of one neuron, and the entire image thus achieves fine-grained control of each neuron in a large-scale neural cluster. The principle of projecting information onto neurons connected to photosensitive elements is similar and will not be repeated here, except that the pattern is directly projected onto the neurons equipped with photosensitive elements.

[0062] In this embodiment, the imaging system includes a computer system that encodes event information into pattern information, and a display device that displays the encoded pattern. The display device in this embodiment is derived from existing technology and can be selected from various options, broadly categorized into three types: self-emissive, transmissive, and reflective. Self-emissive devices mainly include CRTs, LCDs, and OLEDs; transmissive devices include LCDs that simply retain the liquid crystal rotation display structure, projecting patterns by blocking light; other examples include photolithography masks used in lithography machines; backlit devices include DMD digital micromirror devices based on the DLP principle (often used in projectors) and LCOS pattern projection devices.

[0063] Depending on the display device of the aforementioned imaging system, different pattern projection systems will exist. For example, the optical path design of a lithography machine, similar to chip manufacturing, projects the pattern of a mask or translucent LCD screen onto the target location; another example is the optical path design similar to a projector, projecting the image of a DMD or LCIOS chip onto the target location, as seen in common projector designs; yet another example is the use of lens imaging principles to directly project the pattern of a self-emissive display device onto the target location. In short, the display and projection effects of images can be achieved through existing optical path designs, and specific optical paths will not be listed or designed in this embodiment. As long as the optical path, through lens combination and adjustment, can reduce the size of the pattern before projection, it should be considered sufficient to constitute the disclosure of the technical solution in this application.

[0064] In this embodiment, the projection system also includes an optical path system for adjusting the position of the projected pattern, enabling the same sub-projection system to project different patterns onto different regions of a certain brain region, thereby expanding the brain region range regulated by the projection system. In particular, through the image deflection optical path system, the pattern encoding information is automatically matched with the position of the projected pattern, enabling the projected image to perform field scanning on different regions of the same brain region. During a single full-field scan, the same sub-projection system projects different patterns onto different regions of a large brain region; during multiple full-field scans, the same sub-projection system projects different patterns onto different regions of a large brain region, as well as onto the same region at different times, thereby expanding the brain region area regulated by the projection system.

[0065] Those skilled in the art will recognize that other methods capable of projecting such images onto the optic nerve system can also achieve the beneficial effects of this technical solution and should also be considered within the scope of protection of this patent.

[0066] In this embodiment, if the pattern is directly projected onto a photosensitive neuron, considering that the diameter of a neuron axon is generally not less than 12 micrometers, the inner diameter of the image block in the projected pattern is controlled to be within the range of 20nm to 10μm. This achieves a good balance between imaging difficulty and the precision of control, enabling precise control of each neuron in the nervous system.

[0067] In this embodiment, event information is classified and segmented into different dimensions, which are then encoded into different patterns. These different patterns are projected by a pattern projection system to different visual nerve systems, and subsequently transmitted to different brain regions. This achieves the projection of event information segmented according to different dimensions to different brain regions, i.e., projecting multimodal information into the brain and constructing a multimodal neural network corresponding to the event within the brain.

[0068] In this embodiment, dynamic events, i.e., sequential events, can be input into the brain through this system. A sequential event is a dynamic event formed by the combination of multiple consecutive and related frame events. This device projects the entire sequential event through the orderly and continuous projection of each frame event, forming a network group describing the sequential event.

[0069] This technical solution is used for information projection onto brain-like organoids. The brain-like organoid refers to neural cluster tissue obtained through in vitro culture technology. During the growth of the neural cluster tissue, cells that develop into the visual nervous system are mixed in, thereby forming a visual nervous system on the surface of the brain-like organoid; or elements expressing light-sensitive proteins are placed inside the cultured neurons, prompting the neurons to be regulated by light; or several regions are set in the culture device, some regions are used for developing brain-like organs and some regions are used for developing the visual nervous system, and channels are set between the two, using neural development induction tissue to prompt the visual nervous system to project neural axons to the brain-like organoid for information transmission.

[0070] This embodiment uses the visual nervous system to receive patterned light signals and then projects the pattern information onto various neurons within the nervous system. Alternatively, photosensitive proteins or other photosensitive materials can be placed on the neurons to directly project the pattern onto them, thereby regulating the neurons. The technology of receiving light information and activating neurons is a functional description. The photosensitive proteins, visual nervous system, and other photosensitive substances mentioned in this embodiment can all achieve the beneficial effects of this technical solution; therefore, different light-activated neuron technologies should all be considered within the scope of protection of this patent.

[0071] This embodiment provides a method for large-scale fine-tuning of neurons: neurons in the nervous system are equipped with or connected to photosensitive elements. After encoding event information into pattern information, the spatial size of the pattern is compressed to increase the information density in the space where the compressed pattern is located. The compressed pattern is then projected onto the photosensitive elements of the neurons to achieve high-density information transmission to the nervous system.

[0072] More specifically, photosensitive elements are placed on neurons to form photosensitive neurons with photosensitive capabilities. After encoding the event information to be delivered into pattern information, the spatial size of the pattern is compressed, reducing the size of a single image block containing the smallest encoded information unit in the pattern to below the size of the photosensitive neuron. The compressed pattern is then projected onto a nervous system including a set of such photosensitive neurons. Control of a single photosensitive neuron is achieved through single or multiple image blocks containing encoded information within the projected pattern, thereby regulating a single neuron. Finally, by regulating the content of the pattern encoded information, fine-grained regulation of each neuron within a large-scale neuronal cluster is achieved.

[0073] Alternatively, by connecting photosensitive elements externally to neurons, event information is encoded into pattern information. The pattern space size is compressed, reducing individual image blocks of encoded information within the pattern to below the size of the connected photosensitive element. This compressed pattern is then projected onto the photosensitive element. Control of the photosensitive element corresponding to a single neuron is achieved through one or more image blocks of encoded information within the projected pattern, thereby regulating a single neuron. Ultimately, by controlling the content of the pattern's encoded information, precise regulation of individual neurons within a large-scale neuronal cluster is achieved. The externally connected photosensitive element includes connections between neurons and retinal ganglion cells equipped with photoreceptor cells.

[0074] In this embodiment, the information includes multiple categories: one or more of the following dimensions: mechanics, taste, touch, smell, temperature, light stimulation, etc.; within the same dimension, similar information is encoded according to intensity and coordinate information to form a pattern corresponding to the information of that dimension.

[0075] In this embodiment, the pattern is compressed by using a lens imaging system, thereby compressing the spatial size of the pattern and increasing the information density within the space containing the compressed pattern.

[0076] An artificial bio-electro-mechanical intelligent agent includes a brain-like organ and support system for information processing, a optic nerve system connected to the brain-like organ, a pattern projection system that projects information to the optic nerve system, an imaging system that receives external event information and encodes the event information into pattern information, and an information output system connected to the brain-like organ for outputting the result information obtained by the brain-like organ's processing. In this embodiment, the support system refers to a system that maintains the brain-like organ, including a nutrition system, a temperature control system, an oxygen supply system, a development system, etc., to maintain the growth, development, and information processing of the brain-like organ.

[0077] In this embodiment, the external event information comes from the detector's detection of the real physical world; or from information generated or output by the electronic computer system. In this embodiment, the selection of external event information should adhere to the principles of human civilization, maintaining the basic respect humans have for living beings towards artificial bio-electro-mechanical intelligent agents.

Claims

1. A device for delivering spatially compressed event information to the nervous system, characterized in that, The system includes an imaging system that encodes event information into several patterns, several optic nerve systems that use the smallest information units encoded within the patterns to regulate the activity of one or more neurons within the nervous system, and a pattern projection system that projects the several patterns encoded by the imaging system onto each optic nerve system.

2. The apparatus as claimed in claim 1, characterized in that, The imaging system receives event information and divides the various representation parameters of the event information into different dimensions according to the type of information. The information of each dimension is encoded by the imaging system to form an independent pattern; the event information is encoded into several sets of patterns.

3. The apparatus as described in claim 1, characterized in that, The pattern projection system projects several patterns encoding event information onto the optic nerve system.

4. The apparatus as claimed in claim 1, characterized in that, The pattern projection system includes several sub-projection systems, each of which projects a pattern onto a corresponding optic nerve system.

5. The apparatus as claimed in claim 1, characterized in that, The optic nerve system is selected from: A first photosensitive element, independent of the neuron, generates nerve impulses under light and transmits these nerve impulses to the neuron; or, The optic nerve system is selected from neurons with photosensitive points on their surface or inside. The photosensitive points activate the neurons they contain under the action of light signals. These neurons are defined as photoreceptor neurons, i.e., the second photosensitive element.

6. The apparatus as claimed in claim 2, characterized in that, Each pattern formed by the imaging system includes several image blocks. The brightness and darkness of a single image block represent the smallest information unit. The brightness and darkness of each image block within the pattern are used to encode the event information to be projected in the pattern.

7. The apparatus as claimed in claim 6, characterized in that, The brightness and darkness of the image block encoding event information control the activation and deactivation of the first photosensitive element at the projection position of the image block, respectively; or the brightness and darkness of the image block encoding event information control the activation and deactivation of the second photosensitive element at the projection position of the image block, respectively, thereby achieving the regulation of a single neuron.

8. The apparatus as claimed in claim 4, characterized in that, The sub-projection system reduces the size of the pattern formed by the imaging system and projects it onto the corresponding optic nerve system.

9. The apparatus as claimed in claim 4, characterized in that, The sub-projection system also includes an optical path system that adjusts the projection position of the pattern to be projected, enabling the same sub-projection system to project different patterns onto different regions of a certain brain region, thereby expanding the range of brain regions regulated by the projection system.

10. The apparatus as claimed in claim 9, characterized in that, The sub-projection system includes an image deflection optical path system that adjusts the projection position, enabling field scanning of the projected image in different regions of the same brain region. The same sub-projection system projects different patterns onto different regions of a large brain region, thereby expanding the brain region area regulated by the projection system.

11. The apparatus as claimed in claim 8, characterized in that, The sub-projection system reduces a single image block encoding information in the pattern formed by the imaging system to a size smaller than that of the first or second photosensitive element that receives the information. It then independently projects information to each of the first or second photosensitive elements through one or more image blocks encoding information in the projected pattern. This allows for precise control of the activity state of each neuron in a large-scale neuronal cluster by controlling a single neuron through a single image block.

12. The apparatus as claimed in claim 11, characterized in that, The maximum inner diameter of a single image block in the pattern projected by the projection system is in the range of 20 nm to 10 μm.

13. The apparatus as claimed in claim 5, characterized in that, When the optic nerve system is selected from a first photosensitive element independently of neurons, the optic nerve system includes a layer of photoreceptor cells for receiving patterns projected by the sub-projection system and receiving pattern light signals; after receiving the pattern light signals, the photoreceptor cells activate neural interneurons, which further activate retinal ganglion cells, which project to the nervous system through axons, converting the pattern information into nerve impulses and projecting them to neurons in the nervous system; the optic nerve system is selected from neurons with photosensitive points on their surface or inside, and the photosensitive points are selected from photosensitive proteins.

14. The device for delivering spatially compressed event information to the nervous system as described in claim 1, characterized in that, The nervous system is selected from biological brain, cerebellum, spinal cord, peripheral nerves or brain organoids cultured in vitro.

15. The device for delivering spatially compressed event information to the nervous system as described in claim 1, characterized in that, The events include frame events and sequential events; the frame events refer to static events; the sequential events are dynamic events formed by a combination of multiple consecutive and related frame events.

16. The apparatus as claimed in claim 2, characterized in that, The dimensions for classifying event information include, but are not limited to: the mechanical, gustatory, tactile, olfactory, temperature, and light stimulation dimensions of the event. Each dimension also includes the coordinate information of that dimension.

17. A method for large-scale fine-tuning of neurons, characterized in that, Neurons in the nervous system are equipped with photosensitive points or connected to a first photosensitive element; neurons that are equipped with photosensitive points are defined as second photosensitive elements. After the information to be delivered is encoded into a pattern, the spatial size of the pattern is compressed through re-imaging. This increases the information density within the space of the compressed pattern and reduces the size of the image block containing the smallest encoded information unit within the compressed pattern. The compressed pattern is projected onto the first or second photosensitive element to achieve precise control of each neuron in a large-scale neuronal cluster and high-density transmission of information to the nervous system.

18. A method for large-scale fine-tuning of neurons, characterized in that, Photosensitive elements are placed on neurons. After encoding the information to be delivered into pattern information, the spatial size of the pattern is compressed, reducing the individual image block of the smallest encoded information unit in the pattern to below the size of a neuron, thereby obtaining the compressed pattern. The compressed pattern is projected onto a nervous system comprising a set of neurons equipped with the photosensitive element. Control of a single neuron is achieved through one or more image blocks of encoded information within the projected pattern, thereby regulating the single neuron. Finally, by regulating the encoded information content of each image block within the pattern, fine regulation of each neuron within a large-scale neuronal cluster is achieved.

19. The method as described in claim 18, characterized in that, The information includes one or more of the following dimensions: mechanical, taste, touch, smell, temperature, and light stimulation.

20. The method as described in claim 18, characterized in that, The photosensitive element includes photosensitive proteins disposed on neurons.

21. A method for large-scale fine-tuning of neurons, characterized in that, Photosensitive elements are connected to the outside of neurons. After encoding the information into pattern information, the spatial size of the pattern is compressed, reducing the individual image block of the smallest encoded information unit in the pattern to below the size of the photosensitive element, thereby obtaining the compressed pattern. The compressed pattern is projected onto the array of photosensitive elements. By controlling the photosensitive element connected to a single neuron through one or more image blocks of encoded information within the projected pattern, and then by regulating a single neuron through one or more image blocks of encoded information within the projected pattern, the fine regulation of each neuron in a large-scale neuron cluster can be achieved by regulating the encoded information content of each image block within the pattern.

22. The method as described in claim 21, characterized in that, The information includes one or more of the following dimensions: mechanical, taste, touch, smell, temperature, and light stimulation.

23. The method as described in claim 21, characterized in that, The photosensitive element includes connecting neurons to retinal ganglion cells equipped with photoreceptor cells.

24. The method according to any one of claims 17 to 23, characterized in that, By compressing the pattern through a lens imaging system, the spatial size of the pattern is compressed, thereby increasing the information density within the space containing the compressed pattern.

25. The method according to any one of claims 17 to 23, characterized in that the step include: Step 1: Divide the event information into several dimensions; Step II: Encode the information of each dimension to form a corresponding pattern, and obtain several patterns corresponding to all event information; Step III: Project several pattern information separately. The different projected patterns activate neurons in different areas of the nervous system. All event information is projected to the nervous system, forming and activating a neural network corresponding to the projected event information between multiple brain regions within the nervous system.

26. The method as described in claim 25, characterized in that, In step I, the event information is divided into different dimensions according to the types of representation parameters.

27. The method as described in claim 25, characterized in that, Within the same dimension, similar information is encoded according to intensity and coordinate information to form a pattern corresponding to the information in that dimension.

28. The method as described in claim 27, characterized in that, The process of encoding event information into patterns realizes the correspondence between event information and patterns; Subsequently, through a pattern projection process, the event information is associated with the first or second photosensitive element; finally, the neurons are activated, ultimately projecting the event information to the corresponding neurons in the nervous system.

29. The method as described in claim 27, characterized in that, The process of encoding event information into a pattern involves each dimension of event information independently employing a coding language, coding information density, and / or coding information sorting scheme.

30. An artificial bio-electro-mechanical intelligent agent, characterized in that, This includes an imaging system that receives external event information and encodes the event information into pattern information, a pattern projection system that projects pattern information, a photosensitive element that uses pattern information to activate corresponding neurons in the nervous system, and a nervous system and support system for information processing.

31. The artificial bio-electro-mechanical intelligent agent according to claim 30, characterized in that, The event information comes from the detector's detection of the real physical world; or the event information comes from information generated or output by the electronic computer system; or the event information comes from mixed reality information, which is a combination of the detector's detection of the real physical world and information generated or output by the electronic computer system.

32. The artificial bio-electro-mechanical intelligent agent according to claim 30, characterized in that, The nervous system is also connected to the execution system, which is used to output the results information obtained by the nervous system processing.

33. The artificial bio-electro-mechanical intelligent agent according to claim 30, characterized in that, The artificial bio-electro-mechanical intelligent agent was trained using methods similar to those used for raising human infants.

34. A device for delivering spatially compressed event information to the nervous system, characterized in that, The system includes an imaging system that encodes event information into several patterns, several optic nerve systems that use the smallest information units encoded within the patterns to regulate the activity of one or more neurons within the nervous system, and a pattern projection system that projects the several patterns encoded by the imaging system onto each optic nerve system. The pattern projection system compresses the spatial size of the patterns through re-imaging, thereby increasing the information density within the space of the compressed pattern and reducing the size of the image block containing the smallest information unit encoded within the compressed pattern.

35. An artificial bio-electro-mechanical intelligent agent, characterized in that, The system includes an imaging system that receives external event information and encodes the event information into pattern information, a pattern projection system that projects the pattern information, a photosensitive element that activates the corresponding neurons of the nervous system using the pattern information, a nervous system and a support system for information processing. The pattern projection system reduces the size of a single image block that encodes the smallest information unit in the pattern to below the size of a neuron by compressing the spatial size of the pattern, thereby obtaining a compressed pattern.

Images