Information compression and delivery device and large-scale neuron fine regulation and control method

Abstract

The invention relates to spatial information compression and delivery, and belongs to the field of information delivery. The invention provides a device for delivering event information to a nervous system after spatial compression and a method for fine regulation and control of large-scale neurons. The device comprises an imaging system for respectively coding event information into a plurality of patterns, and a plurality of optic nervous systems for regulating and controlling the activity of a single neuron in a nervous system by using a minimum information unit coded in the patterns, and the pattern projection system is used for respectively projecting the plurality of patterns coded by the imaging system to each optic nerve system. According to the device and the method, the problems that an existing neural electrode is low in information transmission efficiency, immunological rejection exists between the neural electrode and a nervous system, and nervous tissues are mechanically damaged are solved, fine regulation and control of all neurons in a large-scale neuron cluster are achieved, and high-bandwidth input of multi-dimensional event information to a whole brain area of the nervous system is achieved.

Description

Technical Field

[0001] The present invention relates to a method and device for delivering information to a nervous system, and in particular to a device for delivering event information to a nervous system after spatial compression, and a method for fine regulation of large-scale neurons. Background Art

[0002] In the prior art, neural electrodes are often used to deliver information to the nervous system, such as Utah electrodes, flexible neural electrodes, etc. However, these neural electrodes have many disadvantages that are difficult to overcome:

[0003] 1. Limited by the channel density of neural electrodes, information cannot be efficiently delivered to the nervous system;

[0004] 2. Limited by the refresh rate of neural electrode signals, the frame rate at which neural electrodes deliver electrical signals to the nervous system is low;

[0005] 3. Neural electrodes need to be implanted in the nervous system to function, which may lead to immune rejection between the neural electrodes and the nervous system, or the neural electrodes may fall off or shift when the animal moves, thus causing mechanical damage to the nervous system. It also affects the stable use of the neural electrodes and reduces the transmission efficiency and accuracy of neural signals.

[0006] Therefore, the existing technologies for high-density information delivery to the nervous system and achieving fine and stable regulation of large-scale neurons have many difficulties that are difficult to overcome, limiting the development of related industries in the field of brain science. Summary of the invention

[0007] The technical problem to be solved by the present invention is to provide a device for spatially compressing event information and delivering it to the nervous system, and a method for fine regulation of large-scale neurons. The device and method solve the problems of low information transmission efficiency of existing neural electrodes, immune rejection with the nervous system, and mechanical damage to neural tissue. At the same time, it also realizes the high-density, low-latency transmission of information to multiple brain regions of the nervous system, and achieves the beneficial effect of fine regulation of each neuron in a large-scale neuronal cluster.

[0008] The first aspect of the present application provides a device for delivering event information to a nervous system after spatial compression, including an imaging system that encodes event information into a plurality of patterns, a plurality of visual systems that use the minimum information unit encoded in the pattern to regulate the activity of a single or multiple neurons in the nervous system, and a pattern projection system that projects the plurality of patterns encoded by the imaging system to each visual system.

[0009] Furthermore, the imaging system receives event information, divides each characteristic parameter of the event information into different dimensions according to the type of information, and encodes the information of each dimension through the imaging system to form an independent pattern; the event information is encoded into several groups of patterns.

[0010] Furthermore, the pattern projection system projects a plurality of patterns encoding event information to the optic nerve system.

[0011] Furthermore, the pattern projection system includes several groups of sub-projection systems, each sub-projection system projects a pattern to a corresponding optic nerve system.

[0012] Further, the optic nerve system is selected from:

[0013] A first photosensitive element independently arranged from the neuron, the first photosensitive element generates a nerve pulse under the action of light and transmits the generated nerve pulse to the neuron; or,

[0014] The visual nervous system is selected from neurons with photosensitive points set on the surface or inside. The photosensitive points activate the neurons where they are located under the action of light signals. The neurons are defined as photosensitive neurons, that is, the second photosensitive elements.

[0015] Furthermore, each pattern formed by the imaging system includes several image blocks, and the brightness and darkness of a single image block represent the smallest information unit respectively. The brightness and darkness of each image block in the projected pattern are used to encode the event information to be projected in the projected pattern.

[0016] Furthermore, the brightness and darkness of the image block of the encoded information respectively control the activation and inactivation states of the first photosensitive element at the position where the image block is projected, or the brightness and darkness of the image block of the encoded information respectively control the activation and inactivation states of the second photosensitive element at the position where the image block is projected, thereby achieving regulation of a single neuron.

[0017] Furthermore, the sub-projection system reduces the pattern formed by the imaging system and projects it to the corresponding optic nerve system;

[0018] Furthermore, the sub-projection system also includes an optical path system for adjusting the position of the projected pattern, so that the same sub-projection system can project different patterns to different areas of a certain brain region, thereby expanding the range of brain regions regulated by the projection system;

[0019] Furthermore, the sub-projection system includes an image deflection optical path system for adjusting the projection position, so as to realize field scanning of the projected image in different areas of the same brain region. The same sub-projection system projects different patterns to different areas of a wide range of brain regions, thereby expanding the area of ​​the brain region regulated by the projection system.

[0020] Furthermore, the sub-projection system reduces a single image block encoding information in a pattern formed by the imaging system to a size below the size of the first photosensitive element or the second photosensitive element that receives the information, and independently projects information to each first photosensitive element or the second photosensitive element through a single or multiple image blocks encoding information in the projected pattern; thereby achieving fine control of the activity state of each neuron in a large-scale neuronal cluster through the projected image by regulating a single neuron through a single image block.

[0021] Furthermore, the maximum inner diameter of a single image block in the pattern projected by the projection system is selected from 20 nm to 10 μm.

[0022] Furthermore, when the optic nerve system is selected from a first photosensitive element independently provided by neurons, the optic nerve system includes a photosensitive cell layer for receiving a pattern projected by a sub-projection system and receiving a pattern light signal; after receiving the pattern light signal, the photosensitive cells activate neural interneuron cells, and the activated neural interneuron cells further activate retinal ganglion cells, which project to the nervous system through axons, convert the pattern information into nerve pulses and project them to neurons of the nervous system; the optic nerve system is selected from neurons having photosensitive points provided on the surface or inside, and the photosensitive points are selected from photosensitive proteins.

[0023] Furthermore, the nervous system is selected from a biological brain, cerebellum, spinal cord, peripheral nerves or brain organoids cultured in vitro.

[0024] Furthermore, the events include frame events and sequential events; the frame events refer to static events; and the sequential events refer to dynamic events formed by the combination of multiple continuous and related frame events.

[0025] Furthermore, the dimensions for classifying event information include: mechanics, taste, touch, smell, temperature, light stimulation and other dimensions of the event, and each dimension of information also includes coordinate information of the dimension information.

[0026] The second aspect of the present application provides a method for fine regulation of large-scale neurons: neurons in the nervous system are set with photosensitivity points or connected to a first photosensitive element; the neurons with photosensitivity points are defined as second photosensitive elements; after the information to be delivered is encoded into a pattern, the spatial size of the pattern is compressed by re-imaging to increase the information density in the space where the compressed pattern is located and reduce the size of the image block encoding the minimum information unit in the compressed pattern; the compressed pattern is projected onto the first photosensitive element or the second photosensitive element to achieve fine regulation of each neuron in a large-scale neuronal cluster and high-density information transmission to the nervous system.

[0027] The third aspect of the present application provides a method for fine regulation of large-scale neurons, comprising: setting a photosensitive element on the neuron; encoding the information to be delivered into pattern information, and then compressing the spatial size of the pattern to reduce the single image block encoding the smallest information unit in the pattern to below the size of the neuron, thereby obtaining a compressed pattern; projecting the compressed pattern onto a nervous system including a collection of such neurons, controlling a single neuron through a single or multiple image blocks of information encoded in the projected pattern, and further regulating a single neuron through a single or multiple image blocks of information encoded in the projected pattern; and finally, achieving fine regulation of each neuron in a large-scale neuronal cluster by regulating the information content encoded in each image block in the pattern.

[0028] In another preferred embodiment, the information includes multiple categories;

[0029] In another preferred example, the information includes one or more dimensions such as mechanics, taste, touch, smell, temperature, and light stimulation.

[0030] Furthermore, the photosensitive element includes a light-sensitive protein disposed on a neuron.

[0031] The third aspect of the present application provides a method for fine regulation of large-scale neurons, which includes connecting a photosensitive element to the outside of a neuron; after encoding information into pattern information, by compressing the spatial size of the pattern, a single image block encoding the smallest information unit in the pattern is reduced to a size below the size of the photosensitive element, thereby obtaining a compressed pattern; the compressed pattern is projected onto an array of the photosensitive elements; the photosensitive element connected to a single neuron is controlled by a single or multiple image blocks of information encoded in the projected pattern, and then the single neuron is regulated by a single or multiple image blocks of information encoded in the projected pattern; finally, fine regulation of each neuron in a large-scale neuron cluster is achieved by regulating the information content encoded in each image block in the pattern;

[0032] In another preferred embodiment, the information includes multiple categories;

[0033] In another preferred example, the information includes one or more dimensions such as mechanics, taste, touch, smell, temperature, and light stimulation.

[0034] Furthermore, the photosensitive element includes connecting neurons to retinal ganglion cells provided with photoreceptor cells.

[0035] Furthermore, by compressing the pattern through a lens imaging system, the spatial size of the pattern is compressed, thereby improving the information density in the space where the compressed pattern is located.

[0036] Furthermore, the method for large-scale fine regulation of neurons also includes the following steps:

[0037] Step I: Divide event information into several dimensions;

[0038] Step II: Encode the information of each dimension to form a corresponding pattern, and obtain several patterns corresponding to all event information;

[0039] Step III: Projecting several pattern information separately, with different projected patterns activating neurons in different areas of the nervous system, projecting all event information to the nervous system, and forming and activating neural networks corresponding to the projected event information between multiple brain regions within the nervous system;

[0040] In another preferred embodiment, in step I, the event information is divided into different dimensions according to the types of characterization parameters;

[0041] In another preferred embodiment, in the same dimension, the same type of information is encoded according to the intensity and coordinate information to form a pattern corresponding to the information of the dimension;

[0042] In another preferred embodiment, the process of encoding the event information into a pattern realizes the correspondence between the event information and the pattern; then, through the pattern projection process, the event information is corresponded to the first photosensitive element or the second photosensitive element; finally, the neurons are activated, and finally the event information is projected to the corresponding neurons in the nervous system;

[0043] In another preferred embodiment, in the process of encoding event information to form a pattern, each dimension of event information independently adopts a coding language, coding information density, and coding information sorting scheme.

[0044] The fourth aspect of the present application provides an artificial bio-electronic-mechanical intelligent body, including an imaging system that receives external event information and encodes the event information into pattern information, a pattern projection system that projects the pattern information, a photosensitive element that uses the pattern information to activate corresponding neurons of the nervous system, and a nervous system and support system for information processing.

[0045] Furthermore, the event information comes from the detector's detection of the real physical world; or the event information comes from information generated or output by an electronic computer system; or the event information comes from mixed reality information of the detector's detection of the real physical world and information generated or output by an electronic computer system.

[0046] Furthermore, the nervous system is also connected to an execution system for outputting result information obtained by the nervous system processing to the outside.

[0047] Furthermore, the artificial bio-electronic-mechanical intelligent body is trained using the method of human raising babies. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] Figure 1Schematic diagram of the device for spatial compression of event information and delivery to the nervous system of the present invention Figure 1 ;

[0049] Figure 2 Schematic diagram of the device for delivering event information to the nervous system after spatial compression of the event information of the present invention Figure 2 . DETAILED DESCRIPTION

[0050] The following is a combination of specific embodiments and attached Figure 1 , Attachment Figure 2 , further illustrating the present invention.

[0051] The present invention proposes a device for delivering event information to the nervous system after spatial compression and a method for fine regulation of large-scale neurons. The method uses a non-direct contact method to project information to the nervous system including the brain, spinal cord, brain-like organs, peripheral nerves, etc. at a high density, thereby achieving the beneficial effect of fine regulation of individual neurons in large-scale neuron clusters. In particular, information is projected to complex nervous system partitions such as the brain to achieve the input of multimodal information of the brain, thus avoiding the problems of low efficiency of neural electrode data transmission, mechanical damage of neural electrodes to neural tissues, inaccurate neural electrode information delivery, and inability of neural electrodes to accurately deliver information to individual neurons.

[0052] Specifically, the device of this embodiment includes an imaging system that encodes event information into a number of patterns, a number of visual nervous systems that use the minimum information unit encoded in the pattern to regulate the activity of a single or multiple neurons in the nervous system, and a pattern projection system that projects the several patterns encoded by the imaging system to each visual nervous system.

[0053] In this embodiment, event information refers to event information input into the brain. Event information can have multiple sources. In this embodiment, event information can come from the combined information obtained by several detectors detecting the physical world, or from virtual events generated by a computer system. It can also be a virtual reality hybrid event of physical world events and virtual events generated by a computer system. Describing an event often requires information of multiple dimensions, such as temperature, taste, touch, smell, vision, acceleration and other information, as well as the coordinate information of these information. In this embodiment, event information is classified, and the overall event information is divided into information of different dimensions, and each item of information in each dimension contains the corresponding coordinate information of the information.

[0054] In this embodiment, the information of each dimension of the event is encoded into a specific pattern, and the information such as the intensity, position, and attributes of the information is converted into the coordinate value and brightness, color, and other information of the image block in the pattern. In this embodiment, the information encoding method and the corresponding encoding algorithm of each dimension can be independent of each other, so that a unique encoding language can be designed according to the different information density and attributes of each dimension, so as to achieve more efficient information input. The encoding method from information to image is detailed in the subsequent embodiments of this specification.

[0055] The visual nervous system is selected from: a first photosensitive element independently set up from neurons, which generates nerve pulses under the action of light and transmits the generated nerve pulses to neurons; or the visual nervous system is selected from neurons with photosensitive points set on the surface or inside, which activate the neurons where they are located under the action of light signals, and the neurons are defined as photosensitive neurons, i.e., the second photosensitive element.

[0056] In this embodiment, a first photosensitive element independent of the neuron setting is used: specifically, each optic nerve system includes a photoreceptor cell layer, the photoreceptor cells of the photoreceptor cell layer are connected to the neural interneuron cells, and the neural interneuron cells are connected to the retinal ganglion cells. The photoreceptor cells activated by light stimulation transmit the light information to the neural interneuron cells. After the neural interneuron cells are activated, they transmit the information to the retinal ganglion cells to activate the retinal ganglion cells. The activated retinal ganglion cells transmit the signal to the neurons connected to them inside the brain through axons, thereby stimulating specific neurons inside the brain by stimulating a certain cell in the photoreceptor layer. In this embodiment, the optic nerve system that projects information to the brain adopts an organoid culture scheme. Several independent culture areas are set on the surface of the brain, and the supporting substances, nutrients, and stem cells required for the development of the optic nerve system are set in this area to promote the differentiation of stem cells into the required optic nerve system and grow nerve axons to the selected area of ​​the brain for information projection.

[0057] In this embodiment, there should be several pattern projection systems, each of which projects a pattern formed by encoding event information of one dimension to a visual nerve system. In this embodiment, the pattern projection system uses the principle of optical imaging to pass the pattern displayed by the imaging system through an optical device, such as an optical lens group, to reduce the smallest information unit in the image, that is, the image block, to a size below that of the first photosensitive element or the second photosensitive element that receives the information carried by the image block. For example, the smallest information unit in the image, that is, the image block, is reduced to a size below that of the first photosensitive element that receives the information carried by the image block, so that each byte of information in the image is projected to a single photoreceptor cell. The photoreceptor cell is connected to the intermediate meta-cell to transmit the byte information to the intermediate meta-cell. The intermediate meta-cell further activates the retinal ganglion cells, so that the byte information is transmitted to specific neurons in the brain through the retinal ganglion cell axons, and finally each byte of information in the pattern is transmitted to a specific neuron in the brain, thereby realizing independent regulation of each neuron in the brain; for example, the smallest information unit in the image, that is, the image block, is reduced to a size below that of the second photosensitive element that receives the information carried by the image block, so that the information carried by each image block in the image is projected to a single photosensitive neuron with light sensitivity, so that the byte information is transmitted to specific neurons in the brain through the retinal ganglion cell axons, thereby realizing independent regulation of each neuron in the brain.

[0058] The encoding of information into a pattern described in this embodiment should be regarded as a functional statement, that is, any technology that encodes information into a pattern should be regarded as a protection scheme of this patent. Considering that the purpose of projecting a pattern is to apply the information in the pattern to the regulation of neurons, the preferred information is encoded into an image block, and the light and dark of a single image block represent the smallest information unit, respectively, and the light and dark of the image block correspond to the activation and inactivation of the photosensitive element at the position where the image block is projected. For example, the temperature information of the target object in the event information, an XY coordinate system is set in the pattern, and the position information of each object is represented by the (x, y) coordinate value of the central image block of a set of image block matrices (i.e., an array of image blocks, or a set of image blocks), and the temperature gradient value of the point on the surface of the object is represented by the number of lit image blocks in the image block matrix. When a large amount of image block matrix information is projected onto the nervous system through the photosensitive element, the event information of the two-dimensional projection shape of the target object and the temperature distribution on the surface of the target object is projected onto the nervous system, that is, the frame event of "the temperature of the target object surface at this moment"; when the surface temperature information of the target object is projected dynamically and in real time, the time series event of "the temperature change process on the target object surface" is projected onto the nervous system, that is, the continuous projection of multiple frame events related to each other completes the projection of the time series event.

[0059] In addition, since the projected event information prompts the nervous system to recombine event information of different dimensions at the neural network level, in this embodiment, the way the information is encoded does not affect the nervous system's "understanding or processing" of the event. It is important to use a stable encoding method for information of a certain dimension, while different encoding methods can be used for information of different dimensions. The above or other information encoding methods can all be used for information such as mechanics, acceleration, and pressure. The ways of encoding information are endless, and the specific information encoding method should not be regarded as a limitation on the scope of protection of this patent. The above encoding method examples are only used to facilitate the demonstration of encoding information into patterns.

[0060] Furthermore, the above-mentioned embodiment adopts a symmetric matrix of image blocks to encode information. The brightness or darkness of each image block in the image block matrix will change the temperature gradient value transmitted by the image block matrix. Therefore, each image block is the smallest unit of encoded information in the image, that is, the carrier of the smallest information unit is an image block. Therefore, when the image block is smaller than the diameter of the projected photosensitive element, the image block is only projected on the photosensitive element. The image block can only activate one or two adjacent photosensitive elements and the neurons connected to them. Therefore, the image block matrix regulates the corresponding number of neurons through the image blocks contained therein. The activated neuron group is input with the temperature and coordinate information recorded by the image block matrix. Further, the image blocks in all matrices in an image project the event information of the two-dimensional projection shape of the target object and the temperature distribution on the surface of the target object to the nervous system.

[0061] Therefore, when the shape of the image block is a circle or other regular polygon or a slightly deformed regular polygon, this type of image block is conducive to projecting information to a single neuron with a photosensitive element, especially when the maximum diameter of the image block is smaller than the neuron diameter and the size of the neuron gap, a single image block can and can only achieve the regulation of one neuron, and the entire image also achieves fine regulation of each neuron in a large-scale neural cluster. The principle of projecting information to neurons connected to photosensitive elements is similar and will not be repeated here, except that the pattern is directly projected on neurons with photosensitive elements.

[0062] In this embodiment, the imaging system includes a computer system that encodes event information into pattern information, and also includes a display device that displays the encoded pattern. The display device in this embodiment comes from the existing technology, and there are many options, which can be roughly divided into three types: self-luminous, light-transmitting, and reflective. The self-luminous type mainly includes CRT, LCD, OLED, etc.; the light-transmitting type, such as LCD that simply retains the liquid crystal optical rotation display structure, realizes the projection of the pattern by blocking the light, and there are also similar devices such as photolithography masks in equipment such as lithography machines; the backlight type includes DMD digital micromirror chips based on the DLP principle (mostly used in projectors), and LCOS pattern projection devices, etc.

[0063] Depending on the display device of the above-mentioned imaging system, there will be different pattern projection systems. For example, the optical path design of a lithography machine similar to chip processing and manufacturing can project the pattern of the mask or translucent LCD screen to the target position; for example, there will be an optical path design similar to a projector, which can project the image of the DMD or LCIOS chip to the target position, such as the optical path design of a common projector; for example, through the principle of lens imaging, the pattern of a self-luminous display device can be directly projected to the target position. In short, the display and projection technical effects of the image can be achieved through the optical path design of the prior art, and the specific optical path will not be listed or designed in this embodiment. As long as the optical path can shrink the pattern and then project it after being combined and adjusted by the lens, it should be sufficient for the disclosure of the technical solution of this application.

[0064] In this embodiment, the projection system also includes an optical path system for adjusting the position of the projected pattern, so that the same sub-projection system can project different patterns to different regions of a certain brain area, thereby expanding the range of brain areas regulated by the projection system. In particular, through the image deflection optical path system, the pattern coding information is automatically matched to the position of the projected pattern, so that the projected image can be field scanned in different regions of the same brain area. During a single full-field scan, the same sub-projection system can project different patterns to different regions of a large range of brain areas; during multiple full-field scans, the same sub-projection system can project different patterns to different regions of a large range of brain areas, as well as to the same region at different times, thereby expanding the area of ​​the brain area regulated by the projection system.

[0065] Those skilled in the art will appreciate that other solutions capable of projecting such images to the visual system can also achieve the beneficial effects of the present technical solution and should also be considered within the scope of protection of this patent.

[0066] In this embodiment, if the pattern is projected directly onto a neuron with photosensitivity, considering that the diameter of a neuron axon is generally not less than 12 microns, the inner diameter of the image block in the projected pattern in this embodiment is controlled to be in the range of 20nm to 10μm at most, which better balances the imaging difficulty and the fineness of control, thereby achieving fine control of each neuron in the nervous system.

[0067] In this embodiment, the event information is classified and divided into information of different dimensions, and the information of different dimensions is encoded into different patterns. Different patterns are respectively projected to different visual nerve systems by the pattern projection system, and then transmitted to different brain regions through different visual nerve systems, thereby realizing that the information divided into different dimensions of the event information is respectively projected to different brain regions, that is, multimodal information is projected into the brain, and a multimodal neural network corresponding to the event is constructed inside the brain.

[0068] In this embodiment, dynamic events, i.e., sequential events, can be input into the brain through the system. Sequential events are dynamic events formed by the combination of multiple continuous and related frame events. The device realizes the projection of the entire sequential event through the orderly and continuous projection of each frame event, forming a network group describing the sequential event.

[0069] This technical solution is used to project information to brain-like organs. The brain-like organ refers to a neural cluster tissue obtained by in vitro culture technology. During the growth of the neural cluster tissue, cells that develop into the visual nervous system are mixed in, so that the visual nervous system is formed on the surface of the brain-like organ; or elements expressing photosensitive proteins are set inside the cultured neurons to enable the neurons to be regulated by light; or several areas are set in the culture device, some areas are used to develop brain-like organs and some areas are used to develop the visual nervous system, and a channel is set between the two, so that the visual nervous system is prompted to project nerve axons to the brain-like organ through the neural development induction tissue to transmit information.

[0070] This embodiment uses the visual nervous system to receive pattern light signals, and then projects the pattern information to each neuron in the nervous system; light-sensitive proteins or other light-sensitive materials can also be set on the neurons to project the pattern directly onto the neurons to regulate the neurons. The technology of receiving light information and activating neurons belongs to the functional description. The light-sensitive proteins, visual nervous system, and other light-sensitive substances described in this embodiment can all achieve the beneficial effects of this technical solution. Therefore, different technologies for activating neurons with light should be regarded as the protection scope of this patent.

[0071] This embodiment provides a method for fine-tuning large-scale neurons: photosensitive elements are set or connected to neurons in the nervous system, and after encoding event information into pattern information, the spatial size of the pattern is compressed to increase the information density in the space where the compressed pattern is located, and the compressed pattern is projected onto the neuron photosensitive elements to achieve high-density information transmission to the nervous system.

[0072] More specifically, a photosensitive element is arranged on a neuron to form a photosensitive neuron with photosensitivity. After encoding the event information to be delivered into pattern information, the spatial size of the pattern is compressed to reduce a single image block encoding the smallest information unit in the pattern to a size below that of the photosensitive neuron, and the compressed pattern is projected onto a nervous system including a collection of such photosensitive neurons. The control of a single photosensitive neuron is achieved through a single or multiple image blocks encoding information in the projected pattern, and further, the regulation of a single neuron is achieved through a single or multiple image blocks encoding information in the projected pattern. Finally, fine regulation of each neuron in a large-scale neuron cluster is achieved by regulating the content of the pattern encoding information.

[0073] Or, after encoding the event information into pattern information by connecting a photosensitive element to the outside of the neuron, the single image block of the encoded information in the pattern is reduced to a size below the size of the connected photosensitive element by compressing the spatial size of the pattern, and the compressed pattern is projected onto the photosensitive element, and the photosensitive element corresponding to the single neuron is controlled by the single or multiple image blocks of the encoded information in the projected pattern, and then the single neuron is regulated by the single or multiple image blocks of the encoded information in the projected pattern; finally, the fine regulation of each neuron in a large-scale neuron cluster is achieved by regulating the content of the pattern encoding information. The externally connected photosensitive element includes connecting the neuron to the retinal ganglion cell provided with the photosensitive cell

[0074] In this embodiment, the information includes multiple categories: one or more dimensions such as mechanics, taste, touch, smell, temperature, and light stimulation; in the same dimension, the same type of information is encoded according to intensity and coordinate information to form a pattern corresponding to the information of that dimension.

[0075] In this embodiment, the pattern is compressed by a lens imaging system to achieve compression of the spatial size of the pattern, thereby improving the information density in the space where the compressed pattern is located.

[0076] An artificial bio-electronic-mechanical intelligent body, including a brain organoid and a support system for information processing, a visual nerve system connected to the brain organoid, a pattern projection system for projecting information to the visual nerve system, an imaging system for receiving external event information and encoding the event information into pattern information, and an information output system connected to the brain organoid for externally outputting result information obtained by the brain organoid processing. The support system described in this embodiment refers to a system for maintaining the brain organoid, including a nutrition system, a temperature control system, an oxygen supply system, a development system, etc., for maintaining the growth and development of the brain organoid and information processing.

[0077] In this embodiment, the external event information comes from the detection of the real physical world by the detector; or the external event information comes from the information generated or output by the electronic computer system. In this embodiment, the selection of external event information should comply with the principles of human civilization, and maintain the basic respect for artificial biological-electronic-mechanical intelligent bodies that humans treat as living beings.

Claims

1. A device for spatially compressing event information and delivering it to a nervous system, characterized in that: It includes an imaging system that encodes event information into a plurality of patterns, a plurality of visual nervous systems that use the minimum information unit encoded in the patterns to regulate the activities of a single or multiple neurons in the nervous system, and a pattern projection system that projects the plurality of patterns encoded by the imaging system to each visual nervous system.

2. The device according to claim 1, characterized in that The imaging system receives event information, and divides each characteristic parameter of the event information into different dimensions according to the type of information. The information of each dimension is encoded by the imaging system to form an independent pattern; the event information is encoded into several groups of patterns.

3. The device according to claim 1, characterized in that The pattern projection system projects a plurality of patterns encoding event information to the optic system.

4. The device according to claim 1, characterized in that The pattern projection system includes several groups of sub-projection systems, each of which projects a pattern to a corresponding optic nerve system.

5. The device according to claim 1, characterized in that The optic nerve system is selected from: A first photosensitive element independently arranged from the neuron, the first photosensitive element generates a nerve pulse under the action of light and transmits the generated nerve pulse to the neuron; or, The visual nervous system is selected from neurons with photosensitive points set on the surface or inside. The photosensitive points activate the neurons where they are located under the action of light signals. The neurons are defined as photosensitive neurons, that is, the second photosensitive elements.

6. The device according to claim 2, characterized in that Each pattern formed by the imaging system includes a plurality of image blocks, and the brightness and darkness of a single image block represent the smallest information unit respectively. The brightness and darkness of each image block in the pattern are used to encode the event information to be projected in the pattern.

7. The device according to claim 6, characterized in that The brightness and darkness of the image block encoding event information respectively control the activation and deactivation states of the first photosensitive element at the position where the image block is projected, or the brightness and darkness of the image block encoding event information respectively control the activation and deactivation states of the second photosensitive element at the position where the image block is projected, thereby achieving regulation of a single neuron.

8. The device according to claim 4, characterized in that The sub-projection system reduces the pattern formed by the imaging system and projects it to the corresponding optic nerve system; Preferably, the sub-projection system further comprises an optical path system for adjusting the projection position of the pattern to be projected, so that the same sub-projection system can project different patterns to different areas of a certain brain region, thereby expanding the range of brain regions regulated by the projection system; Preferably, the sub-projection system includes an image deflection optical path system for adjusting the projection position, so as to realize field scanning of the projected image in different areas of the same brain region. The same sub-projection system projects different patterns to different areas of a wide range of brain regions, thereby expanding the area of ​​the brain region regulated by the projection system.

9. The device according to claim 8, characterized in that The sub-projection system reduces a single image block encoding information in a pattern formed by the imaging system to a size below the size of the first photosensitive element or the second photosensitive element that receives the information, and independently projects information to each first photosensitive element or the second photosensitive element through a single or multiple image blocks encoding information in the projected pattern; thereby achieving fine control of the activity state of each neuron in a large-scale neuronal cluster through the projected image by regulating a single neuron through a single image block.

10. The device according to claim 9, characterized in that The maximum inner diameter of a single image block in the pattern projected by the projection system is in the range of 20 nm to 10 μm.

11. The device according to claim 5, characterized in that When the optic nerve system is selected from the first photosensitive element independently set up from neurons, the optic nerve system includes a photosensitive cell layer for receiving the pattern projected by the sub-projection system and receiving the pattern light signal; after the photosensitive cells receive the pattern light signal, they activate the neural interneuron cells, and the activated neural interneuron cells further activate the retinal ganglion cells, which project to the nervous system through axons, convert the pattern information into nerve pulses and project them to the neurons of the nervous system; the optic nerve system is selected from neurons with photosensitive points set on the surface or inside, and the photosensitive points are selected from photosensitive proteins.

12. The device for spatially compressing event information and delivering it to the nervous system according to claim 1, characterized in that: The nervous system is selected from a biological brain, cerebellum, spinal cord, peripheral nerves or brain organoids cultured in vitro.

13. The device for spatially compressing event information and delivering it to the nervous system according to claim 1, characterized in that: The events include frame events and sequential events; the frame events refer to static events; and the sequential events are dynamic events formed by the combination of multiple continuous and related frame events.

14. The device according to claim 2, characterized in that The dimensions for classifying event information include, but are not limited to: mechanical, taste, tactile, olfactory, temperature, and light stimulation dimensions of the event, and each dimension of information also includes coordinate information of the dimension information.

15. A method for large-scale neuron fine regulation, characterized in that: Neurons in the nervous system are provided with photosensory points or connected to the first photosensory element; the neurons providing photosensory points are defined as the second photosensory element; After the information to be delivered is encoded into a pattern, the spatial size of the pattern is compressed by re-imaging, thereby increasing the information density in the space where the compressed pattern is located and reducing the size of the image block encoding the minimum information unit in the compressed pattern. The compressed pattern is projected onto the first photosensitive element or the second photosensitive element to achieve fine control of each neuron in a large-scale neuronal cluster and high-density information transmission to the nervous system.

16. A method for large-scale neuron fine regulation, characterized in that: By placing photosensitive elements on neurons, After encoding the information to be delivered into pattern information, a single image block encoding the smallest information unit in the pattern is reduced to below the size of a neuron by compressing the spatial size of the pattern, thereby obtaining a compressed pattern, and Projecting the compressed pattern onto a nervous system including a collection of neurons of the type provided with the photosensitive element, controlling a single neuron through a single or multiple image blocks of information encoded in the projected pattern, and further regulating a single neuron through a single or multiple image blocks of information encoded in the projected pattern; and finally achieving fine regulation of each neuron in a large-scale neuron cluster by regulating the information content encoded in each image block in the pattern; Preferably, the information includes multiple categories; Preferably, the information includes one or more dimensions such as mechanics, taste, touch, smell, temperature, light stimulation, etc.

17. The method according to claim 16, characterized in that The photosensitive element includes a light-sensitive protein disposed on a neuron.

18. A method for large-scale neuronal fine regulation, characterized in that: Connecting light-sensitive elements to the outside of neurons, After encoding the information into pattern information, the single image block encoding the smallest information unit in the pattern is reduced to a size below that of the photosensitive element by compressing the spatial size of the pattern, thereby obtaining a compressed pattern, and projecting the compressed pattern onto the array of photosensitive elements, The photosensitive element connected to a single neuron is controlled by a single or multiple image blocks of information encoded in the projected pattern, and the single neuron is regulated by a single or multiple image blocks of information encoded in the projected pattern; finally, the fine regulation of each neuron in a large-scale neuron cluster is achieved by regulating the information content encoded in each image block in the pattern; Preferably, the information includes multiple categories; Preferably, the information includes one or more dimensions such as mechanics, taste, touch, smell, temperature, light stimulation, etc.

19. The method according to claim 18, characterized in that The photosensitive element includes connecting neurons to retinal ganglion cells provided with photoreceptor cells.

20. The method according to any one of claims 15 to 19, characterized in that By compressing the pattern through the lens imaging system, the spatial size of the pattern is compressed, thereby improving the information density in the space where the compressed pattern is located.

21. The method according to any one of claims 15 to 19, characterized in that the step include: Step I: Divide event information into several dimensions; Step II: Encode the information of each dimension to form a corresponding pattern, and obtain several patterns corresponding to all event information; Step III: Projecting several pattern information separately, with different projected patterns activating neurons in different areas of the nervous system, projecting all event information to the nervous system, and forming and activating neural networks corresponding to the projected event information between multiple brain regions within the nervous system; Preferably, in step I, the event information is divided into different dimensions according to the types of characterization parameters; Preferably, in the same dimension, the same type of information is encoded according to the intensity and coordinate information to form a pattern corresponding to the information of the dimension; Preferably, the process of encoding the event information into a pattern realizes the correspondence between the event information and the pattern; then, through the pattern projection process, the event information is corresponded to the first photosensitive element or the second photosensitive element; finally, the neurons are activated, and finally the event information is projected to the corresponding neurons in the nervous system; Preferably, in the process of encoding event information to form a pattern, each dimension of event information independently adopts a coding language, coding information density, and coding information sorting scheme.

22. An artificial bio-electronic-mechanical intelligent body, characterized in that: It includes an imaging system that receives external event information and encodes the event information into pattern information, a pattern projection system that projects the pattern information, a photosensitive element that uses the pattern information to activate corresponding neurons in the nervous system, and a nervous system and support system for information processing.

23. The artificial bio-electronic-mechanical intelligent body of claim 22, characterized in that: The event information comes from the detector's detection of the real physical world; or the event information comes from information generated or output by an electronic computer system; or the event information comes from mixed reality information of the detector's detection of the real physical world and information generated or output by an electronic computer system.

24. The artificial bio-electronic-mechanical intelligent body of claim 22, characterized in that: The nervous system is also connected to an execution system for externally outputting result information obtained by the nervous system processing.

25. The artificial bio-electronic-mechanical intelligent body of claim 22, characterized in that: The artificial bio-electronic-mechanical intelligent entity is trained using the same methods humans use to raise infants.

Images