Device for Information Compression and Delivery and Method for Fine Regulation of Large-Scale Neurons

Abstract

The present invention relates to spatial information compression and delivery, belonging to the field of information delivery. The present invention provides a device for delivering spatially compressed event information to the nervous system and a method for fine regulation of large-scale neurons. The device includes an imaging system that encodes event information into a plurality of patterns respectively, a plurality of visual nervous systems that use the smallest information units encoded within the patterns to regulate the activities of individual neurons within the nervous system, and a pattern projection system that projects the plurality of patterns encoded by the imaging system onto each of the visual nervous systems respectively. This device and method solve the problems of low information transmission efficiency of existing neural electrodes, immune rejection with the nervous system, and mechanical damage to nerve tissues, achieve fine regulation of each neuron in a large-scale neuron cluster, and realize high-bandwidth input of multi-dimensional event information to the entire brain region of the nervous system.

Description

Technical Field

[0001] The present invention relates to a method and device for delivering information to the nervous system, and particularly to a device for delivering event information after spatial compression to the nervous system and a method for fine regulation of a large number of neurons. Background Art

[0002] In the prior art, neural electrodes are mostly used to deliver information to the nervous system, such as Utah electrodes, flexible neural electrodes, etc. However, such neural electrodes have many insurmountable disadvantages:

[0003] 1. Limited by the channel density of the neural electrode, information cannot be efficiently delivered to the nervous system;

[0004] 2. Limited by the refresh rate of the neural electrode signal, the frame rate of the neural electrode delivering electrical signals to the nervous system is low;

[0005] 3. The neural electrode needs to be implanted into the nervous system to function, which will cause immune rejection between the neural electrode and the nervous system, or the neural electrode will fall off or shift during animal movement, thus causing mechanical damage to the nervous system. At the same time, it also affects the stable use of the neural electrode, reducing the transmission efficiency and accuracy of neural signals.

[0006] Therefore, existing technologies for high-density delivery of information to the nervous system and achieving fine and stable regulation of a large number of neurons all have many insurmountable difficulties, which limit the development of related industries in the field of brain science. Summary of the Invention

[0007] The technical problem to be solved by the present invention is to provide a device for delivering event information after spatial compression to the nervous system and a method for fine regulation of a large number of neurons. The device and method solve the problems of low information transmission efficiency of existing neural electrodes, immune rejection with the nervous system, and mechanical damage to nerve tissue. At the same time, it also realizes the beneficial effects of transmitting information to multiple brain regions of the nervous system with high density and low latency, and achieving fine regulation of each neuron in a large number of neuron clusters.

[0008] The first aspect of the present application provides a device for delivering event information after spatial compression to the nervous system, including an imaging system that encodes event information into a plurality of patterns respectively, a plurality of visual nervous systems that use the minimum information units encoded in the patterns to regulate the activities of single or multiple neurons in the nervous system, and a pattern projection system that projects the plurality of patterns encoded by the imaging system onto each visual nervous system respectively.

[0009] Further, the imaging system receives event information, divides the characteristic parameters of the event information into different dimensions according to the information type, encodes the information in each dimension by the imaging system to form independent patterns; the event information is encoded into several groups of patterns.

[0010] Further, the pattern projection system projects several patterns encoding event information onto the visual nervous system.

[0011] Further, the pattern projection system includes several groups of sub-projection systems, and each sub-projection system projects a pattern onto a corresponding visual nervous system.

[0012] Further, the visual nervous system is selected from:

[0013] A first photosensitive element independently arranged from neurons, which generates nerve impulses under the action of light and transmits the generated nerve impulses to neurons; or,

[0014] The visual nervous system is selected from neurons with photosensitive points arranged on the surface or inside, and the photosensitive points activate the neurons where they are located under the action of light signals, and the neurons are defined as photosensitive neurons, that is, the second photosensitive element.

[0015] Further, each pattern formed by the imaging system includes several image blocks, and the light and darkness of a single image block respectively represent the minimum information unit. Using the light and darkness of each image block in the projected pattern, the event information to be projected is encoded in the projected pattern.

[0016] Further, the light and darkness of the image blocks encoding information respectively control the activation and non-activation states of the first photosensitive element at the position where the image blocks are projected, or the light and darkness of the image blocks encoding information respectively control the activation and non-activation states of the second photosensitive element at the position where the image blocks are projected, so as to realize the regulation of single neurons.

[0017] Further, the sub-projection system projects the pattern formed by the imaging system after shrinking it onto the corresponding visual nervous system;

[0018] Further, the sub-projection system further includes an optical path system for adjusting the position of the projected pattern, so as to realize that the same sub-projection system projects different patterns onto different regions of a certain brain area respectively, and expand the range of the brain area regulated by the projection system;

[0019] Further, the sub-projection system includes an image deflection optical path system for adjusting the projection position, so as to realize field scanning of the projected image in different regions of the same brain area, and the same sub-projection system projects different patterns onto different regions of a large range of brain areas respectively, and expand the area of the brain area regulated by the projection system.

[0020] Further, the sub-projection system reduces a single image block of the encoded information in the pattern formed by the imaging system to a size smaller than that of the first photosensitive element or the second photosensitive element that receives the information, and projects the information to each first photosensitive element or second photosensitive element separately through a single or multiple image blocks of the encoded information within the projected pattern; thereby, through the regulation of a single neuron by a single image block, fine regulation of the activity states of each neuron within a large-scale neuron cluster is achieved by projecting an image.

[0021] Further, the maximum inner diameter of a single image block in the pattern projected by the projection system is selected from 20 nm to 10 μm.

[0022] Further, when the visual nervous system is selected as the first photosensitive element independently arranged from neurons, the visual nervous system includes a photosensitive cell layer for receiving the pattern projected by the sub-projection system and receiving the pattern optical signal; after the photosensitive cells receive the pattern optical signal, nerve interneurons are activated, and the activated nerve interneurons further activate retinal ganglion cells. The retinal ganglion cells project to the nervous system through axons, convert the pattern information into nerve impulses and project them to the neurons of the nervous system; when the visual nervous system is selected as neurons with photosensitive points arranged on the surface or inside, the photosensitive points are selected from photosensitive proteins.

[0023] Further, the nervous system is selected from a biological brain, cerebellum, spinal cord, peripheral nerve or an in vitro cultured brain organoid.

[0024] Further, the events include frame events and timing events; the frame events refer to static events; the timing events are dynamic events formed by combining multiple consecutive and related frame events.

[0025] Further, the dimensions for classifying event information include dimensions such as the mechanics, taste, touch, smell, temperature, light stimulation, etc. of the event, and each dimension of information also includes the coordinate information of that dimension of information.

[0026] The second aspect of the present application provides a method for fine regulation of large-scale neurons: photosensitive points are arranged on the neurons within the nervous system or connected to the first photosensitive element; the neurons with photosensitive points arranged are defined as the second photosensitive element; after encoding the information to be delivered into a pattern, the spatial size of the pattern is compressed by re-imaging to increase the information density within the space where the compressed pattern is located and reduce the size of the image block of the smallest information unit encoded in the compressed pattern; the compressed pattern is projected onto the first photosensitive element or the second photosensitive element to achieve fine regulation of each neuron within a large-scale neuron cluster and high-density transmission of information to the nervous system.

[0027] The third aspect of the present application provides a method for fine regulation of large-scale neurons. A photosensitive element is arranged on the neurons; after encoding the information to be delivered into pattern information, by compressing the spatial dimension of the pattern, a single image block encoding the smallest information unit in the pattern is reduced to a size smaller than that of the neurons, thereby obtaining a compressed pattern; the compressed pattern is projected onto a nervous system including a set of such neurons, and the control of a single neuron is achieved through a single or multiple image blocks encoding information in the projected pattern, and further, the regulation of a single neuron is achieved through a single or multiple image blocks encoding information in the projected pattern; finally, by regulating the information content encoded in each image block in the pattern, the fine regulation of each neuron in a large-scale neuron cluster is achieved.

[0028] In another preferred example, the information includes multiple types;

[0029] In another preferred example, the information includes one or more of the dimensions such as mechanics, taste, touch, smell, temperature, light stimulation, etc.

[0030] Furthermore, the photosensitive element includes arranging light-sensitive proteins on the neurons.

[0031] The third aspect of the present application provides a method for fine regulation of large-scale neurons. A photosensitive element is externally connected to the neurons; after encoding the information into pattern information, by compressing the spatial dimension of the pattern, a single image block encoding the smallest information unit in the pattern is reduced to a size smaller than that of the photosensitive element, thereby obtaining a compressed pattern; the compressed pattern is projected onto an array of the photosensitive elements; the control of the photosensitive element connected to a single neuron is achieved through a single or multiple image blocks encoding information in the projected pattern, and further, the regulation of a single neuron is achieved through a single or multiple image blocks encoding information in the projected pattern; finally, by regulating the information content encoded in each image block in the pattern, the fine regulation of each neuron in a large-scale neuron cluster is achieved;

[0032] In another preferred example, the information includes multiple types;

[0033] In another preferred example, the information includes one or more of the dimensions such as mechanics, taste, touch, smell, temperature, light stimulation, etc.

[0034] Furthermore, the photosensitive element includes connecting the neurons to retinal ganglion cells provided with photosensitive cells.

[0035] Furthermore, the spatial dimension of the pattern is compressed by a lens imaging system to improve the information density in the space where the compressed pattern is located.

[0036] Furthermore, the steps of the method for fine regulation of large-scale neurons further include:

[0037] Step I: Split the event information into several dimensions;

[0038] Step II: Encode the information of each dimension to form corresponding patterns, obtaining several patterns corresponding to all the event information;

[0039] Step III: Send the several pattern information separately. Different projected patterns activate neurons in different regions of the nervous system, sending all the event information to the nervous system and forming and activating a neural network corresponding to the projected event information among multiple brain regions within the nervous system;

[0040] In another preferred example, in Step I, the event information is divided into different dimensions according to the types of characterization parameters;

[0041] In another preferred example, within the same dimension, similar information is encoded according to intensity and coordinate information to form a pattern corresponding to the information of this dimension;

[0042] In another preferred example, in the process of encoding the event information into patterns, the corresponding relationship between the event information and the patterns is realized; subsequently, through the pattern projection process, the event information is corresponded to the first photosensitive element or the second photosensitive element; finally, the neurons are activated, ultimately realizing the projection of the event information to the corresponding neurons within the nervous system;

[0043] In another preferred example, in the process of encoding the event information into patterns, for the event information of each dimension, an encoding language, an encoding information density, and an encoding information sorting scheme are independently adopted.

[0044] The fourth aspect of the present application provides an artificial bio - electronic - mechanical intelligent agent, including an imaging system that receives external event information and encodes the event information into pattern information, a pattern projection system that projects the pattern information, a photosensitive element that uses the pattern information to activate corresponding neurons in the nervous system, a nervous system for information processing, and a support system.

[0045] Furthermore, the event information comes from the detection of the real physical world by a detector; or the event information comes from the information generated or output by an electronic computer system; or the event information comes from the mixed reality information of the detection of the real physical world by a detector and the information generated or output by an electronic computer system.

[0046] Furthermore, the nervous system is also connected to an execution system for externally outputting the result information obtained by the nervous system processing.

[0047] Furthermore, the artificial bio - electronic - mechanical intelligent agent is trained by the method of human raising infants. Brief Description of the Drawings

[0048] Figure 1Schematic diagram of the device for spatial compression of event information and delivery to the nervous system according to the present invention Figure 1 ;

[0049] Figure 2 Schematic diagram of the device for delivering the spatially compressed event information to the nervous system according to the present invention Figure 2 。 Specific embodiments

[0050] The following will further elaborate on the present invention in conjunction with specific embodiments and the attached Figure 1 、attached Figure 2 , further elaborating the present invention.

[0051] The present invention proposes a device for delivering spatially compressed event information to the nervous system and a method for fine-tuning a large number of neurons. This method uses a non-direct contact method to project information densely to the nervous system including the brain, spinal cord, brain organoids, peripheral nerves, etc., achieving the beneficial effect of fine-tuning individual neurons in a large number of neuron clusters. In particular, by projecting information to complex nervous system regions such as the brain, multi-modal information input to the brain is realized, that is, the problems of low data transmission efficiency of conventional neural electrodes, mechanical damage of neural electrodes to nerve tissue, inaccurate information delivery of neural electrodes, and inability to accurately deliver information to individual neurons by neural electrodes are avoided.

[0052] Specifically, in the device of this embodiment, it includes an imaging system that encodes event information into a number of patterns respectively, a number of visual nervous systems that use the minimum information units encoded within the patterns to regulate the activities of individual or multiple neurons within the nervous system, and a pattern projection system that projects the number of patterns encoded by the imaging system to each visual nervous system respectively.

[0053] In this embodiment, the event information refers to the event information input to the brain. The event information can have various sources. In this embodiment, the event information can be combined information obtained from the detection of the physical world by a number of detectors, or can be virtual events generated by a computer system. It can also be a virtual reality hybrid event of physical world events and virtual events generated by a computer system. Describing an event often requires information in multiple dimensions, such as temperature, taste, touch, smell, vision, acceleration, etc. information, as well as the coordinate information of this information. In this embodiment, the event information is classified, and the overall event information is segmented into information in different dimensions, and each item of information within each dimension contains the corresponding coordinate information of this information.

[0054] In this embodiment, the information of each dimension of the event is encoded into a specific pattern, and the information such as the intensity, position, and attribute of the information is converted into the coordinate values, brightness, color, etc. of the image blocks in the pattern. In this embodiment, the information encoding method and the corresponding encoding algorithm for each dimension can be independent of each other, so as to design a unique encoding language according to the different information densities and attributes of each dimension, and achieve a higher efficiency of information input. The encoding method from information to image is described in detail in the subsequent embodiments of this specification.

[0055] The visual nervous system is selected from: a first photosensitive element independent of neurons, which generates nerve impulses under the action of light and transmits the generated nerve impulses to neurons; or the visual nervous system is selected from neurons with photosensitive points arranged on the surface or inside, and the photosensitive points activate the neurons where they are located under the action of light signals, and this neuron is defined as a photosensitive neuron, that is, a second photosensitive element.

[0056] In this embodiment, a first photosensitive element independent of neurons is adopted: specifically, each visual nervous system includes a photosensitive cell layer, the photosensitive cells in the photosensitive cell layer are connected to nerve interneuron cells, and the nerve interneuron cells are connected to retinal ganglion cells. The photosensitive cells activated by receiving light stimuli transmit light information to nerve interneuron cells. After the nerve interneuron cells are activated, they transmit the information to retinal ganglion cells and activate the retinal ganglion cells. The activated retinal ganglion cells transmit signals through axons to the neurons connected to them inside the brain, so as to achieve the stimulation of specific neurons inside the brain by stimulating a certain cell in the photosensitive layer. In this embodiment, a scheme of organoid culture is adopted for the visual nervous system that projects information to the brain. A number of independent culture areas are set on the surface of the brain, and the supporting substances, nutrients, and stem cells required for the development of the visual nervous system are set in this area, so as to promote the differentiation of stem cells into the required visual nervous system and grow nerve axons to project information to the selected area of the brain.

[0057] In this embodiment, there should be several pattern projection systems. Each pattern projection system projects a pattern formed by encoding event information of one dimension onto a visual nervous system. In this embodiment, the pattern projection system uses the principle of optical imaging. The pattern displayed by the imaging system is passed through optical devices, such as an optical lens group, to reduce the smallest information unit in the image, that is, the image block, to a size smaller than that of the first photosensitive element or the second photosensitive element that receives the information carried by the image block. For example, the smallest information unit in the image, that is, the image block, is reduced to a size smaller than that of the first photosensitive element that receives the information carried by the image block, so that each byte of information in the image is projected onto a single photosensitive cell. The photosensitive cell is connected to an intermediate cell to transmit the byte information to the intermediate cell. The intermediate cell further activates the retinal ganglion cell, so that the byte information is transmitted to a specific neuron inside the brain through the axon of the retinal ganglion cell. Finally, each byte of information in the pattern is transmitted to a specific neuron in the brain, realizing independent regulation of each neuron in the brain; for example, the smallest information unit in the image, that is, the image block, is reduced to a size smaller than that of the second photosensitive element that receives the information carried by the image block, so that the information carried by each image block in the image is projected onto a single photosensitive neuron with light sensitivity, so that the byte information is transmitted to a specific neuron inside the brain through the axon of the retinal ganglion cell. Finally, each byte of information in the pattern is transmitted to a specific neuron in the brain, realizing independent regulation of each neuron in the brain.

[0058] In this embodiment, the encoding of information into a pattern should be regarded as a functional statement, that is, any technology for encoding information into a pattern should be regarded as the protection scheme of this patent. Considering that the purpose of projecting the pattern is to act on the regulation of neurons with the information in the pattern, preferably, the information is encoded into image blocks. The brightness and darkness of a single image block respectively represent the smallest information unit. The brightness and darkness of the image block respectively correspond to the activation and non-activation of the photosensitive element at the position where the image block is projected. For example, for the temperature information of the target object in the event information, an X-Y coordinate system is set in the pattern. The position information of each part of the object is represented by the (x, y) coordinate values of the central image block of a group of image block matrices (that is, an array of image blocks, or a group of image blocks). The temperature gradient value of this point on the object surface is represented by the number of lit image blocks in the image block matrix. When a large amount of image block matrix information is projected onto the nervous system through the photosensitive element, the event information of the two-dimensional projection shape of the target object and the temperature distribution on the surface of the target object is projected onto the nervous system, that is, the frame event of "the temperature of the target object surface at this moment"; when dynamically and real-timely projecting the temperature information of the target object surface, that is, projecting the sequential event of "the temperature change process of the target object surface" onto the nervous system, that is, continuously projecting multiple mutually related frame events, that is, completing the projection of the sequential event.

[0059] In addition, since the projected event information prompts the nervous system to recombine event information in different dimensions at the neural network level, in this embodiment, the encoding method of information does not affect the "understanding or processing" of events by the nervous system. What matters is that a stable encoding method is used for information in a certain dimension, while different encoding methods can be adopted for information in different dimensions. For information such as mechanics, acceleration, and pressure, all of the above or other information encoding methods can be used. The ways of information encoding are endless, and the specific information encoding method should not be regarded as a limitation of the protection scope of this patent. The above encoding method examples are only used to facilitate the demonstration of encoding information into patterns.

[0060] Furthermore, the above embodiment uses an image block symmetric matrix to encode information. The brightness and darkness of each image block in the image block matrix will change the temperature gradient value transmitted by this image block matrix. Therefore, each image block is the smallest unit for encoding information in the image, that is, the carrier of the smallest information unit is an image block. Therefore, when the image block is smaller than the diameter of the projected photosensitive element, the image block is only projected onto this photosensitive element, and the image block can only activate one or two adjacent photosensitive elements and the neurons connected thereto. Therefore, the image block matrix regulates the corresponding number of neurons through the image blocks contained therein, and the activated neuron group is input with the temperature and coordinate information recorded by the image block matrix. Furthermore, all the image blocks in all the matrices in an image project the event information of the two-dimensional projection shape of the target object and the temperature distribution on the surface of the target object onto the nervous system.

[0061] Therefore, when the shape of the image block is circular or other regular polygons or slightly deformed similar to regular polygons, this kind of image block is conducive to projecting information to a single neuron with a photosensitive element. Especially when the maximum diameter of the image block is smaller than the diameter of the neuron and the size of the neuron gap, a single image block can achieve and can only achieve the regulation of one neuron, and the entire image can achieve fine regulation of each neuron in a large-scale neural cluster. The principle of projecting information to the neuron connected with the photosensitive element is similar and will not be repeated here, except that the pattern is directly projected onto the neuron provided with the photosensitive element.

[0062] In this embodiment, the imaging system includes a computer system that encodes event information into pattern information, and also includes a display device that displays the encoded pattern. The display device in this embodiment comes from the prior art and there are various choices, generally divided into three types: self-luminous type, transmissive type, and reflective type. The self-luminous type mainly includes CRT, LCD, OLED, etc.; the transmissive type such as LCD that simply retains the liquid crystal polarization rotation display structure, and projects the pattern by blocking light. In addition, there are similar devices such as photolithography masks in lithography equipment; the reflective type includes DMD digital micromirror wafers based on the DLP principle (mostly used in projectors), and LCOS pattern projection devices, etc.

[0063] According to the different display devices of the above imaging system, there will be different pattern projection systems. For example, in the optical path design of a lithography machine similar to chip processing and manufacturing, the pattern of a mask or a transmissive LCD screen is projected onto a target position; or there is an optical path design similar to that of a projector, which projects the images of DMD and LCIOS chips onto a target position, such as the optical path design of a common projector; or through the principle of lens imaging, the pattern of a self-luminous display device is directly projected onto a target position. All in all, the technical effects of image display and projection can be achieved through the optical path design of existing technologies, and specific optical paths will not be listed or designed in this embodiment. As long as the optical path can project the pattern after reduction through a lens combination and adjustment, it should be considered that the technical solution of this application is sufficiently disclosed.

[0064] In this embodiment, the projection system further includes an optical path system for adjusting the position of the projected pattern, so as to enable the same sub-projection system to project different patterns onto different regions of a certain brain region respectively, thereby expanding the brain region range regulated by the projection system. In particular, through an image deflection optical path system, the pattern coding information is automatically corresponded to the projected pattern position, so as to realize field scanning of the projected image in different regions of the same brain region. During a single full-field scanning process, the same sub-projection system projects different patterns onto different regions of a large-scale brain region respectively; during multiple full-field scanning processes, the same sub-projection system projects different patterns onto different regions of a large-scale brain region and different moments of the same region respectively, thereby expanding the brain region area regulated by the projection system.

[0065] Those of ordinary skill in the art can understand that other solutions capable of projecting such images to the visual nervous system can also achieve the beneficial effects of this technical solution and should also be regarded as the protection scope of this patent.

[0066] In this embodiment, if the pattern is directly projected onto photosensitive neurons, considering that the diameter of neuron axons is generally not less than 12 micrometers, therefore, the inner diameter of the image block in the projected pattern in this embodiment is controlled within the range of 20 nm to 10 μm at most, which can better balance the imaging difficulty and the regulation fineness, and realize the fine regulation of each neuron in the nervous system.

[0067] In this embodiment, the event information is classified. The event information is segmented into information of different dimensions, and the information of different dimensions is encoded into different patterns. Different patterns are respectively projected onto different visual nervous systems by the pattern projection system, and then transmitted to different brain regions through different visual nervous systems, thereby realizing that the information segmented according to different dimensions of the event information is respectively projected onto different brain regions, that is, projecting multi-modal information into the brain and constructing a multi-modal neural network corresponding to the event inside the brain.

[0068] In this embodiment, dynamic events, i.e., sequential events, can be input into the brain through this system. A sequential event is a dynamic event formed by combining multiple consecutive and related frame events. This device realizes the projection of the entire sequential event through the orderly and continuous projection of each frame event, forming a network group for describing the sequential event.

[0069] This technical solution is used for information projection onto brain organoids. A brain organoid refers to a neural cluster tissue obtained through in vitro culture techniques. During the growth of the neural cluster tissue, cells that develop into the visual nervous system are mixed in, so as to form the visual nervous system on the surface of the brain organoid; or an element expressing a light-sensitive protein is arranged inside the cultured neurons to enable these neurons to be regulated by light; or several regions are set in the culture device, with some regions for developing brain organoids and some regions for developing the visual nervous system, and a channel is set between the two, and the visual nervous system is induced by neural development-inducing tissue to project axons towards the brain organoid for information transmission.

[0070] In this embodiment, the visual nervous system is used to receive the pattern light signal, and then the pattern information is projected onto each neuron in the nervous system; alternatively, a light-sensitive protein or other light-sensitive materials can be set on the neuron, and the pattern is directly projected onto the neuron to regulate the neuron. The technology of receiving light information and activating neurons belongs to functional description. The light-sensitive protein, visual nervous system, and other light-sensitive substances described in this embodiment can all achieve the beneficial effects of this technical solution. Therefore, different technologies for activating neurons with light should all be regarded as the protection scope of this patent.

[0071] This embodiment provides a method for fine regulation of a large number of neurons: photosensitive elements are set or connected to the neurons in the nervous system. After encoding the event information into pattern information, the spatial size of the pattern is compressed to increase the information density in the space where the compressed pattern is located. The compressed pattern is projected onto the photosensitive elements of the neurons, realizing high-density information transmission to the nervous system.

[0072] More specifically, photosensitive elements are set on the neurons to form photosensitive neurons with photosensitive ability. After encoding the event information to be delivered into pattern information, by compressing the spatial size of the pattern, a single image block encoding the smallest information unit in the pattern is reduced to a size smaller than that of the photosensitive neuron, and the compressed pattern is projected onto the nervous system including the set of such photosensitive neurons. The control of a single photosensitive neuron is achieved through one or more image blocks encoding information in the projected pattern, and then the regulation of a single neuron is achieved through one or more image blocks encoding information in the projected pattern; finally, by regulating the content of the information encoded in the pattern, the fine regulation of each neuron in a large-scale neuron cluster is realized;

[0073] Alternatively, a photosensitive element is externally connected to the neuron. After encoding the event information into pattern information, by compressing the spatial dimension of the pattern, a single image block encoding information in the pattern is reduced to a size smaller than that of the connected photosensitive element, and the compressed pattern is projected onto the photosensitive element. The control of the photosensitive element corresponding to a single neuron is achieved through a single or multiple image blocks encoding information in the projected pattern, and further, the regulation of a single neuron is realized through a single or multiple image blocks encoding information in the projected pattern. Finally, by regulating the content of the pattern encoding information, the fine regulation of each neuron in a large-scale neuron cluster is realized. The externally connected photosensitive element includes connecting the neuron to a retinal ganglion cell provided with photosensitive cells.

[0074] In this embodiment, the information includes multiple categories: one or more of dimensions such as mechanics, taste, touch, smell, temperature, light stimulation, etc. In the same dimension, the same type of information is encoded according to intensity and coordinate information to form a pattern corresponding to the information of this dimension.

[0075] In this embodiment, the pattern is compressed through a lens imaging system to compress the spatial dimension of the pattern and increase the information density in the space where the compressed pattern is located.

[0076] An artificial bio-electro-mechanical intelligent body includes a brain-like organ for information processing and a support system, an optic nerve system connected to the brain-like organ, a pattern projection system for projecting information to the optic nerve system, an imaging system for receiving external event information and encoding the event information into pattern information, and an information output system connected to the brain-like organ for externally outputting the result information obtained by the brain-like organ processing. The support system in this embodiment refers to the system for maintaining the brain-like organ, including a nutrition system, a temperature control system, an oxygen supply system, a development system, etc., for maintaining the growth, development and information processing of the brain-like organ.

[0077] In this embodiment, the external event information comes from the detection of the real physical world by a detector; or the external event information comes from the information generated or output by an electronic computer system. In this embodiment, the selection of the external event information should comply with the norms of human civilization and maintain the basic respect of human beings for living things for the artificial bio-electro-mechanical intelligent body.

Claims

1. A device for delivering compressed event information space to the nervous system, characterized in that, An imaging system that encodes event information into a number of patterns respectively, a number of visual nervous systems that use the smallest information units encoded within the patterns to regulate the activities of single or multiple neurons within the nervous system, and a pattern projection system that projects the number of patterns encoded by the imaging system onto respective visual nervous systems. The pattern projection system compresses the spatial dimensions of the patterns through re-imaging, increases the information density within the space where the compressed patterns are located, and reduces the size of the image blocks of the smallest information units encoded within the compressed patterns.

2. The device according to claim 1, characterized in that, The imaging system receives event information, divides the respective characterization parameters of the event information into different dimensions according to the types of information, and each dimension of information is encoded by the imaging system to form independent patterns; the event information is encoded into a number of groups of patterns.

3. The device according to claim 1, characterized in that, The pattern projection system projects the number of patterns encoding event information onto the visual nervous systems.

4. The device according to claim 1, characterized in that, The pattern projection system includes a number of groups of sub-projection systems, and each sub-projection system projects one pattern onto a corresponding visual nervous system.

5. The device according to claim 1, characterized in that, The visual nervous systems are selected from: A first photosensitive element provided independently of neurons, which generates nerve impulses under the action of light and transmits the generated nerve impulses to neurons; or, The visual nervous systems are selected from neurons with photosensitive points provided on the surface or inside, and the photosensitive points activate the neurons where they are located under the action of light signals, and this neuron is defined as a photosensitive neuron, that is, a second photosensitive element.

6. The device according to claim 2, characterized in that, Each pattern formed by the imaging system includes a number of image blocks, and the brightness and darkness of a single image block respectively represent the smallest information units. Using the brightness and darkness of each image block within the pattern, the event information to be projected is encoded within the pattern.

7. The device according to claim 6, characterized in that, The brightness and darkness of the image blocks encoding event information respectively control the activation and non-activation states of the first photosensitive element at the position where the image block is projected, or the brightness and darkness of the image blocks encoding event information respectively control the activation and non-activation states of the second photosensitive element at the position where the image block is projected, thereby realizing the regulation of single neurons.

8. The device according to claim 4, wherein, The sub-projection system projects the pattern formed by the imaging system after shrinking it onto the corresponding visual nervous system.

9. The device according to claim 4, characterized in that, The sub-projection system further includes an optical path system for adjusting the projection position of the pattern to be projected, so as to project different patterns onto different regions of a certain brain area by the same sub-projection system, and expand the range of the brain area regulated by the projection system.

10. The device according to claim 9, characterized in that The sub-projection system includes an image deflection optical path system for adjusting the projection position, so as to perform field scanning of the projected image in different regions of the same brain area, project different patterns onto different regions of a large-scale brain area by the same sub-projection system, and expand the area of the brain area regulated by the projection system.

11. The device according to claim 8, characterized in that, The sub-projection system shrinks the single image block encoding information within the pattern formed by the imaging system to a size smaller than that of the first photosensitive element or the second photosensitive element that receives this information, and projects the information onto each first photosensitive element or second photosensitive element respectively through the single or multiple image blocks encoding information within the projected pattern; thus, through the regulation of single neurons by single image blocks, fine regulation of the activity states of each neuron within a large-scale neuron cluster is realized through the projected image.

12. The device according to claim 11, characterized in that, The maximum inner diameter of a single image block in the pattern projected by the projection system ranges from 20 nm to 10 μm.

13. The device according to claim 5, characterized in that When the visual nervous system is selected from the first photosensitive element arranged independently of neurons, the visual nervous system includes a photosensitive cell layer for receiving the pattern projected by the sub-projection system and receiving the pattern optical signal; after the photosensitive cells receive the pattern optical signal, the nerve interneuron cells are activated, and the activated nerve interneuron cells further activate the retinal ganglion cells. The retinal ganglion cells project to the nervous system through axons, convert the pattern information into nerve impulses and project them to the neurons of the nervous system; when the visual nervous system is selected from neurons with photosensitive points arranged on the surface or inside, the photosensitive points are selected from photosensitive proteins.

14. The device for delivering the compressed event information space to the nervous system as described in claim 1, wherein The nervous system is selected from a biological brain, cerebellum, spinal cord, peripheral nerve or an in vitro cultured brain organoid.

15. The device for delivering the compressed event information space to the nervous system as claimed in claim 1, wherein The events include frame events and timing events; the frame events refer to static events; the timing events are dynamic events formed by combining a plurality of consecutive and related frame events.

16. The device according to claim 2, characterized in that, The dimensions for classifying event information include: the mechanical, gustatory, tactile, olfactory, temperature, and light stimulation dimensions of the event, and each dimension information also includes the coordinate information of that dimension information.

17. A method for fine regulation of a large-scale neuron, characterized in that Photosensitive points are arranged on the neurons in the nervous system or connected to the first photosensitive element; the neurons with photosensitive points arranged are defined as the second photosensitive element; After encoding the information to be delivered into a pattern, the spatial size of the pattern is compressed by re-imaging, the information density in the space where the compressed pattern is located is increased, and the size of the image block of the smallest information unit encoded in the compressed pattern is reduced. The compressed pattern is projected onto the first photosensitive element or the second photosensitive element to achieve fine regulation of each neuron in the large-scale neuron cluster and high-density transmission of information to the nervous system.

18. A method for fine regulation of a large-scale neuron, characterized in that A photosensitive element is arranged on the neuron. After encoding the information to be delivered into pattern information, by compressing the spatial size of the pattern, the single image block of the smallest information unit encoded in the pattern is reduced to a size smaller than that of the neuron, thereby obtaining a compressed pattern, and The compressed pattern is projected onto the nervous system including the set of neurons provided with the photosensitive element, and the control of a single neuron is achieved through a single or multiple image blocks of the encoded information in the projected pattern, and then the regulation of a single neuron is achieved through a single or multiple image blocks of the encoded information in the projected pattern; finally, by regulating the content of the encoded information of each image block in the pattern, the fine regulation of each neuron in the large-scale neuron cluster is achieved.

19. The method according to claim 18, wherein The information includes one or more of the mechanical, gustatory, tactile, olfactory, temperature, and light stimulation dimensions.

20. The method according to claim 18, wherein The photosensitive element includes arranging a light-sensitive protein on the neuron.

21. A method for fine regulation of a large-scale neuron, characterized in that A photosensitive element is connected outside the neuron. After encoding the information into pattern information, by compressing the spatial dimension of the pattern, the individual image block of the smallest information unit encoded in the pattern is reduced to a size smaller than that of the photosensitive element, thereby obtaining a compressed pattern, and projecting the compressed pattern onto the array of the photosensitive element, controlling the photosensitive elements connected to a single neuron through one or more image blocks of the encoded information within the projected pattern, and further regulating a single neuron through one or more image blocks of the encoded information within the projected pattern; ultimately, by regulating the encoded information content of each image block within the pattern, fine regulation of each neuron within a large-scale neuron cluster is achieved.

22. The method according to claim 21, wherein, The information includes one or more of mechanics, taste, touch, smell, temperature, and light stimulation dimensions.

23. The method according to claim 21, wherein The photosensitive element includes connecting a neuron to a retinal ganglion cell provided with photosensitive cells.

24. The method according to any one of claims 17 to 23, characterized in that, Compress the pattern through a lens imaging system to achieve compression of the spatial dimension of the pattern and increase the information density within the space where the compressed pattern is located.

25. The method according to any one of claims 17 to 23, characterized in that the step Including: Step I: Divide the event information into several dimensions; Step II: Encode the information of each dimension to form corresponding patterns, obtaining several patterns corresponding to all the event information; Step III: Send the several pattern information separately, and the different projected patterns activate neurons in different regions of the nervous system, sending all the event information to the nervous system, and forming and activating a neural network corresponding to the projected event information among multiple brain regions within the nervous system.

26. The method according to claim 25, wherein, In Step I, the event information is divided into different dimensions according to the types of characterization parameters.

27. The method according to claim 25, wherein, Within the same dimension, the same type of information is encoded according to intensity and coordinate information to form a pattern corresponding to the information of this dimension.

28. The method according to claim 27, wherein The process of encoding the event information into a pattern realizes the corresponding relationship between the event information and the pattern; Subsequently, through the pattern projection process, the event information is corresponded to the first photosensitive element or the second photosensitive element; finally, the neuron is activated, and ultimately the projection of the event information to the corresponding neuron within the nervous system is realized.

29. The method according to claim 27, wherein In the process of encoding the event information into a pattern, the event information of each dimension independently adopts a scheme of encoding language, encoding information density, and / or encoding information sorting.

30. An artificial bio-electro-mechanical intelligent agent, characterized in that, Including an imaging system that receives external event information and encodes the event information into pattern information, a pattern projection system that projects the pattern information, a photosensitive element that uses the pattern information to activate corresponding neurons in the nervous system, a nervous system for information processing, and a support system. The pattern projection system compresses the spatial dimension of the pattern, reducing the individual image block of the smallest information unit encoded in the pattern to a size smaller than the neuron size, thereby obtaining a compressed pattern.

31. The artificial bio-electro-mechanical intelligent agent according to claim 30, characterized in that, The event information comes from the detection of the real physical world by a detector; or the event information comes from the information generated or output by an electronic computer system; or the event information comes from the mixed reality information of the detection of the real physical world by a detector and the information generated or output by an electronic computer system.

32. The artificial bio - electro - mechanical intelligent agent according to claim 30, characterized in that, The nervous system is also connected to an execution system for externally outputting the result information obtained by the nervous system processing.

33. The artificial bio-electro-mechanical intelligent agent according to claim 30, characterized in that, Train the artificial bio-electro-mechanical intelligent agent using the method of human raising infants.

Images