Animal multi-dimensional state recognition system and method based on full-cortical neural activity

Abstract

The invention provides an animal multi-dimensional state recognition system and method based on full-cortical neural activity, and the system comprises a stimulation generation module which is used for forming target stimulation under the condition that a stimulation generation instruction is received; the full cortical neuron imaging module is used for collecting full cortical nerve response change data generated by the experimental animal under the condition that the experimental animal receives target stimulation; the electroencephalogram signal acquisition module is used for acquiring an electrophysiological signal generated by an experimental animal under the condition that the experimental animal receives target stimulation; the response behavior detection module is used for collecting a physiological response motion state formed by the experimental animal under the condition that the experimental animal receives the target stimulation; and the synchronous recording and analyzing module is used for synchronously analyzing the whole cerebral cortex nerve response change data, the electrophysiological signal and the physiological response motion state to obtain causal association between the nerve activity and the response behavior of the experimental animal under target stimulation. Multi-dimensional state data corresponding to animal response behaviors are synchronously collected, and a foundation is laid for brain function research and analysis.

Description

Technical Field

[0001] The present invention relates to the technical field of neuroethology, and in particular to an animal multi-dimensional state recognition system and method based on whole-cortex neural activity. Background Art

[0002] In the field of neuroscience, revealing how an animal integrates multimodal sensory information through the nervous system and generates adaptive behavioral responses is the core scientific problem of analyzing brain cognitive mechanisms.

[0003] As can be known from related technologies, traditional research mainly focuses on single-modal observations. For example, electrophysiological techniques are used to record local field potentials, optical imaging is used to monitor the neuronal activities of specific brain regions, or animal movement trajectories are obtained through behavioral devices. However, the cognitive process essentially involves the primary encoding of stimuli by the primary sensory cortex, the high-level information integration of the association cortex, and the decision-making regulation of deep nuclei such as the basal ganglia, along with the dynamic feedback regulation of behavioral outputs. This complex interaction characteristic of multi-scale and multi-modal makes it difficult for traditional single-modal research to establish a causal relationship between neural activities and behavioral responses.

[0004] Therefore, finding an animal multi-dimensional state recognition system that can synchronously collect multi-dimensional state data corresponding to animal response behaviors has become a current research hotspot, thus laying a foundation for the research and analysis of brain functions based on the synchronously collected multi-dimensional state data corresponding to animal response behaviors. Summary of the Invention

[0005] The present invention provides an animal multi-dimensional state recognition system and method based on whole-cortex neural activity, which realizes the ability to synchronously collect multi-dimensional state data corresponding to animal response behaviors, thus laying a foundation for the research and analysis of brain functions based on the synchronously collected multi-dimensional state data corresponding to animal response behaviors.

[0006] The present invention provides an animal multi-dimensional state recognition system based on whole-cortex neural activity. The system includes: a stimulation generation module, a whole-cortex neuron imaging module, an electroencephalogram signal acquisition module, a response behavior detection module, and a synchronous recording and analysis module. Among them, the stimulation generation module is used to form a target stimulation corresponding to the stimulation generation instruction when receiving the stimulation generation instruction; the whole-cortex neuron imaging module is connected to the experimental animal and is used to collect the whole-brain cortex neural response change data generated by the experimental animal when receiving the target stimulation, and send the whole-brain cortex neural response change data to the synchronous recording and analysis module; the electroencephalogram signal acquisition module is connected to the experimental animal and is used to collect the electrophysiological signals generated by the experimental animal when receiving the target stimulation, and send the electrophysiological signals to the synchronous recording and analysis module, where the electrophysiological signals include electrophysiological signals of the whole-brain cortex region, the brain muscle region, and the deep brain region; the response behavior detection module is used to collect the physiological response movement state formed by the experimental animal when receiving the target stimulation, and send the physiological response movement state to the synchronous recording and analysis module; the synchronous recording and analysis module is used to receive the whole-brain cortex neural response change data, the electrophysiological signals, and the physiological response movement state, and perform synchronous analysis on the whole-brain cortex neural response change data, the electrophysiological signals, and the physiological response movement state to obtain the causal relationship between the neural activity and the response behavior of the experimental animal under the target stimulation.

[0007] According to the animal multi-dimensional state recognition system based on whole-cortex neural activity provided by the present invention, the synchronous recording and analysis module is used to implement synchronous analysis on the whole-brain cortex neural response change data, the electrophysiological signals, and the physiological response movement state in the following manner to obtain the causal relationship between the neural activity and the response behavior of the experimental animal under the target stimulation: perform alignment processing on the whole-brain cortex neural response change data, the electrophysiological signals, and the physiological response movement state at the time step to respectively obtain the aligned whole-brain cortex neural response change data, the aligned electrophysiological signals, and the aligned physiological response movement state; based on the aligned whole-brain cortex neural response change data, the aligned electrophysiological signals, and the aligned physiological response movement state, perform fitting analysis to obtain the causal relationship between the neural activity and the response behavior of the experimental animal under the target stimulation.

[0008] According to an animal multi-dimensional state recognition system based on whole-cortex neural activity provided by the present invention, the synchronous recording and analysis module is further configured to: upon receiving a first instruction, retrieve first neural activity data corresponding to the first instruction based on the first instruction, wherein the neural activity data includes the whole-brain cortex neural response change data or the electrophysiological signal, and the first instruction is an instruction for performing a causal association analysis of neural activity and response behavior under preset-dimensional neural activity data; perform synchronous analysis based on the first neural activity data and the physiological response motion state to obtain a causal association between the neural activity and the response behavior of the experimental animal under the preset-dimensional neural activity data under the target stimulus.

[0009] According to an animal multi-dimensional state recognition system based on whole-cortex neural activity provided by the present invention, the electroencephalogram signal acquisition module includes a micro-nanoelectrode array and an electrical signal storage unit. Among them, the micro-nanoelectrode array includes a plurality of detection sites, and the micro-nanoelectrode array is respectively implanted into the whole-brain cortex region, the brain muscle region, and the deep brain region through the detection sites; the electrical signal storage unit is configured to store the electrophysiological signals collected after the micro-nanoelectrode array is respectively implanted into the whole-brain cortex region, the brain muscle region, and the deep brain region, and send the electrophysiological signals to the synchronous recording and analysis module.

[0010] According to an animal multi-dimensional state recognition system based on whole-cortex neural activity provided by the present invention, the whole-brain cortex neural response change data includes one or several of primary visual cortex neural response change data, higher visual cortex neural response change data, sensory cortex neural response change data, motor cortex neural response change data, and posterior cingulate cortex neural response change data.

[0011] According to an animal multi-dimensional state recognition system based on whole-cortex neural activity provided by the present invention, the experimental animal is an experimental animal after removing a preset area of the skull and / or performing skull transparency treatment.

[0012] According to an animal multi-dimensional state recognition system based on whole-cortex neural activity provided by the present invention, the response behavior detection module includes a camera unit, which is configured to collect the physiological response motion state of the experimental animal formed upon receiving the target stimulus based on the camera unit, wherein the physiological response motion state includes any one or several of pupil activity state, whisker reaction state, facial activity state, and limb activity state.

[0013] The present invention also provides an animal multi-dimensional state recognition method based on whole-cortex neural activity. The method is applied to any one of the animal multi-dimensional state recognition systems based on whole-cortex neural activity, and the method includes: receiving a stimulus generation instruction, and forming a target stimulus corresponding to the stimulus generation instruction based on the stimulus generation instruction; collecting the whole-brain cortex neural response change data generated by the experimental animal when receiving the target stimulus, and collecting the electrophysiological signals generated by the experimental animal when receiving the target stimulus, wherein the electrophysiological signals include the electrophysiological signals of the whole-brain cortex region, the brain muscle region, and the deep brain region; collecting the physiological response motion state formed by the experimental animal when receiving the target stimulus; synchronously analyzing the whole-brain cortex neural response change data, the electrophysiological signals, and the physiological response motion state to obtain the causal relationship between the neural activity and the response behavior of the experimental animal under the target stimulus.

[0014] According to the animal multi-dimensional state recognition method based on whole-cortex neural activity provided by the present invention, the synchronous analysis of the whole-brain cortex neural response change data, the electrophysiological signals, and the physiological response motion state to obtain the causal relationship between the neural activity and the response behavior of the experimental animal under the target stimulus specifically includes: performing alignment processing on the whole-brain cortex neural response change data, the electrophysiological signals, and the physiological response motion state at a time step to respectively obtain the aligned whole-brain cortex neural response change data, the aligned electrophysiological signals, and the aligned physiological response motion state; performing fitting analysis based on the aligned whole-brain cortex neural response change data, the aligned electrophysiological signals, and the aligned physiological response motion state to obtain the causal relationship between the neural activity and the response behavior of the experimental animal under the target stimulus.

[0015] The present invention also provides a virtual device for animal multi-dimensional state recognition based on whole-cortex neural activities. The virtual device is applied to any one of the animal multi-dimensional state recognition systems based on whole-cortex neural activities. The virtual device includes: a receiving module, configured to receive a stimulation generation instruction and form a target stimulation corresponding to the stimulation generation instruction based on the stimulation generation instruction; a first acquisition module, configured to acquire the whole-brain cortex neural response change data generated by an experimental animal when receiving the target stimulation, and a second acquisition module, configured to acquire the electrophysiological signals generated by the experimental animal when receiving the target stimulation, wherein the electrophysiological signals include the electrophysiological signals of the whole-brain cortex region, the brain muscle region, and the deep brain region; a third acquisition module, configured to acquire the physiological response motion state formed by the experimental animal when receiving the target stimulation; and a processing module, configured to synchronously analyze the whole-brain cortex neural response change data, the electrophysiological signals, and the physiological response motion state to obtain the causal relationship between the neural activities and response behaviors of the experimental animal under the target stimulation.

[0016] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the method for animal multi-dimensional state recognition based on whole-cortex neural activities as described in any one of the above is implemented.

[0017] The present invention also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the method for animal multi-dimensional state recognition based on whole-cortex neural activities as described in any one of the above is implemented.

[0018] The present invention also provides a computer program product, including a computer program. When the computer program is executed by a processor, the method for animal multi-dimensional state recognition based on whole-cortex neural activities as described in any one of the above is implemented.

[0019] The animal multi-dimensional state recognition system and method based on whole-cortex neural activity provided by the present invention, the system includes: a stimulation generation module, a whole-cortex neuron imaging module, an electroencephalogram signal acquisition module, a response behavior detection module, and a synchronous recording and analysis module. Among them, the stimulation generation module is used to form a target stimulus corresponding to the stimulation generation instruction when receiving the stimulation generation instruction; the whole-cortex neuron imaging module is connected to the experimental animal, and is used to collect the whole-brain cortex neural response change data generated by the experimental animal when receiving the target stimulus, and send the whole-brain cortex neural response change data to the synchronous recording and analysis module; the electroencephalogram signal acquisition module is connected to the experimental animal, and is used to collect the electrophysiological signals generated by the experimental animal when receiving the target stimulus, and send the electrophysiological signals to the synchronous recording and analysis module; the response behavior detection module is used to collect the physiological response movement state formed by the experimental animal when receiving the target stimulus, and send the physiological response movement state to the synchronous recording and analysis module; the synchronous recording and analysis module is used to receive the whole-brain cortex neural response change data, electrophysiological signals, and physiological response movement state, and perform synchronous analysis on the whole-brain cortex neural response change data, electrophysiological signals, and physiological response movement state to obtain the causal relationship between the neural activity and response behavior of the experimental animal under the target stimulus. It realizes the ability to synchronously collect multi-dimensional state data corresponding to the animal's response behavior, thereby laying a foundation for the research and analysis of brain functions based on the multi-dimensional state data synchronously collected and corresponding to the animal's response behavior. Description of the Drawings

[0020] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0021] Figure 1 It is a schematic structural diagram of the animal multi-dimensional state recognition system based on whole-cortex neural activity provided by the present invention.

[0022] Figure 2 It is a schematic diagram of the application scenario of the animal multi-dimensional state recognition system based on whole-cortex neural activity provided by the present invention.

[0023] Figure 3 It is a schematic flowchart of the synchronous recording and analysis module performing synchronous analysis on the whole-brain cortex neural response change data, electrophysiological signals, and physiological response movement state to obtain the causal relationship between the neural activity and response behavior of the experimental animal under the target stimulus.

[0024] Figure 4It is a schematic flow chart of the method for identifying multi-dimensional states of animals based on whole-cortex neural activities provided by the present invention.

[0025] Figure 5 It is a schematic structural diagram of a virtual device for identifying multi-dimensional states of animals based on whole-cortex neural activities provided by the present invention.

[0026] Figure 6 It is a schematic structural diagram of an electronic device provided by the present invention.

[0027] Reference numerals: 100: A system for identifying multi-dimensional states of animals based on whole-cortex neural activities; 110: A stimulation generation module; 120: A whole-cortex neuron imaging module; 130: An electroencephalogram signal acquisition module; 140: A response behavior detection module; 150: A synchronous recording and analysis module. Detailed implementation manners

[0028] To make the objectives, technical solutions, and advantages of the present invention clearer, the technical solutions in the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art without creative efforts based on the embodiments in the present invention belong to the scope of protection of the present invention.

[0029] The system for identifying multi-dimensional states of animals based on whole-cortex neural activities provided by the present invention can synchronously record the activities of whole-cortex neurons (corresponding to whole-brain cortex neural response change data), electroencephalogram and electromyogram signals, deep nuclear group electrical signals (corresponding to electrophysiological signals), and multi-modal ethological data of animals (corresponding to physiological response movement states). Through this synchronous recording, the association between neural activities and behaviors can be explored more deeply, and how the brain coordinates the activities of different brain regions at multiple time scales to achieve complex cognitive functions can be analyzed.

[0030] Figure 1 It is a schematic structural diagram of a system for identifying multi-dimensional states of animals based on whole-cortex neural activities provided by the present invention. Figure 2 It is a schematic diagram of an application scenario of a system for identifying multi-dimensional states of animals based on whole-cortex neural activities provided by the present invention.

[0031] Next, in conjunction with Figure 1 and Figure 2 the structure of the system for identifying multi-dimensional states of animals based on whole-cortex neural activities provided by the present invention will be described.

[0032] In an exemplary embodiment of the present invention, in conjunction withFigure 1 and Figure 2 It can be seen that the animal multi-dimensional state recognition system 100 based on whole-cortex neural activity may include a stimulus generation module 110, a whole-cortex neuron imaging module 120, an electroencephalogram signal acquisition module 130, a response behavior detection module 140, and a synchronous recording and analysis module 150. Each module will be introduced separately below.

[0033] In one embodiment, the stimulus generation module 110 is configured to form a target stimulus corresponding to the stimulus generation instruction when receiving the stimulus generation instruction.

[0034] In one embodiment, the stimulus generation module 110 may include an LCD display screen and / or a speaker system, and by playing designed visual stimuli and auditory stimuli (corresponding to the target stimulus corresponding to the stimulus generation instruction) to the experimental animal, an animal visual and auditory cognitive activity experiment is carried out. It can be understood that the target stimulus may include visual stimuli and auditory stimuli. Among them, the visual stimuli and auditory stimuli can be determined according to the stimulus generation instruction. It should be noted that Figure 2 in this case, a mouse is used as the experimental animal. For the convenience of description in this embodiment, the mouse will be used as an example of the experimental animal for description.

[0035] In addition, the stimulus generation instruction can be adjusted according to the actual situation, and then the corresponding target stimulus can be generated according to the actual situation, thus providing the possibility for designing diversified experiments and enhancing the flexibility and adaptability of the experiments.

[0036] In another embodiment, the stimulus generation module 110 may include an LCD display screen (such as 43×43 cm, 1600×800 pixels) and a speaker system, and can play designed visual stripe or image stimuli to the experimental animal, such as black and white stripes with continuous angular changes or natural images with spatio-temporal continuity; and auditory stimuli, such as pure tones, tuning signals with continuous periodic changes at a specified frequency, white noise, etc. It can be understood that the aforementioned black and white stripes with continuous angular changes or natural images with spatio-temporal continuity; and auditory stimuli, such as pure tones, tuning signals with continuous periodic changes at a specified frequency, white noise are the target stimuli.

[0037] In yet another embodiment, the whole-cortex neuron imaging module 120 is connected to the experimental animal, and is configured to collect the whole-brain cortex neural response change data generated by the experimental animal when receiving the target stimulus, and send the whole-brain cortex neural response change data to the synchronous recording and analysis module 150.

[0038] In one embodiment, the whole cortex neuron imaging module 120 can record the neural response changes in the visual cortex, motor cortex, sensory cortex and other cortical regions of the experimental animal during the experiment with wide-field high precision, that is, collect the whole-brain cortical neural response change data generated by the experimental animal when receiving the target stimulus. Further, the whole-brain cortical neural response change data is sent to the synchronous recording and analysis module 150.

[0039] In another exemplary embodiment of the present invention, the whole-brain cortical neural response change data may include one or several of the primary visual cortex neural response change data, the high-level visual cortex neural response change data, the sensory cortex neural response change data, the motor cortex neural response change data, and the retrosplenial cortex neural response change data.

[0040] During the application process, the whole cortex neuron imaging module 120 can record the activities of the cortex at the single neuron level in a large range, record the neural activities of tens of thousands of different types of neurons, covering the primary and high-level visual cortices (VIS, AL, LM, AM, PM, RL, etc.), the sensory cortex (SS), the motor cortex (MO), and the retrosplenial cortex (RSC), etc.

[0041] In another embodiment, the electroencephalogram signal acquisition module 130 is connected to the experimental animal, and is used to collect the electrophysiological signals generated by the experimental animal when receiving the target stimulus, and send the electrophysiological signals to the synchronous recording and analysis module 150, wherein the electrophysiological signals may include the electrophysiological signals of the whole-brain cortical region, the brain muscle region, and the deep brain region.

[0042] In one embodiment, when the experimental animal receives the target stimulus, the electrophysiological signals of the cortex, muscle and deep brain region of the experimental animal during the experimental activity can be collected. Further, the electrophysiological signals are sent to the synchronous recording and analysis module 150.

[0043] In another embodiment, the response behavior detection module 140 is used to collect the physiological response motion state formed by the experimental animal when receiving the target stimulus, and send the physiological response motion state to the synchronous recording and analysis module 150.

[0044] In one embodiment, the response behavior detection module 140 can record in real time the experimental animal during the experiment, such as the motion state data, facial expression data, whisker activity of a mouse, etc., so as to provide animal behavior analysis indicators, that is, collect the physiological response motion state formed by the experimental animal when receiving the target stimulus. Further, the physiological response motion state is sent to the synchronous recording and analysis module 150.

[0045] In yet another embodiment, a synchronous recording and analysis module 150 is configured to receive data on changes in whole-cortex neural responses, electrophysiological signals, and physiological response movement states, and perform synchronous analysis on the data on changes in whole-cortex neural responses, electrophysiological signals, and physiological response movement states to obtain the causal relationship between the neural activities and response behaviors of the experimental animal under the target stimulus.

[0046] In one embodiment, the synchronous recording and analysis module 150 may perform time-synchronous analysis on the data on changes in whole-cortex neural responses, electrophysiological signals, and physiological response movement states and then perform fitting analysis, such as analyzing the regulation of cortical neuron calcium activity by deep neural oscillation information, and analyzing the encoding and decoding of neural optoelectronic signals for complex animal behaviors, so as to obtain the causal relationship between the neural activities and response behaviors of the experimental animal under the target stimulus.

[0047] In yet another embodiment, an animal multi-dimensional state recognition system based on whole-cortex neural activities may also be designed with different visual and auditory stimulus paradigms to synchronously record the fluorescence calcium activities of multiple brain regions in the whole cortex, electroencephalogram and electromyogram data, deep brain nucleus neural oscillations, and biological external behaviors, and explore the synchronous coordination patterns and information emergence mechanisms of biological data in different modalities and at different scales under different visual and auditory stimuli.

[0048] The animal multi-dimensional state recognition system based on whole-cortex neural activities provided by the present invention includes: a stimulus generation module, a whole-cortex neuron imaging module, an electroencephalogram signal acquisition module, a response behavior detection module, and a synchronous recording and analysis module. The stimulus generation module is configured to form a target stimulus corresponding to the stimulus generation instruction when receiving the stimulus generation instruction; the whole-cortex neuron imaging module is connected to the experimental animal and is configured to acquire data on changes in whole-cortex neural responses generated by the experimental animal when receiving the target stimulus, and send the data on changes in whole-cortex neural responses to the synchronous recording and analysis module; the electroencephalogram signal acquisition module is connected to the experimental animal and is configured to acquire electrophysiological signals generated by the experimental animal when receiving the target stimulus, and send the electrophysiological signals to the synchronous recording and analysis module; the response behavior detection module is configured to acquire the physiological response movement states formed by the experimental animal when receiving the target stimulus, and send the physiological response movement states to the synchronous recording and analysis module; the synchronous recording and analysis module is configured to receive the data on changes in whole-cortex neural responses, electrophysiological signals, and physiological response movement states, and perform synchronous analysis on the data on changes in whole-cortex neural responses, electrophysiological signals, and physiological response movement states to obtain the causal relationship between the neural activities and response behaviors of the experimental animal under the target stimulus. It realizes the ability to synchronously acquire multi-dimensional state data corresponding to the response behaviors of animals, thus laying a foundation for the research and analysis of brain functions based on the multi-dimensional state data corresponding to the response behaviors of animals synchronously acquired.

[0049] Figure 3 This is a schematic flowchart showing the process by which the synchronous recording and analysis module provided by the present invention synchronously analyzes the data of changes in neural responses in the whole cerebral cortex, electrophysiological signals, and physiological response movement states to obtain the causal relationship between the neural activities and response behaviors of experimental animals under target stimuli.

[0050] Next, in conjunction with Figure 3 the process by which the synchronous recording and analysis module synchronously analyzes the data of changes in neural responses in the whole cerebral cortex, electrophysiological signals, and physiological response movement states to obtain the causal relationship between the neural activities and response behaviors of experimental animals under target stimuli will be described.

[0051] In an exemplary embodiment of the present invention, in conjunction with Figure 3 it can be seen that the synchronous recording and analysis module synchronously analyzes the data of changes in neural responses in the whole cerebral cortex, electrophysiological signals, and physiological response movement states to obtain the causal relationship between the neural activities and response behaviors of experimental animals under target stimuli, which may include steps 310 to 320. Each step will be introduced separately below.

[0052] In step 310, the data of changes in neural responses in the whole cerebral cortex, electrophysiological signals, and physiological response movement states are aligned at the time step to respectively obtain the data of changes in neural responses in the whole cerebral cortex after alignment processing, the electrophysiological signals after alignment processing, and the physiological response movement states after alignment processing; In step 320, based on the data of changes in neural responses in the whole cerebral cortex after alignment processing, the electrophysiological signals after alignment processing, and the physiological response movement states after alignment processing, fitting analysis is performed to obtain the causal relationship between the neural activities and response behaviors of experimental animals under target stimuli.

[0053] In one embodiment, the data of changes in neural responses in the whole cerebral cortex, electrophysiological signals, and physiological response movement states can be aligned at the time step, and then the data of changes in neural responses in the whole cerebral cortex after alignment processing, the electrophysiological signals after alignment processing, and the physiological response movement states after alignment processing can be respectively obtained.

[0054] Furthermore, based on the data of changes in neural responses in the whole cerebral cortex after alignment processing, the electrophysiological signals after alignment processing, and the physiological response movement states after alignment processing, fitting analysis is performed, so that the causal relationship between the neural activities and response behaviors of experimental animals under target stimuli can be obtained, and thus a foundation can be laid for the research and analysis of brain functions.

[0055] In another exemplary embodiment of the present invention, the synchronous recording and analysis module 150 can also be configured to: Upon receiving the first instruction, retrieve the first neural activity data corresponding to the first instruction. Among them, the neural activity data includes whole-brain cortical neural response change data or electrophysiological signals, and the first instruction is an instruction for performing a causal association analysis of neural activity and response behavior under preset-dimensional neural activity data. Based on the first neural activity data and the physiological response motion state, perform a synchronous analysis to obtain the causal association between the neural activity and the response behavior of the experimental animal under the preset-dimensional neural activity data under the target stimulus.

[0056] In one embodiment, the first instruction may be an instruction for performing a causal association analysis of neural activity and response behavior under preset-dimensional neural activity data. For example, the first instruction may be an instruction for performing a causal association analysis of whole-brain cortical neural response change data and response behavior. In this scenario, the first neural activity data is the whole-brain cortical neural response change data. Further, a synchronous analysis can be performed based on the whole-brain cortical neural response change data and the physiological response motion state to obtain the causal association between the neural activity and the response behavior of the experimental animal in the dimension of the whole-brain cortical neural response change data under the target stimulus.

[0057] The first instruction may also be an instruction for performing a causal association analysis of electrophysiological signals and response behavior. In this scenario, the first neural activity data is the electrophysiological signal. Further, a synchronous analysis can be performed based on the electrophysiological signal and the physiological response motion state to obtain the causal association between the neural activity and the response behavior of the experimental animal in the dimension of the electrophysiological signal under the target stimulus. Through this embodiment, a causal association analysis of neural activity and response behavior in the corresponding dimension is performed according to the user's needs.

[0058] In another exemplary embodiment of the present invention, the electroencephalogram signal acquisition module 130 may include a micro-nanoelectrode array and an electrical signal storage unit, where The micro-nanoelectrode array includes a plurality of detection sites, and the micro-nanoelectrode array is implanted into the whole-brain cortical region, the brain muscle region, and the deep brain region respectively through the detection sites; The electrical signal storage unit is used to store the electrophysiological signals collected after the micro-nanoelectrode array is implanted into the whole-brain cortical region, the brain muscle region, and the deep brain region respectively, and send the electrophysiological signals to the synchronous recording and analysis module 150.

[0059] In one embodiment, an implantable neural micro-nanoelectrode array (corresponding to the micro-nanoelectrode array) can be used to obtain electrophysiological signals in the cortex, muscle, and deep brain regions during experimental activities in real time.

[0060] In another embodiment, the electro-signal storage unit can provide multiple-channel bioelectricity acquisition channels, support the detection, storage and recording of different scenarios and experimental requirements such as cortex, muscle, deep nuclear group, local field potential, etc. simultaneously, and send the stored electrophysiological signals to the synchronous recording and analysis module 150.

[0061] In another exemplary embodiment of the present invention, the experimental animal is an experimental animal after removing a preset area of the skull and / or performing skull transparency treatment.

[0062] During the application process, the selected experimental animal is an experimental animal after removing a large area of the skull or performing skull transparency treatment, so as to ensure the imaging effect of the cortical neuron calcium signal formed by the whole-cortex neuron imaging module 120. It can be understood that the whole-brain cortical nerve response change data is obtained based on the cortical neuron calcium signal imaging.

[0063] In another exemplary embodiment of the present invention, the response behavior detection module 140 may include a camera unit for collecting the physiological response motion state of the experimental animal formed when receiving a target stimulus based on the camera unit, wherein the physiological response motion state includes any one or several of pupil activity state, whisker reaction state, facial activity state, and limb activity state.

[0064] In one embodiment, the camera unit may be a high-speed and high-resolution camera. During the application process, the physiological response motion state of the experimental animal formed when receiving a target stimulus can be collected based on the camera unit. For example, the camera unit can support multi-angle and multi-modal observation of animals, and record rich modalities including pupil activity, whisker reaction, facial activity, limb activity, etc.

[0065] In another embodiment, the response behavior detection module 140 may further include a behavioral data analysis module, wherein the behavioral data analysis module can perform behavioral analysis based on the physiological response motion state collected by the camera unit, automatically identify the animal body parts and analyze the behavioral characteristics, and realize sensitive detection and analysis of minute activities such as pupil dilation, whisker tremor, and forelimb activity.

[0066] According to the foregoing description, the animal multi-dimensional state recognition system based on whole-cortex nerve activity provided by the present invention realizes synchronous acquisition and analysis of the nerve activity and behavioral responses of animals through high-precision nerve activity imaging, electrophysiological signal acquisition, and multi-modal animal behavior data recording, greatly enriching the means of neurobehavioral research; it also provides the possibility for designing diversified experiments, enhancing the flexibility and adaptability of the experiments.

[0067] Based on the same inventive concept, the present invention also provides a method for recognizing the multi-dimensional state of an animal based on whole-cortex nerve activity. Figure 4It is a schematic flowchart of the method for identifying multi-dimensional states of animals based on whole-cortex neural activities provided by the present invention. The following will be combined with Figure 4 to illustrate the process of the method for identifying multi-dimensional states of animals based on whole-cortex neural activities.

[0068] In an exemplary embodiment of the present invention, combined with Figure 4 it can be known that the method for identifying multi-dimensional states of animals based on whole-cortex neural activities may include steps 410 to 450. Each step will be introduced separately below.

[0069] In step 410, a stimulation generation instruction is received, and a target stimulation corresponding to the stimulation generation instruction is formed based on the stimulation generation instruction.

[0070] In one embodiment, a stimulation generation instruction issued by a user can be received, and a target stimulation corresponding to the stimulation generation instruction is formed based on the stimulation generation instruction. During application, a designed visual stimulation and an auditory stimulation (corresponding to the target stimulation corresponding to the stimulation generation instruction) can be played to an experimental animal to conduct an animal visual and auditory cognitive activity experiment. It can be understood that the target stimulation can include a visual stimulation and an auditory stimulation. Among them, the visual stimulation and the auditory stimulation can be determined according to the stimulation generation instruction.

[0071] In step 420, the whole-brain cortex neural response change data generated by the experimental animal when receiving the target stimulation is collected.

[0072] In step 430, the electrophysiological signals generated by the experimental animal when receiving the target stimulation are collected, where the electrophysiological signals include the electrophysiological signals of the whole-brain cortex region, the brain muscle region, and the deep brain region.

[0073] In step 440, the physiological response motion state formed by the experimental animal when receiving the target stimulation is collected.

[0074] In one embodiment, when the experimental animal receives the target stimulation, the neural response changes in the visual cortex, the motor cortex, the sensory cortex, and other cortex regions during the experiment of the experimental animal can be recorded, that is, the whole-brain cortex neural response change data generated by the experimental animal when receiving the target stimulation is collected.

[0075] In another example, when the experimental animal receives the target stimulation, the electrophysiological signals of the cortex, the muscle, and the deep brain region of the experimental animal during the experimental activity can be collected.

[0076] In yet another example, when an experimental animal receives a target stimulus, data on the experimental animal during the experimental activity can be recorded in real time, such as the movement state data of a mouse, facial expression data, whisker movement conditions, etc., so as to provide ethological analysis indicators, that is, to collect the physiological response movement state of the experimental animal when receiving the target stimulus.

[0077] In step 450, synchronous analysis is performed on the whole-brain cortical nerve response change data, electrophysiological signals, and physiological response movement states to obtain the causal relationship between the neural activities and response behaviors of the experimental animal under the target stimulus.

[0078] In one embodiment, time-synchronous analysis can be performed on the whole-brain cortical nerve response change data, electrophysiological signals, and physiological response movement states and then fitting analysis can be performed, such as analyzing the regulation of cortical neuron calcium activity by deep neural oscillation information, analyzing the encoding and decoding of neural optoelectronic signals for animal complex behaviors, etc., so as to obtain the causal relationship between the neural activities and response behaviors of the experimental animal under the target stimulus.

[0079] In yet another exemplary embodiment of the present invention, to perform synchronous analysis on the whole-brain cortical nerve response change data, the electrophysiological signals, and the physiological response movement states to obtain the causal relationship between the neural activities and response behaviors of the experimental animal under the target stimulus, the following method can be used: Align the whole-brain cortical nerve response change data, the electrophysiological signals, and the physiological response movement states at a time step to obtain the aligned whole-brain cortical nerve response change data, the aligned electrophysiological signals, and the aligned physiological response movement states after alignment processing respectively; Based on the aligned whole-brain cortical nerve response change data, the aligned electrophysiological signals, and the aligned physiological response movement states, perform fitting analysis to obtain the causal relationship between the neural activities and response behaviors of the experimental animal under the target stimulus.

[0080] In one embodiment, the whole-brain cortical nerve response change data, electrophysiological signals, and physiological response movement states can be aligned at a time step, and then the aligned whole-brain cortical nerve response change data, the aligned electrophysiological signals, and the aligned physiological response movement states after alignment processing can be obtained respectively.

[0081] Furthermore, based on the aligned whole-brain cortical nerve response change data, the aligned electrophysiological signals, and the aligned physiological response movement states, perform fitting analysis, so as to obtain the causal relationship between the neural activities and response behaviors of the experimental animal under the target stimulus, and thus lay a foundation for the research and analysis of brain functions.

[0082] Figure 5It is a schematic structural diagram of a virtual device for multi-dimensional state recognition of animals based on whole-cortex neural activity provided by the present invention.

[0083] The following describes the virtual device for multi-dimensional state recognition of animals based on whole-cortex neural activity provided by the present invention. The virtual device for multi-dimensional state recognition of animals based on whole-cortex neural activity described below can be correspondingly referred to the method for multi-dimensional state recognition of animals based on whole-cortex neural activity described above.

[0084] In an exemplary embodiment of the present invention, the virtual device for multi-dimensional state recognition of animals based on whole-cortex neural activity can be applied to the system for multi-dimensional state recognition of animals based on whole-cortex neural activity described above. Combining Figure 5 As can be seen, the virtual device for multi-dimensional state recognition of animals based on whole-cortex neural activity may include a receiving module 510, a first acquisition module 520, a second acquisition module 530, a third acquisition module 540, and a processing module 550. Each module will be introduced separately below.

[0085] The receiving module 510 can be configured to receive a stimulus generation instruction and form a target stimulus corresponding to the stimulus generation instruction based on the stimulus generation instruction; The first acquisition module 520 can be configured to acquire the whole-brain cortex neural response change data generated by the experimental animal when receiving the target stimulus, and The second acquisition module 530 can be configured to acquire the electrophysiological signals generated by the experimental animal when receiving the target stimulus, where the electrophysiological signals include the electrophysiological signals of the whole-brain cortex region, the brain muscle region, and the deep brain region; The third acquisition module 540 can be configured to acquire the physiological response motion state formed by the experimental animal when receiving the target stimulus; The processing module 550 can be configured to synchronously analyze the whole-brain cortex neural response change data, the electrophysiological signals, and the physiological response motion state to obtain the causal relationship between the neural activity and the response behavior of the experimental animal under the target stimulus.

[0086] In another exemplary embodiment of the present invention, the processing module 550 can synchronously analyze the whole-brain cortex neural response change data, the electrophysiological signals, and the physiological response motion state in the following manner to obtain the causal relationship between the neural activity and the response behavior of the experimental animal under the target stimulus: Align the whole-brain cortical nerve response change data, the electrophysiological signals, and the physiological response motion state at a time step to obtain the aligned whole-brain cortical nerve response change data, the aligned electrophysiological signals, and the aligned physiological response motion state respectively; Perform fitting analysis based on the aligned whole-brain cortical nerve response change data, the aligned electrophysiological signals, and the aligned physiological response motion state to obtain the causal relationship between the neural activity and the response behavior of the experimental animal under the target stimulus.

[0087] Figure 6 An example of the physical structure diagram of an electronic device is shown as Figure 6 shown. The electronic device may include: a processor 610, a communication interface 620, a memory 630, and a communication bus 640. Among them, the processor 610, the communication interface 620, and the memory 630 complete communication with each other through the communication bus 640. The processor 610 can call the logical instructions in the memory 630 to execute the method for identifying the multi-dimensional state of an animal based on whole-cortical neural activity. The method is applied to any one of the systems for identifying the multi-dimensional state of an animal based on whole-cortical neural activity. The method includes: receiving a stimulus generation instruction, and forming a target stimulus corresponding to the stimulus generation instruction based on the stimulus generation instruction; collecting the whole-brain cortical nerve response change data generated by the experimental animal when receiving the target stimulus, and collecting the electrophysiological signals generated by the experimental animal when receiving the target stimulus, where the electrophysiological signals include the electrophysiological signals of the whole-brain cortical region, the brain muscle region, and the deep brain region; collecting the physiological response motion state formed by the experimental animal when receiving the target stimulus; performing synchronous analysis on the whole-brain cortical nerve response change data, the electrophysiological signals, and the physiological response motion state to obtain the causal relationship between the neural activity and the response behavior of the experimental animal under the target stimulus.

[0088] In addition, when the logical instructions in the above-mentioned memory 630 are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or a part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), magnetic disks, or optical discs that can store program codes.

[0089] On the other hand, the present invention also provides a computer program product. The computer program product includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the animal multi-dimensional state recognition method based on whole-cortex neural activity provided by the above-mentioned various methods. The method is applied to any one of the animal multi-dimensional state recognition systems based on whole-cortex neural activity. The method includes: receiving a stimulus generation instruction and forming a target stimulus corresponding to the stimulus generation instruction based on the stimulus generation instruction; collecting the whole-brain cortex neural response change data generated by the experimental animal when receiving the target stimulus, and collecting the electrophysiological signals generated by the experimental animal when receiving the target stimulus, where the electrophysiological signals include electrophysiological signals of the whole-brain cortex region, the brain muscle region, and the deep brain region; collecting the physiological response motion state formed by the experimental animal when receiving the target stimulus; and synchronously analyzing the whole-brain cortex neural response change data, the electrophysiological signals, and the physiological response motion state to obtain the causal relationship between the neural activity and the response behavior of the experimental animal under the target stimulus.

[0090] In another aspect, the present invention also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements the method for multi-dimensional state recognition of animals based on whole-cortex neural activities provided by the above-mentioned various methods. The method is applied to the system for multi-dimensional state recognition of animals based on whole-cortex neural activities according to any one of the above, and the method includes: receiving a stimulus generation instruction, and forming a target stimulus corresponding to the stimulus generation instruction based on the stimulus generation instruction; collecting the data of the change in the whole-brain cortex neural response generated by the experimental animal when receiving the target stimulus, and collecting the electrophysiological signals generated by the experimental animal when receiving the target stimulus, wherein the electrophysiological signals include the electrophysiological signals of the whole-brain cortex region, the brain muscle region, and the deep brain region; collecting the physiological response movement state formed by the experimental animal when receiving the target stimulus; synchronously analyzing the data of the change in the whole-brain cortex neural response, the electrophysiological signals, and the physiological response movement state to obtain the causal relationship between the neural activities and response behaviors of the experimental animal under the target stimulus.

[0091] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art can understand and implement it without creative labor.

[0092] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, also by hardware. Based on this understanding, the essence of the above technical solution, or the part that contributes to the prior art, can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disc, etc., and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0093] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. An animal multi-dimensional state recognition system based on whole-cortex neural activity, characterized in that The system includes: a stimulation generation module, a whole-cortex neuron imaging module, an electroencephalogram (EEG) signal acquisition module, a response behavior detection module, and a synchronous recording and analysis module. Among them, the stimulation generation module is configured to form a target stimulation corresponding to the stimulation generation instruction when receiving the stimulation generation instruction; the whole-cortex neuron imaging module is connected to the experimental animal and is configured to collect the whole-brain cortex nerve response change data generated by the experimental animal when receiving the target stimulation, and send the whole-brain cortex nerve response change data to the synchronous recording and analysis module; the EEG signal acquisition module is connected to the experimental animal and is configured to collect the electrophysiological signals generated by the experimental animal when receiving the target stimulation, and send the electrophysiological signals to the synchronous recording and analysis module, where the electrophysiological signals include the electrophysiological signals of the whole-brain cortex region, the brain muscle region, and the deep brain region; the response behavior detection module is configured to collect the physiological response motion state formed by the experimental animal when receiving the target stimulation, and send the physiological response motion state to the synchronous recording and analysis module; the synchronous recording and analysis module is configured to receive the whole-brain cortex nerve response change data, the electrophysiological signals, and the physiological response motion state, and perform synchronous analysis on the whole-brain cortex nerve response change data, the electrophysiological signals, and the physiological response motion state to obtain the causal relationship between the neural activity and the response behavior of the experimental animal under the target stimulation.

2. The animal multi-dimensional state recognition system based on whole-cortex neural activity according to claim 1, wherein The synchronous recording and analysis module is configured to implement synchronous analysis on the whole-brain cortex nerve response change data, the electrophysiological signals, and the physiological response motion state in the following manner to obtain the causal relationship between the neural activity and the response behavior of the experimental animal under the target stimulation: perform alignment processing on the whole-brain cortex nerve response change data, the electrophysiological signals, and the physiological response motion state at a time step to respectively obtain the aligned whole-brain cortex nerve response change data, the aligned electrophysiological signals, and the aligned physiological response motion state; perform fitting analysis based on the aligned whole-brain cortex nerve response change data, the aligned electrophysiological signals, and the aligned physiological response motion state to obtain the causal relationship between the neural activity and the response behavior of the experimental animal under the target stimulation.

3. The animal multi-dimensional state recognition system based on whole-cortex neural activity according to claim 1 or 2, characterized in that The synchronous recording and analysis module is further configured to: when receiving a first instruction, retrieve first neural activity data corresponding to the first instruction based on the first instruction, where the neural activity data includes the whole-brain cortex nerve response change data or the electrophysiological signals, and the first instruction is an instruction for performing causal relationship analysis of neural activity and response behavior under preset-dimensional neural activity data; perform synchronous analysis based on the first neural activity data and the physiological response motion state to obtain the causal relationship between the neural activity and the response behavior of the experimental animal under the target stimulation in the preset-dimensional neural activity data.

4. The animal multi-dimensional state recognition system based on whole-cortex neural activity according to claim 1, wherein The electroencephalogram signal acquisition module includes a micro-nanoelectrode array and an electrical signal storage unit. Among them, the micro-nanoelectrode array includes a plurality of detection sites, and the micro-nanoelectrode array is respectively implanted into the whole cerebral cortex region, the cerebral muscle region, and the deep brain region through the detection sites; the electrical signal storage unit is used to store the electrophysiological signals collected after the micro-nanoelectrode array is respectively implanted into the whole cerebral cortex region, the cerebral muscle region, and the deep brain region, and send the electrophysiological signals to the synchronous recording and analysis module.

5. The animal multi-dimensional state recognition system based on whole-cortex neural activity according to claim 1, characterized in that The whole cerebral cortex nerve response change data includes one or several of the primary visual cortex nerve response change data, the high-level visual cortex nerve response change data, the sensory cortex nerve response change data, the motor cortex nerve response change data, and the posterior cingulate cortex nerve response change data.

6. The animal multi-dimensional state recognition system based on whole-cortex neural activity according to claim 1 or 5, characterized in that The experimental animal is an experimental animal after removing a preset area of the skull and / or performing skull transparency treatment.

7. The animal multi-dimensional state recognition system based on whole-cortex neural activities according to claim 1, characterized in that The response behavior detection module includes a camera unit, which is used to collect the physiological response motion state of the experimental animal formed when receiving the target stimulus based on the camera unit. Among them, the physiological response motion state includes any one or several of the pupil activity state, the whisker reaction state, the facial activity state, and the limb activity state.

8. A method for identifying multi-dimensional states of animals based on whole-cortex neural activities, characterized in that, The method is applied to the animal multi-dimensional state recognition system based on whole-cortex nerve activity described in any one of claims 1 to 7. The method includes: Receiving a stimulus generation instruction, and forming a target stimulus corresponding to the stimulus generation instruction based on the stimulus generation instruction; Collecting the whole cerebral cortex nerve response change data generated by the experimental animal when receiving the target stimulus, and Collecting the electrophysiological signals generated by the experimental animal when receiving the target stimulus, where the electrophysiological signals include the electrophysiological signals of the whole cerebral cortex region, the cerebral muscle region, and the deep brain region; Collecting the physiological response motion state of the experimental animal formed when receiving the target stimulus; Synchronously analyzing the whole cerebral cortex nerve response change data, the electrophysiological signals, and the physiological response motion state to obtain the causal relationship between the nerve activity and the response behavior of the experimental animal under the target stimulus.

9. The method for identifying the multi-dimensional state of an animal based on whole-cortex neural activity according to claim 8, wherein The synchronously analyzing the whole cerebral cortex nerve response change data, the electrophysiological signals, and the physiological response motion state to obtain the causal relationship between the nerve activity and the response behavior of the experimental animal under the target stimulus specifically includes: Performing alignment processing on the whole cerebral cortex nerve response change data, the electrophysiological signals, and the physiological response motion state at a time step to respectively obtain the aligned whole cerebral cortex nerve response change data, the aligned electrophysiological signals, and the aligned physiological response motion state; Performing fitting analysis based on the aligned whole cerebral cortex nerve response change data, the aligned electrophysiological signals, and the aligned physiological response motion state to obtain the causal relationship between the nerve activity and the response behavior of the experimental animal under the target stimulus.

10. A virtual device for identifying multi-dimensional states of animals based on whole-cortex neural activities, characterized in that, The virtual device is applied to the animal multi-dimensional state recognition system based on whole-cortex neural activities according to any one of claims 1 to 7. The virtual device includes: a receiving module, configured to receive a stimulation generation instruction and form a target stimulation corresponding to the stimulation generation instruction based on the stimulation generation instruction; a first acquisition module, configured to acquire data on changes in whole-brain cortex neural responses generated by an experimental animal when receiving the target stimulation, and a second acquisition module, configured to acquire electrophysiological signals generated by the experimental animal when receiving the target stimulation, where the electrophysiological signals include electrophysiological signals of the whole-brain cortex region, the brain muscle region, and the deep brain region; a third acquisition module, configured to acquire the physiological response motion state formed by the experimental animal when receiving the target stimulation; a processing module, configured to synchronously analyze the data on changes in whole-brain cortex neural responses, the electrophysiological signals, and the physiological response motion state to obtain the causal relationship between the neural activities and response behaviors of the experimental animal under the target stimulation.

Images