7174 results about "Neuroscience" patented technology

A mechanical end effector for a humanoid robot includes a plurality of identical finger assemblies. Each of the finger assemblies is removably connected to a frame. Each of the finger assemblies is fully self-contained and operable independently of every other one of the finger assemblies and independently of every other component connected to the frame. Each of the finger assemblies includes a single electric motor and is configured to be fully operable using only the single electric motor.

The invention relates to a multi-modal intelligent robot system and an interaction method, and belongs to the technical field of robot digital data processing, and the method comprises the following steps: S1, multi-modal input collection; s2, carrying out multi-modal input preprocessing; s3, performing multi-modal information fusion, inputting the information into a pre-trained multi-modal feature fusion model, and performing feature fusion on each modal feature through a quantitative feature data fusion mechanism to obtain a user interaction intention vector and a user emotional state vector; s4, interaction response generation: matching a preset interaction response strategy library based on the user interaction intention vector to obtain basic response content, and performing emotion adaptation adjustment on the basic response content in combination with the user emotion state vector to generate multi-modal response content including text information, voice information and action information; s5, interactive feedback is executed; the method has the beneficial effects that the robot is fused with multi-modal information through the basic response content and the user emotional state vector, and interaction is dynamically optimized.

The present disclosure relates to systems and methods for enhancing the interaction between users and automated agents, such as digital assistants, by employing Large Language Models (LLMs) to infer the intent of spoken language. The invention involves continuously monitoring ambient audio, converting speech to text, and utilizing LLMs to determine whether spoken language is intended for the automated agent. A structured prompt, including the converted text and specific instructions, is sent to the LLM, which is fine-tuned to process domain-specific prompts. The LLM provides a structured output in a standardized format, indicating the user's intent. The system may involve multiple prompts to perform separate tasks, such as identifying intent and generating additional context-specific data. This approach facilitates a more natural and intuitive user experience by eliminating the need for wake words and allowing seamless conversational interaction with virtual assistants across various platforms and devices.

The invention relates to a multi-mode intention recognition method and system, and the method comprises the steps: carrying out the time domain and frequency domain enhancement of the features of text, video and audio modes, carrying out the splicing to obtain non-language mode fusion features, combining the features of an original text, modeling the time synchronization relation of audio-text and video-text, and carrying out the recognition of a multi-mode intention. Standardized audio features, video features and text features are obtained through context alignment processing; fusing the standardized features of the three modalities to obtain a fused feature vector, and mapping the fused feature vector back to the text modal space to be connected with the weighted residual error of the original text feature to obtain a fused semantic vector; extracting global semantic anchor points and mask positions from the fused semantic vector, and splicing the global semantic anchor points and the mask positions with the original text features and the fused semantic vector to obtain input features; and obtaining probability distribution of multiple intention categories by using the input features. Three types of heterogeneous modal input can be supported, and the accuracy and robustness of intention recognition are improved through fine-grained semantic supervision and enhancement strategies.

The invention discloses a brain image analysis method and system based on multi-modal fusion, and relates to the technical field of brain image processing. A brain image analysis system based on multi-modal fusion comprises a data acquisition module, a data preprocessing module, a feature extraction and fusion module, a brain network analysis module, a comprehensive analysis module and a focus detection module. The comprehensive analysis model adopts a double-branch structure, deep processing is performed on multi-modal features and brain network features, and interactive fusion of the two types of features is realized through a cross-modal attention mechanism; the model is further combined with a classification branch and a regression branch to cooperatively complete brain disease classification and focus quantitative analysis, and the adaptive capacity and diagnosis performance of an existing model in a complex task scene are improved.

The invention discloses an alimentary canal pathological diagnosis visual language large model construction method based on reinforcement learning and application thereof, and belongs to the technical field of medical image processing. The method comprises the following steps: firstly, extracting pathological information through layout analysis and adaptive threshold processing, and recombining the pathological information into a structured data set containing an inference chain; secondly, a visual encoder and a multi-branch classifier are used for extracting features and confidence coefficients, and dynamic structured cue words are generated; and finally, inputting the image and the cue word into a multi-modal large model, carrying out supervised fine-tuning hot start, and carrying out reinforcement learning training by adopting a group relative strategy optimization algorithm in cooperation with a composite reward function containing format, semantics and diagnosis dimensions. The problems that a general model is prone to generating illusion in a pathological scene and lacks reasoning logic are solved, and the accuracy and logicality of pathological report generation are remarkably improved.

A generative mediator engine can perform a requested interaction with a conversational agent of a target entity on behalf of a user. An internal conversational platform can identify intents for the requested interaction. An external artificial intelligence engine can perform intent discovery when an intent is not identified above a confidence threshold. A discovered intent unknown to the generative mediator engine can be received from the external artificial intelligence engine and used, with input requirements determined by the generative mediator for the requested interaction, by a dialog generator to generate a sample dialog for the requested interaction. User feedback can be received after review of action items and expected inputs identified from the sample dialog. The generative mediator engine can perform the requested interaction with the conversational agent on behalf of the user and without receiving user intervention during the requested interaction.

A method for facilitating conversational interaction with users to help the users includes transmitting a conversational interaction interface for conversationally interacting with a user to a user device, receiving a request of the user through the conversational interaction interface from the user device, identifying an information based on the request, generating an input comprising the request and the information for a machine learning model based on the request and the information, processing the input using the machine learning model, generating a response for the request based on the processing of the input, transmitting the response through the conversational interaction interface for conversationally interacting with the user to the user device, and storing the machine learning model, the request, and the response.

Aspects of the disclosure relate to methods of reducing fatigue in a subject having myotonic dystrophy type 1 (DM1). Aspects of the disclosure relate to methods of treating one or more symptoms assessable by the MDHI (e.g., a GI symptom, myotonia, upper extremity function impairment, fatigue, mobility impairment, impairment in the ability to perform activities, pain, vision impairment, communication impairment, sleep impairment, emotional issues, cognitive impairment, social satisfaction impairment, social performance impairment, breathing impairment, swallowing impairment, and / or hearing impairment) in a subject having myotonic dystrophy type 1 (DM1). In some embodiments, the methods comprise administering to the subject a composition comprising complexes (e.g., muscle targeting complexes) comprising an oligonucleotide (e.g., a DMPK- targeting oligonucleotide) covalently linked to an antibody (e.g., anti-TfRl antibody).

In an approach to coordinating a conversational agent with a large language model for conversation repair, one or more computer processors receive a failure indicator from a first conversational agent. One or more computer processors retrieve a descriptive prompt associated with the first conversational agent. One or more computer processors transmit the descriptive prompt to a large language model. One or more computer processors transfer control of the failed conversation from the first conversational agent to the large language model. One or more computer processors determine the intent of the user associated with the failed conversation using the large language model. One or more computer processors determine whether the intent of the user associated with the failed conversation matches a capability of the first conversational agent. One or more computer processors transfer by one or more computer processors, the user back to the first conversational agent.

The invention discloses a virtual-real fusion exhibition display interaction system and a multi-mode perception method, and belongs to the technical field of exhibition display interaction. The system collects audience eyeball fixation points, gesture actions and ambient light data through AR / VR equipment, analyzes coordinates of a region of interest through an eyeball fixation point attention mechanism, a gesture space-time encoder and a multi-modal fusion unit, triggers holographic projection explanation and virtual exhibition stand light and shadow dynamic adjustment (including illumination intensity, color, Gaussian blur and the like) based on a threshold value, and performs real-time display on the virtual exhibition stand. And multi-user collaborative interaction is realized through federal learning. According to the method, reinforcement learning is adopted to optimize an event-driven threshold value, and virtual and real visual splitting is eliminated in combination with ambient light adaptive mapping. The problems of low participation degree, insufficient single-mode interaction information and multi-user cooperation of traditional exhibition are solved, interest analysis accuracy is improved through multi-mode fusion, personalized experience is enhanced through dynamic interaction, the method is suitable for multiple scenes such as museums and science and technology museums, and exhibition intellectualization, immersion and group interaction efficiency are effectively improved.

The delivery of neurostimulation to a subject using a closed-loop neurostimulation device (e.g., using a brain stimulation device to provide neurostimulation to a subject's brain) is controlled based on a global optimization-based temporal prediction framework. As a result, the brain stimulation device (e.g., a transcranial magnetic stimulation (“TMS”) device) is synchronized with the ongoing neural state (e.g., brain state) in real time. For instance, a brain recording is analyzed to extract the brain process of interest (e.g., frequency of brain oscillations) and used train a prediction algorithm. After that, a stimulation stage is implemented, in which the individual brain state is analyzed in real-time, the occurrence of the biomarkers (e.g., brain oscillation phase) is predicted, and the stimulation is triggered at the expected time.

The disclosure provides methods for treating a subject in need thereof comprising administering to the subject a therapeutically-effective dose of psilocybin. The methods described herein may be used to treat a variety of diseases, disorders, and conditions. For example, the methods may be used to treat anxiety disorders, eating disorders, and headache disorders.

The invention relates to an intelligent dialogue system and method based on an AI multi-mode large model. The method comprises the following steps: collecting biological characteristic data of a user in real time; cloning a personalized expression mode of the user by using the generative adversarial network; driving the audio avatar to perform multi-round dialogue interaction with the user, capturing a real-time physiological signal of the user through an expression recognition module, and generating a dynamic response content suggestion in combination with a dialogue context; and analyzing the interaction process based on the reinforcement learning model. The multi-modal deep fusion of the voice rhythm features, the language structure features and the facial dynamic features is realized, so that the limitation of single-modal or simple feature splicing in the prior art is broken through, the emotional state of the user can be accurately and comprehensively captured, the intention is expressed and the fine physiological reaction is expressed, and the user experience is improved. And a solid foundation is laid for constructing high-fidelity user representation.

The disclosure provides methods for treating a subject in need thereof comprising administering to the subject a therapeutically-effective dose of psilocybin. The methods described herein may be used to treat a variety of diseases, disorders, and conditions. For example, the methods may be used to treat anxiety disorders, eating disorders, and headache disorders.

Described herein are methods and systems for a conversational assistant that may be configured for use with one or more applications. The disclosed systems and methods may be configured as an outer loop / inner loop architecture incorporating one or more large language models (LLMs) and / or RAG functionality to support dialog-based interactions.

Aspects of the present disclosure relate to flexible catheters for electrophysiological mapping and ablation using high-density electrode arrays. These catheters can be used to detect the electrophysiological properties of tissue in contact with the electrodes and perform monopolar and bipolar ablation of the tissue.

The system and method for processing a digital pathology image using a machine learning model that includes a self-supervised hierarchical Vision Transformer (ViT) configured to perform unsupervised clustering with multiple classification tokens. The method includes receiving a digital pathology image that depicts a tissue slice stained with histological dyes. The digital pathology image may be processed to generate a result comprising multiple predicted classifications of individual patches of the digital pathology image. The result is generated by a machine-learning model using a self-supervised hierarchical Vision Transformer (ViT) that may further comprise a multi-head self-attention module configured to predict a crosspatch relevance metric using an attention mechanism for each individual patch in the digital pathology image thereby assigning the individual patches to a cluster based on the crosspatch relevance metrics.

A neuromodulation system including at least one input module for inputting a planned neuromodulation event or a series of neuromodulation events and at least one analyzing module for analyzing a neuromodulation event or a series of neuromodulation events.The analyzing module and the input module may be connected such that the input module is configured to forward the planned neuromodulation event or a series of neuromodulation events to the analyzing module and the analyzing module is configured to analyze the planned neuromodulation event or a series of neuromodulation events regarding one or more possible neuromodulation conflict(s).

The invention discloses a data-driven self-adaptive cognitive competence training method and a data-driven self-adaptive cognitive competence training device. The method comprises the following steps: collecting initial cognitive competence data of a user; establishing a mapping relationship between the training tasks and the cognitive ability dimensions, and associating a plurality of predefined training tasks to the corresponding cognitive ability dimensions respectively; based on the user cognitive competence vector, selecting a training task matched with the current cognitive competence level of the user from a training task library through an adaptive recommendation algorithm; providing the training task matched with the current cognitive ability level of the user for the user to execute; and updating the user cognitive ability vector according to the behavior feedback data. According to the technical scheme, the training task is finely matched through the multi-dimensional cognitive vector, the difficulty is adjusted in real time, and the load is prevented from being too high or too low; and by utilizing behavior data closed-loop updating, a capability increasing curve can be accurately quantified, task sorting and rhythm are dynamically optimized, and a learning motivation is stimulated.

An image processing framework for multi-class classifying a subject into cognitive normal, mild cognitive impairment and Alzheimer's disease (AD) conditions is developed. In one realization of the framework, an AD_Net model, which is an attention-enhanced convolution neural network (CNN) formed by embedding a Convolutional Block Attention Module (CBAM) into a CNN having a Visual Geometry Group 19 (VGG19) architecture, processes an image volume of the subject's brain to generate a plurality of AD_Net feature maps and a first plurality of scores that predict respective likelihoods of the three conditions. To enhance the prediction accuracy, a multilayer perception model formed with a plurality of fully connected layers processes the plurality of AD_Net feature maps and a plurality of influencing factors of AD, such as age, gender, geriatric depression scale score, Mini-Mental State Examination score and clinical dementia rating score, to generate a second plurality of scores that predict the respective likelihoods.

The invention relates to the technical field of cognitive impairment detection, and discloses a cognitive impairment early warning method and device based on an electroencephalogram micro state and an eye movement trajectory, and the method comprises the following steps: S1, data acquisition, S2, electroencephalogram preprocessing, S3, electroencephalogram feature extraction, S4, eye movement feature extraction, S5, feature fusion, and S6, early warning judgment. According to the method, through independent convolution branch of electroencephalogram and eye movement features, a receptive field is expanded by utilizing cavity convolution to capture multi-scale features, and long-distance dependence is modeled by a self-attention layer; after tensor splicing, time sequence information is dynamically fused through a gating cycle unit (GRU), and cross-modal time correlation is captured. The method has the advantages that the multi-modal feature hierarchical extraction and self-adaptive modeling capability is enhanced, the complementarity fusion efficiency is optimized, meanwhile, by means of cavity convolution sparse connection, self-attention parameter sharing and GRU lightweight design, the model complexity and the calculation efficiency are balanced, and efficient feature representation is provided for cognitive impairment early warning.

The present invention relates to a system for transforming static websites into artificial intelligence (AI)-enabled interactive multi-modal conversational platforms. The system comprises a computing device having a processor for receiving user queries as text or speech input through an input module cooperating with a speech-to-text module. A natural language processing (NLP) module interprets intent, classifies user context, and retrieves grounded information from multiple webpages. A persona adaptation module dynamically modifies vocabulary, tone, and avatar representation across roles such as sales assistant, recruiter, educator, healthcare professional, etc. A response generator module produces structured natural language output, transmitted to a text-to-speech synthesis module and an avatar generation module to render synchronized lifelike video responses. An output rendering module displays multi-modal responses include text, audio, and video, thereby enabling direct navigation and escalation beyond limitations of conventional static websites.

The invention relates to the technical field of medical instruments, in particular to a high-precision time interference non-invasive brain deep electrical stimulation method, equipment and system, and solves the problems that two stimulation electrodes are used for each pair of current in traditional time interference-based non-invasive brain deep electrical stimulation, so that the current distribution is relatively dispersed, and the stimulation focusing performance is relatively poor. According to the method, high-precision 4 * 1 electrode configuration is used, two electrodes for applying a stimulation current are changed into a 4 * 1 electrode form, the flowing path of the current is effectively limited, the current is more focused, and the focusing performance of the interference current is further improved. According to the device, high-precision current control is realized through the anti-phase output circuit, the 4 * 1 voltage division circuit, the constant current source module and the impedance detection module; the system supports forward and reverse electrode position optimization, a personalized real finite element head model simulation system based on MRI data is used for guiding practical application, the focusing performance of each pair of current in a target brain region is improved, and therefore the overall stimulation precision in the target brain region is improved.

The invention discloses an old people cognitive ability assessment system and method based on multi-modal fusion, and relates to the field of old people cognitive assessment, and the method comprises the steps: firstly obtaining the current multi-modal data of a user, and fusing the current multi-modal data into a current feature vector; then, instead of being compared with the universality standard, the personal baseline portrait of the user is called, and the score of the difference degree between the current state and the historical baseline of the user is calculated; particularly, the core index of the drift speed is introduced, and the difference degree and the historical change rate are combined, so that quantitative modeling is carried out on the changed speed. By analyzing the amplitude and the speed of the change at the same time, normal aging with gentle change and low speed and pathological recession with violent change and high speed can be effectively distinguished, so that the key technical problem that the normal aging and the pathological recession are easy to be confused in the background technology is accurately solved.

The invention discloses an attention deficit hyperactivity disorder recognition system and recognition method, and belongs to the technical field of attention deficit hyperactivity disorder. The data processing module is used for carrying out preprocessing and feature extraction on the acquired electroencephalogram data; a multi-source feature fusion mechanism is firstly used for the extracted original feature data, and then a data enhancement strategy is applied; a multi-source fusion feedback regulation network model is constructed, wherein the model is of a CNN-GRU parallel modeling structure; the training module is used for inputting the enhanced data into a model for training, key hyper-parameters are dynamically adjusted by a performance feedback adjusting mechanism in the training process, and the performance feedback adjusting mechanism is used for dynamically adjusting key training parameters according to the performance of the verification set; and the classification module is used for classifying to-be-detected samples through the trained multi-source fusion feedback regulation network model and outputting a final recognition result. The ADHD electroencephalogram recognition method effectively improves the accuracy, robustness and generalization performance of ADHD electroencephalogram recognition.

The invention discloses a VR teaching experience enhancement system and method, and belongs to the technical field of virtual teaching, and the method specifically comprises the steps: collecting the position data and posture data of a trainee in a VR environment, building a multi-user coordination interaction model based on the position data and posture data of the trainee in the VR environment, and carrying out the interaction of the multi-user coordination interaction model. The method comprises the following steps: acquiring training participants, identifying an interaction relationship and an interaction event among the training participants, generating tactile feedback data corresponding to the interaction event based on the interaction event, performing calibration processing on the tactile feedback data, and synchronously sending the calibrated tactile feedback data to VR equipment of the training participants, the calibration processing comprises adjusting the tactile feedback data based on the spatial propagation difference quantity and the tactile feedback time offset value of the trainees; according to the invention, when multiple trainees cooperatively operate the same virtual object or scene, consistent and real-time tactile response and spatial perception can be obtained, and the teaching experience in a multi-person cooperation scene is improved.

A system that can deliver haptic feedback by applying an electrical stimulation to a first area of a user's body to induce a second area of the user's body to experience a level of natural sensation in response to an action occurring in a simulated remote environment and an intensity of the action is described. The system includes a controller to set parameters for the electrical stimulation based on the action occurring in the simulated remote environment and an intensity of the action. The system also includes a signal generator to generate the electrical stimulation comprising the parameters. The system also includes a skin surface electrode placed at a first location on a user's body remote from a second location on the user's body to deliver the electrical stimulation with the parameters to a nerve at or near the first area of the user's body.

The invention provides a transcranial stimulation control method, a transcranial stimulation control system and a computer readable storage medium, and the method comprises the steps: collecting an electroencephalogram parameter signal, and converting the electroencephalogram parameter signal into an electroencephalogram feature vector; inputting the electroencephalogram feature vector into a large language model, obtaining an initial electrical stimulation signal corresponding to the electroencephalogram feature vector from a stimulation electroencephalogram knowledge model according to the electroencephalogram feature vector, and generating an initial electrical stimulation signal scheme; the initial electrical stimulation signal is optimized through an attention mechanism according to historical response data of a user, a final electrical stimulation signal scheme is output, and the historical response data of the user comprises a historical electrical stimulation signal scheme and user feedback information; and outputting the final electrical stimulation signal scheme to a transcranial stimulation module. The method can improve the insomnia treatment efficiency of the user.