21874 results about "Training methods" patented technology

The invention provides an intelligent rehabilitation training method and system based on artificial intelligence and virtual reality, a user wears an intelligent wearable device to collect multi-modal data such as electroencephalogram, myoelectricity, physiological features and motion signals, the multi-modal data is preprocessed and then input into an artificial intelligence training model, and key features are extracted and fused by using a graph convolutional network and an attention mechanism algorithm. And constructing a digital twinborn model by using the fusion features, performing real-time dynamic mapping and predictive simulation, and generating a customized training scheme by means of a reinforcement learning algorithm in combination with a rehabilitation target and a physical state of the user. A user is trained in the virtual reality interaction model, the system monitors actions and physiological states in real time, the digital twin model synchronously acts, and the scene is dynamically adjusted. After training, the rehabilitation effect is evaluated according to the physiological indexes, the motion data and the twinning optimization analysis result, and an optimization training scheme and a digital twinning model are fed back. Precision, individuation and intelligentization of rehabilitation training are achieved, and the training effect and quality are improved.

The invention provides a network traffic anomaly detection model training method and device and a readable storage medium, and the method comprises the steps: extracting a traffic statistical feature vector according to original network traffic data, and generating an initial mixed data set; generating a confrontation disturbance sample output enhanced feature matrix based on the initial mixed data set; constructing a self-adaptive feature fusion rule based on the enhanced feature matrix, embedding asset association degree parameters into an attention calculation layer of a feature encoder, and outputting encoding features fusing threat intelligence; inputting the coding features fused with the threat intelligence into a pre-constructed initial detection model, generating false report and missing report correction labels based on the suspicious traffic fragments, and outputting an adversarial sample correction data set; and performing adversarial training on the initial detection model through the adversarial sample correction data set to obtain an incremental detection model for network traffic anomaly detection. According to the invention, the detection precision, the anti-interference capability and the real-time defense response capability of the detection model to novel attacks can be improved.

The invention discloses a deep learning-based small target defect recognition model training method, relates to the technical field of defect recognition model training, and aims at meeting small defect detection requirements, starting with high-resolution diversified data construction and accurate labeling, highlighting weak targets through multi-scale feature fusion and spatial attention, and realizing high-resolution target defect recognition. A hard case scene is processed in cooperation with layer-by-layer screening and secondary intensified training, real-time iterative optimization is achieved through multi-model fusion and online dynamic adjustment and optimization, finally, multi-mode and time sequence dimensions are expanded to capture deeper and dynamic defect information, the missing detection and false detection rate is greatly reduced, and the detection efficiency is improved. The detection efficiency and adaptability of micron-sized defects under a complex process background are improved; furthermore, by means of multi-source data such as infrared, X-ray or 3D morphology and a time sequence modeling means, multiple dimensions are fused, and hidden or early cracks are brought into a detection and prediction range, so that a high-reliability and evolvable intelligent recognition system for the tiny target defects is constructed.

The invention relates to the technical field of image recognition, in particular to a diffusion plate defect detection model training method and system and a medium. The method comprises the following steps: acquiring a diffusion plate monitoring image, and performing surface defect feature extraction to obtain surface defect data; performing defect type analysis based on the surface defect data to obtain defect type data; performing spectral parameter setting according to the defect type data, and performing transmissivity difference analysis on the diffusion plate monitoring image through the set spectral parameters to generate a transmission characteristic spectrum; positioning an internal defect area of the diffusion plate monitoring image based on the transmission characteristic spectrum to obtain coordinates of the internal defect area; and performing three-dimensional defect morphology analysis on the internal defect area based on the internal defect area coordinates to generate internal defect data. By combining surface and internal defect analysis, defect coupling relation, risk assessment and region segmentation, the detection comprehensiveness and accuracy of the defect detection model are improved.

The present disclosure relates to the technical field of artificial intelligence, and provides a multimodal large language model training method, a correlation calculation method, and a label generation method. The multimodal large language model training method comprises: on the basis of a sample text feature vector, a sample image feature vector, and a sample first multimodal feature vector which are obtained by processing image information and text description information of a sample commodity by a pre-trained multimodal large language model, training the pre-trained multimodal large language model to obtain a multimodal large language model; and processing a sample search word, the image information and the text description information on the basis of the multimodal large language model to obtain a sample search word feature vector, a first multimodal feature vector and a sample second multimodal feature vector, and training the multimodal large language model to obtain a trained multimodal large language model. The trained multimodal large language model of the present disclosure can simultaneously learn image features related to the search word and the text description information, and thus the generated second multimodal feature vector is more accurate.

The invention relates to a model training method and device, equipment, a storage medium and a product. The method comprises the following steps: constructing a training data set according to a target text reasoning chain obtained by converting multi-modal data; according to the training data set, performing supervision fine tuning on the pre-trained multi-modal large language model to obtain a basic reasoning model; performing optimization processing on the basic reasoning model according to reinforcement learning training of long thinking to obtain a target reasoning model; the target reasoning model is used for outputting a target answer containing a reasoning process according to the input multi-modal data. Therefore, the long text constraint can be directly used for reinforcement learning, and the training efficiency is greatly improved; and by adopting long-thinking reinforcement learning training, the model can easily learn a correct thinking process in training, so that the reasoning ability of the multi-modal large language model for processing a complex visual reasoning task is improved, and the correct thinking process is displayed in the reasoning process.

The invention discloses a ligand information generation model training method and device and a ligand information generation method and device, and belongs to the technical field of artificial intelligence. The method comprises the following steps: acquiring sample receptor information and sample ligand information, wherein the binding affinity between a ligand described by the sample ligand information and a receptor described by the sample receptor information is not less than a set affinity; denoising the reference noise data based on the sample receptor information through a to-be-trained neural network model to obtain predicted ligand information; determining a first loss for characterizing a difference between the sample ligand information and the predicted ligand information; and training the neural network model based on the first loss to obtain a ligand information generation model. The reference ligand information can be generated based on the reference receptor information through the ligand information generation model, and the binding affinity between the ligand described by the reference ligand information and the receptor described by the reference receptor information is high.

The invention discloses a Transform large model training method based on cloud edge collaboration. The method comprises the following steps: S1, constructing a data set; s2, preprocessing the data set; s3, segmenting the preprocessed data set by using a data parallelism strategy, and performing distributed training by combining data parallelism and model parallelism technologies; s4, monitoring computing resources and network conditions of the edge equipment and the cloud server in real time, dynamically adjusting a data distribution strategy, and optimizing computing load distribution; s5, a multi-agent dominant actor-commentator algorithm is combined with a multi-arm tiger machine strategy, and the layered structure of the Transform model is adjusted in real time; s6, performing partial model reasoning tasks on the edge equipment in combination with the edge reasoning capability; s7, protecting data privacy by adopting a federal learning strategy and utilizing a differential privacy technology; and S8, performing hardware acceleration by utilizing heterogeneous computing resources. According to the method, a cloud edge cooperative computing and intelligent scheduling method is adopted, and large model training and reasoning with efficient privacy protection are realized.

The invention discloses a quantitative training method and system for a deep neural network, and the method comprises the steps: obtaining an original neural network model and a verification data set, and generating a quantitative priority through hierarchical sensitivity evaluation and topology analysis; on the basis of the layer sensitivity matrix, differentiated quantization parameters are configured for each layer, and quantization constraints are established; constructing an error compensation mechanism, and generating an error compensation strategy; executing dual-scale adaptive quantization training, and respectively adopting an independently optimized quantization strategy for forward propagation and back propagation; dynamically adjusting quantization parameters according to the training state and the resource constraint; and evaluating model performance and resource efficiency. According to the method, through multi-dimensional sensitivity evaluation, a dynamic quantification strategy and system error compensation, the precision and efficiency of quantification training are improved, and meanwhile it is guaranteed that deployment resource constraints are met.

Provided in the embodiments of the present disclosure are a dialogue content generation method, a model training method, a prompt text generation method, a device and a storage medium. The dialogue content generation method comprises: receiving an input question; determining whether the question needs to be answered in combination with external knowledge; if the question needs to be answered in combination with external knowledge, acquiring target knowledge from a preset knowledge base on the basis of the question, generating prompt text corresponding to the target knowledge, inputting into a dialogue content generation model the question, the target knowledge and the prompt text corresponding to the target knowledge, and generating dialogue content by means of the dialogue content generation model, wherein the prompt text is used for prompting the dialogue content generation model to answer the question with reference to the target knowledge; and if the question does not need to be answered in combination with external knowledge, inputting the question into the dialogue content generation model, and generating dialogue content by means of the dialogue content generation model, wherein the dialogue content generation model is obtained by means of performing fine tuning on a pre-trained language model.

The invention relates to the technical field of artificial intelligence, in particular to a multi-mode agent RAG-ReAct double-engine cooperative training method. The method comprises the following steps: acquiring multi-modal data, and converting the multi-modal data into a high-dimensional vector; constructing a knowledge graph based on the high-dimensional vector; encoding the semantic relationship of the knowledge graph into a model fine adjustment gradient direction by using a dynamic distillation technology; designing a distributed architecture based on the high-dimensional vector; performing hybrid retrieval based on a distributed architecture to obtain hybrid retrieval data; executing distributed reasoning based on a preset recursive reflection mechanism and the mixed retrieval data to generate distributed reasoning data; performing data parallel detection according to the distributed reasoning data to obtain data parallel parameters; and performing node resource scheduling based on the data parallel parameters so as to obtain node load balancing data. Based on the artificial intelligence technology, the reasoning accuracy and the resource utilization rate of the multi-modal agent in a complex task environment are effectively improved.

The invention relates to the technical field of natural language processing, and discloses a question and answer task processing model training method, device and equipment and a storage medium, and the method comprises the steps: adjusting a question and answer task processing model according to an initial training data set and a first model training algorithm, and obtaining a first intermediate question and answer task processing model; according to the initial training data set and the first intermediate question and answer task processing model, obtaining a first reasoning step and first annotation information for processing the question and answer task, and generating a first target training data set; according to the initial training data set and a second model training algorithm, adjusting a question and answer task processing model to obtain a second intermediate question and answer task processing model; and adjusting the second intermediate question and answer task processing model according to the first target training data set to obtain a target model. The problems that when the model for processing the question and answer task is trained, the accuracy of the model is affected by the quality of the manually-labeled data due to the dependence on the manually-labeled data, and the training process is high in cost and low in efficiency are solved.

The invention discloses a hybrid expert network training method, device and equipment and a computer program product, experts in a hybrid expert layer are equally divided into a plurality of groups and equally distributed to a plurality of pieces of equipment, and different pieces of equipment share the same routing module. In the training process, for an input hidden layer sequence of the mixed expert layer, the score of each path of experts is calculated through a routing module, for each expert group, activation experts in the group are selected according to the scores of the experts in the group, the number of the activation experts in different groups is the same, and each expert group processes the complete hidden layer sequence. And processing the input hidden layer sequence by the activation experts in each expert group to obtain the output of the activation experts, and obtaining the output of the hybrid expert layer based on the output of each activation expert. According to the method and the device, absolute balance of calculation among the devices is ensured, and the effect of the model is not influenced by drop-pad (namely data discarding and 0 filling).

The invention provides an operation control model training method and a robot operation control method and system, and the method comprises the steps: carrying out the reinforcement learning training of an initial strategy network according to the first sample state information of a simulation robot and a reward function corresponding to each action task, and obtaining a target strategy network corresponding to each action task; according to second sample state information of the simulation robot, a task label corresponding to a preset training task and expected action information corresponding to the second sample state information output by a target strategy network corresponding to each action task, carrying out joint training of transfer learning, reinforcement learning training and imitation learning on the initial operation control model; and constructing an operation control model according to the trained initial operation control model. Through joint training of multiple training tasks, smooth switching among different action tasks of the robot can be ensured while multi-task compatible processing of the robot can be realized, and the operation control performance of the robot is effectively improved.

The invention provides a model pre-training method and device for a multi-language task, and relates to the technical field of artificial intelligence, and the method comprises the steps: obtaining a multi-modal training data set which comprises a plurality of pieces of sample text data and a plurality of pieces of sample image-text pair data with multi-language contents, and covers a universal field and a preset business field; based on a plurality of sample image-text pair data, performing comparative learning training of alignment of visual features and text features on the initial model, freezing model parameters of a decoding module and adjusting model parameters of a visual encoder and a projection module in the training process until a first ending condition is met; based on the multiple pieces of sample image-text pair data and the multiple pieces of sample text data, constraint training of content understanding is carried out on the initial model meeting a first ending condition, and model parameters of a visual encoder, a projection module and a decoding module are adjusted in the training process until a second ending condition is met to obtain a target model; the information extraction capability of the model in the specific field can be remarkably improved.

Disclosed is an industrial question answering model training method based on reinforcement learning and knowledge base matching, comprising the following steps: S1, collecting professional knowledge questions and answers in an industrial field to construct an industrial knowledge base, training a reward model, carrying out, for industrial knowledge questions and answers, matching comparison on outputs of an industrial question answering model and content of the industrial knowledge base, and obtaining reward values on the basis of similarities; S2, sorting the reward values, and using a sorting loss function to train and update parameters of a reward model network; and S3, carrying out industrial question answering model training, incorporating a penalty term for the reward values, and using a reinforcement learning algorithm to train the industrial question answering model multiple times to obtain an optimal strategy. According to the industrial question answering model training method based on reinforcement learning and knowledge base matching of the present invention, the reinforcement learning algorithm is used, and iterative training is carried out multiple times, thereby helping the industrial question answering model to learn and understand industrial professional knowledge and improving the question answering accuracy of the industrial question answering model.

The present application relates to a retrieval model training method and apparatus and a computer device. The method comprises: acquiring a knowledge document, and performing text segmentation processing on the knowledge document to obtain a text block set (501); on the basis of the text block set and summary information comprised in each text block, writing a question for each text block to obtain one or more question texts corresponding to each text block, separately combining the one or more question texts corresponding to each text block with the corresponding text block to obtain one or more data pairs corresponding to each text block and, on the basis of the one or more data pairs corresponding to each text block, generating a data pair set (502); and using the data pair set to train a first retrieval model so as to obtain a second retrieval model (503).

The invention discloses a model training method and device, electronic equipment and a computer storage medium. The model training method comprises the following steps: performing supervision fine tuning on an initial baseline model based on a first training sample set in a preset training sample set to obtain a supervision fine tuning model and a preference data sample; performing optimization training on the initial reward model based on the preference data sample to obtain a target reward model, and performing optimization training on the supervision fine tuning model based on the preference data sample to obtain a preference optimization model; generating a first reward signal based on the preference optimization model and the first training sample set, and generating a second reward signal based on the preference optimization model, the target reward model and a second training sample set in the preset training sample set; and performing optimization training on the preference optimization model based on the first reward signal, the second reward signal and the second training sample set to obtain a target object generation type pre-training model. By adopting the method, the generalization ability of the model can be improved.

The invention discloses a vertical large language model training method and system in the carbon neutralization field, and the method comprises the following steps: collecting data of the carbon neutralization field, carrying out the data preprocessing, constructing a carbon neutralization field knowledge base, and updating the carbon neutralization field knowledge base through a dynamic updating mechanism; performing dynamic semantic partitioning and vectorization coding on the text of the carbon neutralization domain knowledge base, and storing the text into a vector database; performing staged fine tuning on the pre-trained large language model based on a low-rank adaptation technology, wherein the fine tuning comprises general instruction fine tuning and carbon neutralization field professional fine tuning; a retrieval enhancement generation mechanism is adopted, knowledge fragments related to user query are retrieved through a vector database, and a large language model is input to generate answers. Compared with the prior art, the method has the advantages that the answer reliability is improved through conflict detection and source tracing, so that the large language model can more accurately adapt to knowledge requirements in the carbon neutralization field.

The invention relates to the technical field of data processing, and discloses a training method and system for generating a 5D digital human based on AIGC, and a medium. The method comprises the following steps: preprocessing real person feature data to obtain multi-dimensional preprocessed data; performing multi-level processing on the multi-dimensional preprocessing data to obtain 5D digital human generation data; performing cross-modal coordination processing on the 5D digital human generation data through a progressive multi-task learning algorithm to obtain to-be-processed digital human data; performing dynamic knowledge integration processing on the to-be-processed digital human data to obtain adaptive digital human data; carrying out personalized fine tuning and style migration processing on the adaptive digital human data to obtain target digital human data; and performing real-time rendering and intelligent interaction processing on the target digital human data to obtain target 5D digital human data, and generating a digital human training scheme according to the target 5D digital human data. According to the method and the device, the training efficiency and accuracy of generating the 5D digital human based on the AIGC are improved.

The invention discloses a machine vision model training method and system based on end-side computing power, and belongs to the technical field of machine learning, edge computing and computer vision, and the method comprises the steps: obtaining a machine vision image and constructing a pre-annotation model, so as to carry out the automatic pre-annotation of the image; manually correcting the partial pre-annotation to optimize the pre-annotation model, and obtaining a corrected annotation image; a machine vision model is constructed and is subjected to identification training based on an annotated image, training task variables can be distributed according to hardware perception, then a training task execution position (an edge end or a cloud end) is dynamically selected, and the trained machine vision model is deployed at the edge end so as to carry out an image identification reasoning process; and performing manual spot check on the reasoning result of the model to evaluate the accuracy rate of the machine vision model, starting a new round of model training when the accuracy rate is low, and taking the evaluated machine vision model as the pre-labeling model.

Embodiments of the present invention provide a target multi-modal model system and construction method, a video processing model training method, and a video processing method. The video processing model training method comprises: inputting a video sample and each initial text sample into a video processing model, wherein the initial text sample is a text for performing category description on video content of the video sample; using the video processing model to perform feature extraction on the video sample to obtain a temporal motion feature and a fused image feature; using the video processing model to perform feature extraction on the initial text sample to obtain a dynamic text feature and a fused text feature; and training the video processing model on the basis of the temporal motion feature and the dynamic text feature, and the fused image feature and the fused text feature.

The invention relates to the technical field of slope protection, in particular to a slope protection intelligent detection system based on deep learning. According to the technical scheme, the system comprises a multi-source heterogeneous data sensing module, a data fusion and feature extraction module, a slope state intelligent diagnosis and early warning module, an edge-cloud collaborative computing architecture and a system optimization module. Registration and feature complementation of multi-source heterogeneous data are realized through a multi-modal detection network, an overfitting phenomenon is effectively inhibited through a physical information neural network architecture, risk quantitative evaluation is realized through construction of a dynamic risk evaluation model, early warning response time is shortened in cooperation with a four-level early warning strategy, the false alarm rate is reduced, and the early warning efficiency is improved. Besides, the detection precision of the system in an extreme scene is improved through a physical constraint adversarial training method, so that the environmental adaptability of the system is improved, continuous updating and evolution of the model are realized through an online incremental learning module, and the problem of performance degradation of a traditional system caused by change of geological conditions is solved.

The invention discloses a robot reinforcement learning control method and system based on a gating circulation unit, and relates to the technical field of artificial intelligence. Based on a reinforcement learning state machine, a trained student network is deployed to a real quadruped robot in a zero mapping manner, and movement control of the quadruped robot is realized; the training process of the student network is as follows: building a simulation training terrain environment of the robot, and setting different levels of terrain difficulty for each terrain; based on the distillation learning thought, establishing a teacher network and a student network based on a gating circulation unit, constructing a total loss function, and based on the constructed total loss function, fitting a motor joint angle output by the teacher network through an omnibearing simulation training terrain environment, a large-scale parallel training method and the student network; according to the robot reinforcement learning control method and system, robust motion of the robot in an unstructured terrain is realized, and the robot reinforcement learning control method and system have good anti-interference capability and self-recovery capability for a dynamic environment in which traditional control cannot be competent.

The invention provides a robot motion control model training method and device based on deep reinforcement learning, and relates to the technical field of sensors and robots. The method comprises the following steps: performing deep reinforcement learning-based training on a strategy network for outputting an action strategy for controlling the robot to move by utilizing a teacher-student model framework; wherein the training process of the strategy network further comprises the steps of encoding historical linear velocity information of the robot through a linear velocity encoder to generate a first potential vector, and inputting the first potential vector into the strategy network for auxiliary training. According to the method, the motion trend, the state change track and the surrounding terrain structure of the robot are comprehensively considered during action decision making, and strategy output is more stably and accurately controlled.

Disclosed in the present application are a model training method and apparatus based on multi-modal data, and a device and a storage medium. The method comprises: acquiring training sample sets (201); performing acoustic feature extraction on an acoustic sample comprised in a first training sample set, and performing optical feature extraction on an optical sample comprised therein (202); acquiring a fusion weight for multi-modal fusion (203); and under the constraint of the fusion weight, performing model training on the basis of labeling information of the training sample sets, and an extracted acoustic feature and optical feature, so as to obtain a multi-modal fusion recognition model (204).

Provided are a processing system for a three-dimensional model, a method for obtaining a physical model on the basis of three-dimensional printing of a three-dimensional processing system, a system for generating a three-dimensional model from a virtual reality / augmented reality three-dimensional sketch, a diffusion model training method, and a method for editing a three-dimensional model on the basis of a virtual reality / augmented reality three-dimensional sketch. The method for obtaining a physical model on the basis of three-dimensional printing of a three-dimensional processing system comprises: step one, at an input apparatus, a user using a hand or a handle to draw three-dimensional sketch content in the air, wherein a three-dimensional sketch is stored in the form of a three-dimensional point cloud, and when the user draws a trajectory, a corresponding point cloud is generated in the drawn trajectory and is displayed in a three-dimensional virtual space in a highlighted manner, and displacement and deletion operations of the user for the three-dimensional sketch are overall displacement and deletion operations for points in a region corresponding to the point cloud of the three-dimensional sketch; step two, a computing apparatus converting the three-dimensional sketch content into a three-dimensional model; step three, converting the three-dimensional model into a readable file for an execution apparatus, wherein the conversion is implemented by using a slicing algorithm; and step four, a three-dimensional printer executing the readable file to perform a printing operation, so as to obtain a physical model.

The invention provides a multi-modal document understanding model, a training method, a reasoning method and equipment, global visual features are extracted by using a weight-frozen first visual encoder, the understanding ability of the model to natural scene images is enhanced, a second visual encoder extracts fine-grained features based on high-resolution document images and region-of-interest information, and the understanding ability of the model to natural scene images is enhanced. And the analysis precision of the complex document is improved. And the information interaction module improves the intelligent understanding ability of a specific area in combination with the position of the region of interest input by the user. The feature fusion module splices multi-modal features in a channel dimension, so that visual information from different sources is efficiently integrated. The linear layer converts feature dimensions, so that the visual features are adaptive to the input requirements of the large language model, and the large language model combines visual and text information to generate a text understanding result conforming to semantic logic. According to the model, the capability of analyzing and extracting the fine granularity of the document information is improved by combining the two-way visual encoder with the selection of the region of interest of the user on the document image of the image-text structure.

The invention discloses an inquiry model training method and device based on a long thinking chain, and relates to the field of large models, semantic information is extracted through strategy network analysis of a model, and an initial step decision is generated in combination with context information in a historical memory library; sending the initial step decision into a reasoning path generator, and reasoning to generate a primary diagnosis disease source and an intermediate diagnosis step; sending the primary diagnosis source and the intermediate diagnosis step into a verification module, performing pathological logic verification according to a case diagnosis report and a medical knowledge base, and feeding back a verification result; the reasoning path generator updates the historical memory bank based on the feedback result, the preliminary diagnosis disease source and the intermediate diagnosis steps; the strategy network continues reasoning based on user feedback input and the updated context information in the historical memory bank, and finally an inquiry result is output. According to the scheme, technical means such as reinforcement learning, self-adaptive backtracking and memory enhancement are introduced into a long thinking chain reasoning framework, so that a large language model realizes multi-aspect comprehensive improvement in medical question and answer and auxiliary diagnosis scenes.

The invention is an advanced deep learning system that combines a latent transformer core with a latent dynamics analyzer. This system processes input data into latent space vectors, which are then analyzed in parallel for both prediction and dynamic modeling. The latent transformer generates short-term predictions, while the latent dynamics analyzer derives equations of motion describing the underlying system dynamics. By integrating spectral analysis and change detection, the system can identify significant shifts in behavior, particularly useful for complex systems like financial markets. The invention enables more accurate predictions, interpretable insights, and early detection of regime changes. Its end-to-end training approach ensures all components work harmoniously, balancing predictive accuracy with physical plausibility and interpretability.