17631 results about "Training methods" patented technology

The invention provides an intelligent rehabilitation training method and system based on artificial intelligence and virtual reality, a user wears an intelligent wearable device to collect multi-modal data such as electroencephalogram, myoelectricity, physiological features and motion signals, the multi-modal data is preprocessed and then input into an artificial intelligence training model, and key features are extracted and fused by using a graph convolutional network and an attention mechanism algorithm. And constructing a digital twinborn model by using the fusion features, performing real-time dynamic mapping and predictive simulation, and generating a customized training scheme by means of a reinforcement learning algorithm in combination with a rehabilitation target and a physical state of the user. A user is trained in the virtual reality interaction model, the system monitors actions and physiological states in real time, the digital twin model synchronously acts, and the scene is dynamically adjusted. After training, the rehabilitation effect is evaluated according to the physiological indexes, the motion data and the twinning optimization analysis result, and an optimization training scheme and a digital twinning model are fed back. Precision, individuation and intelligentization of rehabilitation training are achieved, and the training effect and quality are improved.

The invention provides a network traffic anomaly detection model training method and device and a readable storage medium, and the method comprises the steps: extracting a traffic statistical feature vector according to original network traffic data, and generating an initial mixed data set; generating a confrontation disturbance sample output enhanced feature matrix based on the initial mixed data set; constructing a self-adaptive feature fusion rule based on the enhanced feature matrix, embedding asset association degree parameters into an attention calculation layer of a feature encoder, and outputting encoding features fusing threat intelligence; inputting the coding features fused with the threat intelligence into a pre-constructed initial detection model, generating false report and missing report correction labels based on the suspicious traffic fragments, and outputting an adversarial sample correction data set; and performing adversarial training on the initial detection model through the adversarial sample correction data set to obtain an incremental detection model for network traffic anomaly detection. According to the invention, the detection precision, the anti-interference capability and the real-time defense response capability of the detection model to novel attacks can be improved.

The invention discloses a deep learning-based small target defect recognition model training method, relates to the technical field of defect recognition model training, and aims at meeting small defect detection requirements, starting with high-resolution diversified data construction and accurate labeling, highlighting weak targets through multi-scale feature fusion and spatial attention, and realizing high-resolution target defect recognition. A hard case scene is processed in cooperation with layer-by-layer screening and secondary intensified training, real-time iterative optimization is achieved through multi-model fusion and online dynamic adjustment and optimization, finally, multi-mode and time sequence dimensions are expanded to capture deeper and dynamic defect information, the missing detection and false detection rate is greatly reduced, and the detection efficiency is improved. The detection efficiency and adaptability of micron-sized defects under a complex process background are improved; furthermore, by means of multi-source data such as infrared, X-ray or 3D morphology and a time sequence modeling means, multiple dimensions are fused, and hidden or early cracks are brought into a detection and prediction range, so that a high-reliability and evolvable intelligent recognition system for the tiny target defects is constructed.

The present disclosure relates to the technical field of artificial intelligence, and provides a multimodal large language model training method, a correlation calculation method, and a label generation method. The multimodal large language model training method comprises: on the basis of a sample text feature vector, a sample image feature vector, and a sample first multimodal feature vector which are obtained by processing image information and text description information of a sample commodity by a pre-trained multimodal large language model, training the pre-trained multimodal large language model to obtain a multimodal large language model; and processing a sample search word, the image information and the text description information on the basis of the multimodal large language model to obtain a sample search word feature vector, a first multimodal feature vector and a sample second multimodal feature vector, and training the multimodal large language model to obtain a trained multimodal large language model. The trained multimodal large language model of the present disclosure can simultaneously learn image features related to the search word and the text description information, and thus the generated second multimodal feature vector is more accurate.

The invention relates to a model training method and device, equipment, a storage medium and a product. The method comprises the following steps: constructing a training data set according to a target text reasoning chain obtained by converting multi-modal data; according to the training data set, performing supervision fine tuning on the pre-trained multi-modal large language model to obtain a basic reasoning model; performing optimization processing on the basic reasoning model according to reinforcement learning training of long thinking to obtain a target reasoning model; the target reasoning model is used for outputting a target answer containing a reasoning process according to the input multi-modal data. Therefore, the long text constraint can be directly used for reinforcement learning, and the training efficiency is greatly improved; and by adopting long-thinking reinforcement learning training, the model can easily learn a correct thinking process in training, so that the reasoning ability of the multi-modal large language model for processing a complex visual reasoning task is improved, and the correct thinking process is displayed in the reasoning process.

The invention discloses a ligand information generation model training method and device and a ligand information generation method and device, and belongs to the technical field of artificial intelligence. The method comprises the following steps: acquiring sample receptor information and sample ligand information, wherein the binding affinity between a ligand described by the sample ligand information and a receptor described by the sample receptor information is not less than a set affinity; denoising the reference noise data based on the sample receptor information through a to-be-trained neural network model to obtain predicted ligand information; determining a first loss for characterizing a difference between the sample ligand information and the predicted ligand information; and training the neural network model based on the first loss to obtain a ligand information generation model. The reference ligand information can be generated based on the reference receptor information through the ligand information generation model, and the binding affinity between the ligand described by the reference ligand information and the receptor described by the reference receptor information is high.

The invention relates to the technical field of artificial intelligence, in particular to a multi-mode agent RAG-ReAct double-engine cooperative training method. The method comprises the following steps: acquiring multi-modal data, and converting the multi-modal data into a high-dimensional vector; constructing a knowledge graph based on the high-dimensional vector; encoding the semantic relationship of the knowledge graph into a model fine adjustment gradient direction by using a dynamic distillation technology; designing a distributed architecture based on the high-dimensional vector; performing hybrid retrieval based on a distributed architecture to obtain hybrid retrieval data; executing distributed reasoning based on a preset recursive reflection mechanism and the mixed retrieval data to generate distributed reasoning data; performing data parallel detection according to the distributed reasoning data to obtain data parallel parameters; and performing node resource scheduling based on the data parallel parameters so as to obtain node load balancing data. Based on the artificial intelligence technology, the reasoning accuracy and the resource utilization rate of the multi-modal agent in a complex task environment are effectively improved.

Disclosed is an industrial question answering model training method based on reinforcement learning and knowledge base matching, comprising the following steps: S1, collecting professional knowledge questions and answers in an industrial field to construct an industrial knowledge base, training a reward model, carrying out, for industrial knowledge questions and answers, matching comparison on outputs of an industrial question answering model and content of the industrial knowledge base, and obtaining reward values on the basis of similarities; S2, sorting the reward values, and using a sorting loss function to train and update parameters of a reward model network; and S3, carrying out industrial question answering model training, incorporating a penalty term for the reward values, and using a reinforcement learning algorithm to train the industrial question answering model multiple times to obtain an optimal strategy. According to the industrial question answering model training method based on reinforcement learning and knowledge base matching of the present invention, the reinforcement learning algorithm is used, and iterative training is carried out multiple times, thereby helping the industrial question answering model to learn and understand industrial professional knowledge and improving the question answering accuracy of the industrial question answering model.

The present application relates to a retrieval model training method and apparatus and a computer device. The method comprises: acquiring a knowledge document, and performing text segmentation processing on the knowledge document to obtain a text block set (501); on the basis of the text block set and summary information comprised in each text block, writing a question for each text block to obtain one or more question texts corresponding to each text block, separately combining the one or more question texts corresponding to each text block with the corresponding text block to obtain one or more data pairs corresponding to each text block and, on the basis of the one or more data pairs corresponding to each text block, generating a data pair set (502); and using the data pair set to train a first retrieval model so as to obtain a second retrieval model (503).

The invention discloses a model training method and device, electronic equipment and a computer storage medium. The model training method comprises the following steps: performing supervision fine tuning on an initial baseline model based on a first training sample set in a preset training sample set to obtain a supervision fine tuning model and a preference data sample; performing optimization training on the initial reward model based on the preference data sample to obtain a target reward model, and performing optimization training on the supervision fine tuning model based on the preference data sample to obtain a preference optimization model; generating a first reward signal based on the preference optimization model and the first training sample set, and generating a second reward signal based on the preference optimization model, the target reward model and a second training sample set in the preset training sample set; and performing optimization training on the preference optimization model based on the first reward signal, the second reward signal and the second training sample set to obtain a target object generation type pre-training model. By adopting the method, the generalization ability of the model can be improved.

The invention discloses a vertical large language model training method and system in the carbon neutralization field, and the method comprises the following steps: collecting data of the carbon neutralization field, carrying out the data preprocessing, constructing a carbon neutralization field knowledge base, and updating the carbon neutralization field knowledge base through a dynamic updating mechanism; performing dynamic semantic partitioning and vectorization coding on the text of the carbon neutralization domain knowledge base, and storing the text into a vector database; performing staged fine tuning on the pre-trained large language model based on a low-rank adaptation technology, wherein the fine tuning comprises general instruction fine tuning and carbon neutralization field professional fine tuning; a retrieval enhancement generation mechanism is adopted, knowledge fragments related to user query are retrieved through a vector database, and a large language model is input to generate answers. Compared with the prior art, the method has the advantages that the answer reliability is improved through conflict detection and source tracing, so that the large language model can more accurately adapt to knowledge requirements in the carbon neutralization field.

The invention discloses a machine vision model training method and system based on end-side computing power, and belongs to the technical field of machine learning, edge computing and computer vision, and the method comprises the steps: obtaining a machine vision image and constructing a pre-annotation model, so as to carry out the automatic pre-annotation of the image; manually correcting the partial pre-annotation to optimize the pre-annotation model, and obtaining a corrected annotation image; a machine vision model is constructed and is subjected to identification training based on an annotated image, training task variables can be distributed according to hardware perception, then a training task execution position (an edge end or a cloud end) is dynamically selected, and the trained machine vision model is deployed at the edge end so as to carry out an image identification reasoning process; and performing manual spot check on the reasoning result of the model to evaluate the accuracy rate of the machine vision model, starting a new round of model training when the accuracy rate is low, and taking the evaluated machine vision model as the pre-labeling model.

Embodiments of the present invention provide a target multi-modal model system and construction method, a video processing model training method, and a video processing method. The video processing model training method comprises: inputting a video sample and each initial text sample into a video processing model, wherein the initial text sample is a text for performing category description on video content of the video sample; using the video processing model to perform feature extraction on the video sample to obtain a temporal motion feature and a fused image feature; using the video processing model to perform feature extraction on the initial text sample to obtain a dynamic text feature and a fused text feature; and training the video processing model on the basis of the temporal motion feature and the dynamic text feature, and the fused image feature and the fused text feature.

The invention relates to the technical field of slope protection, in particular to a slope protection intelligent detection system based on deep learning. According to the technical scheme, the system comprises a multi-source heterogeneous data sensing module, a data fusion and feature extraction module, a slope state intelligent diagnosis and early warning module, an edge-cloud collaborative computing architecture and a system optimization module. Registration and feature complementation of multi-source heterogeneous data are realized through a multi-modal detection network, an overfitting phenomenon is effectively inhibited through a physical information neural network architecture, risk quantitative evaluation is realized through construction of a dynamic risk evaluation model, early warning response time is shortened in cooperation with a four-level early warning strategy, the false alarm rate is reduced, and the early warning efficiency is improved. Besides, the detection precision of the system in an extreme scene is improved through a physical constraint adversarial training method, so that the environmental adaptability of the system is improved, continuous updating and evolution of the model are realized through an online incremental learning module, and the problem of performance degradation of a traditional system caused by change of geological conditions is solved.

The invention provides a robot motion control model training method and device based on deep reinforcement learning, and relates to the technical field of sensors and robots. The method comprises the following steps: performing deep reinforcement learning-based training on a strategy network for outputting an action strategy for controlling the robot to move by utilizing a teacher-student model framework; wherein the training process of the strategy network further comprises the steps of encoding historical linear velocity information of the robot through a linear velocity encoder to generate a first potential vector, and inputting the first potential vector into the strategy network for auxiliary training. According to the method, the motion trend, the state change track and the surrounding terrain structure of the robot are comprehensively considered during action decision making, and strategy output is more stably and accurately controlled.

Disclosed in the present application are a model training method and apparatus based on multi-modal data, and a device and a storage medium. The method comprises: acquiring training sample sets (201); performing acoustic feature extraction on an acoustic sample comprised in a first training sample set, and performing optical feature extraction on an optical sample comprised therein (202); acquiring a fusion weight for multi-modal fusion (203); and under the constraint of the fusion weight, performing model training on the basis of labeling information of the training sample sets, and an extracted acoustic feature and optical feature, so as to obtain a multi-modal fusion recognition model (204).

Provided are a processing system for a three-dimensional model, a method for obtaining a physical model on the basis of three-dimensional printing of a three-dimensional processing system, a system for generating a three-dimensional model from a virtual reality / augmented reality three-dimensional sketch, a diffusion model training method, and a method for editing a three-dimensional model on the basis of a virtual reality / augmented reality three-dimensional sketch. The method for obtaining a physical model on the basis of three-dimensional printing of a three-dimensional processing system comprises: step one, at an input apparatus, a user using a hand or a handle to draw three-dimensional sketch content in the air, wherein a three-dimensional sketch is stored in the form of a three-dimensional point cloud, and when the user draws a trajectory, a corresponding point cloud is generated in the drawn trajectory and is displayed in a three-dimensional virtual space in a highlighted manner, and displacement and deletion operations of the user for the three-dimensional sketch are overall displacement and deletion operations for points in a region corresponding to the point cloud of the three-dimensional sketch; step two, a computing apparatus converting the three-dimensional sketch content into a three-dimensional model; step three, converting the three-dimensional model into a readable file for an execution apparatus, wherein the conversion is implemented by using a slicing algorithm; and step four, a three-dimensional printer executing the readable file to perform a printing operation, so as to obtain a physical model.

The invention provides a multi-modal document understanding model, a training method, a reasoning method and equipment, global visual features are extracted by using a weight-frozen first visual encoder, the understanding ability of the model to natural scene images is enhanced, a second visual encoder extracts fine-grained features based on high-resolution document images and region-of-interest information, and the understanding ability of the model to natural scene images is enhanced. And the analysis precision of the complex document is improved. And the information interaction module improves the intelligent understanding ability of a specific area in combination with the position of the region of interest input by the user. The feature fusion module splices multi-modal features in a channel dimension, so that visual information from different sources is efficiently integrated. The linear layer converts feature dimensions, so that the visual features are adaptive to the input requirements of the large language model, and the large language model combines visual and text information to generate a text understanding result conforming to semantic logic. According to the model, the capability of analyzing and extracting the fine granularity of the document information is improved by combining the two-way visual encoder with the selection of the region of interest of the user on the document image of the image-text structure.

The invention discloses an inquiry model training method and device based on a long thinking chain, and relates to the field of large models, semantic information is extracted through strategy network analysis of a model, and an initial step decision is generated in combination with context information in a historical memory library; sending the initial step decision into a reasoning path generator, and reasoning to generate a primary diagnosis disease source and an intermediate diagnosis step; sending the primary diagnosis source and the intermediate diagnosis step into a verification module, performing pathological logic verification according to a case diagnosis report and a medical knowledge base, and feeding back a verification result; the reasoning path generator updates the historical memory bank based on the feedback result, the preliminary diagnosis disease source and the intermediate diagnosis steps; the strategy network continues reasoning based on user feedback input and the updated context information in the historical memory bank, and finally an inquiry result is output. According to the scheme, technical means such as reinforcement learning, self-adaptive backtracking and memory enhancement are introduced into a long thinking chain reasoning framework, so that a large language model realizes multi-aspect comprehensive improvement in medical question and answer and auxiliary diagnosis scenes.

The invention is an advanced deep learning system that combines a latent transformer core with a latent dynamics analyzer. This system processes input data into latent space vectors, which are then analyzed in parallel for both prediction and dynamic modeling. The latent transformer generates short-term predictions, while the latent dynamics analyzer derives equations of motion describing the underlying system dynamics. By integrating spectral analysis and change detection, the system can identify significant shifts in behavior, particularly useful for complex systems like financial markets. The invention enables more accurate predictions, interpretable insights, and early detection of regime changes. Its end-to-end training approach ensures all components work harmoniously, balancing predictive accuracy with physical plausibility and interpretability.

The invention provides a polarization three-dimensional reconstruction method and a polarization three-dimensional reconstruction system based on a prior guide diffusion model, which apply a diffusion model in the field of polarization three-dimensional reconstruction and improve the recovery capability of complex details and the robustness of noise interference resistance. According to the method, a two-stage training mode is adopted, and the generation quality and the calculation efficiency are balanced through step-by-step optimization. In the first stage, a VQGAN codec is independently trained to learn high-efficiency low-dimensional potential representation of an image, and direct high-cost calculation in a pixel space is avoided; in the second stage, learnable parameters of the VQGAN are frozen, a diffusion model is trained on a trained potential space, gradual denoising is guided through a priori condition, and potential features are generated and mapped back to an image space. The diffusion model effectively fuses the physical constraint of the polarization clue and the data prior in the gradual denoising process, and the surface normal with rich details can still be stably generated in the case of noise interference or information loss. Experimental results show that the method provided by the invention is excellent in surface normal reconstruction in a plurality of complex scenes.

The invention relates to the technical field of image classification, in particular to a training method and system of a cervical pathological image classification model based on multiple modes. The method comprises the following steps: acquiring a cervical tissue image and carrying out tissue structure segmentation, forming a nucleus-interstitial-epithelium three-distribution framework, collecting development historical data, confirming a prediction trend of each layer, carrying out environment field simulation through the image, generating a simulated cervical environment field, and carrying out hierarchical evolution prediction on the framework. Evolution mapping images are generated according to the evolution data and classified, finally, a visual basic model is obtained through combined modeling training, image-text fusion is achieved, and a cross-center deployment model system is generated. According to the method, vision-language combined modeling is realized, and the stability and controllability of the whole model structure in image space deformation modeling, semantic cross-modal alignment construction and task-level response flow scheduling are improved.

The present disclosure discloses a method for training an industrial question-answering model based on reinforcement learning and knowledge base matching, comprising: S1, training a reward model, and for an industrial knowledge question-answering, matching and comparing an output of an industrial question-answering model with a content of an industrial knowledge base, and generating a reward value based on a similarity between the output of the industrial question-answering model and the content of the industrial knowledge base; S2, ranking a plurality of reward values corresponding to a plurality of outputs of the industrial question-answering model and training and updating network parameters of the reward model based on a ranking loss function; and S3, training the industrial question-answering model, adding the plurality of reward values to a penalty term, and obtaining an optimal policy after performing a plurality of times of reinforcement learning on the industrial question-answering model using a reinforcement learning algorithm.

The invention relates to the field of re-recognition model processing, and discloses a re-recognition model training method and system based on a noise robust prompt learning framework, and the method comprises the steps: generating a global visual feature based on a pre-trained CLIP model, and calculating a context visual feature based on sample neighborhood information; a learnable mapping network is converted into a pseudo-language cue word to construct a self-adaptive cue, and the self-adaptive cue is integrated into a comprehensive text for embedding; through cross-attention module optimization prompting, generalized cross entropy loss and symmetric contrast loss are used to improve robustness to noise labels; through prompt-driven knowledge distillation, learned text embedding is used as a category vector to guide model optimization, and student model output is aligned with a teacher model; training the re-recognition model through identity loss, triple loss and knowledge distillation loss functions; according to the method, the problem that the performance of an existing pedestrian re-identification model is reduced under a noise label is solved, and the identification precision and robustness in a noise environment are improved.

The invention relates to the technical field of big language models, and discloses a big language model training method based on knowledge graph enhancement, comprising the following steps: S1, constructing a multi-source heterogeneous knowledge graph; s2, coding the mixed attention heterogeneity map; s3, bidirectionally mapping a pre-training task; and S4, position specific gating fusion. According to the big language model training method and system based on knowledge graph enhancement, a same proton graph is established for a structured triple and text entity description, nodes are connected across graph edges to form a heterogeneous graph, associated edges are established through entity linking and syntactic analysis, multi-source knowledge is modeled in a unified mode, and the problem of low fusion efficiency is solved; mixed attention coding adopts a layering mechanism, a semantic level calculates weights according to type compatibility, a node level calculates similarity aggregation features through cosine distance and path length, entity vectors are generated through pooling, map structures and semantics are explicitly learned, reasoning accuracy is improved, and the problem of knowledge understanding superficial layer is solved.

The invention belongs to the technical field of intelligent medical treatment, and particularly relates to a traditional Chinese medicine tongue diagnosis and prescription recommendation system based on multi-modal feature fusion. The system comprises a data preprocessing module used for preprocessing tongue picture image data and text data; the feature extraction module is used for extracting image features and text features from the preprocessed tongue picture image data and text data; the multi-modal feature fusion module is used for effectively fusing the extracted image features and text features by adopting a self-attention mechanism as a core fusion strategy to generate joint features; the multi-task learning module is used for completing parallel learning of a plurality of tasks on the basis of the representation of the joint features; and the model training and optimization module is used for designing a training method, a loss function and an optimization algorithm, so that the targets of disease name judgment, symptom judgment and prescription conditioning recommendation are completed after the multi-task neural network model processes the joint features.

The invention provides a private weight self-adaptive heterogeneous data federated cooperative training method and system in the technical field of federated learning and privacy computing, and the method comprises the steps: S1, enabling each client to carry out the differential privacy operation on a local data set based on a private weight, and obtaining a desensitized data set, encoding the desensitized data set through a heterogeneous data encoding model; s2, performing semantic alignment on each coding vector through a contrast learning model to obtain an aligned vector set; s3, training a local model through the alignment vector set, generating a local gradient, extracting local model parameters, and uploading the privacy weight, the local gradient and local difference parameters to a server; and S4, the server trains the global model based on the local difference parameter and the global gradient, extracts the global model parameter and issues the global model parameter to each client for training. The method has the advantages that the compatibility, the flexibility and the efficiency of heterogeneous data federation cooperative training are greatly improved.

The invention discloses a deep counterfeiting detection model training method, a deep counterfeiting detection method and a deep counterfeiting detection system, and relates to the technical field of artificial intelligence, and the method comprises the steps: obtaining a training data set containing a real image and a plurality of counterfeit images, and enabling the image to be provided with a label for representing the authenticity; in the training process, the deep forgery detection model can be in contact with various types of image samples, so that wider and more complex image features and forgery modes can be learned, a forgery reason is further marked for a forgery image, and the deep forgery detection model can be helped to deeply understand essential features of forgery content in the training process. Therefore, the problem of insufficient detection capability for well-designed and high-quality counterfeited contents can be solved, and the technical effect of improving the accuracy of counterfeited detection is achieved.

The invention discloses a semantic fingerprint adaptive training method for a teaching service robot, and relates to the technical field of education neural network real-time training. Comprising six steps of course version semantic fingerprint injection, real-time drift detection and bucket division positioning, small sample correction and high-level weight patching, hierarchical control incremental learning scheduling, shadow reasoning consistency optimization and learning asset registration and cycle verification and tracking. Measuring drifting in real time by using an information entropy self-adaptive window and multi-scale divergence, generating a lightweight weight patch by small sample contrast learning, and performing online loading; shadow channel parallel reasoning is combined with a grading heat exchange superior weight, four-dimensional learning asset tensor is written into a registry through double-clock witness and chain commitment, random sampling verification and singular value performance verification ensure that assets are consistent with robot online examples, and the comprehensive effects of source traceability, risk self-sensing, model self-repairing and compliance full-chain trace reserving are achieved.