Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

27966 results about "Training methods" patented technology

Multi-task joint perception network model and detection method for traffic road surface information

A multi-task joint perception network model and detection method for traffic road surface information can simultaneously detect a lane line and a drivable area. A coordinate attention mechanism is integrated into a traditional feature extraction network to ensure that a feature extraction effect is enhanced while a calculated amount is not increased. In a neck network, a dilated convolution residual module is proposed to enhance performance of prediction of details by the network, and a decoder part shares features of the drivable area into lane line detection to enhance a lane line detection effect under complex road conditions. In a training stage, there is provided a alternating optimization training method to improve integral segmentation performance of the model. The multi-task joint perception network model and detection method realizes quite high accuracy and excellent speed performance in a challenging BDD100K dataset.
Owner:JIANGSU UNIV

Robot agent reinforcement learning training method and system in complex scene

The invention discloses a robot agent reinforcement learning training method in a complex scene, and the method comprises the steps: constructing a reinforcement learning algorithm environment and a state transition model which comprise a barrier, a dynamic target, environment constraints and other complex scenes and are suitable for a multi-agent system; an independent neural network is constructed for each robot agent by adopting a reinforcement learning algorithm; taking vectors of a given state, time sequence information and historical state information of the intelligent agent as input of the state transition model, and outputting a state transition probability and reward information of a prediction state; the action strategy and the action value output by the neural network are executed in the state transition model, and a new prediction state and reward information are generated; through adjusting hyper-parameters of the neural network, a large-scale distributed training architecture is used to carry out cooperative training on the decision network and the evaluation network, parallel learning and cooperative decision of multiple agents are realized, and performance and generalization ability of the agents in a complex scene are improved.
Owner:XIAMEN YUANTING INFORMATION TECH CO LTD

Intelligent rehabilitation training method and system based on artificial intelligence and virtual reality

The invention provides an intelligent rehabilitation training method and system based on artificial intelligence and virtual reality, a user wears an intelligent wearable device to collect multi-modal data such as electroencephalogram, myoelectricity, physiological features and motion signals, the multi-modal data is preprocessed and then input into an artificial intelligence training model, and key features are extracted and fused by using a graph convolutional network and an attention mechanism algorithm. And constructing a digital twinborn model by using the fusion features, performing real-time dynamic mapping and predictive simulation, and generating a customized training scheme by means of a reinforcement learning algorithm in combination with a rehabilitation target and a physical state of the user. A user is trained in the virtual reality interaction model, the system monitors actions and physiological states in real time, the digital twin model synchronously acts, and the scene is dynamically adjusted. After training, the rehabilitation effect is evaluated according to the physiological indexes, the motion data and the twinning optimization analysis result, and an optimization training scheme and a digital twinning model are fed back. Precision, individuation and intelligentization of rehabilitation training are achieved, and the training effect and quality are improved.
Owner:TONGJI HOSPITAL ATTACHED TO TONGJI MEDICAL COLLEGE HUAZHONG SCI TECH

Network traffic anomaly detection model training method and device and readable storage medium

The invention provides a network traffic anomaly detection model training method and device and a readable storage medium, and the method comprises the steps: extracting a traffic statistical feature vector according to original network traffic data, and generating an initial mixed data set; generating a confrontation disturbance sample output enhanced feature matrix based on the initial mixed data set; constructing a self-adaptive feature fusion rule based on the enhanced feature matrix, embedding asset association degree parameters into an attention calculation layer of a feature encoder, and outputting encoding features fusing threat intelligence; inputting the coding features fused with the threat intelligence into a pre-constructed initial detection model, generating false report and missing report correction labels based on the suspicious traffic fragments, and outputting an adversarial sample correction data set; and performing adversarial training on the initial detection model through the adversarial sample correction data set to obtain an incremental detection model for network traffic anomaly detection. According to the invention, the detection precision, the anti-interference capability and the real-time defense response capability of the detection model to novel attacks can be improved.
Owner:CHINA UNITED NETWORK COMM GRP CO LTD

Deep learning-based tiny target defect identification model training method

The invention discloses a deep learning-based small target defect recognition model training method, relates to the technical field of defect recognition model training, and aims at meeting small defect detection requirements, starting with high-resolution diversified data construction and accurate labeling, highlighting weak targets through multi-scale feature fusion and spatial attention, and realizing high-resolution target defect recognition. A hard case scene is processed in cooperation with layer-by-layer screening and secondary intensified training, real-time iterative optimization is achieved through multi-model fusion and online dynamic adjustment and optimization, finally, multi-mode and time sequence dimensions are expanded to capture deeper and dynamic defect information, the missing detection and false detection rate is greatly reduced, and the detection efficiency is improved. The detection efficiency and adaptability of micron-sized defects under a complex process background are improved; furthermore, by means of multi-source data such as infrared, X-ray or 3D morphology and a time sequence modeling means, multiple dimensions are fused, and hidden or early cracks are brought into a detection and prediction range, so that a high-reliability and evolvable intelligent recognition system for the tiny target defects is constructed.
Owner:TONGJI UNIV

Training method and system of diffusion plate defect detection model and medium

The invention relates to the technical field of image recognition, in particular to a diffusion plate defect detection model training method and system and a medium. The method comprises the following steps: acquiring a diffusion plate monitoring image, and performing surface defect feature extraction to obtain surface defect data; performing defect type analysis based on the surface defect data to obtain defect type data; performing spectral parameter setting according to the defect type data, and performing transmissivity difference analysis on the diffusion plate monitoring image through the set spectral parameters to generate a transmission characteristic spectrum; positioning an internal defect area of the diffusion plate monitoring image based on the transmission characteristic spectrum to obtain coordinates of the internal defect area; and performing three-dimensional defect morphology analysis on the internal defect area based on the internal defect area coordinates to generate internal defect data. By combining surface and internal defect analysis, defect coupling relation, risk assessment and region segmentation, the detection comprehensiveness and accuracy of the defect detection model are improved.
Owner:SHENZHEN CHENGYUXING PHOTOELECTRICITY CO LTD

Multimodal large language model training method, correlation calculation method, and label generation method

The present disclosure relates to the technical field of artificial intelligence, and provides a multimodal large language model training method, a correlation calculation method, and a label generation method. The multimodal large language model training method comprises: on the basis of a sample text feature vector, a sample image feature vector, and a sample first multimodal feature vector which are obtained by processing image information and text description information of a sample commodity by a pre-trained multimodal large language model, training the pre-trained multimodal large language model to obtain a multimodal large language model; and processing a sample search word, the image information and the text description information on the basis of the multimodal large language model to obtain a sample search word feature vector, a first multimodal feature vector and a sample second multimodal feature vector, and training the multimodal large language model to obtain a trained multimodal large language model. The trained multimodal large language model of the present disclosure can simultaneously learn image features related to the search word and the text description information, and thus the generated second multimodal feature vector is more accurate.
Owner:HANGZHOU ALIBABA INT INTERNET IND CO LTD

Model training method and device, equipment, storage medium and product

The invention relates to a model training method and device, equipment, a storage medium and a product. The method comprises the following steps: constructing a training data set according to a target text reasoning chain obtained by converting multi-modal data; according to the training data set, performing supervision fine tuning on the pre-trained multi-modal large language model to obtain a basic reasoning model; performing optimization processing on the basic reasoning model according to reinforcement learning training of long thinking to obtain a target reasoning model; the target reasoning model is used for outputting a target answer containing a reasoning process according to the input multi-modal data. Therefore, the long text constraint can be directly used for reinforcement learning, and the training efficiency is greatly improved; and by adopting long-thinking reinforcement learning training, the model can easily learn a correct thinking process in training, so that the reasoning ability of the multi-modal large language model for processing a complex visual reasoning task is improved, and the correct thinking process is displayed in the reasoning process.
Owner:SHUXING TECH (BEIJING) CO LTD

Ligand information generation model training method and device and ligand information generation method and device

The invention discloses a ligand information generation model training method and device and a ligand information generation method and device, and belongs to the technical field of artificial intelligence. The method comprises the following steps: acquiring sample receptor information and sample ligand information, wherein the binding affinity between a ligand described by the sample ligand information and a receptor described by the sample receptor information is not less than a set affinity; denoising the reference noise data based on the sample receptor information through a to-be-trained neural network model to obtain predicted ligand information; determining a first loss for characterizing a difference between the sample ligand information and the predicted ligand information; and training the neural network model based on the first loss to obtain a ligand information generation model. The reference ligand information can be generated based on the reference receptor information through the ligand information generation model, and the binding affinity between the ligand described by the reference ligand information and the receptor described by the reference receptor information is high.
Owner:TENCENT TECHNOLOGY (SHENZHEN) CO LTD

Transform large model training method based on cloud edge collaboration

The invention discloses a Transform large model training method based on cloud edge collaboration. The method comprises the following steps: S1, constructing a data set; s2, preprocessing the data set; s3, segmenting the preprocessed data set by using a data parallelism strategy, and performing distributed training by combining data parallelism and model parallelism technologies; s4, monitoring computing resources and network conditions of the edge equipment and the cloud server in real time, dynamically adjusting a data distribution strategy, and optimizing computing load distribution; s5, a multi-agent dominant actor-commentator algorithm is combined with a multi-arm tiger machine strategy, and the layered structure of the Transform model is adjusted in real time; s6, performing partial model reasoning tasks on the edge equipment in combination with the edge reasoning capability; s7, protecting data privacy by adopting a federal learning strategy and utilizing a differential privacy technology; and S8, performing hardware acceleration by utilizing heterogeneous computing resources. According to the method, a cloud edge cooperative computing and intelligent scheduling method is adopted, and large model training and reasoning with efficient privacy protection are realized.
Owner:SHENHUA HOLLYSYS INFORMATION TECH CO LTD

Quantitative training method and system for deep neural network

The invention discloses a quantitative training method and system for a deep neural network, and the method comprises the steps: obtaining an original neural network model and a verification data set, and generating a quantitative priority through hierarchical sensitivity evaluation and topology analysis; on the basis of the layer sensitivity matrix, differentiated quantization parameters are configured for each layer, and quantization constraints are established; constructing an error compensation mechanism, and generating an error compensation strategy; executing dual-scale adaptive quantization training, and respectively adopting an independently optimized quantization strategy for forward propagation and back propagation; dynamically adjusting quantization parameters according to the training state and the resource constraint; and evaluating model performance and resource efficiency. According to the method, through multi-dimensional sensitivity evaluation, a dynamic quantification strategy and system error compensation, the precision and efficiency of quantification training are improved, and meanwhile it is guaranteed that deployment resource constraints are met.
Owner:NANJING ARTIFICIAL INTELLIGENCE CHIPS RES INST OF AUTOMATION CHINESE ACAD OF SCI +1

Dialogue content generation method, model training method, device, and storage medium

Provided in the embodiments of the present disclosure are a dialogue content generation method, a model training method, a prompt text generation method, a device and a storage medium. The dialogue content generation method comprises: receiving an input question; determining whether the question needs to be answered in combination with external knowledge; if the question needs to be answered in combination with external knowledge, acquiring target knowledge from a preset knowledge base on the basis of the question, generating prompt text corresponding to the target knowledge, inputting into a dialogue content generation model the question, the target knowledge and the prompt text corresponding to the target knowledge, and generating dialogue content by means of the dialogue content generation model, wherein the prompt text is used for prompting the dialogue content generation model to answer the question with reference to the target knowledge; and if the question does not need to be answered in combination with external knowledge, inputting the question into the dialogue content generation model, and generating dialogue content by means of the dialogue content generation model, wherein the dialogue content generation model is obtained by means of performing fine tuning on a pre-trained language model.
Owner:RAJAX NETWORK &TECHNOLOGY (SHANGHAI) CO LTD +1

Multi-modal agent RAG-ReAct double-engine cooperative training method

The invention relates to the technical field of artificial intelligence, in particular to a multi-mode agent RAG-ReAct double-engine cooperative training method. The method comprises the following steps: acquiring multi-modal data, and converting the multi-modal data into a high-dimensional vector; constructing a knowledge graph based on the high-dimensional vector; encoding the semantic relationship of the knowledge graph into a model fine adjustment gradient direction by using a dynamic distillation technology; designing a distributed architecture based on the high-dimensional vector; performing hybrid retrieval based on a distributed architecture to obtain hybrid retrieval data; executing distributed reasoning based on a preset recursive reflection mechanism and the mixed retrieval data to generate distributed reasoning data; performing data parallel detection according to the distributed reasoning data to obtain data parallel parameters; and performing node resource scheduling based on the data parallel parameters so as to obtain node load balancing data. Based on the artificial intelligence technology, the reasoning accuracy and the resource utilization rate of the multi-modal agent in a complex task environment are effectively improved.
Owner:BEIJING ZHONGSHURUIZHI TECH CO LTD

System and method for training a physics informed neural network with reynolds averaged navier stokes formulation of turbulent flows

PCT designated stage expiredWO2024238788A1Design optimisation/simulationNeural learning methodsTraining phaseNavier stokes
Physics informed neural networks (PINNs) can exploit automatic differentiation and incorporate the underlying PDEs to approximate a solution field. PINNs combine differential equations, such as compressible and incompressible Navier-Stokes equations, with experimental data or high-fidelity numerical simulations. Conventional approaches to training PINNs involve introducing data and PDE losses simultaneously at the start of the training phase, often with equal weight multipliers. It is recognized herein, however, that such training approaches often result in noisy training losses, slow convergence, and high validation error.
Owner:SIEMENS AG +1

Question and answer task processing model training method and device, equipment and storage medium

The invention relates to the technical field of natural language processing, and discloses a question and answer task processing model training method, device and equipment and a storage medium, and the method comprises the steps: adjusting a question and answer task processing model according to an initial training data set and a first model training algorithm, and obtaining a first intermediate question and answer task processing model; according to the initial training data set and the first intermediate question and answer task processing model, obtaining a first reasoning step and first annotation information for processing the question and answer task, and generating a first target training data set; according to the initial training data set and a second model training algorithm, adjusting a question and answer task processing model to obtain a second intermediate question and answer task processing model; and adjusting the second intermediate question and answer task processing model according to the first target training data set to obtain a target model. The problems that when the model for processing the question and answer task is trained, the accuracy of the model is affected by the quality of the manually-labeled data due to the dependence on the manually-labeled data, and the training process is high in cost and low in efficiency are solved.
Owner:INSPUR SUZHOU INTELLIGENT TECH CO LTD

Text image generation method and diffusion generative model training method

Provided in the embodiments of the present disclosure are a text image generation method and a diffusion generative model training method. The text image generation method comprises: acquiring an initial image; inputting the initial image into a conditional encoder, so as to obtain an image feature of the initial image; inputting the initial image and the image feature into a diffusion generative model, so as to obtain noise data corresponding to the initial image, wherein the diffusion generative model is obtained by means of performing training on the basis of a sample text image, a sample image feature of the sample text image and a noise sample image, the noise sample image is obtained by means of adding sample noise to the sample text image, and the sample image feature comprises at least one of a sample visual feature and a sample semantic feature; and according to the initial image and the noise data, generating a target text image corresponding to the initial image.
Owner:ALIBABA INNOVATION PRIVATE LIMITED

Hybrid expert network training method, device, equipment and computer program product

The invention discloses a hybrid expert network training method, device and equipment and a computer program product, experts in a hybrid expert layer are equally divided into a plurality of groups and equally distributed to a plurality of pieces of equipment, and different pieces of equipment share the same routing module. In the training process, for an input hidden layer sequence of the mixed expert layer, the score of each path of experts is calculated through a routing module, for each expert group, activation experts in the group are selected according to the scores of the experts in the group, the number of the activation experts in different groups is the same, and each expert group processes the complete hidden layer sequence. And processing the input hidden layer sequence by the activation experts in each expert group to obtain the output of the activation experts, and obtaining the output of the hybrid expert layer based on the output of each activation expert. According to the method and the device, absolute balance of calculation among the devices is ensured, and the effect of the model is not influenced by drop-pad (namely data discarding and 0 filling).
Owner:IFLYTEK CO LTD

Operation control model training method and robot operation control method and system

The invention provides an operation control model training method and a robot operation control method and system, and the method comprises the steps: carrying out the reinforcement learning training of an initial strategy network according to the first sample state information of a simulation robot and a reward function corresponding to each action task, and obtaining a target strategy network corresponding to each action task; according to second sample state information of the simulation robot, a task label corresponding to a preset training task and expected action information corresponding to the second sample state information output by a target strategy network corresponding to each action task, carrying out joint training of transfer learning, reinforcement learning training and imitation learning on the initial operation control model; and constructing an operation control model according to the trained initial operation control model. Through joint training of multiple training tasks, smooth switching among different action tasks of the robot can be ensured while multi-task compatible processing of the robot can be realized, and the operation control performance of the robot is effectively improved.
Owner:IFLYTEK CO LTD

Model pre-training method and device for multi-language task

The invention provides a model pre-training method and device for a multi-language task, and relates to the technical field of artificial intelligence, and the method comprises the steps: obtaining a multi-modal training data set which comprises a plurality of pieces of sample text data and a plurality of pieces of sample image-text pair data with multi-language contents, and covers a universal field and a preset business field; based on a plurality of sample image-text pair data, performing comparative learning training of alignment of visual features and text features on the initial model, freezing model parameters of a decoding module and adjusting model parameters of a visual encoder and a projection module in the training process until a first ending condition is met; based on the multiple pieces of sample image-text pair data and the multiple pieces of sample text data, constraint training of content understanding is carried out on the initial model meeting a first ending condition, and model parameters of a visual encoder, a projection module and a decoding module are adjusted in the training process until a second ending condition is met to obtain a target model; the information extraction capability of the model in the specific field can be remarkably improved.
Owner:LIANLIAN YINTONG ELECTRONIC PAYMENT CO LTD +1

Industrial question answering model training method based on reinforcement learning and knowledge base matching

Disclosed is an industrial question answering model training method based on reinforcement learning and knowledge base matching, comprising the following steps: S1, collecting professional knowledge questions and answers in an industrial field to construct an industrial knowledge base, training a reward model, carrying out, for industrial knowledge questions and answers, matching comparison on outputs of an industrial question answering model and content of the industrial knowledge base, and obtaining reward values on the basis of similarities; S2, sorting the reward values, and using a sorting loss function to train and update parameters of a reward model network; and S3, carrying out industrial question answering model training, incorporating a penalty term for the reward values, and using a reinforcement learning algorithm to train the industrial question answering model multiple times to obtain an optimal strategy. According to the industrial question answering model training method based on reinforcement learning and knowledge base matching of the present invention, the reinforcement learning algorithm is used, and iterative training is carried out multiple times, thereby helping the industrial question answering model to learn and understand industrial professional knowledge and improving the question answering accuracy of the industrial question answering model.
Owner:NANJING UNIV OF SCI & TECH

Retrieval model training method and apparatus and computer device

The present application relates to a retrieval model training method and apparatus and a computer device. The method comprises: acquiring a knowledge document, and performing text segmentation processing on the knowledge document to obtain a text block set (501); on the basis of the text block set and summary information comprised in each text block, writing a question for each text block to obtain one or more question texts corresponding to each text block, separately combining the one or more question texts corresponding to each text block with the corresponding text block to obtain one or more data pairs corresponding to each text block and, on the basis of the one or more data pairs corresponding to each text block, generating a data pair set (502); and using the data pair set to train a first retrieval model so as to obtain a second retrieval model (503).
Owner:TENCENT TECHNOLOGY (SHENZHEN) CO LTD

Training method and apparatus for image processing model, electronic device, computer program product, and computer storage medium

This application provides a training method and apparatus for an image processing model, an electronic device, and a storage medium. The method includes: obtaining a plurality of multimodal images used as training samples, types of the multimodal images including full-modality images and missing-modality images; invoking, based on each of the multimodal images, an initialized image processing model to execute a first training task for reconstructing the full-modality image, the image processing model outputting a first full-modality reconstructed image in a process of executing the first training task; performing image completion processing on each of first full-modality reconstructed images based on the full-modality image, to obtain a full-modality template image; determining a consistency loss between a multimodal image pair and the full-modality template image; and invoking, based on each of the multimodal images, a trained image processing model to execute a second training task for segmenting each of the multimodal images, and using the consistency loss as a constraint condition in the second training task.
Owner:TENCENT TECHNOLOGY (SHENZHEN) CO LTD

Model training method and device, electronic equipment and storage medium

The invention discloses a model training method and device, electronic equipment and a computer storage medium. The model training method comprises the following steps: performing supervision fine tuning on an initial baseline model based on a first training sample set in a preset training sample set to obtain a supervision fine tuning model and a preference data sample; performing optimization training on the initial reward model based on the preference data sample to obtain a target reward model, and performing optimization training on the supervision fine tuning model based on the preference data sample to obtain a preference optimization model; generating a first reward signal based on the preference optimization model and the first training sample set, and generating a second reward signal based on the preference optimization model, the target reward model and a second training sample set in the preset training sample set; and performing optimization training on the preference optimization model based on the first reward signal, the second reward signal and the second training sample set to obtain a target object generation type pre-training model. By adopting the method, the generalization ability of the model can be improved.
Owner:RAJAX NETWORK &TECHNOLOGY (SHANGHAI) CO LTD

Vertical large language model training method and system in carbon neutralization field

The invention discloses a vertical large language model training method and system in the carbon neutralization field, and the method comprises the following steps: collecting data of the carbon neutralization field, carrying out the data preprocessing, constructing a carbon neutralization field knowledge base, and updating the carbon neutralization field knowledge base through a dynamic updating mechanism; performing dynamic semantic partitioning and vectorization coding on the text of the carbon neutralization domain knowledge base, and storing the text into a vector database; performing staged fine tuning on the pre-trained large language model based on a low-rank adaptation technology, wherein the fine tuning comprises general instruction fine tuning and carbon neutralization field professional fine tuning; a retrieval enhancement generation mechanism is adopted, knowledge fragments related to user query are retrieved through a vector database, and a large language model is input to generate answers. Compared with the prior art, the method has the advantages that the answer reliability is improved through conflict detection and source tracing, so that the large language model can more accurately adapt to knowledge requirements in the carbon neutralization field.
Owner:SUN YAT SEN UNIV

Training method and system for generating 5D digital human based on AIGC and medium

The invention relates to the technical field of data processing, and discloses a training method and system for generating a 5D digital human based on AIGC, and a medium. The method comprises the following steps: preprocessing real person feature data to obtain multi-dimensional preprocessed data; performing multi-level processing on the multi-dimensional preprocessing data to obtain 5D digital human generation data; performing cross-modal coordination processing on the 5D digital human generation data through a progressive multi-task learning algorithm to obtain to-be-processed digital human data; performing dynamic knowledge integration processing on the to-be-processed digital human data to obtain adaptive digital human data; carrying out personalized fine tuning and style migration processing on the adaptive digital human data to obtain target digital human data; and performing real-time rendering and intelligent interaction processing on the target digital human data to obtain target 5D digital human data, and generating a digital human training scheme according to the target 5D digital human data. According to the method and the device, the training efficiency and accuracy of generating the 5D digital human based on the AIGC are improved.
Owner:中影年年(北京)科技有限公司

Machine learning model training method, service data processing method, apparatus, and system

A machine learning model training method, a service data processing method, and an apparatus are provided, which are applied to the artificial intelligence field. In a training phase, a cloud server sends a machine learning submodel to an edge server. The edge server performs federated learning with client devices in a management domain of the edge server based on the obtained machine learning submodel, to obtain a trained machine learning submodel, and sends the trained machine learning submodel to the cloud server. The cloud server fuses obtained different trained machine learning submodels, to obtain a machine learning model. According to this application, training efficiency of the machine learning model can be improved. In an inference phase, the client device processes service data by using the trained machine learning submodel. According to this application, prediction efficiency of the machine learning model can be improved.
Owner:HUAWEI TECH CO LTD

Machine vision model training method and system based on end side computing power

The invention discloses a machine vision model training method and system based on end-side computing power, and belongs to the technical field of machine learning, edge computing and computer vision, and the method comprises the steps: obtaining a machine vision image and constructing a pre-annotation model, so as to carry out the automatic pre-annotation of the image; manually correcting the partial pre-annotation to optimize the pre-annotation model, and obtaining a corrected annotation image; a machine vision model is constructed and is subjected to identification training based on an annotated image, training task variables can be distributed according to hardware perception, then a training task execution position (an edge end or a cloud end) is dynamically selected, and the trained machine vision model is deployed at the edge end so as to carry out an image identification reasoning process; and performing manual spot check on the reasoning result of the model to evaluate the accuracy rate of the machine vision model, starting a new round of model training when the accuracy rate is low, and taking the evaluated machine vision model as the pre-labeling model.
Owner:SANSHENG ZHILIAN TECHNOLOGY (HANGZHOU) CO LTD

Target multi-modal model system and construction method, video processing model training method, and video processing method

Embodiments of the present invention provide a target multi-modal model system and construction method, a video processing model training method, and a video processing method. The video processing model training method comprises: inputting a video sample and each initial text sample into a video processing model, wherein the initial text sample is a text for performing category description on video content of the video sample; using the video processing model to perform feature extraction on the video sample to obtain a temporal motion feature and a fused image feature; using the video processing model to perform feature extraction on the initial text sample to obtain a dynamic text feature and a fused text feature; and training the video processing model on the basis of the temporal motion feature and the dynamic text feature, and the fused image feature and the fused text feature.
Owner:CLOUD INTELLIGENCE ASSETS HOLDING (SINGAPORE) PTE LTD

Slope protection intelligent detection system based on deep learning

The invention relates to the technical field of slope protection, in particular to a slope protection intelligent detection system based on deep learning. According to the technical scheme, the system comprises a multi-source heterogeneous data sensing module, a data fusion and feature extraction module, a slope state intelligent diagnosis and early warning module, an edge-cloud collaborative computing architecture and a system optimization module. Registration and feature complementation of multi-source heterogeneous data are realized through a multi-modal detection network, an overfitting phenomenon is effectively inhibited through a physical information neural network architecture, risk quantitative evaluation is realized through construction of a dynamic risk evaluation model, early warning response time is shortened in cooperation with a four-level early warning strategy, the false alarm rate is reduced, and the early warning efficiency is improved. Besides, the detection precision of the system in an extreme scene is improved through a physical constraint adversarial training method, so that the environmental adaptability of the system is improved, continuous updating and evolution of the model are realized through an online incremental learning module, and the problem of performance degradation of a traditional system caused by change of geological conditions is solved.
Owner:ANHUI WATER CONSERVANCY DEV CO LTD

Robot reinforcement learning control method and system based on gating circulation unit

The invention discloses a robot reinforcement learning control method and system based on a gating circulation unit, and relates to the technical field of artificial intelligence. Based on a reinforcement learning state machine, a trained student network is deployed to a real quadruped robot in a zero mapping manner, and movement control of the quadruped robot is realized; the training process of the student network is as follows: building a simulation training terrain environment of the robot, and setting different levels of terrain difficulty for each terrain; based on the distillation learning thought, establishing a teacher network and a student network based on a gating circulation unit, constructing a total loss function, and based on the constructed total loss function, fitting a motor joint angle output by the teacher network through an omnibearing simulation training terrain environment, a large-scale parallel training method and the student network; according to the robot reinforcement learning control method and system, robust motion of the robot in an unstructured terrain is realized, and the robot reinforcement learning control method and system have good anti-interference capability and self-recovery capability for a dynamic environment in which traditional control cannot be competent.
Owner:UNIV OF SCI & TECH OF CHINA