10462 results about "Training data sets" patented technology

In embodiments, systems and methods for improving machine-learning systems are disclosed. In embodiments, a system includes a data pool system that is configured to receive data from a plurality of different data sources and maintain a training data set that is used to train a specific machine-learning model based on the data from the plurality of different data sources. In embodiments, the system further includes a data scoring system that determines a data reliability score corresponding to the new data based on a set of intrinsic features of the new data and a data scoring model, wherein the data pool system selectively adds the new data to the training data set based on the reliability score of the new data. The system also includes a machine learning system that trains the specific machine-learning model based on the training data set.

An example method can include providing a natural language instruction and user interface image data to a machine-learned sequence processing model that is configured to process image data and generate commands for controlling the target computing device, wherein the machine-learned sequence processing model has parameters learned using an interface recognition objective based on an evaluation of an interface recognition output generated based on processing a rendered training interface from a pre-training dataset and an interface navigation objective based on an evaluation of a user interface command generated based on processing a rendered training interface from a fine-tuning dataset; receiving, from the machine-learned sequence processing model, a command indicating an interaction with the user interface to implement the natural language instruction; and generating, based on the command, a control signal configured to initiate the interaction.

The invention relates to a model training method and device, equipment, a storage medium and a product. The method comprises the following steps: constructing a training data set according to a target text reasoning chain obtained by converting multi-modal data; according to the training data set, performing supervision fine tuning on the pre-trained multi-modal large language model to obtain a basic reasoning model; performing optimization processing on the basic reasoning model according to reinforcement learning training of long thinking to obtain a target reasoning model; the target reasoning model is used for outputting a target answer containing a reasoning process according to the input multi-modal data. Therefore, the long text constraint can be directly used for reinforcement learning, and the training efficiency is greatly improved; and by adopting long-thinking reinforcement learning training, the model can easily learn a correct thinking process in training, so that the reasoning ability of the multi-modal large language model for processing a complex visual reasoning task is improved, and the correct thinking process is displayed in the reasoning process.

The invention relates to the technical field of structural health monitoring and intelligent diagnosis, in particular to a structural fatigue damage identification method based on acoustic emission and deep learning, and the method comprises the steps: collecting a structural response signal under a fatigue load through an acoustic emission sensor array, inputting the structural response signal to a CNN-BiLSTM-Attention mixed deep learning model, and carrying out the recognition of the structural fatigue damage through the CNN-BiLSTM-Attention mixed deep learning model; the model extracts local time domain features through a dynamic adaptive convolution kernel, captures long time sequence dependence by using a bidirectional long-short-term memory network, focuses key damage features through a bimodal space-time attention mechanism, divides damage stages based on a nonlinear dynamic threshold algorithm of fracture opening amount, constructs a training data set of physical-data fusion, and performs dynamic time domain feature extraction. The learning rate is optimized by adopting a gradient sensitive cosine annealing algorithm, and the robustness of the model is improved in combination with an anti-noise and anti-loss function. The method integrates physical characteristics and an intelligent algorithm, and has the advantages of adaptive noise suppression, strong cross-domain generalization ability, high real-time performance and the like.

The invention provides a road bridge crack detection method and system, and the method comprises the steps: collecting a bridge surface multi-view image, and constructing a training data set containing crack feature labeling through quality screening and standardized labeling; preprocessing the image by using a multi-scale feature fused deep convolutional neural network and carrying out semantic segmentation, initially identifying a suspected crack region and generating a segmentation mask; and constructing a BeNNS proxy model based on the mask, and establishing a mapping relationship between the detection result and the bridge structure topology, the stress flow field and the service function chain so as to evaluate the result reliability. And inputting an evaluation result into a hybrid evaluation mechanism, performing online real-time detection and offline batch verification to optimize precision, and outputting a verified crack region. Finally, morphological analysis is conducted on the area, geometric parameters and danger levels of cracks are extracted and integrated to a bridge health monitoring system, a crack evolution tracking algorithm and an early warning mechanism are established, and dynamic tracking early warning is achieved. The problem of low detection precision in a complex environment can be solved.

The invention provides a storage battery pack performance evaluation method and system based on big data, and relates to the technical field of storage battery performance evaluation, and the method comprises the steps: obtaining the charging and discharging data of a to-be-evaluated storage battery under different working conditions, carrying out the denoising processing of the charging and discharging data, carrying out the adaptive normalization processing, and obtaining the standard charging and discharging data, equalization processing is carried out, time domain features and frequency domain features are extracted respectively, and high-dimensional feature vectors are obtained through combination; performing dimension reduction operation on the high-dimensional feature vector to obtain low-dimensional embedded representation, generating an initial data set, dividing the initial data set into a training data set and a test data set, constructing an initial prediction model and performing hyper-parameter optimization to obtain a first prediction model; and acquiring real-time charging and discharging data, constructing a real-time feature vector, adding the real-time feature vector into the first prediction model to generate a real-time performance parameter, filtering the real-time performance parameter, constructing a health state prediction model for prediction, and obtaining a comprehensive performance evaluation result.

The invention discloses a super-resolution image reconstruction method, system and device based on dynamic frequency domain adaptive coding and contrast constraint optimization, and a medium. The method comprises the following steps: creating an original training data set; image data features and application scenes are considered, and feature extraction is performed on image data by adopting a modular design method; in combination with discrete cosine transform and inverse transform thereof, adaptive transform coding is carried out on different frequency components in the image features through a dynamic weight adjustment mechanism; the U-Net and Transform architectures are combined, isotropic design is optimized, a diffusion model and a feature fusion and reconstruction technology are applied, and diffusion process reconstruction is achieved; by introducing a contrast loss function, contrast learning is carried out between images with different resolutions, and the feature learning ability is enhanced. The image reconstruction method is more intelligent and efficient, and can effectively deal with frequency feature recovery and detail reconstruction problems in a complex image scene.

The invention discloses a knowledge graph analysis and question answering method and device based on a large language model. The method comprises the steps of obtaining original data, performing data processing based on a large language model to obtain target data, constructing a knowledge graph according to the target data, and storing the knowledge graph into a graph database; acquiring an open source data set, and processing the open source data set by using the large language model to obtain a training data set; according to the graph database, constructing a dictionary which is used for reflecting a graph structure of the graph database; utilizing the training data set, the dictionary and a preset prompt instruction to finely adjust the large language model to obtain an optimized large model; generating a query statement by utilizing the graph database and the optimization large model according to a query problem of a user, and determining a query result in the graph database according to the query statement; and based on the optimization large model, carrying out integration processing on the query question and the query result to obtain a final answer. According to the method, the construction process of the knowledge graph is simplified, and the accuracy of analysis and question answering is improved.

The invention relates to a metro field large language model evaluation method and system. The method comprises the following steps: step 1, constructing a data set; the step 1 comprises the following steps of: 1.1, collecting public professional data; step 1.2, collecting internal professional data; 1.3, collecting a general data set; 2, data processing; in the step 2, the following steps are executed: step 2.1, data formatting; step 2.2, data cleaning is carried out; step 2.3, performing data enhancement; 3, fine adjustment of the model; in the step 3, the following steps are executed: step 3.1: constructing a training data set; step 3.2, fine adjustment of the model; step 3.3, carrying out model evaluation; 4, constructing an evaluation system; in the step 4, the following steps are executed: step 4.1, determining evaluation indexes; step 4.2, constructing an evaluation system; step 4.3, constructing an intelligent agent; step 4.4, multi-agent cooperation is carried out; and 5, performing model evaluation.

The present application discloses a cloud resource prediction method and system based on a GC-LSTM neural network model, an electronic device, and a readable storage medium. The method comprises two stages: a training stage and a prediction stage. In the training stage, historical data of cloud resources is collected and normalized to obtain a training data set, input data and labels used for training a neural network are organized and made, and an established GC-LSTM neural network model is trained. In the prediction stage, by means of acquired real-time sampling data, the trained model is loaded to perform result prediction, and, on the basis of a prediction result, resources may be scheduled and distributed to respond in advance. The present application aims to predict customers' demands for resources in advance and optimize customers' cloud experience. The model provided by the present application is simple and has few parameters, can guarantee the real-time performance of the prediction result, is practical and feasible, is suitable for the prediction of cloud resource utilization, and provides a guarantee for instant scheduling of resources.

The invention discloses a long-tail image recognition method based on multi-modal semantic generation and image-text fusion. The method comprises the following steps: extracting structured semantic description from a tail image; carrying out semantic rewriting and enhancement based on a multi-modal visual language model, and generating an image semantic extension description; the image semantic extension description is optimized based on semantic duplicate judgment and a style alignment mechanism, and an optimized text description set is obtained; inputting the optimized text description set into a text graph model, generating a tail class image sample, performing semantic and visual quality screening, and constructing to obtain an enhanced image set for training; constructing a training data set based on the original long-tail data set and the enhanced image set, and training an image-text fusion classification model; and inputting a to-be-identified image into the trained image-text fusion classification model, and outputting classification results of all categories. According to the method, the discrimination capability in a long-tail distribution scene is enhanced, and the method has a stronger generalization characteristic.

The invention discloses an image semi-supervised semantic segmentation method and system based on pixel-level correction, and relates to the technical field of computer vision and semantic segmentation, and the method comprises the steps: constructing a training data set which comprises a labeled image and an unlabeled image, and the labeled image is an image labeled with a pixel-level label; carrying out random diversity image enhancement to obtain a weakly-enhanced labeled image, a weakly-enhanced unlabeled image and a strongly-enhanced unlabeled image; constructing a teacher-student model; training a teacher-student model by using the training data set, constructing a total loss function based on a supervised loss function, a cross-image unsupervised loss function and an agent-related loss function, and optimizing and updating network parameters of the teacher-student model through the total loss function until the total loss function is minimized, so as to obtain the teacher-student model. Obtaining a trained teacher-student model; and inputting a to-be-segmented scene image into the trained student model, and obtaining and outputting a more accurate image semantic segmentation result.

The invention provides a service prediction method and device based on a time sequence model, equipment and a storage medium, and the method comprises the steps: carrying out the preprocessing of historical time sequence data, and obtaining a training data set; performing fast Fourier transform on the training data set to obtain frequency domain data and frequency component intensity; extracting a plurality of main frequency components and corresponding period values from the frequency domain data, and determining a plurality of two-dimensional feature tensors according to the period values and the training data set; constructing L layers of time blocks including feature mapping, an attention mechanism and a feedforward network according to the two-dimensional feature tensor, and establishing residual connection between adjacent time blocks to obtain a time sequence model to be trained; performing feature extraction on each two-dimensional feature tensor by applying a multi-branch convolutional network to obtain a one-dimensional representation vector, and performing weighted fusion on the one-dimensional representation vector according to the frequency component intensity to obtain a fusion feature; and training the to-be-trained time sequence model through the fusion features, and outputting an analysis report of historical time sequence data.

The invention discloses an improved YOLOv11-based high-reflection and high-transmittance material surface defect detection method, which comprises the following steps: S1, acquiring a mobile phone screen surface defect image, preprocessing and labeling, and generating a training data set containing three defects of scratches, edge breakage and cracks; s2, constructing a defect detection model; s3, averagely dividing an input image into four independent detection regions, adopting a bounding box overlapping area weight distribution strategy for cross-region defects, and performing partition counting on the image by using a defect detection model; s4, constructing a surface defect detection network meeting the real-time requirement of the industrial production line, and outputting a detection result and a processing frame rate; s5, pixel-level mask segmentation is carried out on the scratch defect, and contour coordinates and geometric features are extracted; and S6, fitting the actual damage size of the scratch defect on the surface of the high-reflection and high-transmittance material according to the segmentation result. According to the method, the detection speed is high under the condition that the accuracy is ensured, and a reliable solution is provided for surface flaw detection of the high-reflection and high-transmittance material.

The invention discloses a power equipment fault prediction method based on support vector regression, and aims to improve the prediction accuracy. The method comprises the following steps: firstly, collecting multi-dimensional operation parameter data of power equipment, and constructing an original monitoring data set; a data set is segmented through a sliding time window, wavelet transform is used for noise reduction, and then a normalization method is applied to generate a standardized data set. Time domain and frequency domain features are further extracted, a feature vector space is constructed, an optimal feature subset is screened through a mutual information method, and a training data set is generated; performing preliminary training on a support vector regression model by using the training data set to generate candidate support vectors, and screening a support vector set with the maximum contribution through an optimization algorithm; a grid search method is adopted to adjust kernel function parameters and penalty factors, and a support vector set is further optimized. And evaluating the performance of the model through cross validation, applying the optimized support vector regression model to power equipment fault prediction, and generating a fault occurrence probability prediction value.

The invention provides an infectious disease early warning and monitoring method and system based on big data and deep learning, and relates to the technical field of infectious disease early warning, and the method comprises the steps: obtaining infectious disease historical data, crowd movement track data, medical treatment data and environment monitoring data as a training data set; establishing a space-time propagation link diagram and carrying out dynamic segmentation coding to generate a propagation characteristic sequence; training a deep learning model based on the propagation feature sequence to predict an infectious disease propagation inflection point and a high-risk area propagation probability; and when the propagation probability exceeds a preset threshold value, generating early warning information and pushing the early warning information to a monitoring terminal. According to the invention, accurate prediction and timely early warning of the transmission trend of infectious diseases can be realized, and the epidemic prevention and control efficiency is improved.

The invention provides a self-adaptive polarization modulation-based inter-satellite laser communication and signal scheduling method, which relates to the field of laser communication, and comprises the following steps of: acquiring polarization state information of emitted and received light beams, calculating a mismatch degree, generating a compensation parameter, constructing a polarization state prediction model by using a deep learning neural network for pre-correction, and calculating the mismatch degree; a polarization modulator is adopted to perform real-time modulation and establish a link quality evaluation model, carrier synchronization and channel compensation are realized based on an adaptive optical carrier recovery technology of coherent detection, a link state is monitored in real time, and a training data set is updated.

The invention discloses an electrical equipment life prediction system and method based on deep learning, and belongs to the field of electrical equipment life prediction, and the method comprises the steps: constructing a data set, and carrying out the preprocessing; performing convolution operation on the time sequence data in the data set, extracting local features to obtain a convolutional neural network, capturing a long and short term dependency relationship of the time sequence data in the data set by using LSTM to obtain a recurrent neural network, and fusing output features of the convolutional neural network and the recurrent neural network to obtain comprehensive feature representation; constructing a deep learning model based on the fusion of a convolutional neural network and a recurrent neural network, adding an attention mechanism, adopting a mean square error as a loss function, optimizing model parameters, carrying out model training by utilizing a training data set, evaluating model performance by adopting a verification set, and adjusting hyper-parameters; and inputting real-time data into the trained model, predicting the residual life of the electrical equipment, and designing an online learning mechanism. According to the invention, the accuracy and real-time performance of prediction are improved.

The invention discloses a power transformer fault auxiliary decision-making method and system based on a knowledge graph and a large language model, and the method comprises the steps: obtaining power transformer fault text data, carrying out the preprocessing, obtaining fault-related text and table data, preliminarily defining an ontology, selecting a part of text data for marking, and carrying out the recognition of the ontology; a plurality of named entity recognition and relation extraction models are trained, an optimal model is determined, then triple extraction is carried out on unlabeled text data, and a knowledge graph is constructed; predicting a potential entity relationship in the knowledge graph based on a link prediction model, and complementing the knowledge graph under the large language model and human assistance; constructing a semantic search model training data set based on the large language model and training a semantic search model; based on the complemented knowledge graph, the trained semantic search model is utilized to retrieve knowledge graph sub-graphs according to the problem, and auxiliary decision making is completed. According to the method, the problem of low potential knowledge utilization level in the existing power transformer fault auxiliary decision-making based on the knowledge graph is solved.

There are provided methods and systems for training and using machine learning (ML) models to determine suitability of a given patient for an endovascular aortic repair (EVAR) intervention and to monitor the given patient after the EVAR intervention. The pre-EVAR ML models are trained on training datasets comprising strain maps having been generated based on a multiphase image stack of the aorta of each respective patient during a cardiac cycle, measures of aortic weakness in the aorta of each respective patient, geometric features of the aorta of the respective patient, and outcomes of the EVAR intervention on the respective patient. The post-EVAR ML models are trained on pre-EVAR strain maps, post-EVAR strain maps having been generated after the EVAR intervention, and a respective outcome of the EVAR intervention.

A method, system, and device for wind speed prediction and layout optimization in wind power generation are provided. The method includes: obtaining a basic wind resource dataset of a target region; constructing a physics-informed neural network model based on the basic wind resource dataset; obtaining wind speeds data at a specific location in a velocity field based on the physics-informed neural networks and constructing a training dataset; training the physics-informed neural network model based on the training dataset; reconstructing a wind speed distribution within the velocity field and predicting wind speeds for a next time period with a wind farm using the trained physics-informed neural network model; and optimizing a layout of a wind turbine cluster based on a reconstructed wind speed distribution within the velocity field. The present application reconstructs a two-dimensional velocity field of the wind farm by training the PINN and enables accurate ultra-short-term wind speed prediction.

The invention discloses a multi-modal large model optimization method and system based on defect detection and analysis. The method comprises the following steps: S1, collecting a multi-modal original sample with power business scene characteristics; s2, performing standardization preprocessing on the original data to obtain a fine-tuned standard data set; and S3, establishing relational mapping among the labels of the training data set to form a semantic relation graph of the labels, and extracting a topological structure relation of the semantic relation graph to generate the power text knowledge base. S4, various task function modules of the computer vision large model are trained, so that the computer vision large model has various tasks for processing the electric power scene. And S5, fusing the trained Clip semantic large model and the trained computer vision large model into a multi-modal large model by using a Transform structure. According to the method, the multi-modal large model subjected to fine tuning through the power text knowledge base not only maintains the specific analysis and reasoning performance under various power scenes, but also can ensure the generalization ability of the large model to various algorithm tasks.

Computerized systems and methods for training a trajectory prediction model for autonomous driving vehicles. The systems and methods receive agent dynamics data, high-dimensional (HD) map data; a training data set; and a plurality of meta paths through the HIN representing lane transitions, each meta path comprising a sequence of lane nodes and edges. Scene encoding is performed on the agent dynamics data and the HD map data to produce a directed Heterogeneous Information Network (HIN) as a graph comprising nodes and edges. The trajectory prediction model is trained based on a comparison between a prediction, by the trajectory prediction model, of a positive or negative presence of the meta paths between nodes and meta path ground truth obtained from the training data set and between motion trajectory predictions, by the trajectory prediction model, and motion trajectory ground truth obtained from the training data set.

The invention discloses an intelligent detection method and device for fusing a medical image learning image, and relates to the technical field of medical image processing. The method comprises the following steps: acquiring and preprocessing a bimodal medical image, and extracting a feature map through multi-scale decomposition; constructing a cross-modal correlation model, and setting a modal attention mechanism (embedding anatomical structure prior guidance feature complementation) and a morphological attention mechanism (setting lesion morphological constraint weight); the method comprises the following steps: collecting multiple types of image samples, pairing according to a focus form and an imaging mode to construct a bimodal joint data set, and correlating and labeling to generate a training data set with modal attributes; after a multi-stage iteration training model, inputting the preprocessed image to carry out feature fusion so as to obtain a fused image; and generating a lesion probability graph according to the fused image, positioning a lesion area through multi-threshold segmentation, and outputting a detection result. The system comprises a data acquisition module, a preprocessing module and the like. The method improves the accuracy and reliability of medical image detection, and is suitable for clinical multi-modal image analysis.

The invention relates to an infrared and visible light image fusion method based on a cross-domain Transform, and belongs to the field of computer image processing. The method comprises the following steps: respectively carrying out preprocessing operation on an infrared image and a visible light image to obtain a training data set; an end-to-end image generator network is designed, an encoder module is used for extracting deep semantic features of an infrared image and a visible light image, a fusion module introduces an axial attention mechanism to enhance the global modeling capability of the features, and feature fusion is carried out in combination with information of a spatial domain and a frequency domain; the fused features are gradually recovered to an image space through a decoder module, and a fused image is generated; constructing a fusion loss function module, and guiding the network to focus a significant feature difference between the source image and the fusion image based on a comparative learning idea; and finally, inputting the infrared and visible light image Y channel into the network model, generating a fusion image, completing a training process, and realizing unified optimization of fusion performance and visual quality.

The invention discloses a deep counterfeiting detection model training method, a deep counterfeiting detection method and a deep counterfeiting detection system, and relates to the technical field of artificial intelligence, and the method comprises the steps: obtaining a training data set containing a real image and a plurality of counterfeit images, and enabling the image to be provided with a label for representing the authenticity; in the training process, the deep forgery detection model can be in contact with various types of image samples, so that wider and more complex image features and forgery modes can be learned, a forgery reason is further marked for a forgery image, and the deep forgery detection model can be helped to deeply understand essential features of forgery content in the training process. Therefore, the problem of insufficient detection capability for well-designed and high-quality counterfeited contents can be solved, and the technical effect of improving the accuracy of counterfeited detection is achieved.

The invention provides a pump station flow channel flow field prediction and optimization method based on a transfer learning enhanced physical information neural network. The method comprises the following steps: constructing a training data set; constructing a loss function based on the control equation, the initial runner condition and the inlet and outlet boundary; a physical information neural network is constructed, hydraulic design parameters, space coordinates and time data are input into the physical information neural network, and pump station flow channel flow field data are output into the physical information neural network; intensively training the physical information neural network through time slice transfer learning by using the training data set based on the loss function to obtain a target physical information neural network model; determining a plurality of candidate hydraulic design parameters, and inputting each candidate hydraulic design parameter into the target physical information neural network model to obtain corresponding candidate pump station flow channel flow field data so as to obtain candidate performance parameters; and an objective function is constructed based on the performance parameters, the objective function is solved to obtain optimal performance parameters, and the candidate hydraulic design parameters corresponding to the optimal performance parameters are the optimal candidate hydraulic design parameters.

The invention discloses a multivariable time series prediction method based on an NMF multi-scale lightweight space-time convolutional neural network, and belongs to the technical field of machine learning and deep learning application. The method specifically comprises the following steps: (1) collecting and processing multivariable time sequence data, and unifying the scale of the data; (2) decomposing the time sequence data by using NMF, extracting basis matrixes and coefficient matrixes of different scales, and constructing a multi-scale feature pyramid; (3) applying a space-time convolution layer on the basis of the output of the feature pyramid, introducing a Bayesian optimization algorithm, and adopting a feature fusion layer fused with a multi-scale attention mechanism; (4) dividing a training data set and a test data set, and carrying out model training; and (5) predicting future time sequence data by using the trained model and outputting an expected value. According to the method, a more powerful and more efficient multivariable time sequence prediction model is effectively constructed, and the method is suitable for analysis and prediction of multivariable time sequence data.

The invention discloses a coal mining subsidence area surface crack intelligent extraction method based on an improved Transform model, and belongs to the technical field of remote sensing image processing. Firstly, an unmanned aerial vehicle carrying a high-resolution optical camera is used for collecting images, the image overlapping rate of 70%-80% is guaranteed, and a training data set is constructed through professional labeling, cutting screening and data enhancement. The encoder of the innovative model is very distinctive, and the adaptive multi-scale patch mapping layer can dynamically adjust the patch size according to the local complexity of the image and efficiently extract features; double-attention fusion is combined with optimization position coding, and long-distance dependency capture is enhanced; and the calculation amount and the overfitting are reduced by the dynamic sparse connection full-connection layer. Residual attention enhancement pyramid pooling and a space-channel attention bottleneck mechanism are adopted, key features are highlighted, and noise is suppressed; and a breakpoint detection and connection rule determination module is utilized to realize complete restoration of the ground fracture. After the data set is used for training a model, deployment is carried out, and through preprocessing, encoding and decoding and post-processing, ground fracture information can be accurately obtained, and a data foundation is built for mining area safety management and geological disaster prevention and control.

The invention discloses a thinking chain-based text2sql model implementation method and device, computer equipment and a readable storage medium, and the method comprises the steps: firstly obtaining a sample SQL query instruction text, carrying out RAG retrieval, constructing cue words, calling at least two open source large language models for output, carrying out the evaluation of a target large model to obtain a step-by-step and reward training data set, and carrying out the calculation of the step-by-step and reward training data set; and performing fine tuning training on the initial step-by-step and reward model. And after the target instruction input by the user is obtained, reasoning is performed in combination with the trained step-by-step and reward model to obtain the corresponding SQL statement, so that efficient and accurate text-to-SQL conversion is realized.