458 results about "Sample selection" patented technology

The invention discloses a low-cost cell segmentation method, system and device based on active learning. The method comprises the following steps: selecting an initial cell image for preprocessing and bounding box labeling; forming a training set and constructing a target detection model for training so as to predict a bounding box of pictures of the verification set; taking the bounding box as a prompt for segmenting a cut model (SAM), and outputting a corresponding cell mask; adopting a Monte Carlo discarding method to predict the uncertainty of the unlabeled pictures, and selecting the pictures with higher uncertainty to be labeled by experts; adding the marked image data into the training set of the last round for updating, and repeating the training and sample selection of the model; and outputting a model weight and an index record after the required performance is achieved. According to the method, the data annotation cost of a cell segmentation algorithm is greatly reduced on the premise of ensuring the model performance.

The invention discloses an uncertainty and representativeness combined active learning method and system for medical image data annotation, and relates to the technical field of medical image data. The method comprises the following steps of: training a variational auto-encoder infoVAE on an image pool; m samples are randomly extracted from the image pool and labeled, an initial labeled image set is constructed, and a segmentation model is trained on the labeled image set; t rounds of active learning circulation are carried out, and in each round of t active learning circulation, the following steps are specifically executed: screening candidate samples based on a representative method; screening a final sample based on an uncertainty method; updating the labeled data set and the unlabeled data set; retraining the segmentation model on the updated labeled image set, and optimizing model parameters; and obtaining final model parameters. According to the method, by designing a sample selection strategy integrating uncertainty and representativeness, the global performance of the model and the difficult sample segmentation capability are improved.

The invention provides a large model named entity recognition method based on representative sample selection and context enhancement, which comprises a representative sample selection module, an entity knowledge construction module, a dynamic context selection module, a large model calling module and an iterative feedback optimization module, according to representative sample selection, samples with representativeness and information diversity are automatically selected from unlabeled data for labeling through a sample screening strategy based on clustering, entity description integration aims at each entity type, a plurality of high-quality instances are extracted from labeled samples, and standardized entity definition or description prompts are constructed. According to the dynamic context selection, for to-be-recognized text content, a context example most relevant to a target text is dynamically selected from a historical annotation sample or a description set through a semantic similarity retrieval mechanism to serve as auxiliary prompt input, and the adaptability and generalization ability of LLM in a complex or variable scene are improved.

The invention discloses a cross-domain image classification method based on few-sample unsupervised domain adaptation. The method comprises the following steps: acquiring a training feature data set; constructing a feature extractor, and using a pre-training model; building a model based on a sample selection strategy, adversarial domain adaptation and prototype learning; a total loss function is obtained, and iteration is carried out to optimize the model; and performing cross-domain image classification by using the trained domain adaptive classification model. According to the invention, the source domain sample is expanded by using the sample selection strategy without additional unmarked source domain data. Besides, by constructing a source domain category prototype, a target domain sample is directly aligned with the source domain prototype, and refined cross-domain feature alignment is realized. According to the method, local category prototype alignment and global adversarial alignment are combined, the capability of the model in the aspect of feature alignment is enhanced, the excellent classification performance of the model is verified on a public data set, and particularly, remarkable robustness is shown under the condition that source domain labeled samples are extremely limited.

Systems and methods for predicting a trajectory of a moving object are disclosed herein. One embodiment downloads, to a robot, a probabilistic hybrid discrete-continuous automaton (PHA) model learned as a deep neural network; uses the deep neural network to infer a sequence of high-level discrete modes and a set of associated low-level samples, wherein the high-level discrete modes correspond to candidate maneuvers for the moving object and the low-level samples are candidate trajectories; uses the sequence of high-level discrete modes and the set of associated low-level samples, via a learned proposal distribution in the deep neural network, to adaptively sample the sequence of high-level discrete modes to produce a reduced set of low-level samples; applies a sample selection technique to the reduced set of low-level samples to select a predicted trajectory for the moving object; and controls operation of the robot based, at least in part, on the predicted trajectory.

Methods, systems, and apparatuses, including computer programs encoded on computer storage media, for receiving a query relating to a data item that includes multiple data item samples and processing the query and the data item to generate a response to the query. In particular, the described techniques include adaptively selecting a subset of the data item samples using a selection neural network conditioned on features of the data item samples and the query. Then processing the subset and query using a downstream task neural network to generate a response to the query. By adaptively selecting the subset of data item samples according to the query, the described techniques generate responses to queries that are more accurate and require less computation resources than would be the case using other techniques.

The invention discloses a mine geological environment evaluation system based on multi-scale characteristics and an evaluation method thereof. The mine geological environment evaluation system comprises a remote sensing image acquisition unit, a mine geological environment problem analysis unit, a mine geological environment element extraction unit, a mine geological environment problem identification unit and a mine geological environment evaluation unit. The method comprises the following steps: collecting a remote sensing image of a target mine area, extracting mine geological environment elements, analyzing temporal and spatial change characteristics of the elements, performing similarity comparison calculation with change characterization of different mine geological environment problems, identifying the geological environment problems, and training an evaluation model to obtain a geological environment evaluation prediction result. According to the method, index factor characterization of different mine geological environment problems is analyzed from remote sensing image modal data, through automatic comparison and matching with target remote sensing image multi-scale features, the problem that the efficiency and quality of a mine geological environment investigation mode and a sample selection method are low is solved, and scientific evaluation of the mine geological environment is achieved.

The invention discloses a single-point supervised directional target detection method based on adaptive sample allocation and a global-local context enhancement module, which comprises the following steps: inputting an original remote sensing image into a backbone network, extracting to obtain a multi-scale feature map set, inputting a feature map with the highest resolution into a global-local context module to obtain an enhanced feature, and extracting the enhanced feature from the global-local context module; inputting the enhanced features into a projection layer to generate a category probability graph; based on the category probability graph, training and optimizing the category probability graph to obtain a probability histogram set by adopting a sample distribution and optimization strategy combining adaptive positive sample selection, online difficult case mining and a focus loss dynamic weighting mechanism based on prediction confidence; and based on the full training set category probability histogram set, carrying out adaptive pseudo tag threshold calculation, and finally, realizing end-to-end joint training of pseudo tags and enhanced features through a prediction quality guide weighting strategy. According to the method, the target contour precision and the detection robustness are remarkably improved, and high-performance remote sensing image directional target detection is realized under a weak supervision condition.

The invention discloses a remote sensing image sample intelligent acquisition method based on image classification, and relates to the technical field of image acquisition, and the method comprises the following steps: carrying out the feature extraction of a remote sensing image, and obtaining an initial feature; performing classification uncertainty evaluation according to the initial features to obtain uncertainty indexes; performing sample representativeness calculation according to the uncertainty index to obtain a representative index; performing sample diversity analysis according to the representative indexes to obtain diversity indexes; performing comprehensive sample scoring according to the diversity indexes to obtain sample scoring data; and performing sample selection according to the sample scoring data to obtain a final collection sample. According to the method, uncertainty weighted items are introduced, representativeness is calculated in combination with similarity, global distribution and local feature differences are considered, reliability of representativeness calculation is improved, balance of samples on ground feature type distribution is improved, and stability and scientificity of sample screening are improved.

The invention discloses a positive sample data set construction method for astronomical image denoising application, relates to the field of image processing, and solves the problems that data sets for denoising and stray light removing tasks of astronomical images are relatively deficient and the processing performance needs to be improved at present. The method comprises the following steps: acquiring and cutting star maps at different time periods; identifying and positioning star points; generating and matching a double-triangle structure; and star map alignment and data set positive and negative sample selection are realized. The method is suitable for model training data construction of astronomical image denoising and stray light removal processing. In the subgraph cutting process, an unpolluted or lightly polluted area is preferentially reserved, the effectiveness and pertinence of data are improved, a double-triangle structure is constructed by accurately recognizing star points subsequently, star point matching and image alignment are carried out by utilizing a geometric hash algorithm, and finally, proper images are selected as positive and negative samples of a data set. Under the same astronomical observation condition, the method is better in denoising effect and higher in data processing efficiency.

The invention provides an intention perception recommendation method based on knowledge graph and comparative learning fusion, relates to the technical field of artificial intelligence, and aims to optimize node representation by fusing knowledge graph and comparative learning technologies so as to improve the recommendation precision of a recommendation system for long-tail projects. Meanwhile, on the basis of data enhancement, positive sample selection in contrast learning is expanded in combination with user intentions, the ability of the model in the aspect of user intention modeling is further enhanced, and finally the accuracy and correlation of recommendation results are improved. The objective of the invention is to solve the problems of poor long-tail project representation quality, insufficient user intention modeling and limited recommendation precision caused by knowledge graph noise interference in the prior art.

A long-term continuous learning method based on task core memory management and consolidation aims to enable a model to sequentially learn from a large number of task sequences, new knowledge is obtained, information of previous learning is reserved, and the method is similar to a human learning mode. The method comprises the following steps: 1) task input and instruction fine tuning; 2) performing difference analysis on the model parameters of the current task and the previous task, identifying a task core memory unit, calculating an adaptive weight based on task prototype similarity, and dynamically updating the memory unit; 3) constructing an experience playback buffer area through a difficult sample selection strategy and a difference sample selection strategy; and 4) utilizing the joint loss function training model to keep the memory of the historical tasks while learning the new tasks. According to the method, the problem of disastrous forgetting in long-term continuous learning is mainly solved, and the performance of the model in a long-term sequence task is remarkably improved.

The invention discloses a multi-component catalyst active site prediction system and method fused with quantum embedding, and relates to the technical field of catalysis and material informatics, and the system comprises a structure and site enumeration module which generates candidate sites; the adaptive quantum embedding calculation module obtains key reaction microcosmic parameters; the unified site fingerprint and feature engineering module constructs and fuses standard site fingerprints; the physical consistency machine learning module predicts adsorption energy and other parameters and uncertainty thereof; the active learning and sample selection module selects a high-value sample optimization model; the microdynamics evaluation module calculates index values such as activity; and the multi-objective optimization and sorting module generates an optimization sorting list. According to the method, the unification of calculation precision and efficiency is realized, the problem of non-unification of locus characterization is solved, the model interpretability and extrapolation reliability are improved, and the comprehensive evaluation and optimization sorting of multi-target performance are completed.

The invention belongs to the technical field of voiceprint recognition, and discloses an intelligent voiceprint recognition method and system based on features. Comprising the following steps: collecting a plurality of voiceprint data samples, and preprocessing each voiceprint data sample to obtain a comprehensive voice sample; constructing a voice directed graph model based on the comprehensive voice samples, and recognizing a core voice sample set from the voice directed graph model; performing feature extraction on the core voice sample set to obtain # imgabs0 # comprehensive feature vectors; obtaining a sample selection strategy by using a clustering algorithm based on the comprehensive feature vector and the core voice sample set; based on the comprehensive feature vector, a voiceprint recognition model is adaptively trained by using a sample selection strategy, and after training is completed, the trained voiceprint recognition model is applied to voiceprint recognition, so that the advantages of deep learning in the voiceprint recognition field are fully played, the voiceprint recognition speed and efficiency are improved, and the voiceprint recognition efficiency is improved. And the misrecognition rate and the missed recognition rate of the system are also reduced.

Methods and systems are described herein for minimizing resource expenditure during model training using user-defined constraints in sample selection. A system may obtain user-defined target parameter values for data labeling, a user input indicative of a value added per unit of model performance improvement, and a dataset (e.g., unlabeled samples). The system may select a first subset of the dataset and may transmit a request for labeling the samples. The system may receive a first training dataset comprising label data and the samples of the first subset. The system may train a machine learning model using the first training dataset and generate a margin curve. Based on the margin curve, the system may determine whether an amount of resource usage exceeds value added and responsive to determining that it does not exceed the amount of resource usage, select a second subset of the dataset.

Embodiments of the present description provide a target detection method, comprising: determining an image to be detected of a target domain; inputting said image into a target detection model corresponding to the target domain, to obtain a target object image corresponding to said image, wherein the target detection model is obtained by training on the basis of a source domain labeled sample in a source domain training data set, and target domain initial samples and target domain labeled samples in a target domain training data set, the target domain labeled samples are obtained by screening from among the target domain initial samples on the basis of a preset sample selection policy, the target domain training data set, and the source domain training data set. A training sample of a source domain and training samples of the target domain are considered in the training process, so that the migration of a model from the source domain to the target domain is realized, the trained target detection model is also applicable in the target domain, and the generalization performance and the task processing performance of the target detection model in various fields are further ensured.

The invention relates to the field of federated learning, in particular to a federated learning method based on fairness enhancement, and the method comprises the steps: optimizing sample selection and resource allocation to improve the fairness of a model; performing hierarchical processing on the data through Power similarity measurement and hierarchical clustering to ensure the representativeness of the data of different hierarchies; in combination with a dynamic weight adjustment strategy of a parameterized loss weight, the sensitivity of the data layers is optimized in real time, contributions of different data layers in training are dynamically balanced, and weight distribution optimization is completed; constructing a weighted aggregation model based on an auto-encoder, performing anomaly detection on the data by using the auto-encoder, and optimizing updating of a global model in combination with a fairness index; according to the method, the local model deviation can be effectively reduced, and the fairness and the model precision of federal learning are remarkably improved in a heterogeneous data environment.

The invention discloses a big language model knowledge extraction method and device based on difficulty perception, and aims to solve the problems that an existing knowledge extraction method is high in training cost and lack of pertinence in sample selection. According to the method, the difficulty of a distillation difficulty score evaluation sample is introduced, a difficult sample with learning value for a student model is identified, a distillation data set is dynamically adjusted in combination with a hierarchical data updating strategy, the difficult sample is preferentially reserved, a simple sample is removed, and meanwhile, data diversity is kept. Besides, a bidirectional difference loss function is provided, KL divergence and inverse KL divergence are combined, the optimization process is stabilized, more attention is paid to difficult samples, and gradient explosion or disappearance is avoided. Experimental results show that the performance of a student model is effectively improved, the method even exceeds a teacher model under some conditions, meanwhile, the training cost is remarkably reduced, and the method is suitable for task-independent instruction following and specific tasks and has wide application prospects.

The invention belongs to the field of food quality evaluation, and provides a delicate flavor synergistic effect evaluation method based on an electroencephalogram monitoring technology. Psychological or physiological factors such as subjective judgment, forced selection or scoring, individual umami cognition and umami sensitivity difference of sensory officers may affect the accuracy of sensory experiment results; the invention discloses methods such as umami sample selection and strength evaluation, electroencephalogram signal acquisition experiment normal form, quantitative evaluation and statistical analysis, feature extraction and response difference analysis, and the like, and the response mechanism of typical umami compounds in the human brain is explored by taking the response of people to umami signals as a research object and taking electroencephalogram signal detection analysis as a main method. A new theoretical basis is provided for quantitative evaluation based on the human palatable taste intensity, and the method is worthy of wide popularization.

The invention provides a photovoltaic scene generation method based on an improved generative adversarial network, and the method is realized based on an improved generative adversarial network model, and the construction of the model comprises the following steps: 1) collecting annual hourly photovoltaic irradiance historical data, and carrying out the normalization processing; 2) carrying out weather feature extraction on the collected photovoltaic irradiance historical data; 3) taking the weather-related characteristics as input and the photovoltaic irradiance data as output, training to obtain an improved generative adversarial network model, generating photovoltaic power data by a generator of the model according to noise input, and evaluating the distribution difference between the generated data and real data by an evaluator; the generator ensures that the generated data accords with the physical law of photovoltaic power generation through dynamic gate function constraint, the sample selection probability can be optimized and adjusted through weighted sampling, and the learning ability of the generator for scarce samples is enhanced. Through the method, accurate and diversified photovoltaic power scenes can be generated, and reliable data support is provided for a power system.

The invention provides a fine-grained image clustering method and system based on FG-CLIP and language enhancement, and belongs to the field of image clustering. A pre-training text generation model is utilized to generate diversified coarse-grained text descriptions, then a text fine-grained module and a text screening module are utilized to perform fine processing on a text, and two enhanced views are fused to form consistent text representation, so that the comprehensiveness of text information is enhanced. Then, a neighbor set is constructed according to the feature similarity through a random neighbor sample selection module, attention to samples in the same cluster is improved, and the selection range of positive samples is expanded; and finally, inputting the image features, the text features and neighbor samples thereof into each modal cluster-level mapping head for dimension mapping, and realizing alignment and joint training of the two modal features through random neighbor contrast loss. Under the assistance of the text information, the fine-grained clustering targets can be accurately distinguished, so that the accuracy and robustness of fine-grained image clustering are effectively improved.

The present disclosure relates to improving recommendations for small shops on an ecommerce platform while maintaining accuracy for larger shops. The improvement is achieved by retraining a machine-learning recommendation model to reduce sample selection bias using a meta-learning process. The retraining process comprises identifying a sample subset of shops on the ecommerce platform, where the sample batch includes shops in both a small size category and shops in a large size category. The machine-learning model is then used to make shop-specific user-item interaction predictions for each shop in the sample batch. A shop-specific loss is calculated for each shop based on the model's predicted user-item interactions for the shop-specific training dataset and the actual user-item interactions in the shop-specific training dataset. A global loss is calculated based on each of the shop-specific losses, and the baseline model is updated to minimize the global loss.

The invention discloses a sample screening prompt generation method based on knowledge point graph guidance, and belongs to the field of computer natural language processing. The method is divided into two stages: in the first stage, knowledge points are extracted and a knowledge point graph is constructed by analyzing book contents of Common Course Standard Invention, and data are aligned to the graph; in the second stage, input query is mapped to corresponding knowledge points through knowledge point association, samples with the knowledge point overlapping degree being 0 are removed through a sample initial screening model, deep knowledge semantic features are extracted through a self-attention neural network, an optimal sample is screened out from a training set in combination with a knowledge point similarity and diversity comprehensive selection model, and the deep knowledge semantic features are extracted; and inputting a large language model to generate an answer after combining with the query. According to the method, the context learning performance of a large language model is remarkably improved, the problem that sample selection is interfered by surface language characteristics is solved, the knowledge point dimension information is introduced, so that the understanding of the model on tasks is more accurate, the generation illusion is reduced, and experimental verification is achieved.

The invention relates to the technical field of geological disaster assessment, in particular to a non-landslide sample selection optimization method and system based on information amount, and the method comprises the steps: collecting historical landslide data and environmental factor data in a to-be-predicted region, carrying out the importance evaluation of environmental factors, and screening out landslide characteristic factors which have large impact on the landslide susceptibility; carrying out information quantity analysis on the screened landslide characteristic factors, carrying out weight assignment on the factor information quantity according to the importance of the landslide characteristic factors to obtain comprehensive information quantity, and selecting reliable non-landslide samples in an area with relatively low comprehensive information quantity; inputting the data into a prediction model to obtain a prediction result; and carrying out landslide susceptibility evaluation on the to-be-predicted region, generating a landslide susceptibility partition map, and formulating targeted disaster prevention and reduction measures. According to the method, a machine learning algorithm and an information amount method are combined, the objectivity of weight assignment of the influence factors is improved, so that more representative non-landslide samples are selected, and the precision of a landslide susceptibility prediction model is improved.

The invention discloses a positive and negative unmarked image classification method and system based on depth metric learning, and relates to the technical field of sample classification, and the method comprises the steps: obtaining a marked positive sample image and an unmarked image, inputting the marked positive sample image and the unmarked image into a depth metric learning model, adjusting the marked positive sample image in a depth feature space, and obtaining the unmarked image; minimizing the distance between the marked positive sample image and the center of the positive sample image, aligning the unmarked image and the corresponding enhanced view in a representation space through self-consistent metric learning, and outputting related feature representation; using related feature representation to select sample images which are in multiple proportion to the positive sample images as reliable negative samples; and taking the related feature representation as input, using a positive sample image and a reliable negative sample as supervision signals to train a binary classifier, and classifying positive and negative unmarked images to be detected. According to the method, dependence on heuristic negative sample selection is avoided, and high-quality feature representation with discrimination on positive and negative samples can be learned.

The invention discloses a miRNA and disease relation prediction system and method based on causal feature selection. According to the system, the accuracy of miRNA and disease relation prediction is improved through a plurality of modules such as data acquisition, negative sample selection, feature selection and causal analysis, model training and evaluation and the like. The data acquisition module is used for acquiring miRNA expression data and disease characteristics from a biomedical database; the negative sample selection module is used for grouping unknown miRNA-disease relationships through k-means clustering and randomly selecting negative samples; the feature selection module adopts a causal feature selection algorithm to construct a Markov blanket so as to screen out miRNA features directly related to disease states, and redundancy is reduced; the model training module uses a single machine learning algorithm for training, and optimizes the model performance through cross validation; and finally, the evaluation module evaluates the model effect through indexes such as AUROC and AUPR. According to the method, the accuracy of miRNA and disease relation prediction is remarkably improved, and important support is provided for medical research.

The invention discloses a target detection online learning dynamic sample selection method and system, computer equipment and a storage medium. The method comprises the steps that classification uncertainty and positioning uncertainty of samples to be screened are obtained through Monte Carlo Dropout sampling; constructing multi-dimensional feature vectors including classification uncertainty, positioning uncertainty, knowledge gap matching degree and the like; constructing a dynamic weight learning network based on an attention mechanism, and calculating the weight of each feature in combination with a model verification set performance index; and performing multi-dimensional value scoring on the samples according to the feature weights, and screening out an optimal sample subset in combination with calculation power limitation so as to complete online updating of the model. According to the method, the sample value is comprehensively evaluated through multi-dimensional feature fusion, different scene requirements are adapted by utilizing dynamic weights, and resource consumption and updating effects are balanced in combination with computing power perception sampling, so that the adaptability and detection precision of the model in a dynamic scene are effectively improved, and meanwhile, the dependence on manual annotation is reduced.

The invention discloses a high-speed train bogie gearbox bearing fault diagnosis method, which comprises the following steps of: acquiring vibration acceleration signals of a bearing in a train bogie gearbox in different health states, preprocessing the vibration acceleration signals into a training sample set and a test sample set, and constructing a fault diagnosis classification model of noise label robustness; and training the classifier model by adopting a self-paced learning strategy, and inputting the test sample set into the trained classification model to obtain a train bogie gearbox bearing fault diagnosis result. According to the method, through the provided adaptive course sample selection strategy, the threshold value of confidence sample selection is associated with the development of the network, and the introduction of a resistance loss function can effectively resist the over-fitting problem easily generated by the model on a noise label. According to the method, the diagnosis accuracy of the data set with the noise label can be improved, and the high-speed train bogie gearbox bearing fault diagnosis precision is improved under the condition of high noise label rate.

The invention relates to a safety knowledge fusion method based on distributed continuous learning and intelligent sample driving, and belongs to the technical field of machine learning. The core of the method is that an edge node not only executes a local model, but also evaluates the performance of the model on local data, so that a representative data sample which is most valuable for global model optimization is intelligently screened out. The confidentiality of the samples is ensured through asymmetric encryption (such as ECIES), and the completeness and source authenticity of the samples are ensured through digital signature (such as ECDSA) in combination with a hash function (such as SHA-256), and then the samples are uploaded to a cloud server. And the cloud server verifies, decrypts and aggregates the received samples for training and updating the global model. The updated global model is then safely distributed back to the edge node. According to the method, an intelligent sample selection mechanism is introduced at an edge end, and a cryptographic tool is combined, so that the efficiency of distributed learning, the model performance and the security of data transmission and fusion are effectively improved.