81 results about "Class prediction" patented technology

The invention relates to the technical field of medical image processing and computer vision, in particular to a parasitic ovum microscopic image detection method and system based on polymorphic prior, and the method comprises the steps: obtaining a to-be-detected microscopic image, and carrying out the feature extraction of the to-be-detected microscopic image through a convolutional neural network, and obtaining an initial feature map; constructing a polymorphic convolution kernel library based on preset biological morphological characteristics of the parasitic ova; performing deep convolution and feature fusion operation on the initial feature map by using a polymorphic convolution kernel library to generate a space attention map; performing feature enhancement processing on the initial feature map by using the spatial attention map to obtain an enhanced feature map; and performing bounding box regression and category prediction on the enhanced feature map to obtain a parasitic ovum detection result. According to the method, morphological priori and attention mechanisms are introduced, so that the problems of egg form similarity, background interference and the like are solved, accurate and robust automatic detection is realized, and the clinical diagnosis efficiency is remarkably improved.

Methods, systems, and apparatus for classification. In one aspect, a method includes receiving an input and a request to classify the input into one of a plurality of classes, processing the input using a multimodal model to generate (i) a description of the input and (ii) a class prediction, processing the description of the input and the class prediction using a text encoder embedding neural network to generate a (i) text description feature embedding and (ii) a prediction feature embedding, generating, from at least the description feature embedding and the prediction feature embedding, a query feature embedding representing the input, and classifying the input into one of the plurality of classes using the query embedding.

The present invention relates to a quantum machine learning method for multi-class classification, and the method comprises the steps of: applying a Quantum Convolution Neural Network (QCNN) quantum circuit to input data having q qubits, and outputting a feature vector based on Pauli-Z measurement; and applying a Quantum Neural Network (QNN) quantum circuit to the feature vector, and outputting a multi-class prediction vector with scalability increased compared to q qubits based on basis measurement.

The invention discloses an EEG channel selection method and system based on double-branch collaborative guide learning. The method comprises the steps that original electroencephalogram signals are collected; the original electroencephalogram signals are input into the channel importance evaluation module through the signal input module, the smooth score of each channel is calculated, and a set number of optimal channels are selected; the signal feature extraction module extracts the space-time features of the optimal channel and pools and projects the space-time features to obtain final embedded features; the embedded features are input into the double branches, global average pooling is carried out on the embedded features, and prediction label probability distribution is obtained through multi-class prediction; reconstructing the complete electroencephalogram signals according to the embedded features to obtain reconstructed electroencephalogram signals; constructing a total loss function, minimizing the total loss, and adjusting the weight of the electroencephalogram channel selection model; and performing channel selection by using the trained electroencephalogram channel selection model. According to the method, through a collaborative learning mechanism, on the basis of ensuring the performance, the number of channels required by electroencephalogram signals is remarkably reduced.

The invention belongs to an SDTW-IPAM-based short-term power load prediction method and system, electronic equipment and a storage medium. The method comprises the steps of data preprocessing, clustering analysis, single-class prediction model construction and future load prediction. The clustering analysis comprises setting of upper and lower limits of a cluster number, construction of a distance matrix, calculation of a Gap value and a standard error, selection of an optimal cluster number, generation of an initial center, clustering processing and normalization processing; according to the method, a distance measurement method is introduced into load clustering, so that the dynamic time sequence characteristics of a load curve can be described more accurately, the local time deformation of the load curve can be effectively identified, and the distinguishing capability of similar load days under the influence of weather, events or potential new energy fluctuation is improved; a clustering algorithm is improved by using statistics and an initialization strategy, so that the stability and the accuracy of performing mode recognition on complex load data are improved, and the load can be effectively divided into typical modes with different dynamic characteristics.

The invention discloses an intestinal polyp identification method based on images and multi-modal data. The method comprises the following steps: acquiring pathological images of a plurality of microscopes, objective magnification information corresponding to the pathological images, and text information corresponding to enteroscopes; performing data preprocessing on each frame of acquired pathological image and text information to obtain a training data set; a multi-scale multi-modal feature classification network is constructed, the training data set is used for training, and a trained multi-scale multi-modal feature fusion classification network is obtained; the method comprises the following steps: collecting a microscope pathological image of a patient, obtaining corresponding enteroscope text information, respectively carrying out data preprocessing, and inputting into a multi-scale multi-modal feature fusion classification network to obtain disease category prediction of a model. According to the method, pathological images and enteroscope text information are fully fused, accurate classification and prediction of disease types are finally achieved, the effect and efficiency of multi-modal diagnosis of intestinal diseases are improved, and therefore the accuracy of patient diagnosis is improved.

The invention belongs to the technical field of traffic target detection, and discloses a traffic target detection method, system and model architecture under severe weather conditions. The method comprises the following steps: preprocessing an input traffic scene image; performing multi-scale feature extraction on the preprocessed image, and obtaining multi-scale feature representation through AMSConv operation; carrying out bidirectional fusion on the extracted multi-scale features to obtain fusion features; the fusion features are processed, and category prediction, bounding box coordinates and confidence of the target are generated; and optimizing bounding box regression based on InfoAware-IoU measurement, and dynamically weighting a high information sample. Through multi-scale feature extraction, efficient detection head design and information perception regression optimization, the problem of visual degradation under severe weather conditions is effectively solved, and the accuracy and real-time performance of traffic target detection are improved.

The application relates to a visual language model test adaptation method based on logarithmic calibration and consistency cache, and relates to the technical fields of computer vision, pattern recognition, machine learning and artificial intelligence. The method aims at the problems of class prediction bias, insufficient cache sample coverage and low utilization rate of boundary samples of a visual language model in a target domain test stage, and constructs an online adaptation framework composed of an image encoder, a text encoder, a dynamic logarithmic calibration module, a consistency guide exploration cache module and a cross-modal joint optimization module. The method improves the identification opportunities of difficult classes and low-frequency classes through a dynamic logarithmic calibration mechanism, and improves the overall class balance and classification stability. Through the consistency guide exploration cache mechanism, the coverage range of the cache to the real distribution of the target domain is expanded, and the perception ability of the model to the decision boundary region is enhanced, so that the adaptation effect in a complex distribution offset scene is improved.

The invention provides a multi-class attitude estimation method and system based on shared key point adaptive matching, and the method comprises the steps: constructing a large-scale multi-class attitude data set for model training and evaluation, carrying out the processing of the data set, obtaining a training image subset and a test image subset, respectively inputting the training image subsets into a query model comprising an image feature extraction module, a structure prototype classification module, a shared key point prediction module, an adaptive matching module and a model optimization module, training the query model through mutual cooperation of the modules, and optimizing model parameters; and applying the optimized query model to a test image to obtain a structure prototype category prediction result and a key point estimation result of the test image. According to the method, cross-category universal features are learned by sharing key point embedding, and unified and high-precision attitude estimation of mass categories of objects with variable structures is realized by using a prototype exclusive matching mechanism of momentum updating.

The application relates to a kind of aerial image rotating target detection methods based on annular smooth label, belong to image processing field.The method comprises the following steps: S1: the format of image label is handled using annular smooth label (CSL), so that the angle information in the label has periodicity;S2: for the problem of difficult feature extraction caused by occlusion, small target and other reasons, a global context module is introduced into the feature extraction module of YOLOv5s network, which is improved and a rotating target detection model is built;S3: use GSConv convolution to replace the standard convolution to optimize the Neck module of the network and generate feature maps of different sizes;S4: class prediction and rotating envelope box prediction containing angle information are carried out;S5: calculate classification loss, confidence loss, positioning loss and angle loss;S6: use the improved detection model to train the preprocessed data set;S7: input test set, obtain detection result.

A data classification and recognition method includes: obtaining a first data set and a second data set, the second data set including second data, samples in the second data being labeled; performing training using first data in an unsupervised training mode and using the second data in a supervised training mode to obtain a first classification model; obtaining a second classification model; performing distillation training on a model parameter of the second classification model to obtain a data classification model; and performing class prediction on target data by using the data classification model.

The invention discloses a YOLO-based lightweight attention-guided digestive endoscopy abnormal region detection method. The method comprises the following steps: preprocessing data by adopting an image enhancement strategy, and inputting the preprocessed data into a backbone network to extract features; and the extracted features are subjected to up-sampling, fusion and enhancement on the neck layer and then are input into the detection layer to complete position regression and category prediction of the target area. According to the method, an MDR-YOLO model is developed and is used for abnormal region detection of a digestive endoscopy image, and a proposed MSC2f module comprises a multi-scale parallel convolution attention module used for extracting multi-scale feature information; the provided D4f module comprises a deep semantic expression structure constructed by a multi-level convolution residual path, so that high-quality feature fusion and enhancement are realized; a proposed RSC2f module comprises a channel attention residual module which is used for improving the ability of the model to extract all-channel features. The experimental result verifies the effectiveness of the MDR-YOLO model in the detection of the abnormal region in the digestive endoscopy image, and especially shows higher accuracy and robustness in the detection of a small target.

Disclosed in the present invention is an endoscopic ultrasound-based lesion invasion depth evaluation system, comprising: an image acquisition module for acquiring an endoscopic ultrasound image, a model creation module for creating a convolutional neural network model, and a model training module. The convolutional neural network model comprises: a feature extraction module, used for performing layer-by-layer feature extraction across at least three layers on the endoscopic ultrasound image, so as to obtain encoded feature maps; a feature fusion module, used for performing feature fusion on at least three groups of encoded feature maps, so as to obtain a first fused feature map; a decoder module, used for using an attention mechanism to process the encoded feature maps used in the feature fusion module and the feature map obtained by the feature fusion module, so as to obtain multiple decoded feature maps, and used for performing image segmentation on a finally obtained decoded feature map, so as to obtain a lesion region; and a class prediction module, used for performing classification with respect to the lesion invasion level on the basis of the first fused feature map and the decoded feature maps. The present invention can accurately predict lesion regions and lesion invasion depth types.

This invention relates to the field of cardiovascular disease auxiliary diagnosis technology, specifically to a method and system for auxiliary diagnosis of high-altitude hypertension based on electrocardiogram (ECG). It uses 12-lead ECG images as input, constructs a multi-branch adaptive classification model that integrates regional priors, sequentially extracts shallow general features through a shared feature extraction module, combines independent feature branches from multiple leads with a paired spatial attention module to capture relative potential differences between leads, and a multi-path adaptive fusion module dynamically fuses differential features between high-altitude and plain areas using regional labels as gating signals. Finally, a hybrid classifier composed of capsule networks and DenseNet cascades the features to complete a four-class prediction: high-altitude hypertension, high-altitude normal, plain hypertension, and plain normal. This invention effectively overcomes the problem of cross-regional data domain shift, improves the ability to capture weak pathological features in ECG images, and has strong clinical transferability and robustness, making it suitable for auxiliary screening of hypertension across high-altitude and plain areas.

A small sample action recognition method based on a graph neural network, comprising the following steps: S1, acquiring a video and extracting video features; S2, remodeling and enhancing the video features to obtain video timing features; S3, performing average pooling operation on all video timing features to form corresponding node features, and using the node features to construct edge features, the node features and the edge features are input into a pre-trained graph network for feature propagation and update, and task-oriented features of a query video and a class support set video are calculated; S4, performing class matching on the task-oriented features to obtain a class prediction value of the query video; S5, identifying the action of the actor in the query video through the class prediction value, wherein the method can accurately and quickly identify the action of the actor in the actual scene with only a small amount of labeled training data.

The invention relates to a drowning diagnosis diatom detection method and device resistant to background interference. The method comprises the steps that S1, diatom image data are collected, an image and a format are processed, a double-decoupling gating convolution fusion unit DDG-Conv is constructed, an expert kernel is generated through frequency domain decoupling, and high and low frequency feature fusion is achieved by combining feature translation to expand a receptive field and gating; s2, constructing a fine-grained hybrid encoder FGH-Encoder, extracting multi-scale features by a backbone network, performing global modeling, constructing a feature fusion path by using DDG-Conv, and outputting full-scale encoding features; and S3, constructing a micro-scale refining decoder MSR-Decoder to analyze and predict the full-scale coding features, and outputting a target bounding box and a category prediction result. According to the invention, through frequency domain decoupling, spatial feature translation and gating fusion, the problems of weak feature expression in small target diatom detection and poor detection effect under a complex background are effectively solved.

Approaches that intend to reduce disparate impact, particularly those for providing equal coverage sets in conformal prediction, can in fact increase disparate impact for human-in-the-loop systems. To improve these systems, rather than optimizing selection processes for a class prediction set for a confidence level (e.g., a percentage confidence that the correct class is in the class prediction set), a selection process is determined that reduces the set size difference across groups.

The application discloses a photovoltaic panel damage detection method and system based on an open vocabulary, and a medium, solves the problems of high model training cost and long training time in the prior art, has the beneficial effects of reducing training cost and improving recognition accuracy, and the specific scheme is as follows: a photovoltaic panel damage detection method based on an open vocabulary, comprising constructing a training data set; performing knowledge distillation pre-training, using the pre-trained open vocabulary target detection model as the teacher model, using the detection model to be trained as the student model, distilling the intermediate layer features and class prediction distribution of the teacher model respectively, and the student model learns basic semantic understanding ability through the first pre-training data set; freezing the knowledge distillation module of the student model, collecting images of photovoltaic panels to be detected and preprocessing, and inputting the fused multi-scale feature map and the updated text embedding vector into the detection output module.

The embodiment of the invention provides a classification model training method based on hierarchical knowledge migration. The method comprises the steps of obtaining a universal baseline model with a semantic understanding capability; according to the hierarchical classification structure of the target domain, an industry domain model containing a plurality of sub-classification output heads is constructed, and initialization is carried out by using a general baseline model parameter; constructing a hierarchical constraint loss function, and constraining the parent class prediction probability to be greater than or equal to the child class prediction probability; obtaining domain classification training samples, and respectively inputting the domain classification training samples into the general baseline model and the industry domain model to obtain first and second prediction category probability distributions; calculating domain cross entropy loss based on the second prediction distribution and the real label, calculating knowledge distillation loss based on the difference between the two distributions, and constructing a target loss function in combination with hierarchical constraint loss; and taking minimization of the target loss function as a target training industry domain model. According to the method, the model training efficiency is effectively improved, efficient migration of domain knowledge is realized, and the hierarchical classification accuracy is remarkably improved.

The application provides a self-adaptive feature enhancement method, device and equipment and a readable storage medium. The method comprises the following steps: performing multi-dimensional feature extraction on input image data to obtain a multi-dimensional feature map, performing fusion enhancement on the multi-dimensional feature map to generate a multi-scale feature map; inputting the multi-scale feature map into a fountain feature enhancement module, performing dimension reduction convolution module calculation at each scale to obtain the class prediction confidence of each detection unit; determining an overall loss function based on the class prediction confidence of each detection unit, and determining the detection result of the input image data according to the overall loss function. The application can effectively improve the problem of insufficient high-dimensional semantic feature point feature cohesion and make the sub-optimal detection unit pay more attention to the target region features in the receptive field and enhance the feature expression, thereby improving the image target detection accuracy.

The invention discloses a pulse time-driven network performance optimization system and method, and the system comprises a sparse scrambling coding module which is used for carrying out the sparse scrambling coding of input data, so as to convert the input data into a pulse sequence with the determined time distribution in the coding time, and obtain a coded pulse sequence; the decoding module is used for inputting the coded pulse sequence into the pulse neural network for reasoning, and continuously monitoring pulse activity of each category of channel of an output layer of the pulse neural network in the reasoning process; when the first pulse of any category of channel is detected, generating category prediction based on the pulse time, the pulse count or the combination thereof of the first pulse; and the coding and decoding driving training module is used for carrying out combined optimization of weights and thresholds on the network or carrying out conversion from an artificial neural network and carrying out threshold calibration on the network based on category prediction. Therefore, by adopting the embodiment of the invention, the recognition robustness of the network on the data set can be obviously improved.

The invention discloses a real-time weld defect detection method and system based on a lightweight neural network. The method comprises the steps of image acquisition, feature extraction, feature fusion, target detection and result output: acquiring a weld image through industrial equipment and performing standardization processing; a StarNet lightweight backbone network is adopted, and star operation is taken as a core to extract multi-scale features; partial convolution, local attention extraction and a global attention mechanism are fused through a C3k2-FasterFusion module, noise is suppressed, and feature representation is enhanced; through shared convolutional layer design of a LeanHead lightweight detection head, defect position regression and category prediction are realized, and a defect position frame and a classification label are output. Through collaborative optimization of the three core modules, model parameters and calculation loads are greatly simplified while high detection precision is guaranteed, and the method has the advantages of being light in weight and high in real-time performance, can be flexibly deployed on various edge calculation devices and is suitable for online real-time detection of weld defects, and the production quality control efficiency is effectively improved.

A method of generating text-driven prompts and class prediction probabilities using a vision-language model (VLM) includes receiving candidate class names associated with a plurality of candidate classes for images, generating class text tokens based on a text description of the candidate class names, and generating a plurality of context prompt vectors using a prompt generator. The context prompt vectors define context information associated with an image classification task to be performed by the VLM. The method further includes generating prompts for each of the plurality of candidate classes by appending respective class text tokens to the context prompt vectors for each of the plurality of candidate classes, and, using the VLM, generating and outputting a class prediction probability for a sample image based on the plurality of context prompt vectors.

This invention discloses an adaptive model reuse method based on adapter fine-tuning. Taking object detection in computer vision as an example, firstly, a model pre-trained on a large-scale image dataset is obtained as the original model, and candidate adapters are set for it according to the structure of the pre-trained model. Then, the Taylor expansion method is used to calculate the global gain of adding adapters at different positions in the network for images with localized bounding boxes and class labels in the target domain, thereby achieving adaptive adapter configuration. In the fine-tuning stage, the global gain of adapters at different positions for labeled image samples is recalculated. The original model parameters are frozen, and the adapter parameters are updated using gradient backpropagation with a learning rate weighted by the global gain softmax. Finally, the fine-tuned model is reused in downstream tasks to locate objects in images and provide class predictions. This invention achieves adaptive adapter configuration based on global gain, realizing more accurate object localization and class prediction in object detection tasks.

This disclosure relates to methods and apparatus for generating counterfactual data samples for a neural network. According to various embodiments, a method for generating counterfactual data samples for a neural network based on input sensor data samples is described, comprising: using the neural network to determine a class prediction for the input sensor data samples; determining, in addition to the class prediction, an estimate of the uncertainty of the class prediction; generating candidate counterfactual data samples for which the neural network determines class predictions different from those of the input sensor data samples; determining a loss function, wherein the loss function includes an estimate of the uncertainty of the class predictions made by the neural network for the candidate counterfactual data samples; modifying the candidate counterfactual data samples based on the determined loss function to obtain counterfactual data samples; and outputting the counterfactual data samples.

Single-stage frameworks for open-vocabulary panoptic segmentation are provided. One aspect provides a computing system comprising a processor and memory storing instructions that, when executed by the processor, cause the processor to: receive an image; extract a plurality of feature maps from the image using a convolutional neural network-based vision-language model; generate a plurality of pixel features from the plurality of feature maps; generate a plurality of mask predictions from the plurality of pixel features; generate a plurality of in-vocabulary class predictions corresponding to the plurality of mask predictions using the plurality of pixel features; generate a plurality of out-of-vocabulary class predictions using the plurality of feature maps; perform geometric ensembling on the plurality of in-vocabulary class predictions and the plurality of out-of-vocabulary class predictions to generate a plurality of final class predictions; and output the plurality of mask predictions and the plurality of final class predictions.

The invention discloses an underwater small target identification method and system based on a multi-view deep convolutional neural network. The method comprises the following steps: firstly, performing tensor remodeling and channel copying on an acquired multi-view sonar image to adapt to a pre-training feature extraction network; then, a multi-view deep convolutional neural network is utilized to extract discriminative features from each view image; further, through the maximum pooling operation along the view angle dimension, performing efficient fusion on the obtained multi-view angle features, so as to screen out the most significant feature response; and finally, target category prediction is carried out based on the fused features, and the category with the highest confidence coefficient is selected as a prediction result of the underwater small target. Based on the above process, the method constructs a complete target feature space and more discriminative target representation through efficient mining and fusion of complementary features such as texture and shape of the target under different visual angles, and effectively overcomes the recognition performance bottleneck caused by information loss, geometric distortion and shielding of a single-visual-angle sonar image.

Described embodiments generally relate to a method of generating an image editing tool recommendation. The method includes receiving a prompt entered by a user; processing the prompt using a tool class prediction model to predict a tool class associated with the prompt, wherein the tool class is associated with at least one image editing tool that is configured to perform an image editing function described by the prompt; determining an image editing tool associated with the predicted tool class; and outputting a recommendation to the user directing the user to the determined image editing tool.

The invention relates to a railway bullet train bolt fault detection method, in particular to a railway bullet train bolt fault detection method. The objective of the invention is to solve the problems that the existing method cannot accurately distinguish the state of the bolt of the railway bullet train and the recognition precision is low. The method comprises the following steps: step 1, constructing a railway bullet train bolt fault detection network model; and 2, obtaining a to-be-detected railway bullet train image, inputting the to-be-detected railway bullet train image into the railway bullet train bolt fault detection network model, and generating a target detection frame and category prediction by the railway bullet train bolt fault detection network model. The method is used in the field of railway bullet train bolt fault detection.

The invention provides an arch dam body damage identification method. The method comprises the following steps: constructing a normal operation condition model and a potential damage condition model; obtaining the three-dimensional static displacement field response of each working condition model under different water level conditions; utilizing an interpolation function to calculate monitoring node displacement, and calculating an incremental displacement characteristic value; constructing a displacement characteristic matrix and a state characteristic matrix under different working conditions; and training an arch dam body state prediction model by using the feature matrix, and realizing dichotomy prediction of the normal / damaged state of the arch dam body based on engineering monitoring data. According to the arch dam body damage identification method provided by the invention, the damage state of the arch dam body is captured by utilizing the displacement characteristics, and the limitation of the current arch dam body damage identification method can be effectively solved.