Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

1110 results about "Sample graph" patented technology

Model pre-training method and device for multi-language task

The invention provides a model pre-training method and device for a multi-language task, and relates to the technical field of artificial intelligence, and the method comprises the steps: obtaining a multi-modal training data set which comprises a plurality of pieces of sample text data and a plurality of pieces of sample image-text pair data with multi-language contents, and covers a universal field and a preset business field; based on a plurality of sample image-text pair data, performing comparative learning training of alignment of visual features and text features on the initial model, freezing model parameters of a decoding module and adjusting model parameters of a visual encoder and a projection module in the training process until a first ending condition is met; based on the multiple pieces of sample image-text pair data and the multiple pieces of sample text data, constraint training of content understanding is carried out on the initial model meeting a first ending condition, and model parameters of a visual encoder, a projection module and a decoding module are adjusted in the training process until a second ending condition is met to obtain a target model; the information extraction capability of the model in the specific field can be remarkably improved.
Owner:LIANLIAN YINTONG ELECTRONIC PAYMENT CO LTD +1

Zero sample image anomaly detection method and device

PendingCN119130931AAccurate and comprehensive automated buildsImprove efficiencyImage enhancementImage analysisSample graphAnomaly detection
The invention provides a zero sample image anomaly detection method and device, and belongs to the field of computer vision and image anomaly detection. The method comprises the steps that an image of a to-be-detected target is input into a preset zero sample image anomaly detection network, the network comprises an image encoder and a text encoder, and through multi-mode prompt learning, the image encoder outputs local visual features of the image, and the text encoder outputs text features capable of being learned and prompted to be embedded; and calculating the cosine similarity of the local visual features and the text features and interpolating to obtain a similar graph, and measuring the similarity to obtain an abnormal graph so as to obtain an abnormal detection result of the input image. According to the method, the flexibility of feature representation and the generalization ability of prompt are enhanced by constructing multi-modal prompt learning, the complexity of manual design of prompt engineering can be reduced, and a better anomaly detection prompt can be constructed, so that the effect of a zero sample anomaly detection model is improved.
Owner:TSINGHUA UNIVERSITY

Multi-modal small sample image classification method and system based on multi-scale dynamic feature fusion

The invention relates to the technical field of small sample image classification, in particular to a multi-modal small sample image classification method and system based on multi-scale dynamic feature fusion. The method comprises the following steps: acquiring a small sample image data set, and dividing the small sample image data set into a support set and a query set; and inputting the two features into a feature extraction network to extract global features, and inputting the features into a regional proposal network (RPN) to obtain corresponding local features. Extracting semantic information according to the category label of the support set data, and inputting the semantic information into a text encoder to obtain text features; inputting the global feature, the local feature and the text feature of the input image into an adaptive weight network, and performing dynamic feature fusion to effectively integrate multi-modal information; and inputting the fused multi-modal features into a classification model which takes a prototype network as a learning device and takes an MAML algorithm as a meta-learning device for classification prediction, finally training a network model by using a composite loss function, and performing image classification by using the trained classifier.
Owner:CHANGCHUN UNIV OF SCI & TECH

Method and apparatus for training text-graph model, device, and storage medium

PCT designated stage expiredWO2025035924A1Image enhancement2D-image generationSample graphObject Class
A method and apparatus for training a text-graph model, a device, and a storage medium, relating to the artificial intelligence. The method comprises: on the basis of a training set of graph-text sample pairs, performing iterative training on a model to be trained, to obtain a text-graph model; in a training process: selecting a graph-text sample pair from the training set of graph-text sample pairs, the graph-text sample pair comprising a sample image and a description text, and the sample image comprising at least two objects; obtaining mask images corresponding to the at least two objects and associated object class names, the mask images being used for distinguishing position regions of the objects in the sample image; inputting the sample image and the description text to a model to be trained, to obtain an image prediction noise of the sample image, and inputting at least two mask images and the associated object class names to the model to be trained to obtain object prediction noises respectively associated with the at least two mask images; and constructing a loss function on the basis of the image prediction noise and the object prediction noises, and by using the loss function, adjusting a parameter for the model to be trained.
Owner:TENCENT TECHNOLOGY (SHENZHEN) CO LTD

Memory matching industrial defect detection method based on adaptive feature fusion

The invention relates to the technical field of industrial defect detection, and discloses a memory matching industrial defect detection method based on adaptive feature fusion, and the method comprises the steps: generating a plurality of unknown defect samples through an enhanced image-level defect simulation strategy, and helping a model to effectively distinguish a normal mode from an abnormal mode; the method comprises the following steps: extracting multi-scale features of a to-be-detected sample image, a normal sample image and a defect sample image, designing an adaptive hierarchical memory bank architecture, embedding the multi-scale features into a grid memory bank in a layered manner, further improving the reasoning speed through an adaptive core set sampling strategy, and combining multi-scale feature fusion and a defect positioning optimization technology to obtain a defect positioning algorithm. And the difference between the multi-scale features and the normal mode is fully utilized, so that the accuracy of defect detection and positioning is remarkably improved. Compared with the prior art, the defect detection precision and the positioning accuracy can be improved, and meanwhile, the real-time detection requirement can be met.
Owner:SUQIAN COLLEGE

Face anti-fraud model training method and device based on image-text comparison assisted learning

The invention discloses a face anti-fraud model training method and device based on image-text comparison assisted learning, and belongs to the technical field of artificial intelligence. The method comprises the following steps: identifying the content of each sample image in an image set to obtain a description text corresponding to each sample image; generating text data corresponding to each sample image in combination with the description text and the label; and inputting each sample image in the image set into an image encoder in the multi-modal pre-training model, and inputting text data corresponding to each image into the text encoder in the multi-modal pre-training model, so as to train the multi-modal pre-training model and obtain a face anti-fraud model. According to the method, the image content description text and the face type label are integrated, the features are mixed, the central difference convolution adapter module is introduced to capture the fine features of the face, the features are subjected to semantic alignment through image-text comparison learning and matching, and the generalization ability of the model in different application scenes is improved.
Owner:GRG TALLY VISION I T CO LTD +2

Combined zero sample image classification method based on hierarchical feature fusion

The invention belongs to the technical field of computer vision and artificial intelligence, and discloses a combined zero sample image classification method based on hierarchical feature fusion. According to the method, a solution based on hierarchical feature fusion is innovatively provided for the technical difficulty of combined zero sample image classification. According to the method, features of different depths in a CLIP model visual encoder are selected and subjected to hierarchical fusion, multi-level and multi-scale visual information is effectively extracted, the fused features are further used for visual and semantic cross-modal interaction, and the understanding ability of the model for complex combinations is remarkably improved. In addition, by introducing a specific loss item, attributes and object features are effectively separated, and the feature aliasing problem is avoided. In a combined zero sample image classification task, the method shows excellent generalization ability and recognition effect, and can significantly improve the classification performance of the model for unknown complex combined images.
Owner:NANJING UNIV OF AERONAUTICS & ASTRONAUTICS

Lithium battery health state assessment method based on deep learning

The invention discloses a lithium battery health state evaluation method based on deep learning, and relates to the technical field of battery evaluation. Comprising the following steps: acquiring a Nyquist curve graph of a lithium battery through an electrochemical impedance spectroscopy test, and mapping the Nyquist curve graph with internal impedance characteristic parameters one by one to generate a sample image set; and establishing a deep learning network model based on the sample image set, and training and generating a prediction model by taking the Nyquist curve graph as input and the internal impedance characteristic parameters as labels. And testing the to-be-evaluated battery, and inputting the target Nyquist curve graph to predict internal impedance characteristic parameters. And calculating a capacity retention ratio index, a cycle efficiency degradation index and a shape expansion influence index in combination with the electric power characteristic parameters. The indexes are comprehensively analyzed to obtain a health state comprehensive coefficient, and the health state comprehensive coefficient is compared with a health threshold value to judge the health state of the battery. According to the method, the evaluation precision is improved through deep learning, and efficient and accurate health state evaluation is realized.
Owner:CHINA JILIANG UNIV

Automatic driving obstacle recognition method and system based on deep learning

The invention provides an automatic driving obstacle recognition method and system based on deep learning, and relates to the technical field of automatic driving, and the method comprises the steps: collecting sample image data and sample point cloud data; performing feature extraction on the marked point cloud and the marked image by using a 3DCNN network, and performing training according to an extraction result to obtain a classifier and a prediction head; enhancing the unmarked image and the unmarked point cloud; performing feature extraction on the enhanced image and the enhanced point cloud to obtain a multi-scale image feature and a multi-scale point cloud feature; dynamically adjusting the weights of the multi-scale image features and the multi-scale point cloud features based on a feature fusion method of an attention mechanism to obtain fusion features; and inputting the fused features into the trained classifier and the prediction head to obtain an obstacle recognition result. According to the method, the accuracy, robustness and generalization ability of obstacle recognition are remarkably improved, the marking cost is reduced, and the high requirements of an automatic driving scene for real-time performance and reliability are met.
Owner:BEAR ROBOT CO LTD

Mathematical problem solving method and device based on multi-modal large model and electronic equipment

The invention provides a mathematical problem solving method and device based on a multi-modal large model and electronic equipment, and relates to the technical field of artificial intelligence. The method comprises the following steps: determining a mathematical element image of a mathematical problem; inputting the mathematical element image into an image coding model to obtain an image vector output by the image coding model; the image coding model is obtained by training based on a sample mathematical element image and a positive sample text description and a negative sample text description corresponding to the sample mathematical element image; inputting the image vector into a self-adaptive module to obtain an image conversion coding vector output by the self-adaptive module; the adaptive module is obtained based on training of a sample image vector and a sample text vector; determining question stem characters of the mathematical question, and inputting the question stem characters and the image conversion coding vector into the large language model to obtain a prediction answering process output by the large language model; the large language model is obtained based on sample question stem characters, sample image conversion coding vectors and sample answering process training, and the mathematical problem solving capability of the multi-modal large model can be improved.
Owner:TSINGHUA UNIVERSITY

Warehouse inventory intelligent management method, device and terminal based on AI visual monitoring

The embodiment of the invention relates to the technical field of data processing and AI vision, and provides a warehouse inventory intelligent management method and device based on AI vision monitoring and a terminal, and the method comprises the steps: obtaining inventory management basic data and external dynamic influence data of a to-be-monitored warehouse; based on an AI visual technology, according to the sample image data set and the label image data set, performing dynamic optimization processing on current inventory data in the inventory management basic data to obtain dynamically optimized inventory data; according to the inventory management basic data and the dynamic optimization inventory data, carrying out inventory structure evaluation to obtain inventory structure evaluation data; performing real-time dynamic adjustment processing on the inventory structure evaluation data according to the external dynamic influence data to obtain inventory dynamic adjustment data; according to the dynamic optimization inventory data, the inventory structure evaluation data and the inventory dynamic adjustment data, an inventory health evaluation report is generated, and the purpose of more accurate and more comprehensive warehouse inventory intelligent management is achieved.
Owner:SHENZHEN MINGXIN DIGITAL TECH CO LTD

Intelligent defect detection method and intelligent defect detection network based on S-shaped dynamic convolution and cross-weighted feature pyramid

The invention provides an intelligent defect detection method and an intelligent defect detection network based on S-shaped dynamic convolution and a cross-weighted feature pyramid, and the method comprises the following steps: collecting an OK sample image and a plurality of NG sample images, and employing a co-occurrence matrix matching method based on Laplacian gradient features, extracting defect labeling area images of the plurality of NG sample images; constructing a feature extraction network based on S-type dynamic convolution for extracting defect features; constructing a pyramid module based on cross-weighted features, wherein the pyramid module is used for multi-level fusion calculation; building an intelligent defect detection network based on S-type dynamic convolution and a cross-weighted feature pyramid, and training the intelligent defect detection network; performing product detection by using the defect intelligent detection network based on the S-shaped dynamic convolution and the cross-weighted feature pyramid; through the arrangement, high-precision segmentation can be better carried out on the defect area and the background area, the precision and accuracy of industrial AOI defect detection are improved, and the quality safety of industrial AOI products is guaranteed.
Owner:SHENZHEN JINGCHUANG TECH CO LTD

Electronic component defect detection method, system and device

The invention relates to the technical field of defect detection, and particularly discloses an electronic component defect detection method, system and device, and the method comprises the steps: collecting a multiband original image set based on multispectral imaging, inhibiting batch material difference and surface reflection through orthogonal complementary space projection, and obtaining a de-noised image set; performing feature extraction on the de-noised image set, and identifying and marking all fragmented defect areas; based on a graph neural network space attention mechanism, establishing an association relationship between fragmented defect areas to form a complete defect feature chain; gray frequency value sequences of the to-be-detected image and the standard sample image are constructed respectively, and a first fitting curve and a second fitting curve are obtained through fitting of a skewed distribution function; and finally, comprehensively judging whether the electronic component has defects or not by combining the defect characteristic chain and the difference characteristics of the two fitting curves. According to the method, interference can be effectively suppressed, fragmented defects can be accurately identified, and the detection accuracy and reliability are remarkably improved through multi-dimensional feature fusion.
Owner:FOSHAN HENGXIANG SAFETY TECHNOLOGY CO LTD

Multi-modal retrieval model generation method and apparatus, device, and storage medium

Disclosed in embodiments of the present application are a multi-modal retrieval model generation method and apparatus, a device, and a storage medium. The embodiments of the present application can be applied to various scenarios such as artificial intelligence, intelligent transportation, and assisted driving. The multi-modal retrieval model generation method comprises: by means of a prefix vector module, performing feature recognition on first sample image modal data to obtain a first image prefix vector; by means of a modal identification module and on the basis of the first image prefix vector, the first sample image modal data, and first sample text modal data, generating a first retrieval character; by means of a constrained decoding module, acquiring from a pre-generated database a first sample retrieval result associated with the first retrieval character; and on the basis of a first reference retrieval result and the first sample retrieval result, adjusting the model parameters corresponding to the prefix vector module and the constrained decoding module to obtain a retrieval model after the adjustment. The present application can improve the training efficiency of multi-modal retrieval models.
Owner:TENCENT TECHNOLOGY (SHENZHEN) CO LTD

Occupancy grid prediction method and apparatus, smart device, and storage medium

The present application relates to the field of autonomous driving, and in particular relates to an occupancy grid prediction method, an occupancy grid prediction apparatus for implementing the method, a computer storage medium for implementing the method, and a smart device having the occupancy grid prediction apparatus. The method comprises: acquiring a pure visual image of the surroundings of a vehicle body; inputting the pure visual image into an occupancy grid prediction model; and using the occupancy grid prediction model to determine an occupancy result of an object in the pure visual image as a model output. The model output is an occupancy result in a cylindrical form, and the occupancy grid prediction model is constructed on the basis of a training dataset comprising sample images and truth value information of the sample images. The truth value information is directly generated from point cloud data or converted from occupancy information in a voxel form generated on the basis of the point cloud data.
Owner:ANHUI NIO AUTONOMOUS DRIVING TECH CO LTD

Key point prediction model training method and device, electronic equipment and computer readable storage medium

The invention provides a key point prediction model training method and device, electronic equipment and a computer readable storage medium. The method comprises the following steps: acquiring a sample key point in a sample image and first sample position information of the sample key point; extracting a feature map of the sample image through a to-be-trained key point prediction model; determining first prediction position information of the sample key point and first prediction offset information of a target pixel area where the sample key point is located in the feature map; determining a model loss value based on the first sample position information, the first prediction position information, and first sample offset information and first prediction offset information of the sample key point in the target pixel region; and performing model parameter updating on the to-be-trained key point prediction model based on the model loss value to obtain a trained key point prediction model. According to the invention, the precision and stability of the key point prediction model can be improved.
Owner:UBTECH ROBOTICS CORP LTD

Vegetation graph model training method, image generation method, device and medium

The invention provides a text graph model training method and device, an image generation method and device and a medium, relates to the technical field of artificial intelligence such as computer vision, deep learning and the like, can be applied to scenes such as AIGC content generation based on artificial intelligence, and comprises the following steps: obtaining a candidate text graph model and a sample high-quality image set; obtaining a candidate user preference data set corresponding to the user set, and obtaining a sample high-quality preference image set corresponding to the sample high-quality image set based on the candidate user preference data set; constructing a sample image-text pair set corresponding to the sample high-quality preference image set, and based on the sample preference image-text pair set, obtaining a target fine tuning sample required by the candidate text graph model; and based on the target fine adjustment sample, performing model fine adjustment on the candidate text graph model to obtain a target text graph model.
Owner:BEIJING BAIDU NETCOM SCI & TECH CO LTD

Feature cache optimization-based few-sample classification method research

The invention discloses a few-sample classification method research based on feature cache optimization, and the method comprises the steps: (1), employing an improved ResNet-based SwAV model as a backbone, and enabling the SwAV model to be used for generating auxiliary features; (2) taking the image data and the text description as original input, and generating text input with rich downstream language semantics by utilizing GPT-3 to serve as text prompt of a CLIP model; (3) through a feature selection method based on feature similarity and difference, the problems of feature redundancy and inaccurate selection in the feature selection process are solved, feature dimensions with high selection value are identified, and normalization and enhancement zooming processing are performed on the features; and (4) utilizing visual contrast knowledge of SwAV, introducing a learnable cache model, and adaptively mixing prediction results from CLIP and SwAV. According to the method, under the CLIP framework without extra training, the accuracy of few-sample image classification is effectively improved through feature cache optimization and a self-adaptive hybrid strategy.
Owner:GUILIN UNIV OF ELECTRONIC TECH

Target detection model training method and device, electronic equipment and storage medium

The invention provides a target detection model training method and device, electronic equipment and a storage medium, and relates to the technical field of computer processing. The method comprises the following steps: acquiring a data set for model training, and inputting the data set into a feature extraction network in a to-be-trained initial detection model to perform multi-scale feature extraction and attention feature extraction on sample images to obtain a plurality of multi-scale feature maps corresponding to each sample image; inputting each multi-scale feature map into a detection head in the initial detection model to obtain a detection result corresponding to the sample image, then obtaining a loss value between each to-be-detected target and a real target corresponding to each to-be-detected target in the detection result, judging whether the loss value meets a preset model convergence condition, and if yes, determining that the to-be-detected target does not meet the preset model convergence condition; and if yes, taking the initial detection model meeting a preset model convergence condition as a target detection model. In this way, the problems that a traditional target recognition model is low in small target detection precision and poor in effect in the video satellite image can be solved.
Owner:WUHAN INST OF TECH

Model training method and device based on visual reinforcement learning, equipment and medium

The embodiment of the invention provides a model training method and device based on visual reinforcement learning, equipment and a medium. Comprising the following steps: acquiring a sample image frame and semantic category information, inputting the semantic category information into a visual large language model to obtain a first convolution kernel parameter, and inputting the sample image frame into a first feature convolution kernel to obtain a first feature thermodynamic diagram; obtaining a second convolution kernel parameter and a second feature thermodynamic diagram of the sample image frame through a preset visual reinforcement learning model; constructing a first distillation loss based on the first convolution kernel parameter and the second convolution kernel parameter, and constructing a second distillation loss based on the first characteristic thermodynamic diagram and the second characteristic thermodynamic diagram; through prediction and calculation of the sample action data and the sample state data, self-supervision loss and target strategy loss are constructed; and based on the first distillation loss, the second distillation loss, the self-supervision loss and the target strategy loss, performing parameter adjustment on a preset visual reinforcement learning model to obtain a target visual reinforcement learning model.
Owner:PENG CHENG LAB

Multi-model fusion PCB through hole defect detection method, device, equipment and medium

The invention discloses a multi-model fusion PCB through hole defect detection method, device and equipment and a medium, and the method comprises the steps: obtaining a to-be-processed sample image set, and processing the to-be-processed sample image set to obtain a target sample image set; performing pruning training on each to-be-trained deep learning model based on the target sample image set to obtain a target deep learning model corresponding to each to-be-trained deep learning model, the target deep learning model including a target key point model, a target detection model and a target segmentation model; the model structures of the to-be-trained deep learning models are different from each other; and establishing a target fusion model based on the target deep learning model, inputting the to-be-detected image into the target fusion model, and determining a through hole defect detection result corresponding to the to-be-detected image. Through multi-model fusion and pruning optimization, the advantages of each model in defect detection can be fully played, and the reasoning speed is remarkably improved on the basis of ensuring high precision.
Owner:WUXI UNICOMP TECH

Network training method and apparatus for pose estimation, pose estimation method and apparatus, and electronic device, storage medium and computer program product

PCT designated stage expiredWO2025036450A1Biometric pattern recognitionSample graphData set
The present disclosure relates to the technical field of computers, and relates to a network training method and apparatus for pose estimation, a pose estimation method and apparatus, and an electronic device, a storage medium and a computer program product. The network training method for pose estimation comprises: inputting a sample image, which is acquired from a training data set, into a preset feature extraction network; and performing training on an initial pose network according to a feature tensor, which is outputted by the feature extraction network, of a target object in the sample image, so as to obtain a target pose network. By means of the embodiments of the present disclosure, the training efficiency can be improved, thereby further reducing the consumption of computing power resources a processor and memory resources.
Owner:MOORE THREADS TECH CO LTD

Image processing method and apparatus, and computer device, storage medium and program product

PCT designated stage expiredWO2025044485A1Image enhancementImage analysisData packSample graph
Provided in the present application are an image processing method and apparatus, and a computer device, a storage medium and a program product. The method relates to computer vision technology of artificial intelligence. The method comprises: acquiring sample data, wherein the sample data comprises a sample image, a sample category to which the sample image belongs, and a sample identifier, which is set for the sample image; calling an image generation model to extract training representation information of the sample identifier; calling the image generation model to predict, on the basis of the training representation information of the sample identifier, noise added to a noise image corresponding to the sample image, so as to obtain predicted noise, wherein the noise image is obtained by adding label noise to the sample image; and on the basis of the difference between the label noise and the predicted noise, and the difference between training semantics of the sample identifier and semantics of the sample category, updating model parameters of the image generation model, so as to train the image generation model. Using the present application can reduce the degree of overfitting of the image generation model and improve the training effect of the image generation model.
Owner:TENCENT TECHNOLOGY (SHENZHEN) CO LTD

Parameter efficient fine tuning method and device based on hybrid expert system, and image segmentation method and device

The invention provides a parameter efficient fine tuning method based on a hybrid expert system, and an image segmentation method and device. The method comprises the following steps: based on an improved sensitivity constraint function and a low-rank matrix constraint function in a self-adaptive low-rank adaptation module; obtaining a target low-rank matrix corresponding to a to-be-trained model parameter of a to-be-trained network layer in the pre-trained segmentation model; obtaining an output result of the to-be-trained network layer according to the target low-rank matrix, a routing decision value of the hybrid expert system and the sample image; according to a segmentation loss value between an image segmentation result corresponding to an output result of the to-be-trained network layer and an image segmentation label of the sample image, and an equilibrium loss value corresponding to each expert module in the hybrid expert system, obtaining a target loss value of the pre-trained segmentation model; and according to the target loss value, performing parameter efficient fine tuning on the to-be-trained model parameter iteration to obtain an image segmentation model. According to the method, the robustness is improved, the inter-task interference is reduced, and the task processing performance is improved.
Owner:元始智能科技(南通)有限公司

Target detection method, system and device based on semi-supervised learning and storage medium

The invention relates to the technical field of target detection, and particularly provides a semi-supervised learning-based target detection method, system and device and a storage medium, and the method comprises the steps: obtaining a data set which comprises a marked image and an unmarked image; generating a pseudo label for the unmarked image based on the marked image by using a dense detector; dividing the pseudo labels into reliable labels and soft labels according to the scores of the pseudo labels by using a pseudo label distributor; the pseudo label is updated to the data set, the updated data set is utilized to train a target detection model, and the target detection model identifies a target object in the sample image after training; the soft label is set to only participate in the preset partial loss calculation in the training process so as to reduce the training error caused by the soft label. According to the invention, an efficient semi-supervised learning target detection framework is constructed, and the accuracy of a target detection model is improved.
Owner:SHANDONG ENERGY GRP CO LTD +1

Model training method and device, target detection method and device and electronic equipment

The embodiment of the invention provides a model training method and device, a target detection method and device and electronic equipment, and relates to the technical field of computer vision. The method comprises the following steps: acquiring a sample image and a label; for each sample image, utilizing an encoder in the target detection model to obtain a first sample feature vector; the model further comprises a decoder; the decoder comprises at least one partial cross attention module; for each part of the cross attention module, splitting input data in a channel dimension, and processing a first input part and a second input part by utilizing a self-attention layer and a cross attention layer of the module; processing results of the self-attention layer and the cross attention layer are combined to obtain output data of the module; obtaining a detection result by using output data of the last module; and calculating a loss value based on the detection result and the label, and adjusting model parameters to obtain a trained target detection model. Therefore, the time delay of target detection can be reduced.
Owner:INTELLINDUST INFORMATION TECH (SHENZHEN) CO LTD

Semantic segmentation model training method, electronic device and storage medium

A semantic segmentation model training method and apparatus, an electronic device and a storage medium are provided. The semantic segmentation model training method includes: acquiring a sample image, and extracting visual image features corresponding to the sample image by a semantic segmentation model to be trained; processing the sample image to obtain a text image feature corresponding to the sample image, the text image feature being an image feature generated from language description text for the sample image; fusing the visual image features with the text image feature to obtain multimodal features, and performing image segmentation prediction based on the multimodal features to obtain a target loss; and training the semantic segmentation model to be trained based on the target loss to obtain a target semantic segmentation model.
Owner:BEIJING ZITIAO NETWORK TECH CO LTD

Country style and appearance design image generation method and system based on knowledge graph and large model

The invention relates to the technical field of image generation, and discloses a country style and appearance design image generation method and system based on a knowledge graph and a large model, and the method comprises the steps: constructing a core element covering country style and appearance design and a knowledge graph; constructing a multi-level label system based on the knowledge graph; pre-processed rural style and appearance sample images are obtained, the rural style and appearance sample images are labeled based on a multi-level label system, and a special training set in the field of rural style and appearance design is obtained; constructing a basic diffusion large model architecture, and training the basic diffusion large model architecture by using the special training set for the country style and appearance design field to obtain a trained country style and appearance design image generation model; and generating a rural style and appearance design image by using the trained rural style and appearance design image generation model. According to the method, the problems that a general large model is insufficient in domain knowledge support and insufficient in data labeling specialty in rural style and appearance design image generation are solved, and the rural style and appearance design image generation efficiency and quality are improved.
Owner:GUANGDONG URBAN & RURAL PLANNING & DESIGN INST

Training method and device of open vocabulary detection model and electronic equipment

The embodiment of the invention provides a training method and device of an open vocabulary detection model and electronic equipment. The open vocabulary detection model training method comprises the steps of obtaining sample data; the sample data comprises a sample image, a sample text and label information, inputting the sample data into a neural network model to be trained, and extracting text feature information of the sample text and image feature information of the sample image; generating dynamic text prompt information according to the image feature information; performing fusion processing on the text feature information and the dynamic text prompt information to obtain semantic fusion feature information; predicting an object in the sample image according to the semantic fusion feature information; and performing iterative training on the neural network model according to the object prediction result, the label information, the text feature information, the dynamic text prompt information and the semantic fusion feature information to obtain an open vocabulary detection model. According to the invention, the context sensing, semantic generalization and fine-grained understanding capabilities of the open vocabulary detection model can be improved.
Owner:HANGZHOU WEIMING XINKE TECH CO LTD +1

Multi-modal large model training method and device, target detection method and device and electronic equipment

The embodiment of the invention provides a multi-modal large model training method and device, a target detection method and device and electronic equipment, and relates to the technical field of artificial intelligence, and the multi-modal large model training method comprises the steps: obtaining a plurality of sample images and a first sample description text of an object labeling box in the image; utilizing the first large language model and the first text prompt to extract a category name and an attribute of an object described by the first sample description text corresponding to each sample image, and combining at least one of the obtained category name and the attribute to obtain a second sample description text; determining whether each object labeling box in the sample image is matched with each attribute of a plurality of corresponding second sample description texts or not; constructing a sample question containing the second sample description text and a corresponding sample answer in a thinking chain form to obtain a question and answer sample pair; and training the multi-modal large model by using the constructed question and answer sample pair. The complexity of descriptive target detection can be reduced, and the detection efficiency is improved.
Owner:HANGZHOU HIKVISION DIGITAL TECHNOLOGY CO LTD