268 results about "Segmentation system" patented technology

The invention provides a remote sensing image building semantic segmentation system based on a visual language model. The remote sensing image building semantic segmentation system comprises an initial building mask generation module and a pseudo label optimization and model iteration enhancement module. The initial building mask generation module comprises a query text set construction unit, a feature extraction unit, a cross-modal attention interaction unit, an initial building instance generation unit and an instance fusion and mask generation unit; and the pseudo-label optimization and model iteration enhancement module comprises a pseudo-label screening unit, a model iteration training unit and a dynamic parameter adjustment unit. According to the method, the quality of the building segmentation pseudo tag generated by the VLMs can be improved, the performance of a remote sensing image weak supervision semantic segmentation algorithm is improved, the problem that the building tag generated by the VLMs pre-trained by the natural scene image cannot be directly applied to the remote sensing image is solved, and the dependence of the remote sensing image building semantic segmentation on manual annotation is reduced.

The invention relates to the technical field of medical image processing, in particular to a multimodal-based digestive tract tumor lesion image segmentation method and segmentation system. The method comprises the following steps: acquiring an alimentary canal tumor lesion image, and extracting an alimentary canal tumor ultrasonic image; evaluating the tumor invasion depth based on the digestive tract tumor ultrasonic image; performing focus three-dimensional visual modeling according to the tumor invasion depth to obtain a digestive tract tumor focus model; extracting a tumor tissue pathological image according to the digestive tract tumor lesion image; performing tumor region segmentation based on the tumor tissue pathological image to obtain digestive tract tumor region data; performing tissue arrangement anomaly detection based on the digestive tract tumor region data to obtain tissue arrangement anomaly data; and calculating a tissue arrangement disorder index according to the tissue arrangement abnormal data and the digestive tract tumor area data. According to the invention, the tumor identification accuracy and the malignant region segmentation precision are improved based on the medical image processing technology.

The invention discloses a field unstructured road real-time segmentation system and method for agricultural machinery autonomous navigation, particularly relates to the field of agricultural machinery autonomous navigation, and is used for solving the problems of high precision and low delay of real-time segmentation of a driving area and an obstacle in a field unstructured road environment. The image stability under complex illumination is improved through brightness balance, and texture and contour features are extracted through lightweight multi-scale coding; texture deflection and contour focusing are normalized into probability distribution, direction consistency is analyzed based on modal competition fusion, direction embedding is dynamically adjusted, and deviation is avoided; guiding branch activation of a BiSeNet decoder by the direction perception tensor, and outputting a driving area probability graph and an edge heat graph; and continuous frame consistency filtering is used for eliminating instantaneous fluctuation, a stable segmentation mask and a boundary position vector are generated, and the path stability and operation continuity of navigation control are ensured.

The invention discloses a medical image fuzzy boundary segmentation system and method based on COD frequency domain guidance. In order to solve the problem of boundary fuzzy segmentation of a medical image under a complex background, frequency domain feature processing and an improved camouflage target detection (COD) algorithm are innovatively combined, and a progressive boundary optimization segmentation framework FEA-Net is designed. According to the framework, four key modules are designed: a semantic edge enhancement module (SEEM) realizes boundary preliminary positioning through space-channel self-attention; on the basis of SEEM, a frequency domain feature guide enhancement module (FTEM) further improves boundary prediction precision by using Fourier transform and adaptive frequency selection; an adaptive edge feature module (AEFM) highlights key boundary features; a Context Attention Aggregation Module (CAAM) implements feature fusion. Experiments show that evaluation indexes of the method on data sets of Kvasair-SEG, ISIC2018 and KPIs2024 are remarkably improved, particularly, obvious advantages are shown when boundary fuzzy areas are processed, and reliable support is provided for accurate segmentation of medical images.

The invention discloses a brain lesion nuclear magnetic image Transform diffusion segmentation method and a brain lesion nuclear magnetic image Transform diffusion segmentation system based on symmetry prior. The invention provides a novel prior-guided diffusion denoising brain lesion segmentation Transform model, long-distance coding features are extracted from an image, local information related to medical image prior features is supplemented, and frequency domain screening fusion coding components are further introduced. A U-shaped denoising model is designed based on a transform network structure, and in order to maintain accurate lesion-related semantic details, a prior feature coding branch is introduced. A priori feature coding branch considers modal-related voxel distribution characteristics and spatial symmetry in a modal, so that a priori guidance attention mask is learned, and attention weights of a pixel level and a patch level are dynamically adjusted. In order to eliminate image noise and a low contrast effect, in a decoding part, a three-branch wavelet frequency spectrum mixed attention module is designed for fusing and screening frequency spectrum feature embedding, and a stable segmentation result is further generated.

The invention discloses a remote sensing video segmentation method and segmentation system based on text guidance, belongs to the crossing field of remote sensing image processing and computer vision, and relates to a remote sensing video segmentation method and segmentation system. The invention aims to solve the problems that the existing remote sensing video segmentation technology is poor in flexibility, cannot interact with natural languages, is insufficient in generalization ability for new categories or complex targets, and cannot meet the requirement of quickly and accurately extracting semantic information in a dynamic remote sensing scene. The method comprises the following steps: 1, acquiring a video frame sequence, and acquiring a key frame based on the video frame sequence; 2, obtaining an initial segmentation mask; 3, obtaining an optimized mask; 4, calculating a minimum bounding rectangle of the optimized mask, obtaining a bounding box of the minimum bounding rectangle, and obtaining an expanded bounding box; and 5, inputting the expanded bounding box and the video frame sequence obtained in the step 1 into an improved SAM2 video segmentation model, and outputting a frame-by-frame segmentation result of the region of interest by the improved SAM2 video segmentation model.

The invention relates to the technical field of image processing, in particular to a clinical focus auxiliary segmentation system based on a nuclear magnetic resonance image. The system comprises an MRI image processing module, a lesion auxiliary segmentation module, a probability segmentation correction module and a lesion boundary smoothing module, a corresponding clinical nuclear magnetic resonance image set of a patient can be obtained, image position alignment and gray level adjustment processing can be carried out, and meanwhile a corresponding clinical image lesion segmentation model is constructed to carry out multi-scale fusion auxiliary segmentation. Generating a clinical focus region segmentation fusion image; obtaining a focus confidence probability corresponding to each pixel point in the segmentation image through the clinical focus region segmentation fusion image, and carrying out probability segmentation boundary correction on the clinical focus region segmentation fusion image to obtain a clinical focus region segmentation correction result image; and performing focus edge shape smoothing processing on the clinical focus region segmentation correction result map to generate a clinical focus edge shape segmentation optimization result. According to the invention, high-precision segmentation of the focus in the MRI image can be realized.

The invention discloses a weak supervision image semantic segmentation system and method based on an attention mechanism, and the method comprises the following steps: obtaining to-be-segmented image data and an image-level label, and extracting a multi-level semantic feature map; fusing the multi-level feature map with the space and the channel dimension to generate an attention feature map; combining the attention feature map with an image-level label to obtain a target area positioning map; inputting the attention feature map and the target area positioning map into a double-edge reconstruction network to generate a high-quality pseudo-label map; carrying out progressive decoding structure convolution on the pseudo label graph and the multi-level semantic feature graph to generate a segmentation prediction graph; constructing a supervision signal based on the segmentation prediction map and the pseudo-label map to obtain a supervision training result; dynamically updating the supervised training result to generate an updated pseudo-label graph; and continuously iterating based on the updated pseudo-label graph until the loss function is converged, and outputting an image semantic segmentation result. According to the invention, weak supervision image semantic segmentation based on the attention mechanism is realized.

The invention provides an urban landscape semantic segmentation system adopting an EGLiteSeg model, and belongs to the field of image processing. Comprising three main parts: an encoder; an polymerizer; and a decoder. The EGLiteSeg framework adopts a lightweight encoder-decoder pipeline to carry out image processing, and an encoder of the EGLiteSeg framework is provided with a five-level DeSTDCNet framework. In the first four stages, depth separable convolution with the stride being 2 is utilized, and the AECA module automatically adjusts the size of a kernel according to the number of input channels so as to enhance the multi-scale feature adaptability. For context aggregation, the framework uses GDSPPM. The module processes features through deep convolution to enhance distinguishability, and then performs multi-scale pyramid pooling to capture hierarchical contextual information. The multi-scale features are connected together and fed into a decoder. The decoder is composed of two key components: a universal attention fusion module (UAFM) and a partition head. The method not only has high semantic segmentation accuracy, but also has superiority in real-time performance, and meets actual requirements.

The invention discloses a zero sample object instance segmentation system and method in a robot environment, and belongs to the technical field of robot visual perception, and the method comprises the steps: firstly carrying out the Vibriis color mapping preprocessing of a depth image, and then generating an initial object mask candidate through an SAM (Segment Anything Model) model; meanwhile, a pre-trained Vision Transform is used as a feature description model of a scene to process the image, an attention map of the last layer is extracted, and a feature weighting mechanism is constructed based on the information entropy of the attention map; a similarity matrix of the image blocks and the background blocks is calculated to remove non-object masks, a K-Medoids clustering algorithm is adopted for each remaining object mask candidate to obtain representative sampling points, and finally the points serve as prompt information to be input into an SAM model to obtain an accurate object instance segmentation result. According to the method, the zero sample generalization ability of the visual basic model is fully utilized, accurate segmentation of the unseen object can be realized without additional training, and the method has good universality and practical value.

The invention discloses a diffuse large B-cell lymphoma segmentation system based on deep learning, and the system comprises a data collection module which is used for collecting PET and CT images of a patient; the double-branch encoder module is used for processing PET and CT images respectively; the cross-modal feature cross fusion module is used for extracting positioning clues from the CT anatomical features by taking the PET metabolic features as queries; taking CT structure characteristics as query, and screening PET high-metabolism regions; the global-attention suppression module is used for extracting global context features, performing down-sampling, remodeling input features into a low-dimensional matrix, then performing self-attention calculation, generating a sparse weight matrix for the input features based on a full connection layer, and then performing sparse attention calculation; and finally, fusing the two attention calculation results and outputting enhanced features. And the multi-scale jump connection module is used for fusing the encoder features and the decoder features and recovering spatial details.

The invention relates to the technical field of image segmentation, and discloses a street view image semantic segmentation system for a complex city scene, and the system comprises a double-edge energy ratio calculation module which obtains a double-edge energy ratio through calculation; the priori mask generation module is used for generating a priori mask; the segmentation network construction module is used for outputting logarithmic probabilities and probabilities of various categories through a trunk segmentation network; the total loss construction module is used for constructing total loss; the mutual suppression optimization module is used for calculating to obtain a preliminary semantic segmentation result; and the semantic segmentation output module is used for calculating to obtain a final semantic segmentation result. According to the method, a unified process of double-edge energy ratio driving direction convolution, separation loss and reasoning period mutual suppression is adopted, repeated boundaries and false objects caused by reflection and transmission mixing in a complex city scene containing glass and a water surface are reduced, pixel-level boundary positions are stabilized, and road space, building facades and traffic element division are consistent.

The invention discloses a collaborative data model adaptation-based adaptive medical image segmentation method during testing, and aims to solve the problem that the image segmentation performance of an existing segmentation method needs to be improved. According to the technical scheme, a collaborative data model adaptation-based self-adaptive medical image segmentation system during testing is firstly constructed, a prompt update model is arranged in a prompt update module of the segmentation system, an image segmentation module is composed of image segmentation models, and batch normalization layers are arranged in the two models; a source domain model and a medical image are adopted to test a segmentation system, a batch normalization layer is used as a bidirectional bridge to realize collaborative self-adaption of data adaption and model adaption, and low-level distribution alignment and high-level semantic feature adaption are realized in a Fourier space; and segmenting the medical image by using the adapted segmentation system. By adopting the method, error accumulation and disastrous forgetting can be avoided, data adaptation and model adaptation are coordinated, the image segmentation effect can be improved, and the Dice coefficient is improved.

The invention relates to the technical field of medical image processing, and particularly discloses an intelligent segmentation system for a kidney tumor in a CT image, and the system comprises an image preprocessing module, an ROI automatic detection module, a kidney tumor segmentation module, a segmentation result post-processing module, a visual interaction module, and a model updating module. The system improves image quality through normalization and filtering, uses a target detection network to position a kidney area, realizes precise tumor segmentation based on an integrated channel attention mechanism and a U-Net network guided by structure priori, optimizes a boundary in combination with a conditional random field, adopts a multi-plane fusion strategy to improve three-dimensional consistency, and calculates tumor volume. The system supports federal learning update, improves the cross-mechanism generalization ability, has the advantages of high segmentation precision, strong boundary reducibility, good structural rationality, strong clinical deployment and the like, and is suitable for kidney tumor auxiliary diagnosis and quantitative analysis.

The invention belongs to the technical field of image recognition, and discloses a farmland remote sensing image intelligent segmentation system and method based on dynamic feature learning, and the system carries out the automatic extraction of farmland features based on visible light, multispectrum, synthetic aperture radar (SAR) image data and historical segmentation results. High-precision geometric adaptive segmentation of farmland boundaries is realized through multispectral band recombination, multi-temporal feature fusion, dynamic deformable convolutional network operation and the like. And a standardized farmland distribution diagram and a standardized statistical report containing factors such as field area statistics, crop type distribution and a boundary topological relation are dynamically generated according to a farmland drawing specification and a preset agricultural thematic standard, so that a whole-process intelligent technical support is provided for businesses such as farmland resource supervision, agricultural subsidy accounting and planting structure analysis.

The invention discloses a camouflage target segmentation system based on multi-scale boundary fusion. The camouflage target segmentation system comprises a data division module for acquiring a training data set; the feature extraction module performs feature extraction based on a backbone network to obtain multi-level hierarchical feature information; the edge priori module combines the low-level features and the high-level features, performs enhancement by using a parameter-free attention mechanism, and obtains camouflage target edge information; the multi-scale edge enhancement module extracts multi-scale edge feature information by using global average pooling processing, and obtains output features in combination with camouflage target edge information; the multi-scale detail fusion module uses a Hadamard product to be combined with the output features to obtain enhanced information; and the up-sampling module combines the enhanced information with low-level features based on PFNet, and takes a prediction result of the last-level focusing module as a final segmentation result. According to the method, the defects of an existing camouflage target detection technology in the aspects of boundary detail capture and multi-scale feature fusion are overcome, and the precision and robustness of camouflage target detection are remarkably improved.

This application relates to the field of artificial intelligence technology and discloses a semantic segmentation system and method for satellite remote sensing images. The system includes: an encoding module configured to extract multi-scale features of the target image; a feature fusion module configured to fuse the original feature maps at various scales through linear attention calculation to obtain a first fused feature, and then split it to generate multiple mixed feature maps with the same scale as the original feature maps; a collaborative decoding module configured to extract spatial domain features and frequency domain features from the original feature maps and the mixed feature maps of the same scale, and perform cross-attention calculation to iteratively fuse spatial domain information and frequency domain information to generate a first tensor; and an output module configured to process the first tensor to obtain the segmentation result of the target image. This system can improve the recognition accuracy of detailed textures and small targets in remote sensing images, and improve the accuracy of semantic segmentation of remote sensing images.

The invention discloses a post-earthquake building segmentation system and method based on an MDDFAN-Net multi-scale dynamic fusion network, relates to a remote sensing image processing technology, and solves the technical problems that the multi-scale feature extraction capability is insufficient, the feature fusion capability is weak, the boundary quantization effect is poor, and the background has great influence on target segmentation. The system comprises an input module, a segmentation module and an output module, the input module is used for processing a to-be-segmented post-earthquake satellite remote sensing image and then inputting the processed post-earthquake satellite remote sensing image into the trained segmentation module, an MDDFAN-Net network is arranged in the segmentation module, the segmentation module carries out building damage segmentation according to the input data, and the output module outputs the segmented post-earthquake satellite remote sensing image. The output module is used for outputting the segmentation effect for checking; according to the method, global and local features are extracted at the same time through double branches, fragile edge local information of the building is extracted through curved convolution, the global features are extracted through standard convolution branches, and complex and multi-scale dynamic building edges are better captured.

The invention relates to the technical field of digital image processing, in particular to a real-time video semantic segmentation system and optimization method fusing an edge size model, and the system comprises an edge end lightweight model belonging to terminal equipment, an edge server large model belonging to an edge server, a dynamic frame distribution module and a self-adaptive cache module. An optical flow change rate and scene complexity are analyzed through edge detection and entropy calculation by a dynamic frame distribution module, then a dynamic distribution strategy is output, the dynamic distribution strategy is formed by processing a low-change frame by a small model and processing a key frame by a large model, a high-confidence segmentation result of the large model is cached by a self-adaptive cache module, and a high-confidence segmentation result of the large model is obtained. The method can be used for reuse of small models in similar scenes so as to reduce calling frequency of large models, flexibly deploy resources of the large models and the small models during operation and solve the real-time performance-precision contradiction in edge computing scenes, and compared with a single model scheme, the method has the advantages that precision is improved, and load is reduced.

The invention discloses a rapid semantic segmentation system and method for a pneumonia DR image. The rapid semantic segmentation system comprises a context graph construction module, a context information aggregation module, a detail and context information fusion module and a decoding fusion feature segmentation module. According to the method, when a to-be-segmented DR image is processed, a context information aggregation module gradually collects and integrates long-distance context features and detail features outside an image block based on a context graph neural network model of an end-to-end training mode; then, based on a detail and context fusion module, effectively fusing context information and detail features of the image blocks; and the fusion feature is segmented by a decoding fusion feature segmentation module so as to generate an accurate segmentation mask. According to the method, accurate segmentation and rapid evaluation of the pneumonia focus in the DR image are realized, and powerful assistance and support are provided for diagnosis of doctors.

The invention discloses a global and local feature fusion-based semi-supervised video target segmentation method and a global and local feature fusion-based semi-supervised video target segmentation system. According to the implementation scheme, the method comprises the following steps: firstly, acquiring required data sets including image and video data sets and corresponding segmentation labels, expanding the image data set, and sampling the video data set to obtain a training data set for training a segmentation model; and secondly, designing a segmentation model, constructing a loss function to train the segmentation model, and finally performing video target segmentation by using the trained segmentation model. According to the invention, a local-global branch fusion module is designed to carry out global context modeling and local detail enhancement on features used for non-local matching, so that the distinguishing capability of the model for distinguishing similar features is improved; therefore, the network can effectively solve the problem of wrong feature matching caused by similar interferents in a semi-supervised video target segmentation task. On this basis, a target scale self-adaptive down-sampling layer is further combined, and information of the same target under different scales is captured through the layer, so that the self-attention calculation complexity is reduced while the feature distinguishability is improved, and the balance between the model segmentation performance and the reasoning prediction efficiency is realized.

The invention belongs to the technical field of image analysis, and particularly relates to a railway track image abnormal region segmentation system combined with fractal dimension feature extraction, which comprises a preprocessing unit, a multi-scale fractal feature processing unit, an abnormal region processing unit and a segmentation unit, the preprocessing unit is used for suppressing noise, retaining a main structure and outputting a denoising result; the multi-scale fractal feature processing unit is used for obtaining a fused fractal dimension based on a denoising result, and forming a feature vector by the fused fractal dimension and a denoising result gradient; the abnormal region processing unit is used for obtaining processed candidate abnormal regions by using a spectral clustering method; and the segmentation unit is used for performing intersection operation on the processed candidate abnormal region and a track mask to obtain a track abnormal region. According to the invention, high-precision segmentation of the abnormal region in the track image is realized.

The invention provides a YOLO-based aviation product assembly component instance segmentation system, which is characterized in that an improved SAC-YOLO model based on a YOLOv11 algorithm is used, an MSECA module is connected between an SPPF module and a C2PSA module in a backbone network of the SAC-YOLO model, and convolution in a C3k2 module is WTConv convolution; the convolution in the C3k2 module in the neck network is a DSConv convolution; therefore, the SAC-YOLO adopts the technologies of multi-scale feature fusion, special-shaped convolution, attention mechanism and the like, so that the detail features of the complex structure in the assembly scene can be more effectively captured; when the trained segmentation model is used for processing assembly elements with large form difference and slender and tortuous non-rigid structures such as a locking piece and the like observed from the front face and the side face, high segmentation precision can be kept; that is to say, the positioning precision of identifying the assembly component and the locking point is higher, the morphological characteristics of the assembly component and the locking point can be obtained, and the identification and segmentation of the components such as the parts and the locking point of the aviation assembly can be completed.

The invention discloses a pig organ automatic segmentation method and segmentation system based on a CT anatomical structure relationship. The method comprises the following steps: acquiring a whole-body CT scanning image of a live pig; and processing the pig whole body CT scanning image by using a pig multi-organ automatic segmentation model to obtain a pig multi-organ prediction mask, and completing automatic segmentation of the multiple organs of the pig. The live pig multi-organ automatic segmentation system comprises a live pig CT image acquisition module and a multi-organ automatic segmentation module, wherein the live pig CT image acquisition module is used for acquiring a to-be-segmented live pig CT image; the multi-organ automatic segmentation module comprises a visual state space block-based encoder-decoder architecture, a spatial link GRU module, a global organ category encoding module, a global organ category guiding module and a semi-supervised training framework. According to the method, multiple organs in the CT image of the live pig can be segmented efficiently and accurately, the problems of low segmentation speed and low precision of a traditional method are solved, and a more efficient solution is provided for medical image analysis and animal husbandry management of the pig.

The invention relates to a video full-object segmentation system and method based on 3D prior enhancement and a double-branch structure, and the system comprises a visible region segmentation branch and a full-object region segmentation branch which are connected to an image encoder and a prompt encoder. The visible region segmentation branch comprises a first pixel perception memory module, a first mask decoder, a first memory bank and a first memory encoder; the whole object area segmentation branch comprises a three-dimensional space perception memory module, a second pixel perception memory module, a third pixel perception memory module, a second mask decoder, a second memory bank and a second memory encoder. Compared with the prior art, the method has the advantages that powerful priori knowledge of the basic segmentation model is efficiently migrated, the complete region segmentation capability of the target object in the video is greatly improved, the perception capability of the object shielding region can be improved, the segmentation effect of the shielding region is improved, the problem of insufficient early frame memory is greatly improved, and the overall segmentation effect is improved.

The invention provides a kidney wound intelligent segmentation system, and relates to the technical field of image data processing. The kidney wound intelligent segmentation system comprises an image enhancement module; an edge fuzzy index acquisition module; a wound rule index acquisition module; and a wound segmentation index acquisition module. According to the method, the edge fuzzy index is obtained by combining the obtained kidney image edge data and the preset reference image edge data, and then the wound rule index is obtained according to the obtained kidney wound rule data and the preset reference wound rule data; and finally, the wound segmentation index is obtained by combining the obtained wound segmentation data and the preset reference segmentation data, so that the effect of improving the kidney wound segmentation accuracy is achieved, and the problem of low association degree of kidney wound segmentation and wound edge in the prior art is solved.

The invention provides a ship unloader grab bucket system and method based on multi-modal perception and artificial intelligence semantic segmentation. According to the system, point cloud data and image data are synchronously collected through a laser radar and an RGB camera, feature level alignment and fusion are conducted through an image fusion module, an artificial intelligence semantic segmentation network is combined with attention gating to restrain dust interference, grab bucket boundary information is output, and a position and posture estimation module solves the grab bucket position and posture based on the boundary information and geometric constraints. The path planning module combines reinforcement learning and model prediction control to generate a trajectory instruction, and the compensation module implements hierarchical correction according to the pose deviation and drives an execution device to realize high-precision positioning and stable control under severe working conditions.

This disclosure provides methods, devices, and systems for planning and performing medical procedures. The present implementations more specifically relate to analyzing objects in 3D images. In some aspects, a segmentation system may receive image data representing a 3D image of an anatomy, select a seed location for a target in the 3D image, and infer a segmentation mask associated with the seed location from at least a portion of the received image data based on a neural network model trained to segment a class of objects associated with the target. The system further extracts a polygon mesh from the segmentation mask to produce a 3D model of the target. The system can determine a spatial relationship between an instrument and the target based on a position of the 3D model relative to the 3D image. The system can also estimate a geometry of the target based on the 3D model.

In accordance with one aspect of the inventive concepts, provided is an autonomous mobile robot, comprising: at least one processor in communication with at least one computer memory device; at least one sensor configured to acquire point cloud data; a pallet detection system configured to provide a pose of a payload; and an object segmentation system comprising computer program code executable by the at least one processor to segment detected objects into obstructions and allowed objects based on the point cloud data, the pose of the payload and semantic data about the payload. A corresponding method is also provided.