39913 results about "Radiology" patented technology

Disclosed in the present invention is a salient contour matching-based method for target measurement in a severe imaging environment. The method specifically comprises: (1) acquiring a binocular image of a target; (2) establishing a global-local joint constraint-based background light estimation model, and removing a scattering effect of a medium in an imaging environment to obtain a restored left eye image and a restored right eye image; (3) learning an original image, and on the basis of a residual between a network reconstructed image and the original image, obtaining target localization prediction maps of the left eye image and the right eye image; and (4) respectively extracting contour lines of the target in the left eye image and the right eye image, constructing feature matching descriptors of contour points, performing stereo matching on the two sets of contour lines by minimizing matching cost, and performing three-dimensional reconstruction on the contour lines in light of calibrated intrinsic and extrinsic parameters to complete the measurement of a key size. According to the present invention, the key sizes of different targets in a severe environment can be accurately measured, thereby providing an effective solution for the problem of measuring the sizes of targets in a severe environment.

A method includes obtaining an image, the image associated with a mask corresponding to a portion of the image, generating a plurality of images based on the image and the mask, each image of the plurality of images depicting a different color in the portion of the image corresponding to the mask, executing a machine learning model to generate an image performance score for each of the plurality of images, ranking the plurality of images according to the image performance scores for the plurality of images, and generating a record comprising one or more images of the plurality of images based on the rankings of the plurality of images.

The invention discloses a Mama-based spectrum dynamic fusion and double-attention enhancement medical image segmentation method, which comprises the following steps of: firstly, constructing a Mama integrated spectrum domain and attention pyramid module, fusing spectrum dynamic characteristics and a self-attention pooling mechanism, and performing frequency domain information compensation and local characteristic enhancement to obtain a spectrum dynamic fusion image; the spatial correlation loss caused by image blocking processing is relieved; secondly, designing a layered enhanced U-shaped architecture, deploying an MISAP module in a shallow layer of an encoder to capture multi-scale global context features, introducing a bipolar routing attention mechanism in a deep layer, and dynamically allocating sparse attention weights to focus a key pathological region; according to the method, the segmentation precision of complex edge textures and tiny lesions in medical images can be remarkably improved, and the Dice coefficient in breast tumor, polyp and abdominal organ segmentation tasks is averagely improved by 6.5%.

SOLUTION: A semi-supervised medical image segmentation method based on a visual language model includes the steps of: obtaining a medical image; inputting an unlabeled image and a text description into a visual language model, and obtaining a text-guided mask based on obtained dense image embedding and text embedding; inputting a labeled image into a student model, and calculating supervised loss by using obtained labeled image prediction; respectively inputting the unlabeled image into the student model and a teacher model to obtain unlabeled image prediction and a pseudo label, merging the text-guided mask with the pseudo label, and calculating semi-supervised loss by using the merged pseudo label and unlabeled image prediction; and performing medical image segmentation by using a trained student model on the basis of the supervised loss and the semi-supervised loss.EFFECT: A target segmentation region can be accurately identified by using advantages of text descriptions.SELECTED DRAWING: Figure 1

An example operation may include at least one of receiving, via a user interface of a device, an activation input from a user to initiate a session, capturing, by a camera of the device, a scan of a body of the user, wherein the capturing comprises recording at least one image and / or at least one video of the user, processing the at least one image and / or video to generate a three- dimensional model of the user comprising measurements and contours of the body, retrieving, from a database, at least one clothing item associated with the user, the at least one clothing item comprising dimensional attributes and texture attributes, rendering, by a graphics processing unit, the at least one clothing item onto the three-dimensional model to generate a visual representation, wherein the rendering simulates draping behavior, movement, and light interaction of the at least one clothing item relative to the three-dimensional model, and displaying, on the user interface, an interactive visualization comprising the visual representation of the three-dimensional model with the at least one clothing item from multiple viewing angles.

A non-invasive physiological sensor system implemented as a smart watch or other wearable device includes an emitter for emitting light and a detector for collecting light after the light interacts with a tissue of a wearer. The system can measure light intensity at one or more radial distances to estimate attenuation parameter values that can be used to correct physiological parameter bias across subjects. In addition or alternatively, the system can determine whether a detector is positioned sufficiently proximate to an obstructing tissue (for example, an artery or vein) so as to cause inaccurate measurements by the detector.

The invention discloses a cradle head tracking method and device based on a binocular camera and a storage medium, and relates to the technical field of computer vision, and the method comprises the steps: processing image data based on a binocular parallax principle, and generating a three-dimensional coordinate of a center point of a tracking target; based on the three-dimensional coordinates of the camera coordinate system and the offset from the optical center of the camera to the rotation center of the holder, generating three-dimensional holder coordinates through coordinate transformation solution; determining a historical track based on the tracking target feature information and a historical target feature matching result, and outputting an identifier and a three-dimensional position observation value through correlation verification of a three-dimensional holder coordinate and the historical track; inputting an observation updating equation correction state through the identifier and the three-dimensional position observation value, and outputting a three-dimensional prediction position; based on the three-dimensional prediction position and a deviation formula, calculating the angle deviation with the camera image center under the holder coordinate system, and driving the holder to center the target in the picture center according to the angle deviation. The problem that the target tracking effect is poor is solved, and the robustness of target tracking in a complex scene is improved.

The invention discloses an article recognition system based on computer vision. The article recognition system comprises a multi-modal data acquisition module, a multi-modal data processing module and a computer vision processing module, wherein the multi-modal data acquisition module is used for acquiring multi-modal data through a multi-modal sensor array; the data preprocessing module is used for standardizing a multi-modal data format and generating a time-space aligned multi-modal tensor; the feature extraction module is used for respectively extracting modal specific features from texture, spectrum and geometric dimensions by adopting ResNet50, 3D-CNN and PointNet + +; the multi-modal fusion module is used for constructing cross-modal joint representation; the adaptive sensing module is used for modeling illumination invariance and scene dynamics based on self-supervised comparative learning and a 3D-STMN space-time memory network, predicting a shielded target trajectory by using Kalman filtering in combination with the shielding sensing propagation module, and generating an environment sensing parameter set; and the recognition engine module is used for integrating YOLOv8 detection, Mask R-CNN segmentation and multi-modal decision tree classification, outputting a target bounding box, a category and confidence in combination with the depth data, and generating three-dimensional space coordinates combined with the depth data.

A method and apparatus for reconstructing a three-dimensional (3D) scene from a two-dimensional (2D) input image of the scene using a fully-differentiable transformer-based encoder-decode. A 2D input image encoded into a set of image features using a pre-trained vision transformer model, wherein the vision transformer model is pre-trained with multi-view RGB image supervision and point cloud supervision. The set of image features is projected onto a 3D triplane representation using a transformer decoder to obtain output triplane tokens. A triplane representation is created from the tokens and queried. 3D point features of color and density for volumetric rendering re predicted using a multi-layer perceptron. The geometry of the generated 3D asset is represented with a surface mesh including vertices and triangular faces. A texture map by is created with a multichannel image in UV space. Multiple views of the 3D scene are simultaneously generated based on the surface mesh.

The invention relates to the technical field of image classification, in particular to a training method and system of a cervical pathological image classification model based on multiple modes. The method comprises the following steps: acquiring a cervical tissue image and carrying out tissue structure segmentation, forming a nucleus-interstitial-epithelium three-distribution framework, collecting development historical data, confirming a prediction trend of each layer, carrying out environment field simulation through the image, generating a simulated cervical environment field, and carrying out hierarchical evolution prediction on the framework. Evolution mapping images are generated according to the evolution data and classified, finally, a visual basic model is obtained through combined modeling training, image-text fusion is achieved, and a cross-center deployment model system is generated. According to the method, vision-language combined modeling is realized, and the stability and controllability of the whole model structure in image space deformation modeling, semantic cross-modal alignment construction and task-level response flow scheduling are improved.

The invention belongs to the technical field of medical image processing, and discloses a CT image segmentation and classification system based on segmentation feature guidance, and the specific technical scheme is as follows: the system adopts a shared encoder to extract general features, realizes collaborative optimization of segmentation and classification through a double decoding path, adopts a partial decoder in a segmentation path, and adopts a partial decoder in the segmentation path; in combination with a local feature attention module, through multi-scale feature fusion and a boundary perception mechanism, the region consistency of a global segmentation map is gradually optimized, edge detail information is supplemented, and a classification path generates a space attention weight through a segmentation feature guide module by utilizing segmentation prediction; the classification network is guided to focus on a focus area and suppress background interference, a self-adaptive loss weighting strategy based on multi-task learning is adopted, the double-task gradient flow is dynamically balanced, and the gradient competition problem in the multi-task learning is effectively relieved.

The invention discloses a self-adaptive three-dimensional scene reconstruction method and system based on a single panorama, and belongs to the field of computer vision processing. The method comprises the following steps: firstly, generating a depth map through an indoor scene panorama and constructing an initial three-dimensional grid; then generating a multi-view image and a shielding mask thereof based on view conversion, forming a training sample pair for fine tuning of the diffusion completion model, and injecting scene prior information for the model; then extracting a grid boundary contour and calculating a central axis, and adaptively constructing a camera pose set; after the integrity of the grid is optimized through iteration completion, the grid is converted into a 3D Gaussian sputtering field, and Gaussian point parameters are optimized through multi-view data; in the optimization process, an up-sampling strategy of rendering error feedback and edge Gaussian points is adopted, and finally a scene model with complete geometric textures is output. According to the method, a high-quality three-dimensional scene is reconstructed from a single panorama through a structure self-adaptive completion and Gaussian refining technology, and the method is particularly suitable for immersive roaming reconstruction of indoor scenes.

The invention discloses a medical image segmentation method and system based on guidance information and a multi-dimensional attention mechanism. The method comprises the following steps: collecting an original dermatoscope image for preprocessing; constructing a segmentation model, wherein the segmentation model comprises a double-path image encoder, a guide information encoder and a mask decoder; the two-way image encoder is used for extracting local detail features and global context semantic information in the image; the guide information encoder is used for converting a coarse segmentation mask predicted by the last round of network into guide feature information; the mask decoder fuses the image feature information and the guide feature information, gradually restores and refines the coarse-grained feature map, and finally outputs an accurate lesion segmentation mask; constructing a loss function, and training the segmentation model by using the preprocessed data; and inputting a to-be-segmented original dermatoscope image into the trained segmentation model, and outputting a lesion region segmentation mask of the image. According to the method, the segmentation precision and the model generalization ability can be improved, and the multi-scale lesion processing ability is enhanced.

Various embodiments described herein relate to systems, devices, and methods for non-invasive image-based plaque analysis and risk determination. In particular, in some embodiments, the systems, devices, and methods described herein are related to analysis of one or more regions of plaque, such as for example coronary plaque, using non-invasively obtained images that can be analyzed using computer vision or machine learning to identify, diagnose, characterize, treat and / or track coronary artery disease.

The invention discloses a pump shell welding seam quality detection method based on image segmentation. The method comprises the following steps: generating a steady-state pump shell welding seam image flow under the driving of motion compensation; obtaining a domain adaptive DINOv2 visual embedded feature map; performing adaptive pyramid fusion and cross-scale attention operation on the domain adaptive DINOv2 visual embedded feature map to generate a semantic form segmentation map; generating a semantic-texture fusion mask; performing uncertainty weighted optimization on the semantic-texture fusion mask in combination with the pixel-level confidence map to obtain a weld defect instance map; generating an interpretable texture anomaly heat map; and through multi-view supplementary shooting or manual auditing, supplementary pump shell welding seam image data is obtained, and the steady-state pump shell welding seam image flow is updated. According to the method, the system can continuously keep accurate positioning of the pixel-level segmentation boundary in a weak-label or even non-label migration scene, and boundary drift and area missing detection of a segmentation result are effectively avoided.

The invention relates to the technical field of defect detection, in particular to an efficient identification and detection method for printing defects on the surface of a metal plate. The method comprises the following steps: acquiring a difference characterization value and a suspected judgment index value of a pixel point to be detected, and acquiring a suspected defect pixel point according to the suspected judgment index value; clustering all the suspected defect pixel points according to the suspected judgment index values and the coordinate values of the suspected defect pixel points to obtain each cluster; according to the difference characterization value of the suspected defect pixel point, the gradient direction of the suspected defect pixel point in the cluster to which the suspected defect pixel point belongs and the gray value standard deviation and mean value of all the suspected defect pixel points in the cluster to which the suspected defect pixel point belongs, obtaining an abnormal degree characterization value of the suspected defect pixel point; and performing printing defect identification on the surface of the to-be-detected printed metal plate according to the abnormal degree characterization value. And the identification accuracy of the printing defect area on the surface of the printing metal plate can be improved.

The invention relates to the technical field of medical image processing, in particular to an engineered heart tissue pulsation trajectory automatic analysis method based on an image recognition algorithm, which comprises the following steps: S1, multi-modal image fusion: performing space-time registration and feature fusion on acquired multi-modal heart images to generate a fused image sequence; s2, cardiac muscle tissue segmentation: outputting a cardiac muscle tissue segmentation result with a timestamp; s3, motion track modeling: generating three-dimensional track point cloud data in a pulsation period; s4, feature parameter extraction: performing spatial-temporal feature analysis on the track point cloud data, and extracting multi-dimensional motion parameters; and S5, heterogeneity atlas generation: generating a cardiac pulse heterogeneity atlas according to the multi-dimensional motion parameters. According to the method, automatic analysis of the cardiac pulse track and generation of the heterogeneity atlas based on the multi-modal image and space-time modeling are realized, and the precision and the intelligent level of cardiac motion anomaly recognition are remarkably improved.

The invention provides a dynamic screening medical image target tracking method and device based on visual Transform, and relates to the technical field of computer vision, and the method comprises the steps: standardizing near-infrared or visible light fundus video frames into uniform resolution, constructing a template-search frame pair, and then jointly mapping the two frames of images into a Token sequence; a dynamic local interaction module is embedded in front of each pruning layer of the whole network, a local context is captured by using depth separable convolution and point convolution, a dynamic convolution kernel generator is driven, and a neighborhood Token is adaptively weighted and aggregated. Next, the Token screening and the compression mechanism TSC are operated in the same pruning layer, only the Top-K key Token is reserved, the redundant Token is cut off, and the original index is recorded; the objective of the invention is to improve the positioning stability and reasoning efficiency of a focus area (such as an optic disc) in a complex operation video.

The invention relates to the technical field of computer vision and pattern recognition, in particular to a deep-forged face image detection method based on a double-flow CNN and ViT hybrid model. The method comprises the following steps: preprocessing a real video and a forged video to obtain an original face image; obtaining a high-frequency noise residual error feature image of the original face image based on an improved high-frequency noise residual error feature extraction module; performing first feature enhancement operation on the original face image and the high-frequency noise residual feature image based on a double-flow CNN; carrying out secondary feature enhancement operation on the original face image and the high-frequency noise residual feature image which are subjected to the primary feature enhancement operation on the basis of double-flow ViT; and fusing the features of the original face image and the high-frequency noise residual feature image after the secondary feature enhancement operation, performing true and false prediction on the fused features, and outputting a detection result. The objective of the invention is to solve the technical problems of feature splitting, local-global imbalance and insufficient cross-modal interaction in the prior art.

The invention discloses an abnormal scene detection method based on visual and semantic feature fusion, and relates to the technical field of safety monitoring and intelligent identification, and the method comprises the steps: carrying out the preprocessing of a collected original image, and obtaining a preprocessed image; forming a multi-modal input pair by the preprocessed image and a predefined structured prompt statement; inputting the multi-modal input pair into the visual language large model, and outputting semantic features including visual feature vectors and text vectors; inputting the preprocessed image into a target detection model, and outputting visual features; fusing the semantic features and the visual features through a cross-modal attention mechanism to obtain multi-scale fusion features; and inputting the multi-scale fusion features into detection heads of all scales, executing abnormal scene detection, and outputting an abnormal detection result. When the unconventional object is identified in the abnormal scene, the visual features and the semantic features are fused to perform abnormal scene detection, so that the strong perception capability of a complex scene is realized, and false alarm or missing alarm is effectively avoided.

The present application relates to the field of computer vision. Provided are a visual encoding method and apparatus, and a visual encoding model training method and apparatus, which are used for using the same visual encoding model to encode images of different resolutions, and are applied to encoding scenarios for images of more sizes. The visual encoding method comprises: first, acquiring an input image, wherein the input image may be a high-resolution image and may also be a low-resolution image; and then inputting the input image into a visual encoding model, so as to output visual encoding data, wherein the visual encoding model is used for dividing the input image into a plurality of image blocks according to positional embedding, extracting features from each image block, and outputting visual encoding data on the basis of the features of each image block and corresponding positional encoding, the positional embedding is obtained by means of adjusting initial positional embedding on the basis of the difference between the input image and a preset resolution, and the positional embedding may specifically comprise a matrix corresponding to the division of the input image

Disclosed are apparatuses, systems, and techniques for segmentation-assisted detection and tracking of objects or features in videos, across images, and / or in other 2D and / or 3D visual content. The techniques include processing a plurality of frames of a video to obtain a plurality of representations of an object depicted in the video. A first subset of the plurality of representations is obtained by processing, using an object detection model, a first subset of the plurality of frames. A second subset of the plurality of representations is obtained using visual similarity of an appearance of the object in a second subset of the plurality of frames to the appearance of the object in at least one other frame of the plurality of frames. The techniques further include obtaining, using the plurality of representations, segmentation masks for the plurality of frames and performing one or more operations based on the segmentation masks.

The embodiment of the invention discloses an image annotation method and system applied to brain MRI image segmentation, and the method comprises the steps: obtaining a brain MRI image data set of a target object, and the brain MRI image data set comprises original image sequences of a plurality of scanning levels; performing multi-modal feature fusion processing on the original image sequence to generate an enhanced image feature set; calling a multi-layer cascade segmentation network to perform hierarchical feature extraction on the enhanced image feature set to obtain a multi-scale anatomical structure feature map; and performing region boundary optimization processing based on the multi-scale anatomical structure feature map, and generating a marked brain structure segmentation image. Therefore, the boundary of each structure of the brain can be accurately defined, the segmented image is more accurate and clearer, and the image segmentation and marking of the brain MRI image can be accurately and clearer realized.

The invention provides a semi-supervised image semantic segmentation method and system based on a visual basic model, and the method comprises the steps: constructing a multi-task model which comprises a visual basic model and a depth estimation basic model, and the visual basic model is connected with a task solution head, an adapter parameter efficient fine tuning module and a multi-modal cross fusion module; the task solution head comprises a semantic segmentation head and a depth estimation head; extracting semantic hierarchy features and a depth feature map of the RGB image, performing cross attention fusion on the semantic hierarchy features and the depth feature map, and inputting obtained fusion features into a semantic segmentation head and a depth estimation head respectively; semi-supervised learning is adopted to train a multi-task model, only parameters in the adapter parameter efficient fine tuning module and the multi-modal cross fusion module are trained, and a multi-task loss function is adopted. The image semantic segmentation model obtained through training can improve semantic segmentation performance, reduce training cost and is suitable for different tasks.

A clinical vertebra image segmentation method for assisting pedicle screw placement surgery, said method comprising: constructing a VerseDiff-UNet end-to-end framework, the framework being integrated with a denoising diffusion probabilistic model (DDPM); combining a noise-added image with a marked mask by using the VerseDiff-UNet framework, and guiding a diffusion direction toward a target region; and introducing a shape priors module on the basis of the DDPM, and extracting structural semantic information from an input spine image. In order to capture specific anatomical prior information in a medical image, the shape priors module is combined and the module effectively extracts the structural semantic information from the input spine image, thereby enabling more accurate anatomical structure segmentation, and facilitating accurate diagnosis and treatment of spinal disorders.

The invention provides a small sample tympanic membrane image recognition method based on meta-prompt and knowledge driving, and the method comprises the steps: inputting a small sample training set into an initial multi-mode pre-training model, obtaining a prediction category, comparing the prediction category with a real category, and screening misclassification samples in combination with confidence to construct a meta-task set; and inputting the meta-task set into the primary diagnosis model, and outputting a primary diagnosis report. And then, optimizing the medical description text sample based on the preliminary diagnosis report by utilizing a knowledge refining model, and replacing the original text sample, so as to obtain an updated sample. And finally, iteratively training the initial multi-modal pre-training model by using the updated sample until a termination condition is met. According to the method, a closed-loop optimization system composed of a primary diagnosis model and a knowledge refining model is constructed. Under the condition of small samples, the system dynamically optimizes the visual-semantic understanding ability of the model by using error samples generated by the model, and the accuracy of small sample tympanic membrane image recognition is effectively improved.

The invention relates to the technical field of pneumoconiosis image detection, and discloses a pneumoconiosis-oriented chest X-ray image processing method based on an AI small shadow detection rate. According to the method, a basic mask is generated through an initial segmentation network, and then an accurate lung contour is obtained through correction of a hierarchical optimization unit. The multi-scale feature extraction module analyzes gray features in the contour and constructs an initial small shadow probability distribution map. A morphological structure analyzer identifies discrete shadow regions and marks suspicious shadow clusters, and a dynamic confidence feedback mechanism evaluates its credibility to generate an optimized feature map. A shadow cluster topological incidence matrix is established by the spatial relation modeling network and matched with a pneumoconiosis pathological feature library to screen a target shadow area. The three-dimensional reconstruction engine generates a small shadow volume density thermodynamic diagram, the hierarchical fusion module integrates the thermodynamic diagram and original image space coordinates, an enhanced distribution map is output, and finally structured diagnosis report data is generated.

The invention relates to the technical field of boundary recognition, in particular to a glioma boundary recognition method and system based on image fusion, and the method comprises the following steps: obtaining a multi-modal brain image, constructing a fusion matrix, extracting the gray features of an edge region and an adjacent region, recognizing signal-noise abnormal points, and revising a judgment standard. And adjusting the path direction and reconstructing an edge communication structure, and generating a glioma boundary region map under fusion. According to the method, high-precision alignment among modals is realized through multi-modal image gray scale unification and registration processing, key details are expanded and focused by enhancing edges and regions, the recognition accuracy is improved, gray scale comparison between the edges and outer adjacent regions is introduced, the signal distinguishing capability is enhanced, misjudgment is avoided, judgment conditions are dynamically revised according to the signal-noise difference, and the accuracy of recognition is improved. The method enables the recognition standard to have local adaptability, combines the path change trend to reorder and connect edge points, guarantees the continuity of a boundary structure, integrally improves the accuracy and integrity of fuzzy boundary recognition, and enhances the glioma contour extraction effect.

The invention discloses a renal clear cell carcinoma prognosis prediction method based on multi-mode MRI (Magnetic Resonance Imaging) image and digital pathological omics fusion. The method comprises the following steps: S1, collecting a training data set based on an MR image and a pathological image; s2, feature extraction of MR radiomics; s3, deep learning feature extraction of the pathological image; s4, an MR-pathological feature fusion module; and S5, deploying the network. According to the method, depth features with prognosis information are obtained from two scales of pre-treatment images and post-operation pathology, effective features are extracted by adopting image omics and a convolutional neural network mode according to data characteristics of MR images and pathology images, and depth fusion of the two types of features is completed in a hidden space through a multi-task guiding mode, so that the accuracy of the MR image and the pathology image is improved. A precise prognosis model with multi-scale information is provided, and the method has a relatively strong clinical application prospect and is of great significance for realizing precise immunotherapy and improving prognosis of a patient.

The invention relates to the technical field of computer vision, in particular to a defect segmentation positioning method and system for an inorganic mineral casting image, and the method comprises the following steps: calling an illumination image to analyze brightness, matching exposure parameters, splicing the image, analyzing a gradient, recognizing a defect, screening an effective region, calculating a gray variance, and constructing roughness weight recognition texture features. According to the method, the high-reflection area identification, the brightness gradient analysis, the pixel-level roughness weight and the structure tensor analysis are combined, the exposure interval can be dynamically adjusted when the casting image is processed, the defect type information is output in the direction, and the positioning information is generated by correcting the recognition position in combination with the actual coordinate of the target spot. The method has the advantages that the high-reflection area identification, the brightness gradient analysis, the pixel-level roughness weight and the structure tensor analysis are combined; the method has the advantages that the method is simple and easy to implement, detail loss of overexposure areas is reduced, the recognition precision of defect areas is improved, accurate area segmentation and classification processing are achieved, roughness weight calculation combining gray variance and pixel density is combined, the sensitivity to surface fine defects is enhanced, and the precision and reliability of defect positioning are improved.