33040 results about "Radiology" patented technology

A method includes obtaining an image, the image associated with a mask corresponding to a portion of the image, generating a plurality of images based on the image and the mask, each image of the plurality of images depicting a different color in the portion of the image corresponding to the mask, executing a machine learning model to generate an image performance score for each of the plurality of images, ranking the plurality of images according to the image performance scores for the plurality of images, and generating a record comprising one or more images of the plurality of images based on the rankings of the plurality of images.

An example operation may include at least one of receiving, via a user interface of a device, an activation input from a user to initiate a session, capturing, by a camera of the device, a scan of a body of the user, wherein the capturing comprises recording at least one image and / or at least one video of the user, processing the at least one image and / or video to generate a three- dimensional model of the user comprising measurements and contours of the body, retrieving, from a database, at least one clothing item associated with the user, the at least one clothing item comprising dimensional attributes and texture attributes, rendering, by a graphics processing unit, the at least one clothing item onto the three-dimensional model to generate a visual representation, wherein the rendering simulates draping behavior, movement, and light interaction of the at least one clothing item relative to the three-dimensional model, and displaying, on the user interface, an interactive visualization comprising the visual representation of the three-dimensional model with the at least one clothing item from multiple viewing angles.

A non-invasive physiological sensor system implemented as a smart watch or other wearable device includes an emitter for emitting light and a detector for collecting light after the light interacts with a tissue of a wearer. The system can measure light intensity at one or more radial distances to estimate attenuation parameter values that can be used to correct physiological parameter bias across subjects. In addition or alternatively, the system can determine whether a detector is positioned sufficiently proximate to an obstructing tissue (for example, an artery or vein) so as to cause inaccurate measurements by the detector.

The invention discloses a pump shell welding seam quality detection method based on image segmentation. The method comprises the following steps: generating a steady-state pump shell welding seam image flow under the driving of motion compensation; obtaining a domain adaptive DINOv2 visual embedded feature map; performing adaptive pyramid fusion and cross-scale attention operation on the domain adaptive DINOv2 visual embedded feature map to generate a semantic form segmentation map; generating a semantic-texture fusion mask; performing uncertainty weighted optimization on the semantic-texture fusion mask in combination with the pixel-level confidence map to obtain a weld defect instance map; generating an interpretable texture anomaly heat map; and through multi-view supplementary shooting or manual auditing, supplementary pump shell welding seam image data is obtained, and the steady-state pump shell welding seam image flow is updated. According to the method, the system can continuously keep accurate positioning of the pixel-level segmentation boundary in a weak-label or even non-label migration scene, and boundary drift and area missing detection of a segmentation result are effectively avoided.

The invention discloses an abnormal scene detection method based on visual and semantic feature fusion, and relates to the technical field of safety monitoring and intelligent identification, and the method comprises the steps: carrying out the preprocessing of a collected original image, and obtaining a preprocessed image; forming a multi-modal input pair by the preprocessed image and a predefined structured prompt statement; inputting the multi-modal input pair into the visual language large model, and outputting semantic features including visual feature vectors and text vectors; inputting the preprocessed image into a target detection model, and outputting visual features; fusing the semantic features and the visual features through a cross-modal attention mechanism to obtain multi-scale fusion features; and inputting the multi-scale fusion features into detection heads of all scales, executing abnormal scene detection, and outputting an abnormal detection result. When the unconventional object is identified in the abnormal scene, the visual features and the semantic features are fused to perform abnormal scene detection, so that the strong perception capability of a complex scene is realized, and false alarm or missing alarm is effectively avoided.

The present application relates to the field of computer vision. Provided are a visual encoding method and apparatus, and a visual encoding model training method and apparatus, which are used for using the same visual encoding model to encode images of different resolutions, and are applied to encoding scenarios for images of more sizes. The visual encoding method comprises: first, acquiring an input image, wherein the input image may be a high-resolution image and may also be a low-resolution image; and then inputting the input image into a visual encoding model, so as to output visual encoding data, wherein the visual encoding model is used for dividing the input image into a plurality of image blocks according to positional embedding, extracting features from each image block, and outputting visual encoding data on the basis of the features of each image block and corresponding positional encoding, the positional embedding is obtained by means of adjusting initial positional embedding on the basis of the difference between the input image and a preset resolution, and the positional embedding may specifically comprise a matrix corresponding to the division of the input image

The invention provides a semi-supervised image semantic segmentation method and system based on a visual basic model, and the method comprises the steps: constructing a multi-task model which comprises a visual basic model and a depth estimation basic model, and the visual basic model is connected with a task solution head, an adapter parameter efficient fine tuning module and a multi-modal cross fusion module; the task solution head comprises a semantic segmentation head and a depth estimation head; extracting semantic hierarchy features and a depth feature map of the RGB image, performing cross attention fusion on the semantic hierarchy features and the depth feature map, and inputting obtained fusion features into a semantic segmentation head and a depth estimation head respectively; semi-supervised learning is adopted to train a multi-task model, only parameters in the adapter parameter efficient fine tuning module and the multi-modal cross fusion module are trained, and a multi-task loss function is adopted. The image semantic segmentation model obtained through training can improve semantic segmentation performance, reduce training cost and is suitable for different tasks.

A clinical vertebra image segmentation method for assisting pedicle screw placement surgery, said method comprising: constructing a VerseDiff-UNet end-to-end framework, the framework being integrated with a denoising diffusion probabilistic model (DDPM); combining a noise-added image with a marked mask by using the VerseDiff-UNet framework, and guiding a diffusion direction toward a target region; and introducing a shape priors module on the basis of the DDPM, and extracting structural semantic information from an input spine image. In order to capture specific anatomical prior information in a medical image, the shape priors module is combined and the module effectively extracts the structural semantic information from the input spine image, thereby enabling more accurate anatomical structure segmentation, and facilitating accurate diagnosis and treatment of spinal disorders.

The invention relates to the technical field of boundary recognition, in particular to a glioma boundary recognition method and system based on image fusion, and the method comprises the following steps: obtaining a multi-modal brain image, constructing a fusion matrix, extracting the gray features of an edge region and an adjacent region, recognizing signal-noise abnormal points, and revising a judgment standard. And adjusting the path direction and reconstructing an edge communication structure, and generating a glioma boundary region map under fusion. According to the method, high-precision alignment among modals is realized through multi-modal image gray scale unification and registration processing, key details are expanded and focused by enhancing edges and regions, the recognition accuracy is improved, gray scale comparison between the edges and outer adjacent regions is introduced, the signal distinguishing capability is enhanced, misjudgment is avoided, judgment conditions are dynamically revised according to the signal-noise difference, and the accuracy of recognition is improved. The method enables the recognition standard to have local adaptability, combines the path change trend to reorder and connect edge points, guarantees the continuity of a boundary structure, integrally improves the accuracy and integrity of fuzzy boundary recognition, and enhances the glioma contour extraction effect.

The invention relates to the technical field of computer vision, in particular to a defect segmentation positioning method and system for an inorganic mineral casting image, and the method comprises the following steps: calling an illumination image to analyze brightness, matching exposure parameters, splicing the image, analyzing a gradient, recognizing a defect, screening an effective region, calculating a gray variance, and constructing roughness weight recognition texture features. According to the method, the high-reflection area identification, the brightness gradient analysis, the pixel-level roughness weight and the structure tensor analysis are combined, the exposure interval can be dynamically adjusted when the casting image is processed, the defect type information is output in the direction, and the positioning information is generated by correcting the recognition position in combination with the actual coordinate of the target spot. The method has the advantages that the high-reflection area identification, the brightness gradient analysis, the pixel-level roughness weight and the structure tensor analysis are combined; the method has the advantages that the method is simple and easy to implement, detail loss of overexposure areas is reduced, the recognition precision of defect areas is improved, accurate area segmentation and classification processing are achieved, roughness weight calculation combining gray variance and pixel density is combined, the sensitivity to surface fine defects is enhanced, and the precision and reliability of defect positioning are improved.

The invention provides a pathological image visual positioning method and system, equipment and a storage medium, and belongs to the technical field of image recognition, and the method comprises the steps: extracting visual features based on a target pathological image, and determining a semantic feature vector and a knowledge feature vector based on first text description; the target pathological image is a pathological image to be subjected to target area positioning, and the knowledge feature vector is used for representing knowledge information associated with the content of the target pathological image; fusing the semantic feature vector and the knowledge feature vector to obtain a fused text feature; performing cross-modal fusion on the fused text features and the visual features to obtain fused multi-modal features, and obtaining fusion representation based on the fused multi-modal features; and based on the fusion representation, positioning a target area in the target pathological image through a multi-layer perceptron to obtain position information of a bounding box of the target area. The method can improve the capability of accurately and flexibly positioning the pathological image region level.

A video tag recognition method, executed by an electronic device and comprising: by means of a video tag recognition model, respectively encoding video frames in a video to be recognized, to construct a global feature set comprising global features of the video frames obtained by encoding, and a local feature set comprising local features of the video frames obtained by encoding; on the basis of a feature similarity between the global features in the global feature set, compressing the global feature set to obtain a sequence of global features of a preset storage quantity; and on the basis of a feature similarity between the local features in the local feature set, compressing the local feature set to obtain a sequence of local features of a preset storage quantity (S91); concatenating a global query feature and a local query feature obtained by pre-training, and then using a self-attention mechanism to extract a self-attention feature, wherein the global query feature and the local query feature are obtained by training learnable query features on the basis of a sample video, and the self-attention feature fuses key information in the global query feature and the local query feature (S92); using a cross-attention mechanism to respectively extract a first cross-attention feature between the self-attention feature and each global feature in the global feature sequence, and to respectively extract a second cross-attention feature between the self-attention feature and each local feature in the local feature sequence (S93); and on the basis of the obtained first cross-attention features and second cross-attention features, recognizing a video tag of the video to be recognized (S94).

The invention discloses a glioma T cell prediction and prognosis evaluation method based on pathological images, particularly relates to the field of patient prognosis health evaluation, and aims to solve the problems that existing pathological evaluation is difficult to combine with tumor structure heterogeneity and immune infiltration distribution, and the future progress risk of a patient cannot be predicted based on follow-up visit pathological data. A spatial heterogeneity map of a tumor core area and an invasion edge is constructed in a digital pathological section, density gradients of T cells in different areas are calculated to generate a distribution heterogeneity coefficient, interaction processing is performed on the two types of characteristics in combination with historical follow-up visit records, and a time sequence neural network constructed based on a gating structure is combined to obtain a high-efficiency characteristic of the tumor. And outputting disease progress probabilities of a plurality of follow-up visit time points in the future to form a prognosis trajectory prediction curve, calculating a quantitative recurrence risk score according to curve slope change and an immune fluctuation mode, and finally generating an individualized management scheme, thereby realizing quantitative prediction evaluation and risk management of the prognosis trend of the glioma patient.

The invention relates to the technical field of image processing, in particular to a high-voltage electrical equipment surface defect identification method based on image processing. The method comprises the following steps: analyzing the gradient of pixel points in a to-be-analyzed image of a to-be-detected area on the surface of the high-voltage electrical equipment to obtain the weight of each pixel point; weighting the gray value of each pixel point in the to-be-analyzed image subjected to Laplacian filtering by using the weight of each pixel point of the to-be-analyzed image to obtain a first feature map; calculating a local standard deviation of each pixel point in the to-be-analyzed image so as to obtain a first parameter and a second parameter; constructing two Gaussian kernels based on the first parameter and the second parameter to filter the to-be-analyzed image to obtain a second feature map; fusing the first feature map and the second feature map of the to-be-analyzed image to obtain a defect saliency map of the to-be-analyzed image; and recognizing a surface defect area of the high-voltage electrical equipment based on the defect saliency map of each to-be-analyzed image. According to the invention, the accuracy of high-voltage electrical equipment surface defect identification can be improved.

The invention relates to a medical image segmentation method based on wavelet boundary enhancement and multi-scale perception, and the method comprises the steps: firstly carrying out the preprocessing of an input medical image, including size standardization, intensity normalization and data enhancement; then, inputting the processed image into a deep fusion segmentation network, extracting high-frequency boundary features through wavelet transform and generating a boundary attention map, and capturing global context information in combination with a multi-scale dynamic sparse attention mechanism; and finally, fusing the multi-scale features through a boundary enhancement up-sampling module in a decoder stage, and optimizing a segmentation result by adopting multi-scale supervision and a mixed loss function. According to the method, the boundary precision and the detail retention capability of medical image segmentation are effectively improved, and the segmentation performance under a fuzzy boundary, a multi-scale structure and a complex background is remarkably improved.

The invention discloses a medical image segmentation method based on TransUNet, and belongs to the technical field of medical image segmentation. The method comprises the steps of firstly performing data preprocessing on an original image to obtain preprocessed data; and a DCA attention module is used at a jump joint, so that the problem that a semantic gap exists between characteristics of an encoder and a decoder due to the fact that a simple jump connection scheme is difficult to capture a multi-scale context is solved. The semantic difference leads to redundancy between low-level and high-level features, and finally the segmentation performance is limited. Secondly, a multi-scale boundary sensing module is added to the top layer of the encoder, so that the neural network can better segment the boundary of the target image in the training process; and inputting the preprocessed data into the improved TransUNet model to train the medical image, and outputting an image segmentation result.

The invention relates to the technical field of image compensation, in particular to a reflection compensation method based on image processing, and provides the following scheme: acquiring an environment panoramic image by using a panoramic camera to establish a scene global coordinate system, and acquiring a multi-view original image in combination with a camera array arranged in the circumferential direction of an object; determining a rotation symmetry axis according to the multi-view contour features, reconstructing a three-dimensional geometric body, and calculating normal distribution and curvature change; generating a prediction image based on diffuse reflection and specular reflection hypothesis in the surface expansion domain through virtual visual angle disturbance, identifying a reflection region according to color and gradient consistency, and generating a reflection mask; and performing texture reconstruction on the reflective area by using geometric registration and multi-view compensation, and finally performing splicing and fusion to obtain a non-reflective high-fidelity panoramic image. The method does not need to change the field illumination condition, and can achieve the precise recognition and compensation of the complex curved surface reflection in the cultural relic in-situ collection environment.

The invention provides a multi-small-target tracker and tracking method based on SAM2, and the method comprises the steps: dividing a video into a plurality of segments, and enabling the last frame of a previous video segment to be overlapped with the first frame of a next video segment; performing target detection on a first frame of the initial video clip, and allocating an ID to a detected target object; target tracking is executed in each video clip through SAM2, target detection is executed on overlapped frames between adjacent video clips, a detected bounding box is matched with a mask output by SMA2 through a previous video clip according to a mask-to-detection association strategy, and target tracking is executed in each video clip through SAM2; therefore, when a new target appears in the next video clip, a new ID can be allocated to avoid tracking interruption. According to the method, the mask and the detection are located at the same space-time position through video frame overlapping, so that tracking cannot be interrupted as long as the appearance of the target can still be visually distinguished, and the tracking failure rate when the size of the target is too small or the camera is zoomed and moved can be remarkably reduced.

The invention provides a multi-modal large language model for generating a hepatocellular carcinoma key pathological diagnosis report, a framework main body is a visual coding module, and a multi-modal feature alignment module, a multi-head low-rank attention mechanism, an enhanced medical MoE mechanism and a structured output decoding layer are also introduced. The visual coding module is constructed on the basis of a Swin Transform architecture, visual pre-training is completed on hepatocellular carcinoma MRI data, and after a task specific classification head is stripped, a trunk feature extraction network is reserved to serve as an image modal representation encoder. The multi-modal feature alignment module guides the model to learn a cross-modal semantic mapping relation between a hepatocellular carcinoma MRI image and a key pathological diagnosis report language, image modal input is a visual feature sequence, and text modal output is a structured description text; and the structured output decoding layer generates six types of liver cancer focus attributes. According to the method, the pre-operative multi-parameter and multi-stage enhanced MRI image is utilized, and the open-source large model is finely adjusted to generate a matched liver cancer postoperative pathology report.

The invention discloses a 2D medical image segmentation method and system based on Mama and UNet, and the method comprises the steps: collecting and preprocessing a medical image segmentation data set, and obtaining a training set; constructing a 2D medical image segmentation model based on Mama and UNet, wherein the 2D medical image segmentation model comprises a block embedding layer, an encoder, a decoder and a prediction generation layer; designing an adaptive hierarchical loss function based on gradient statistics, and training the 2D medical image segmentation model on the training set; and inputting the medical image with segmentation into the trained model to complete image segmentation. According to the invention, the method can achieve the automatic and intelligent segmentation of the medical image through the innovative construction of the 2D medical image segmentation model based on Mamba and UNet, and is higher in segmentation accuracy and efficiency.

The invention discloses a heterogeneous double-flow fusion method and system for diabetic retinopathy grading. The method comprises the following steps: obtaining an output result of diabetic retinopathy grading by utilizing a heterogeneous double-flow architecture; processing an input fundus image into images with different resolutions; extracting global context features from the low-resolution image by using a lightweight visual Transform model distilled by composite knowledge, and extracting local focus features from the high-resolution image by using a convolutional neural network model; performing interactive fusion on the global context features and the local focus features of the double-branch architecture through a symmetric bidirectional cross attention fusion module to obtain enhanced fusion feature representation; and finally, inputting the fusion features into a classifier, and outputting a severity grading result of the lesion. The method aims at improving the accuracy and robustness of hierarchical diagnosis through deep analysis of global information and local details, and can be applied to the medical fields of clinical computer-aided diagnosis, eye image analysis and the like.

A device for processing frame data may be configured to identify one or more semantic characteristics for the frame data, wherein the frame data comprises a plurality of frames, each frame of the plurality of frames being acquired for a same scene and by a different frame source of a plurality of frame sources; extract features from each respective frame of the plurality of frames; determine a non-uniform sampling pattern of the plurality of frames based on the one or more semantic characteristics; and project, using the non-uniform sampling pattern, a portion of the extracted features into a bird's-eye-view (BEV) space having a grid structure to generate a fused set of BEV features.

The invention relates to the technical field of medical image processing, and particularly discloses a medical image segmentation method with adaptive receptive field and feature correction, which comprises the following steps: (1) acquiring an original medical image and a segmentation label thereof, and constructing a training and testing data set; (2) carrying out size normalization and enhancement processing on the image; (3) establishing an improved U-shaped encoder-decoder segmentation network, introducing an adaptive branch mixed shape convolution module in a shallow layer, and improving edge and texture feature modeling capability by adopting a multi-branch banded convolution and channel attention mechanism; (4) a residual directional feature interaction module is introduced into a deep layer, a spatial dependency relationship is modeled through an information interaction structure in the horizontal and vertical directions, and the direction sensing ability of the heterostructure is enhanced; and (5) completing network training and reasoning, and outputting a segmentation result. The method gives consideration to the calculation efficiency and the segmentation precision, and is suitable for the automatic segmentation task of various types of medical images with complex structures.

The disclosure herein relates to systems, methods, and devices for medical image analysis, diagnosis, risk stratification, decision making and / or disease tracking. In some embodiments, the systems, devices, and methods described herein are configured to analyze non-invasive medical images of a subject to automatically and / or dynamically identify one or more features, such as plaque and vessels, and / or derive one or more quantified plaque parameters, such as radiodensity, radiodensity composition, volume, radiodensity heterogeneity, geometry, location, perform computational fluid dynamics analysis, facilitate assessment of risk of heart disease and coronary artery disease, enhance drug development, determine a CAD risk factor goal, provide atherosclerosis and vascular morphology characterization, and determine indication of myocardial risk, and / or the like. In some embodiments, the systems, devices, and methods described herein are further configured to generate one or more assessments of plaque-based diseases from raw medical images using one or more of the identified features and / or quantified parameters.

The invention provides a dermatoscope image segmentation method, and relates to the technical field of medical image processing, and the method comprises the steps: inputting a to-be-segmented image into an improved encoder module, carrying out the multi-scale feature information extraction, and obtaining a deep advanced semantic feature map; inputting the deep advanced semantic feature map into the bridging module, and performing context information modeling and cross-scale feature fusion to obtain a fused feature map; inputting the fused feature map into the decoder module, and carrying out layer-by-layer up-sampling and feature integration to obtain a reconstructed feature map; inputting the reconstructed feature map into the boundary sensing double-branch module, and performing collaborative feature processing; wherein the main branch outputs a binary segmentation mask, and the auxiliary branch is used for measuring a sign distance function diagram to provide boundary perception supervision; obtaining a binary segmentation mask output by the main branch as a segmentation result; compared with an existing model, the optimized dermatoscope image segmentation model is higher in recognition accuracy.

The invention discloses a monocular and binocular cooperative localization and mapping method and device for underwater refraction compensation, and the method comprises the steps: extracting checkerboard angular points, compensating an underwater light path through employing a two-time vector correction model based on a Snell law, and precisely calibrating the internal and external parameters of a binocular camera. According to the method, an underwater real light path is effectively restored, and calibration errors caused by medium refraction are remarkably reduced. Then epipolar correction is performed on the corrected left and right images, so that the geometric consistency of stereo matching is ensured; and finally, monocular and binocular poses are fused, and seven-degree-of-freedom similarity transformation global alignment is applied, so that the problem of monocular scale uncertainty is effectively solved, and high-precision and high-robustness three-dimensional mapping is realized by means of binocular real scale introduction. Key links such as camera pre-calibration, refraction compensation, image correction, monocular tracking, binocular depth measurement, scale alignment and the like are connected in series to form an integrated process, so that the underwater vision positioning and mapping precision is improved.

The invention belongs to the technical field of three-dimensional scene understanding, and particularly relates to a training method and device for a three-dimensional open vocabulary semantic segmentation model. The training method comprises the steps of obtaining multi-view RGB-D images of a target area, performing multi-stage reasoning on each image through a visual language model, generating a target vocabulary list, prompting a two-dimensional segmentation model to establish a pixel-level text label, performing depth mapping on the images to generate a first point cloud, and generating a second point cloud; mapping the text tag to the first point cloud to generate a point-by-point text tag; pre-training a neural network model with a sparse encoder-decoder structure by taking the point-by-point text label as a supervision signal, and generating a three-dimensional segmentation model on the first point cloud; and for the second point cloud of the complete scene of the target area, matching point feature embedding and text embedding with the highest similarity in the shared vision-language feature space, generating a credible point-text tag pair, and finely adjusting the three-dimensional segmentation model based on the credible point-text tag pair.

The invention discloses a urinary calculus CT image automatic segmentation method based on deep learning, particularly relates to the technical field of medical image processing, and is used for solving the problem of low geometric fidelity of a segmentation result caused by hardening artifacts when an existing deep learning segmentation method is used for processing a high-density urinary calculus CT image. The method comprises the following steps: acquiring a urinary calculus CT image, performing initial segmentation by using a deep learning model to generate an initial calculus segmentation region, evaluating texture heterogeneity degree and identifying a hardening artifact risk region by analyzing feature value distribution of a structure tensor field, and positioning an artifact-causing source point based on a CT imaging projection geometric principle by reversely tracing a spatial position relation. According to the method, boundary distortion features are identified by analyzing CT value profile curve form distortion features and local boundary curvature singularity features, geometric correction is performed on corresponding boundaries in an initial stone segmentation region according to the boundary distortion features, a final stone segmentation region is obtained, and the geometric accuracy and reliability of a segmentation result are effectively improved.

Disclosed is a image processing apparatus and a method for controlling the image processing apparatus. The image processing apparatus according to an embodiment of the present disclosure may identify an object from an acquired image, determine whether the object is hidden by another object by using an aspect ratio of a bounding box of the detected object, and based on the object being hidden, estimate an entire length of the object based on coordinate information of the bounding box. Accordingly, the size information of the hidden object may be efficiently identified while a large amount of database is applied or resources of the apparatus is minimized. The present disclosure may be in connection with a surveillance camera, an automotive driving vehicle, an artificial intelligence module of at least one of a user terminal or a server, a robot, an augmented reality (AR) device, a virtual reality (VR) device, a device related to a 5G service, and the like.

The utility model discloses a tumor electric field treatment device and a treatment system, the tumor electric field treatment device is provided with a frame body and a pole piece module, the frame body forms a skeleton structure of the treatment device, the pole piece module is attached to the frame body, the pole piece module is provided with a plurality of electrode contacts, and each electrode contact can form an active contact or a passive contact. The active contact and the radio frequency generation module can form a loop; after the treatment device is implanted into a tumor excision part, all the electrode contacts form active contacts, and all the electrode contacts and the radio frequency generation module form a loop to distinguish normal tissues from pathological tissues; after the normal tissue and the lesion tissue are distinguished, the electrode contacts in the normal tissue area form passive contacts, and the electrode contacts in the lesion tissue area form active contacts, so that targeted treatment of the lesion tissue is realized, and side effects generated by electric field treatment are reduced.