25 results about "Multimodal imaging" patented technology

This invention discloses a multimodal imaging and multidimensional index evaluation software and hardware system for scars, involving an infrared, RGB, and stereoscopic three-modal imaging hardware system, and an intelligent calculation and monitoring software system for more than twenty scar evaluation indicators. The intelligent evaluation system for scars includes indicators such as perimeter, length, width, thickness, area, volume, color, roughness, consistency, elasticity, blood flow density, risk of continued scar growth, and color difference. This forms an objective, multidimensional, precise, and intelligent evaluation system for the scar diagnosis and treatment process, thereby assisting in diagnosis and treatment, as well as monitoring and tracking the entire life cycle of scars. This contributes to the visualization, objectification, and accuracy of the scar diagnosis and treatment process, providing doctors and patients with comprehensive diagnostic and treatment evidence and enabling tracking and tracing.

Disclosed in the present invention are a simple phenolic acid derivative- and rosmarinic acid derivative-based multimodal imaging probe and a use thereof. The multimodal imaging probe of the present invention has a structure selected from those represented by formulas (I to III). By subjecting phenolic acids such as danshensu, caffeic acid, ferulic acid, and rosmarinic acid to derivatization modification and by means of molecular imaging technology, the present invention realizes in vivo tracing and imaging of diseases such as various tumors (liver cancer, pancreatic cancer, and breast cancer), stroke, myocardial infarction, and acute kidney injury, and achieves in vivo and in vitro high-contrast imaging, real-time monitoring, and qualitative and quantitative evaluation. Moreover, the probe of the present invention itself has good metabolic properties and targeting performance, is simple to prepare and low in cost, and has broad clinical application prospects.

The application relates to the technical field of medical devices, in particular to a skin ultrasound contrast-based axillary sentinel lymph node puncture guiding method. The core of the method is as follows: after injecting an ultrasound contrast agent with a specific particle size through the skin, a preset low-mechanical-index high-frame-rate double-amplitude contrast imaging mode is adopted to dynamically track lymph drainage and sentinel lymph node development, and the enhancement characteristics are recorded; then, under the guidance of multimodal imaging which is fused with real-time contrast, elastic imaging and color Doppler, the target lymph node is accurately punctured and biopsied, and a tissue sample is obtained for pathological analysis. The application realizes integrated operation from sensitive development of the sentinel lymph node, function evaluation to accurate puncture, and provides a non-radiation high-precision puncture guiding method for accurate evaluation of the axillary lymph node state of breast cancer patients before operation.

This invention discloses a deformable capsule endoscope probe and image fusion system based on multimodal imaging, belonging to the field of medical endoscopy technology. This invention solves the problems of existing capsule endoscope technology, which has relatively limited functionality and a fixed shape, making it difficult to adapt to the complex structure of the digestive tract and resulting in poor imaging effects. By using flexible silicone material to make the capsule endoscope probe's shell and deformable structure, it can automatically adjust its shape according to the shape of the digestive tract lumen, ensuring clear and accurate multimodal images are acquired from different locations. A neural network model accurately identifies potential lesion areas and adaptively adjusts the fusion weights based on the importance of the lesion and tissue characteristics to optimize image quality. Furthermore, a deep learning fusion network generates a comprehensive image, which, after contrast optimization and automatic labeling of lesion areas, provides doctors with clearer and more detailed diagnostic prompts, aiding in the early diagnosis and precise treatment of digestive tract diseases.

This invention relates to a nuclear-targeted multimodal imaging diagnostic probe with BNCT therapeutic efficacy, its preparation, and its application, belonging to the fields of biomedicine and nuclear medicine technology. This boron drug contains... 10 Using acetylacetone difluoroborate as the parent nucleus, this invention endows the tumor with nuclear targeting ability by introducing N- or S-containing heterocyclic structures, while utilizing its conjugated structure to provide fluorescence / photoacoustic dual-modal imaging functionality. Based on this, the invention achieves three core functions: first, through fluorescence / photoacoustic dual-modal imaging, it enables the visual localization and real-time monitoring of tumor sites; second, by leveraging the binding of nuclear targeting groups to nuclear DNA / RNA, it... 10 B is precisely delivered into the nucleus, significantly improving the killing efficiency of BNCT; thirdly, thermal neutron irradiation is performed under imaging guidance, triggering... 10 The B(n,α)⁷Li nuclear fission reaction ultimately enables high-precision integrated diagnosis and treatment. This invention also discloses a method for preparing this probe, which has promising clinical application prospects.

The invention relates to the technical field of polaroid quality detection, in particular to a polaroid quality detection method based on multi-modal imaging and fusion deep learning, and the method comprises the steps: collecting optical, intermediate infrared polarization and ultrasonic corresponding three-modal original data of a polaroid; the three-mode original data is preprocessed, and the preprocessed three-mode data is obtained; respectively extracting local defect features and global distribution features of the preprocessed three-mode data through a double-branch feature extraction network; fusing the local defect feature and the global distribution feature by using a dynamic weight to obtain a fused feature; and outputting a quality detection result of the polaroid based on the fusion features, and performing closed-loop feedback control on the production of the polaroid according to the quality detection result and production line process parameters. According to the scheme, comprehensive and high-precision detection of various defects on the surface and in the polaroid can be achieved, and meanwhile the real-time requirement of online detection of a production line is met.

This invention relates to the field of intelligent diagnostic technology for oral medical imaging, specifically an intelligent auxiliary diagnostic system for oral diseases integrating multimodal imaging. The system includes: a data receiving module that receives intraoral optical photographs, cone-beam CT, and oral and maxillofacial MRI; an image analysis module that automatically delineates and segments the optical photographs to generate two-dimensional structural maps with tooth position markers, reconstructs a three-dimensional jawbone from CBCT and extracts root canal structures to generate a model containing bone density and root canal parameters, and enhances soft tissue from MRI and identifies inflammatory areas to generate a model showing muscles, blood vessels, nerves, and inflammatory boundaries; a multimodal fusion module that uses spatial registration and feature fusion to construct a unified digital model; and an intelligent diagnostic module that calls a pre-trained model for analysis and reasoning to generate a disease list and quantitative parameters. Through differentiated image processing and multimodal fusion, the system achieves a panoramic presentation of oral structure and lesions, enhancing the comprehensiveness of disease identification. This invention can improve the accuracy and efficiency of intelligent auxiliary diagnosis of oral diseases.

The application relates to the technical field of image processing, and discloses a kind of unmanned aerial vehicle inspection method and device of photovoltaic power station.The method comprises: carrying out multimodal imaging scanning to photovoltaic module, and carrying out time correlation processing to scanning data and electrical parameter data by IEEE1588 clock synchronization protocol, to obtain synchronous detection data package;Synchronous detection data package is processed by feature recognition through multidimensional feature extraction algorithm, and is processed by mapping correlation with electrical parameter, to obtain component health assessment model;Component health assessment model is processed by abnormal feature recognition through historical data comparison algorithm, to obtain component diagnosis data package;Component diagnosis data package is processed by area weight calculation to carry out inspection parameter adjustment, to obtain inspection strategy data package.The application improves the efficiency and accuracy of unmanned aerial vehicle inspection of photovoltaic power station.

This invention relates to the field of medical imaging diagnostic technology, specifically to a method and system for precise localization of small lesions in the breast and thyroid glands based on AI multimodal imaging. The method includes the following steps: acquiring ultrasound, X-ray, and magnetic resonance images of the breast and thyroid glands; extracting anatomical spatial location and imaging direction; calculating and mapping multimodal pixel spatial offsets; calculating scale consistency and normalizing response intensity based on co-located pixels; comparing multimodal intensity differences to assess consistency and form a scoring distribution; combining the score and intensity to adjust conditional probabilities; calculating joint probabilities and selecting spatial aggregates to locate small lesions. In this invention, by uniformly calibrating the spatial location and imaging direction of multimodal images, precise correspondence between different images at the same anatomical location is achieved. Multimodal response intensities are fused and consistency assessment is performed. Combining probability weight adjustment and spatial aggregation weakens the influence of noise in single images, enhances the common expression of small abnormal areas, and improves the stability and consistency of lesion localization.

This invention relates to the field of multimodal imaging technology, and more particularly to a spatiotemporal registration method for multimodal imaging data based on motion consistency. This method effectively solves the registration deviation problem caused by time asynchrony and parallax effects between visible light and infrared images during dynamic flight of a UAV. Under the high-dynamic flight conditions of a UAV, stable alignment of multimodal images is achieved through temporal compensation driven by motion consistency constraints, cross-modal geometric coarse registration, and dense deformation correction weighted by the region of interest. The method outputs overlay maps, difference maps, deformation fields, and geometric alignment indices for verification and engineering deployment. This invention does not require complex coaxial hardware design or strict time synchronization conditions, and can significantly improve the registration accuracy and robustness of multimodal imaging data in moving scenarios, providing highly consistent input data for subsequent image fusion, target detection, and recognition, and has good engineering applicability.

This invention relates to the field of rail transit inspection technology, and specifically discloses a 3D visual track contour detection system resistant to sunlight interference. The system includes a four-dimensional situational awareness module that collects light intensity, light direction, sunlight interference type, and track surface condition type; a three-factor coupling analysis module that calculates first to third coupling coefficients between sunlight incident angle and track surface reflection characteristics, sunlight incident angle and camera imaging posture, and track surface reflection characteristics and camera imaging posture; a multimodal imaging and hierarchical anti-interference module that determines the dominant interference factor and interference intensity level based on the coupling coefficients, matches and executes collaborative anti-interference strategies from a preset anti-interference strategy library, and obtains an anti-interference enhanced image; and a three-dimensional reconstruction and contour output module that performs multimodal fusion point cloud reconstruction and outputs the track contour detection result. This invention achieves high-precision detection of track contours under complex lighting conditions through an active anti-interference architecture of environmental perception, coupling analysis, and dynamic adaptation.

The present application relates to the technical field of imaging chip, and particularly relates to a multi-modal imaging chip and a preparation method thereof; the multi-modal imaging chip, wherein each macro-pixel in a light modulation layer corresponds to a pixel cluster of an image sensing layer; each macro-pixel adopts an anti-crosstalk micro-nano structure primitive array; a plurality of polarization-independent spectral selection micro-nano units and a plurality of spectral-independent polarization selection micro-nano units are arranged in a non-uniform manner in each anti-crosstalk micro-nano structure primitive array; the polarization-independent spectral selection micro-nano unit is a two-dimensional grating structure with four-fold rotational symmetry, and based on a first preset parameter, selective modulation of light of a preset specific waveband is realized; the spectral-independent polarization selection micro-nano unit is a one-dimensional grating structure with anisotropy, and based on a second preset parameter, selective modulation of light of a specific polarization state is realized. The present application can decouple and reconstruct spectral information and polarization information of an incident light field from a single frame of image obtained by single exposure.

This invention discloses a 3D multimodal imaging observation endoscope system, belonging to the field of medical device technology. The system includes a multispectral composite light source device, an integrated electronic endoscope, an image processing device, an ultrasound processor, and an image display. The endoscope's insertion tip integrates optical imaging components and an instrument channel for accommodating an electronic array probe. The multispectral composite light source device can generate different combinations of light and transmit illumination through a composite fiber bundle. The image processing device receives and processes signals from four image sensors, generating and fusing 3D white light, fluorescence, or narrowband light images in two imaging modes, outputting a stereoscopic fused image. The ultrasound processor controls the probe to generate a three-dimensional ultrasound image. The image display provides multimodal image display based on the fused image and the ultrasound image. This invention enables real-time, synchronous provision of multi-dimensional image information, comprehensively improving the early lesion detection rate and the accuracy of surgical planning.

This application provides a multimodal imaging system and a multimodal imaging method, which can be applied to the field of image processing technology. The multimodal imaging system includes: an optical imaging unit, used to obtain an optical image of a target object by performing optical detection on the target object under the action of a signal isolation control unit; a magnetic resonance imaging unit, used to obtain a magnetic resonance image of the target object by performing magnetic resonance detection on the target object under the action of a signal isolation control unit; a signal isolation control unit, used to shield the electromagnetic field generated by the magnetic resonance imaging unit within the working range of the optical imaging unit, isolate the electrical signals of the optical imaging unit, and control the working timing of the optical imaging unit and the magnetic resonance imaging unit; and an image fusion unit, used to fuse the optical image and the magnetic resonance image to obtain a multimodal image.

This application relates to an artificial intelligence phase segmentation method, computer equipment, and computer program product for cement-based materials based on high-dimensional multimodal imaging. It pertains to the fields of image analysis and phase recognition. The method includes: acquiring BSE images and EDS multi-element surface scan images from the same field of view; constructing a high-dimensional multimodal feature tensor that integrates composition, chemical ratios, BSE image features, and spatial coordinates; performing superpixel segmentation in the high-dimensional space and projecting it back onto a two-dimensional plane; extracting core representative points far from the boundary within the superpixel region; calculating elemental ratios and stoichiometric consistency descriptors; screening high-confidence phase seeds using preset chemical judgment rules; obtaining a complete phase label map through superpixel adjacency graph label propagation; interactively verifying and correcting regions with propagation confidence below a preset threshold and updating the label map; and finally outputting a spatially continuous, manually verified phase segmentation result, effectively reducing manual annotation time.

This application relates to the preparation and application of a gambogeylic acid formulation targeting malignant tumors. It employs a three-layer structure: the core is a gambogeylic acid-black phosphorus quantum dot complex, possessing both chemotherapy and photothermal therapy functions; the middle layer consists of cryogenically frozen NK92 MI cell-derived nanovesicles, providing natural immune targeting and killing capabilities; the outer shell is a hyaluronic acid chelate, enabling active targeting and pH / photothermal responsive drug release. The core of its preparation method lies in using coaxial electrospray technology to form the three layers in one step, resulting in a highly efficient process and good formulation stability. This formulation can achieve synergistic photothermal-chemo-immunotherapy and simultaneously possesses near-infrared fluorescence and photoacoustic multimodal imaging capabilities, effectively solving the problems of poor targeting, significant toxic side effects, and lack of real-time monitoring associated with traditional chemotherapy. It demonstrates significant advantages and application potential in the precision treatment and diagnosis of solid tumors.

According to one aspect of the present disclosure for achieving the above-described object, a multimodal imaging catheter inserted into the body to acquire information of an internal body tissue for achieving the above-described object is disclosed. The multimodal imaging catheter may include an imaging core including a double clad fiber and a focusing device, the imaging core transfers light to the internal body tissue and collects information within the internal body tissue; and an imaging sheath including the imaging core therein to protect the imaging core from an external environment and to separate the internal body tissue and the imaging core during an imaging operation of the multimodal imaging catheter for the internal body tissue.

This application relates to the field of medical image processing technology and discloses a method and system for preoperative risk assessment of breast cancer by integrating multimodal images. The method includes: weighted integration of image feature data and historical image data to generate quantitative results of image contrast differences and obtain preliminary boundary distribution characteristics; analysis of dynamic changes in multimodal images and determination of regional expansion trends to generate a description of the direction of dynamic changes; real-time correction of current image data based on boundary adjustment needs to generate risk distribution data; dynamic correction of boundary lines for high-risk areas based on the risk distribution data to generate boundary ranges under real-time monitoring; identification of potential abnormal signals within the boundary range; if present, re-analysis of boundary dynamic changes, updating the boundary change status, generating a risk area expansion description, and completing the risk assessment corresponding to the multimodal images. This application improves the accuracy of preoperative risk assessment for breast cancer.

This invention discloses an intelligent detection method and system for defects in plastic parts of optical lenses, belonging to the field of machine vision inspection. The method includes: controlling a multimodal imaging module to acquire bright-field, dark-field, and backlight images of the plastic part under test; inputting the preprocessed images into a deep learning fusion detection network; the network extracting deep features of each modality through parallel feature extraction branches, weighted fusion via an attention mechanism, and outputting defect classification, location, and confidence level; finally, controlling a sorting execution mechanism to automatically sort the defects based on a comparison of the detection results with a tolerance threshold. The system includes a motion platform, a multimodal imaging module, an image processing and controller, and a sorting execution mechanism. This invention achieves high-precision detection and automated sorting of various defects such as scratches and weld lines through multimodal imaging and adaptive feature fusion.

This invention relates to the fields of ophthalmic medical devices and image processing technology, specifically disclosing a system and method for detecting corneal microlenses based on multimodal imaging. The system includes: an image acquisition module for acquiring corneal density maps, anterior surface elevation maps, and anterior segment OCT images of the examined eye after SMILE surgery; a data processing module for identifying focal areas with low corneal optical density values ​​within the expected lenticule removal area from the corneal density map as suspected microlenses (SRL) areas, and locating microbulges spatially related to the suspected SRL area in the anterior surface elevation map; a confirmation module for determining whether lamellar detachment and compensatory thinning of the superior tissue exist at the suspected SRL area based on the anterior segment OCT image, thus confirming the SRL; and a quantification output module for calculating and outputting the area of ​​the SRL, the number of corneal quadrants it occupies, and its morphological classification. This invention solves the problem of the lack of standardized methods for detecting microlenses after SMILE surgery in the prior art.

The invention relates to the technical field of biomedical detection, and particularly discloses a multiple histochemical staining method based on controllable staining-decolorizing circulation. The method is realized through the steps of water bath-assisted antigen repair, composite pretreatment, alternate labeling dyeing of nanogold and quantum dots, electrochemical-assisted controllable decoloration, dynamic monitoring circulation, optical transparency treatment, multi-modal imaging reconstruction and the like. The key composition comprises a composite decolorizing agent containing a specific electron shuttling medium and a series of coloring agents containing nanogold and quantum dots. The preparation method mainly comprises the following steps: performing incubation reaction on each component and a tissue sample according to a specific sequence, completing controllable decolorization circulation under the assistance of an electric field, and regulating and controlling the process in real time through an optical monitoring system. According to the method disclosed by the invention, the sequential marking and accurate recognition of multiple target molecules on the same tissue sample can be realized; in addition, the preparation method has the advantages of being high in process controllability, good in dyeing cycle stability and high in operation repeatability.

This invention discloses a method for selecting design parameters for pulse ablation catheters based on finite element analysis, relating to the field of medical device technology. The method includes: obtaining a registered and aligned DICOM format image dataset through high-resolution CT and DTI multimodal imaging of the patient's skull base; obtaining the optimal combination of pulse voltage parameters through gradient optimization under geometric constraints based on a high-fidelity simulation model; generating a catheter manufacturing and treatment plan through catheter 3D printing and intraoperative treatment planning; and constructing a catheter tip with electrode slots and an optimized 3D printing file based on the catheter manufacturing and treatment plan to obtain the pulse ablation catheter design parameters. This invention also achieves realistic simulation of electric field conduction along the axonal direction in finite element simulation by constructing a composite neural tissue model incorporating nerve fiber pathways and defining anisotropic conductivity, thus obtaining precise catheter design parameters that combine anatomical adaptability and electrophysiological targeting.

This invention relates to the field of medical image processing technology, and discloses a method and system for ocular surgical localization based on image detection. The method includes: acquiring intraoperative fundus color images, microscopic images, and optical coherence tomography (OCT) data; performing multimodal fine registration; generating enhanced fused images; performing retinal key structure detection and localization on the enhanced fused images; and generating intraoperative navigation overlay display information based on three-dimensional pose information using a residual-gated dynamic tracking mechanism. Compared to methods that rely solely on single-modal images for assisted manual localization in teaching demonstrations and simulation training systems, especially under conditions of intraoperative tissue occlusion and significant grayscale differences in multimodal imaging, this invention addresses the technical problem of failing to achieve stable and continuous tissue localization under complex intraoperative environments through unified calibration of multimodal images and a residual-gated dynamic tracking mechanism.