86 results about "Multimodal imaging" patented technology

A robotic surgical system includes a robotic manipulator configured to perform surgical procedures under direct surgeon control. A surgical camera system captures real-time intraoperative video. An external imaging interface receives multimodal imaging data, including preoperative and intraoperative data from at least one of magnetic resonance imaging (MRI), computed tomography (CT), ultrasound, and fluoroscopy. An artificial intelligence (AI module has a trained neural network and a deep learning model trained on multi-institutional annotated surgical datasets, The AI module is configured to execute one or more of: fuse acquired video and imaging data into temporally and spatially coherent anatomical visualizations; generate continuously updating overlays aligned with the surgical field, with segmented anatomical features; projected tissue boundaries, proximity indicators for instruments, and predictive deformation trends; provide dynamic predictive trend visualization indicating zones of future anatomical complexity or risk; register and align preoperative imaging data with intraoperative imaging data in real time; adapt overlay presentation in response to tissue deformation without actuating the robotic manipulate or; and passively augment visual feedback without initiating any autonomous actuation of surgical instruments.

The invention relates to the technical field of tumor interventional operations, and discloses a visual navigation method based on a tumor interventional operation robot. The method comprises the following steps: acquiring real-time medical image data of a tumor area containing multi-modal imaging information so as to comprehensively present anatomical details; and performing three-dimensional reconstruction on the image data to generate a tumor area three-dimensional anatomical structure model capable of visually displaying a space structure. Key anatomical feature points are extracted based on the model, space coordinates are calculated, a surgical robot intervention path is planned according to the coordinates, and an initial navigation track is generated; and continuously collecting real-time pose data of the robot in an operation, dynamically matching the real-time pose data with the initial navigation trajectory, adjusting motion parameters according to a matching result, and generating a corrected navigation instruction. The method can reflect the intraoperative anatomy condition in real time, dynamically optimize the path, solve the problems that traditional navigation depends on preoperative static images and lacks real-time adjustment, reduce operative complications and improve the treatment effect of patients.

The invention discloses a lumbar disc herniation postoperative recurrence prediction system based on a multi-modal medical image, and belongs to the field of medical images. The lumbar disc herniation postoperative recurrence prediction model based on the multi-modal image is trained by using the lumbar vertebra image set, the feature true value corresponding to each image and the recurrence prediction label corresponding to each patient, and in the training process, model parameters are updated by using a stochastic gradient descent algorithm; and a trained lumbar disc herniation postoperative recurrence prediction model based on the multi-modal image is obtained. According to the method and the system, due to rich image features provided by the multi-modal image, the prediction network trained based on the multi-modal data shows higher accuracy in postoperative recurrence prediction of the lumbar disc herniation.

The invention discloses a multi-mode head and neck tumor segmentation and survival prognosis prediction method. The method comprises the following steps: constructing a DE-LS-UNet model; training the DE-LS-UNet model to obtain a trained DE-LS-UNet model, and inputting the new PET image and the CT image into the trained DE-LS-UNet model to obtain a predicted tumor segmentation mask; extracting multi-modal radiomics features according to the predicted tumor segmentation mask, and fusing clinical features through the multi-modal radiomics features to generate multi-source features of the patient; inputting the multi-source features of the patient into the survival analysis model for training to obtain a trained survival analysis model, and inputting the features of the patient into the trained survival analysis model to obtain a prognosis prediction result. According to the method, a feature extraction and fusion mechanism is provided, and a survival analysis model strategy is combined, so that the stability and prediction performance of survival prognosis modeling can be enhanced while the image segmentation precision is improved.

In some embodiments provided herein is a generative foundation model trained over millions of health system-scale electronic health records along with web-scale medical text corpora to acquire knowledge of both medical practices and theories, and use of the generative model for rare disease diagnosis (including rare ophthalmic, diseases and rare systemic diseases), emergency condition identification (including ophthalmic emergencies and systemic emergencies), complex disease solving ("diagnostic puzzles"), or generating multimodal medical imaging reports (including ophthalmic images and radiology images such as X-rays and CT scans). In some embodiments, the generative model involves the use of language data, for pre-training, language data for supervised finetuning using a instruction tuning approach (e.g., QA pairs), and a human-machine hybrid evaluation strategy. In some embodiments, both the pre-training and supervised finetuning phases involve the use of a particular method of scaling to extend the context window. In some embodiments, the human-machine hybrid evaluation strategy involves language data for automated evaluations, as well as evaluations by generalists and by different specialists (e.g., ophthalmologists and radiologists) of varying levels of experience. In some embodiments, the generative foundation model, MetaGP, is used for unmet clinical needs through integration of medical and multimodal imaging data.

A multimodal imaging unit for depth-surface imaging of a skin region of interest includes an ultrasound imaging transceiver, an optically transparent acoustic deflector, an optical module, and an optical camera sensor. An ultrasound beam emitted towards the acoustic deflector is deflected towards the skin region of interest, and an ultrasound beam reflected from the skin region of interest is returned to the ultrasound imaging transceiver. An optical beam from the optical module is passed through the acoustic deflector to a skin area of the skin region of interest and an optical beam reflected from the skin area is returned to an optical camera sensor through the acoustic deflector. The transceiver and the acoustic deflector are surrounded by an intermediary coupling medium and are hermetically enclosed by a cover provided with an acoustically and optically transparent access port for the ultrasound beams and the optical beams.

The invention discloses a disposable absorbent article defect detection system and method based on AI vision, the system is arranged corresponding to a production line, an image acquisition module in a multi-modal imaging unit is arranged corresponding to a station on the production line so as to acquire an image and preprocess the image, the image acquisition module is arranged corresponding to an encoder, and the encoder is arranged corresponding to the multi-modal imaging unit. The encoder sends out a pulse signal to trigger the image acquisition modules, and all images corresponding to the same product acquired by all the image acquisition modules are associated based on the encoder; the AI processing unit is used for carrying out defect detection analysis and the like on the image; and the control unit is used for controlling the working state of the multi-mode imaging unit and forming a control instruction according to a detection and analysis result. According to the system, the purpose of seamless integration of defect information of multiple procedures across multiple paths and branches is achieved, so that the defects of the absorptive article can be detected more accurately and comprehensively, and products with the defects can be better removed in the follow-up process.

Systems and methods are provided for real-time multimodal deformable image registration for image-guided interventions. A pre-interventional three-dimensional (3D) magnetic resonance imaging (MRI) image and multiple 3D ultrasound (US) images capturing various respiratory states and poses are acquired for a patient. The MRI image is registered to each US image using a trained MR-US deformation model, producing deformed MRI images. During intervention, an interventional 3D US image is acquired and registered to a pre-interventional US image using a trained US-US deformation model, determining a warp field. This warp field is applied to the corresponding deformed MRI image, producing a registered 3D MRI image for visualizing annotated tissue features from the pre-interventional MRI on the live interventional US image. The disclosed approach leverages multimodal imaging and deep learning models to enhance visualization during interventions by combining superior soft tissue contrast of MRI with real-time US imaging capabilities.

This invention discloses a multimodal imaging and multidimensional index evaluation software and hardware system for scars, involving an infrared, RGB, and stereoscopic three-modal imaging hardware system, and an intelligent calculation and monitoring software system for more than twenty scar evaluation indicators. The intelligent evaluation system for scars includes indicators such as perimeter, length, width, thickness, area, volume, color, roughness, consistency, elasticity, blood flow density, risk of continued scar growth, and color difference. This forms an objective, multidimensional, precise, and intelligent evaluation system for the scar diagnosis and treatment process, thereby assisting in diagnosis and treatment, as well as monitoring and tracking the entire life cycle of scars. This contributes to the visualization, objectification, and accuracy of the scar diagnosis and treatment process, providing doctors and patients with comprehensive diagnostic and treatment evidence and enabling tracking and tracing.

This disclosure is directed toward systems and methods for monitoring patients in a clinical setting by using non-contact multimodal imaging. For example, based on receiving imaging data, a computing device may identify an object and a region of focus formed by the object. The computing device may then cause a sensor to capture first sensor data at a first time and second sensor data at a second time, wherein the sensor data is associated with the region of focus. Based on determining that a difference between the first sensor data and the second sensor data is greater than or equal to a threshold difference, the computing device may generate and send, to an additional computing device, an alert indicative of the second sensor data.

The application relates to a method for optimizing multimodal imaging and a multimodal imaging system. Based on the multimodal imaging system, an optical coherence imaging module converts collected optical coherence imaging signals into interference photoelectric signals, an optical phase extraction module calculates a wavefront phase diagram according to the interference photoelectric signals, and an adaptive signal processing module generates a driving signal according to the wavefront phase diagram, so that a spatial light modulator in an adaptive optical module is dynamically controlled, the spatial light modulator dynamically adjusts the wavefront phase of incident laser, higher-precision wavefront distortion compensation is realized, and the imaging quality of the multimodal imaging is optimized. The method utilizes the deep penetration and layer cutting capabilities of the optical coherence imaging mode, simultaneously has full field of view and high-speed regulation and control capabilities, accurately adjusts the phase, and realizes adaptive optimization. The method provided by the application improves the overall imaging effect of the multimodal imaging, and promotes the wide application of the multimodal imaging system in the fields of disease detection and scientific research.

The application relates to an ophthalmic multimodal imaging joint calibration device and a calibration method. The device comprises a variable diaphragm, an eye simulation lens, a water room and a calibration plate. The eye simulation lens is placed at the best working distance of the calibrated equipment. The variable diaphragm is placed in front of the front surface of the eye simulation lens, and the light aperture of the variable diaphragm can be adjusted at will. The calibration plate is placed at the back focal plane of the eye simulation lens, and a calibration pattern is drawn on the front surface of the calibration plate. The front surface of the calibration plate, the rear surface of the eye simulation lens and the water room form a closed space, and the inside can be injected with liquid. The application is mainly used for joint imaging calibration of fundus camera equipment and ophthalmic OCT equipment, and solves the problem of poor spatial matching of imaging data when two modal instruments are used for joint imaging.

The application discloses a multi-modal imaging system and method based on an optical low-coherence interference field. The application can realize efficient interference signal collection and imaging under various OCT imaging modes in one set of system and imaging mechanism, and can realize mapping of imaging coordinate systems of various modes through linear transformation by combining the OCT axial imaging characteristics and the scanning setting under the same galvanometer mirror, so that the fusion display of multi-dimensional information in tissues can be completed without complex offline registration. The application can provide wide-area positioning imaging in a large depth range, structure imaging with high resolution and high signal-to-noise ratio, blood flow velocity detection and angiography with a large dynamic range, fast elastic imaging, and can also provide a real-time structure imaging mode with a large lateral field of view, so that a user can observe and operate according to the above information in a dynamic scene. The application has great significance for biomedical application scenes with multi-tissue information requirements.

Aspects of the disclosure relate to the use of an optical detection scheme enabling multiple imaging sub-systems concurrently optimized for retrieving multiple characterization modalities. The feature described is an offset illumination and detection arrangement for a multimodal imaging probe. The imaging probe comprises multiple waveguides disposed within a torque-transfer coil, distally terminating at longitudinally separated positions. A first waveguide may have focusing optics for focused illumination and / or detection. Any number of other waveguides may be deployed for illumination and / or detection having no focusing optics. The disclosure enables high-fidelity multimodal imaging systems.

The application belongs to the technical field of medicines, and relates to a ferric bismuth oxide multi-modal imaging probe and a preparation method and application thereof. x The ferric bismuth oxide multi-modal imaging probe has a molecular formula of BiFeO x wherein x is 2.5-3.5, the ferric bismuth oxide multi-modal imaging probe has CT imaging and MRI imaging functions, and has POD-like activity, CAT-like activity and GSH-Px-like activity. The preparation method comprises the following steps: dissolving bismuth nitrate in a mannitol solution, then adding a high-molecular polymer to form an A solution; dissolving ferric nitrate in a mannitol solution to form a B solution; dropping the B solution into the A solution, then adding ammonia water, performing high-temperature treatment after reaction, and obtaining the ferric bismuth oxide multi-modal imaging probe after cooling and washing. The ferric bismuth oxide multi-modal imaging probe has significant advantages in multi-modal imaging and tumor treatment, overcomes part of the limitations of single imaging technology and traditional treatment methods, and has important clinical application value.

Disclosed in the present invention are a simple phenolic acid derivative- and rosmarinic acid derivative-based multimodal imaging probe and a use thereof. The multimodal imaging probe of the present invention has a structure selected from those represented by formulas (I to III). By subjecting phenolic acids such as danshensu, caffeic acid, ferulic acid, and rosmarinic acid to derivatization modification and by means of molecular imaging technology, the present invention realizes in vivo tracing and imaging of diseases such as various tumors (liver cancer, pancreatic cancer, and breast cancer), stroke, myocardial infarction, and acute kidney injury, and achieves in vivo and in vitro high-contrast imaging, real-time monitoring, and qualitative and quantitative evaluation. Moreover, the probe of the present invention itself has good metabolic properties and targeting performance, is simple to prepare and low in cost, and has broad clinical application prospects.

The invention relates to an AD early intervention-oriented multi-modal image omics feature and multi-strategy algorithm collaborative MCI subtype classification system. The system comprises a graph acquisition unit, a multi-modal feature extraction unit, a multi-strategy feature selection unit, a hybrid machine learning classification unit and a model integration and evaluation unit. According to the method, a systematic solution of MCI subtype classification is realized by establishing a complete technical chain from multi-modal feature extraction, multi-strategy feature selection to hybrid algorithm optimization. The system not only overcomes the problem of single feature extraction in traditional research, but also remarkably improves the accuracy and generalization ability of a classification model through multi-strategy feature selection and a hybrid machine learning framework. Especially, a cascading strategy combining traditional machine learning and deep learning is adopted, so that the interpretability of the model is ensured, the feature characterization capability is enhanced, reliable technical support is provided for early diagnosis and intervention of AD, and meanwhile, the stability and clinical applicability of a classification result are improved.

The application relates to the technical field of medical imaging, in particular to a photoacoustic magnetic multi-modal imaging system and method for prostate cancer identification, which comprises the following steps: the photoacoustic imaging unit is used for photoacoustic imaging of microvessels in a prostate part; the ultrasonic elastic imaging unit is used for ultrasonic elastic imaging of the prostate part; the magnetic resonance imaging unit is used for magnetic resonance imaging of the prostate part; the multi-modal image fusion unit is used for information fusion of photoacoustic imaging, ultrasonic elastic imaging and magnetic resonance imaging of the prostate part, so as to obtain a multi-modal fusion image of the prostate part. The application adopts high-quality imaging equipment for the prostate part, guarantees high-quality acquisition of the multi-modal images in the imaging stage, and after the high-quality image acquisition is completed, a bidirectional supervision registration network is used to realize registration and fusion of photoacoustic, ultrasonic elastic images and high-resolution magnetic resonance images, so that high-quality images are provided for image identification of prostate cancer.

The invention belongs to the technical field of nanowires and microscope probes. The invention discloses a preparation method of a shape-programmable pinpoint type nanowire, which can accurately control the diameter of the nanowire, the cantilever type (single cantilever or double cantilevers) and the included angle between the double cantilevers by adjusting the step angle and the structure of a guide channel. The morphology programmability enables the AFM probe to be customized according to specific application requirements. The double-cantilever design can also realize multi-modal imaging, such as simultaneous measurement of mechanical and electrical properties of a sample, so that the functional range of the AFM is expanded. The morphology programmability not only improves the adaptability of the probe, but also provides possibility for the application of the probe in a complex environment.

The invention discloses a joint surgical operation data fusion processing method and system based on a multi-modal image, and relates to the technical field of image processing. The method comprises the following steps: performing motion state evaluation based on joint trajectory data of each posture point image in a multi-modal image, and dynamically acquiring a reference joint image of the multi-modal image based on a motion state evaluation result; performing image accuracy evaluation based on joint position data in each reference joint image, and dynamically correcting the joint data based on an image accuracy evaluation result; and forming a joint three-dimensional model based on the corrected joint data, performing dynamic region division based on joint evaluation parameters in the joint three-dimensional model, and dynamically adjusting the model geometric accuracy of the joint three-dimensional model based on a region division result and a joint category. Accurate quantitative analysis of the joint movement function, individualized high-precision three-dimensional model reconstruction and systematic improvement of clinical diagnosis efficiency are achieved.

The application relates to the technical field of medical devices, in particular to a skin ultrasound contrast-based axillary sentinel lymph node puncture guiding method. The core of the method is as follows: after injecting an ultrasound contrast agent with a specific particle size through the skin, a preset low-mechanical-index high-frame-rate double-amplitude contrast imaging mode is adopted to dynamically track lymph drainage and sentinel lymph node development, and the enhancement characteristics are recorded; then, under the guidance of multimodal imaging which is fused with real-time contrast, elastic imaging and color Doppler, the target lymph node is accurately punctured and biopsied, and a tissue sample is obtained for pathological analysis. The application realizes integrated operation from sensitive development of the sentinel lymph node, function evaluation to accurate puncture, and provides a non-radiation high-precision puncture guiding method for accurate evaluation of the axillary lymph node state of breast cancer patients before operation.

This invention discloses a deformable capsule endoscope probe and image fusion system based on multimodal imaging, belonging to the field of medical endoscopy technology. This invention solves the problems of existing capsule endoscope technology, which has relatively limited functionality and a fixed shape, making it difficult to adapt to the complex structure of the digestive tract and resulting in poor imaging effects. By using flexible silicone material to make the capsule endoscope probe's shell and deformable structure, it can automatically adjust its shape according to the shape of the digestive tract lumen, ensuring clear and accurate multimodal images are acquired from different locations. A neural network model accurately identifies potential lesion areas and adaptively adjusts the fusion weights based on the importance of the lesion and tissue characteristics to optimize image quality. Furthermore, a deep learning fusion network generates a comprehensive image, which, after contrast optimization and automatic labeling of lesion areas, provides doctors with clearer and more detailed diagnostic prompts, aiding in the early diagnosis and precise treatment of digestive tract diseases.

The invention provides a multi-mode imaging system fusing optical coherence tomography (OCT) and multi-photon microscopic imaging, which is characterized in that optical system design is carried out on the basis of a laser light source and a laser control module of an OCT shared multi-photon microscope, and various imaging modes such as OCT angiography, Doppler OCT, multi-photon fluorescence imaging, second harmonic and third harmonic are fused. Synchronous acquisition of multi-mode and multi-dimensional optical information is achieved, and the application range is wider.

The present disclosure relates to systems and methods for monitoring a patient in a clinical setup environment by using non-contact multi-modal imaging. For example, based on receiving imaging data, a computing device may identify an object and a region of interest formed by the object. The computing device may then cause a sensor to capture first sensor data at a first time instant and capture second sensor data at a second time instant, where the sensor data is associated with the region of interest. Based on determining that a difference between the first sensor data and the second sensor data is greater than or equal to a threshold difference, the computing device may generate an alert indicative of the second sensor data and send the alert indicative of the second sensor data to an additional computing device.

The invention provides an early-stage focus multi-mode imaging observation endoscope system, and belongs to the technical field of medical apparatuses and instruments. An integrated electronic endoscope; the integrated electronic endoscope internally comprises an image processing device, an ultrasonic processor, a display, a natural light source device and a composite optical fiber, the system can quickly switch a white light mode and a narrow-band light mode, and tiny blood vessel abnormalities on the mucous membrane surface layer can be clearly shown; when a suspicious area is found, ultrasonic and opto-acoustic synchronous imaging can be started instantly, and the deep infiltration condition and metabolic activity information of a focus are obtained noninvasively; when pathology-level confirmation is needed, a multi-mode cooperative working mechanism of confocal microscopic imaging, in-vivo optical biopsy and direct observation of cellular morphology and glandular canal structures can be started, so that focuses, such as early cancerization and precancerous lesions, which are easy to be missed in diagnosis by a traditional endoscope can be found and identified earlier and more accurately, and the missed diagnosis rate and the misdiagnosis rate are remarkably reduced.

The invention discloses a near-infrared AIE light diagnosis and treatment agent with a D-A-D structure as well as a preparation method and application thereof. The near-infrared AIE light diagnosis and treatment agent comprises a compound with a structural formula as shown in a formula I, or pharmaceutically acceptable salt, solvate and tautomer of the compound, wherein R is one or more of O, S and Se; m is n, X is O, S or Se, n is equal to 0, 1, 2 or 3, and dotted lines represent joints. The TPATBS NPs provided by the invention has a relatively strong inhibition effect on the growth of tumor cells, and has a good anti-tumor effect. Experimental results show that the optical diagnosis and treatment agent-TPATBS NPs can be applied to long-time tumor monitoring and tumor phototherapy with photodynamic and photo-thermal therapy synergy, multi-mode imaging guided tumor phototherapy is achieved, and a new thought is provided for diagnosis and treatment integrated application of AIE diagnosis and treatment agents.

The application discloses a real-time three-dimensional photoacoustic multimodal imaging system and an imaging method thereof. The application introduces a two-dimensional surface array ultrasonic detector array system based on a partial spherical shell, realizes real-time three-dimensional photoacoustic and ultrasonic imaging, significantly improves the imaging rate, effectively reduces the interference of motion artifacts, supports two imaging modes of normal and upside-down, enhances the ability to adapt to different research needs, greatly expands the application scenarios, can image in deeper tissues, has a larger imaging range, and provides stronger applicability and flexibility for complex biomedical research, combines photoacoustic imaging and ultrasonic imaging organically, utilizes the molecular contrast advantage of photoacoustic imaging and the structural contrast advantage of ultrasonic imaging, and realizes complementation, so that the dual-mode imaging method can simultaneously acquire functional and structural information in one system, and greatly improves the comprehensive diagnostic capability of imaging.

The invention relates to the field of imaging, and discloses a multi-modal imaging device and an imaging method. The multi-modal imaging device includes: a container for accommodating a coupling agent and a living body; the rotating assembly is rotatably arranged in the container, and the rotating assembly is used for bearing a living body and driving the positions of two parts, located above and below the liquid level of the coupling agent, of the living body to be exchanged; the opto-acoustic ultrasonic dual-mode imaging device comprises a detection device which is arranged in the container and is used for detecting opto-acoustic signals and / or ultrasonic signals of the part, below the liquid level of the coupling agent, of the organism; the fluorescence imaging device is arranged opposite to the rotating assembly in the depth direction of the container and is used for acquiring a fluorescence image of the part, located above the liquid level of the coupling agent, of the organism. The multi-mode imaging device provided by the invention can combine the advantages of a photoacoustic ultrasonic imaging technology on depth and three-dimensional imaging with the stability and accuracy of a fluorescence imaging technology, and is beneficial to better research on internal conditions of biological tissues.

This invention relates to a nuclear-targeted multimodal imaging diagnostic probe with BNCT therapeutic efficacy, its preparation, and its application, belonging to the fields of biomedicine and nuclear medicine technology. This boron drug contains... 10 Using acetylacetone difluoroborate as the parent nucleus, this invention endows the tumor with nuclear targeting ability by introducing N- or S-containing heterocyclic structures, while utilizing its conjugated structure to provide fluorescence / photoacoustic dual-modal imaging functionality. Based on this, the invention achieves three core functions: first, through fluorescence / photoacoustic dual-modal imaging, it enables the visual localization and real-time monitoring of tumor sites; second, by leveraging the binding of nuclear targeting groups to nuclear DNA / RNA, it... 10 B is precisely delivered into the nucleus, significantly improving the killing efficiency of BNCT; thirdly, thermal neutron irradiation is performed under imaging guidance, triggering... 10 The B(n,α)⁷Li nuclear fission reaction ultimately enables high-precision integrated diagnosis and treatment. This invention also discloses a method for preparing this probe, which has promising clinical application prospects.

The invention relates to a multi-mode imaging system performance detection device and method, and the device comprises a fixing mechanism which is provided with a pair of oppositely-arranged support plates, and each support plate is provided with oppositely-arranged first positioning holes; the imaging guide pipe is connected between the pair of support plates, and the two ends of the imaging guide pipe are arranged in the first positioning holes of the pair of support plates respectively; and the plurality of targets are connected between the pair of bracket plates, and the plurality of targets are positioned on the periphery of the imaging conduit and are parallel to the imaging conduit. The imaging conduit is fixed through the support plate, and the rigid transparent protection tube is matched to prevent displacement, so that synchronous testing of four modes of opto-acoustic, ultrasonic, OCT and temperature in the same device is realized, the measurement difference after single-mode fractional testing of a system by a traditional detection device is eliminated, and the testing efficiency is greatly improved; data deviation caused by inconsistency of test platforms is avoided, manual operation interference is reduced, and batch test requirements are met.