151 results about "Multimodal image" patented technology

An improved system and method (i.e. utility) for registration of medical images is provided. The utility registers a previously obtained volume (s) onto an ultrasound volume during an ultrasound procedure to produce a multimodal image. The multimodal image may be used to guide a medical procedure. In one arrangement, the multimodal image includes MRI information presented in the framework of a TRUS image during a TRUS procedure.

An apparatus for obtaining area images and optical coherence tomography (OCT) image of a tissue comprises an image sensor, a first illumination means providing broadband polarized polychromatic light, a second illumination means providing narrow-band ultraviolet light, a third illumination means providing Near-Infrared light, an optical coherence tomography (OCT) imaging apparatus, one or more polarization elements, and an optical filter. An image processor identifies a region of interest according to area image, which can be a polarized reflectance image, a fluorescence light image, or both for the OCT imaging apparatus to obtain an OCT image over the region of interest.

The present invention provides a system and method for analysis of multimodal imaging and non-imaging biomedical data, using a multi-parametric data representation and integration framework. The present invention makes use of (1) dimensionality reduction to account for differing dimensionalities and scale in multimodal biomedical data, and (2) a supervised ensemble of embeddings to accurately capture maximum available class information from the data.

The invention discloses a cloud computation based early oncotherapy efficacy evaluation system and method. The system comprises a multimodal imaging acquisition device in the oncotherapy process, a voxel-based multimodal image registration and fusion cloud computation device, a voxel-based early evaluation cloud computation device for efficacies in the oncotherapy process, and a posttreatment cloud computation evaluation device. The system and method provides more accurate, reliable and real-time information abundant in information amount to doctors, and accurate bases are provided for establishing patient-orientated personalized treatment programs. By establishment of a molecular image guided early oncotherapy efficacy evaluation cloud system with high-speed processing capacity, a posttreatment historical data reference platform is provided for medical staff, and a platform used for providing bases to timely adjustment, fast tracking or implementation of treatment schemes on the basis of real-time data in the current treatment course can be provided.

A method for multimodal image registration includes providing a pair of images acquired from differing imaging modalities, defining an intensity correction function that corrects the intensities of a first image in terms of the intensities of the second image, defining a registration transformation function that registers the second image with the first image, wherein said intensity correction function and transformation function are functions of a plurality of parameters, obtaining corrections to the plurality of parameters by minimizing an energy functional of a square difference of the intensity corrected first image and the registration transformed second image, and updating the intensity correction function and the registration transformation function based on the corrected plurality of parameters.

The invention discloses a multimodal feature extraction and matching method based on ASIFT (affine scale invariant feature transform), and the method is mainly used for realizing the point feature extraction and matching of the multimodal image which cannot be solved in the prior art. The method can be realized through the following steps: carrying out sampling on the ASIFT affine transformational model tilting value parameters and longitude parameters, thus obtaining two groups of views of two input images; adopting a difference of Gauss (DoG) feature detection method to detect the position and size of the feature point on the two groups of views; using an average squared-gradient method to set the principle directions of the features and setting the feature vector amplitude by a counting method; calculating the symmetric ASIFT descriptor of the features; and adopting a nearest neighborhood method to carry out coarse matching on the symmetric ASIFT descriptor, and using an optimized random sampling method to remove mis-matching features. In the invention, features can be extracted and matched in the images sensed by various sensors, and the method provided by the invention has the characteristic of invariability after complete affine, and can be applied to the fields of object recognition and tracking, image registration and the like.

The invention discloses a real-time puncture navigation system, which comprises a puncture needle; a host computer to display puncture navigation space of a multimodal image based on the fusion of a magnetic resonance image prior to a surgery and an ultrasonic image during the surgery; an ultrasonic detecting device comprising an ultrasonic probe and an ultrasonic imaging apparatus wherein the ultrasonic probe sends acquired ultrasonic data to the ultrasonic imaging apparatus for processing and outputs the ultrasonic image during the surgery for display and transmission to the host computer; a space registering device comprising a magnetic locator and a calibration body die wherein the magnetic locator receiver is fixedly arranged on the ultrasonic probe through a probe fixture, the calibration body die calibrates the corresponding positions of the magnetic locator receiver and the ultrasonic image plane during the surgery and the magnetic locator receiver acquires the space position of the ultrasonic probe so as to further obtain the space position of the ultrasonic image plane during the surgery; and reality augmented glasses in connection with the host machine and the puncture needle. According to the invention, no special ultrasonic probe and imaging apparatus are needed, making the system not limited to specific puncture parts, and achieving convenient and high puncture navigation.

The invention provides an image registration method based on improved structural similarity. According to the invention, the improved structural similarity serves as the objective function of the image registration for the first time; four parameters of the two-dimensional image rigid body transformation are obtained through translation, rotation and consistent scaling along the X-axis and Y-axis; and the single-modal and multimodal images are analyzed in detail based on the registration algorithm and performance of the structural similarity and are compared with that based on a normalized mutual information registration algorithm. The result shows that when an absolute value is extracted during defining the structural similarity, the structural similarity has favorable features of a convex function; for either the single-modal image registration or the multimodal image registration, the structural similarity serving as the measure function can achieve the sub-pixel registration with registration precision and robustness better than that based on the classic normalized mutual information registration algorithm; and if K1 is less than or equal to 0.000001, and K2 is less than or equal to 0.000003, the two-value image can achieve the pixel registration.

An apparatus for visualizing image material in a multimodal imaging environment. Images (XF, USV) from an X-ray imager (100) and an ultrasound probe (USP) are fused into an interactive graphics display (GUI) to form a 3D scene, where, alongside to a 3D rendering (USS) of an ultrasound volume (USV) an X-Ray projection plan (XF) is displayed in perspective within the same scene. The rendering is according to a user selected view (UV) which is changeable upon user interaction with the interactive graphics display (GUI).

The invention provides an Au-ICG (gold-indocyanine green) lipidosome multifunctional nano probe and application thereof. The nano probe consists of a kernel and a shell, wherein the kernel is a nanogold particle of which the surface is wrapped with a poly-dopamine layer and adsorbs indocyanine green; the shell is a DSPE-PEG (distearoyl phosphatidyl ethanolamine-polyethylene glycol) lipidosome film which is coupled with lactobionic acid and is chelated with Gd<3+> ions. The Au-ICG lipidosome multifunctional nano probe disclosed by the invention can be used for various image modes such as MRI (nuclear magnetism imaging), CT (computed tomography) imaging and near infrared fluorescence imaging of the liver cancer; a patient only needs to stand medicine supplying of a contrast agent, and various diagnosis effects can be achieved; furthermore, by virtue of the improvement of the sensitivity, the using amount of the contrast agent can be reduced, so that the toxic and side effect is further relieved; under near infrared illumination at 808 nm, adsorbed ICG molecules can effectively convert light energy into heat energy to produce superhigh heat of 60-70 DEG C, so that liver cancer cells can be killed thermally; therefore, the multifunctional nano probe can be used as a multimodal contrast agent for liver cancer diagnosis and can be used as a photothermal therapy agent for the liver cancer.

A multimodal fiducial marker (10) for registration of data is disclosed. The multimodal fiducial marker (10) generally comprises a first portion (12) made from at least one radiopaque material and a second portion (14) made from a porous material capable of absorbing at least one radioactive material. The second portion (14) at least partially surrounds the first portion (12).

The invention relates to a Prussian Blue based nanoparticle comprising a Prussian Blue based metal core doped with one or more metal isotope and an organic biocompatible coating. The invention relates furthermore to a process for the preparation of said nanoparticle, and the use thereof as imaging contrast material or in the therapy.

An embodiment in accordance with the present invention provides a thermo-chemoembolization formulation and method for enhanced interventional image-guided therapy for cancer. The T-C formulation includes magnetic iron oxide nano-particles (MIONs) that heat when exposed to an alternating magnetic field (AMF), a liquid tumorphilic drug carrier that enhances tumor retention of the T-C formulation, and a chemotherapeutic or radiotherapeutic agent. The T-C formulation enhances delivery of heat and chemo- or radio-therapeutic agents with hyperthermia produced by magnetic nanoparticles to improve therapeutic outcomes. The magnetic nanoparticles and tumorphilic drug carrier also allow for multimodal image-guided monitoring of treatment and patient follow-up. The method for enhanced interventional image-guided therapy for cancer includes using an AMF to heat the T-C formulation and activate the thermotherapy.

The present disclosure is directed towards methods and systems for determining multimodal image edits for a digital image. The systems and methods receive a digital image and analyze the digital image. The systems and methods further generate a feature vector of the digital image, wherein each value of the feature vector represents a respective feature of the digital image. Additionally, based on the feature vector and determined latent variables, the systems and methods generate a plurality of determined image edits for the digital image, which includes determining a plurality of set of potential image attribute values and selecting a plurality of sets of determined image attribute values from the plurality of sets of potential image attribute values wherein each set of determined image attribute values comprises a determined image edit of the plurality of image edits.

The invention discloses a face multimodal image acquisition and processing device and method. The face multimodal image acquisition and processing device comprises a box body; an industrial personal computer main board for processing face images, as well as a visible light camera and an infrared camera which are used for collecting the face images and are electrically connected with the industrialpersonal computer main board are installed in the box body; the visible light camera and the infrared camera are arranged side by side; through holes corresponding to the visible light camera and theinfrared camera are formed in the box body; the industrial personal computer main board comprises a control module; the control module is connected with an image registration module for aligning visible light images collected by the visible light camera with infrared images collected by the infrared camera, a color correction module for normalizing the colors of the collected face images, a faceidentification module for precisely positioning a face region, and a face region segmentation module used for segmenting the face region so as to put the temperature of each area into statistics.

The present invention relates to a multimodal imaging apparatus (1a, 1b) for imaging a process (63) in a subject (23), said process (63) causing the emission of gamma quanta (25, 61), said apparatus (1a, 1b) comprising a scintillator (3) including scintillator elements (31) for capturing incident gamma quanta (25, 61) generated by the radiotracer and for emitting scintillation photons (26) in response to said captured gamma quanta (25, 61), a photodetector (5) including photosensitive elements (33) for capturing the emitted scintillation photons (26) and for determining a spatial distribution of the scintillation photons, and a readout electronics (7) for determining the impact position of an incident gamma quantum in the scintillator (3) and/or a parameter indicative of the emission point of the gamma quantum (25, 61) in the subject (23) based on the spatial distribution of the scintillation photons, wherein the imaging apparatus (1a, 1b) is configured to be switched between a first operation mode for detecting low energy gamma quanta and a second operation mode for detecting high energy gamma quanta, wherein the high energy gamma quanta have a higher energy than the low energy gamma quanta, and the scintillator (3) is arranged to capture incident gamma quanta (25, 61) from the same area of interest (65) in the first operation mode and in the second operation mode without requiring a relative movement of the subject (23) versus the scintillator (3), wherein the scintillator (3) comprises an array of scintillator elements (31) including a first region with high energy scintillator elements (27) for capturing high energy gamma quanta and a second region with low energy scintillator elements (29) for capturing low energy gamma quanta; and/or the apparatus (1a, 1b) further comprises a positioning mechanism (35) for changing the orientation and/or position of the scintillator elements (31), in particular for tilting the scintillator elements (31), to switch the imaging apparatus (1a, 1b) between the first operation mode and the second operation mode.

The invention provides a multispectral-based fundus image registration method, comprising the steps: acquiring the multispectral fundus image through RHA, and selecting a template fundus image and a fundus image to be registered; constructing a regression network for obtaining a deformation field between the template fundus image and the fundus image to be registered, and adding a feature balancelayer and a pyramid structure into the regression network; constructing a loss function, wherein the loss function comprises similarity loss of the blood vessel label graph and flattening constraint of a deformation field; and training the network in a weak supervision mode, and taking the processed segmentation image of the fundus image as a label of the training network. According to the multispectral-based fundus image registration method, the registration model is trained by taking the segmentation image as guidance and adopting a weak supervision mode, and practice proves that the methodcan effectively solve the problem of multispectral fundus image registration, and a good effect can be achieved, and the weak supervision segmentation oriented registration method can be expanded to more multimodal image registration problems.