Global processing of multiple luminescence images for mapping and / or segmentation

Abstract

A technique for imaging one or more body parts (109) of a patient (106) for medical applications is proposed. A corresponding method (500) includes determining (533-536) a mapping function that maps a global range of values ​​of multiple luminescence images of the body part (109) to a (common) dynamic range of a display (169). The luminescence images are mapped (539-545) by transforming their values ​​according to the mapping function. The resulting mapped luminescence images are then displayed (584) together on the display (169). Additionally or alternatively, the method (500) includes providing (557) at least one (common) segmentation threshold for the luminescence images or starting images that are equal to the mapped luminescence images. The starting images are each segmented (560-569) according to a comparison of the values ​​of the starting images with the segmentation threshold.

Description

[Technical field]

[0001] The present disclosure relates to imaging applications, and more particularly to the processing of luminescence images in medical applications. [Background technology]

[0002] The background of the present disclosure is introduced below with a discussion of technologies relevant to its context. However, even if this discussion refers to documents, acts, artifacts, or the like, it is not intended to imply or represent that the technologies discussed are part of the prior art or are common general knowledge in the field relevant to the present disclosure.

[0003] Images (in digital form) are commonly used to provide a visual representation of a scene that includes one or more material objects. In particular, imaging techniques are utilized in medical applications to inspect body parts of a patient (typically substantially non-invasively, even if they are not directly visible).

[0004] A particular imaging technique that is increasingly being explored is luminescence imaging, and in particular fluorescence imaging. Luminescence imaging is based on the phenomenon of luminescence, consisting of the emission of light by luminescent substances, and in particular the phenomenon of fluorescence, in fluorescent substances (called fluorophores), when subjected to an excitation different from heating. These emit light (fluorescence) when illuminated. The image of a body part defined by the fluorescent light emitted from different locations of the body part (fluorescence image) represents the fluorophores present there. For example, a fluorescent agent, possibly configured to reach a specific molecule of a desired target, such as a lesion like a tumor, and to remain fixed there in a fluorescence molecular imaging (FMI) application, may be administered to a patient. The representation of the (fixed) fluorescent agent in the fluorescence image then facilitates the identification (and quantification) of the corresponding target. This information can be used in several medical applications, for example in surgical applications to recognize the margins of a lesion to be removed, in diagnostic applications to find / monitor lesions, and in therapeutic applications to delineate the lesion to be treated.

[0005] However, accurate recognition of lesions remains quite challenging since it is adversely affected by several interfering factors.

[0006] In particular, different fluorescence images acquired from the same body part during the associated medical procedure may have different dynamic ranges, which makes differentiation of fluorescent agents very difficult both in absolute terms (for quantification) and in relative terms (between different fluorescence images).

[0007] Therefore, the fluorescence image is generally segmented into segments defined by parts with approximately homogeneous properties to distinguish the fluorescent agent (and the corresponding target) from the rest of the body part. For this purpose, the value of each fluorescence image (representing the corresponding location in the body part) is compared with a segmentation threshold. The segmentation threshold is calculated according to the statistical distribution of the values ​​of the fluorescence images. However, interfering light (e.g. due to surgical instruments, hands, surgical tools, surrounding body parts and background materials) will bias the statistical distribution of the values ​​of the fluorescence images and thus bias (increase or decrease) the segmentation threshold.

[0008] This entails the risk of misclassifying the location of the body part. For example, in surgical applications, this leads to uncertainty regarding the exact recognition of the margins of the lesion (with the risk of incomplete resection of the lesion or of excessive removal of healthy tissue). In diagnostic applications, this has a negative impact on the identification and / or quantification of the lesion, which may lead to incorrect interpretations (risk of false positives / negatives and incorrect follow-ups). In therapeutic applications, this has a negative impact on the delineation of the lesion to be treated (with the risk of reduced efficacy of the treatment or damage to healthy tissue). All of the above can be detrimental to the patient's health. Summary of the Invention [Means for solving the problem]

[0009] A simplified summary of the disclosure is presented here in order to provide a basic understanding of the disclosure. However, its sole purpose is to introduce some concepts of the disclosure in a simplified form as a prelude to the more detailed description below. It is not intended to identify key elements or to delineate the scope of the disclosure.

[0010] In general terms, the present disclosure is based on the idea of ​​processing fluorescence images on a global level.

[0011] In particular, one aspect provides a method for imaging one or more body parts of a patient in a medical application. A mapping function is determined that maps a global range of values ​​of a plurality of luminescence images of the body part to a dynamic range of a display. The luminescence images are mapped by transforming their values ​​according to the mapping function. The resulting mapped luminescence images are displayed together on a display.

[0012] Additionally or alternatively, at least one segmentation threshold is determined according to the values ​​of all the luminescent images for separating the values ​​of all the luminescent images into a separate number of groups. The luminescent images are segmented according to a comparison of the values ​​of the luminescent images with the segmentation threshold.

[0013] A further aspect provides a computer program for implementing this method.

[0014] A further aspect provides a corresponding computer program product.

[0015] A further aspect provides a computer apparatus for implementing this method.

[0016] A further aspect provides an imaging system comprising a computing device.

[0017] A further aspect provides a corresponding surgical method.

[0018] A further aspect provides a corresponding diagnostic method.

[0019] Further aspects provide corresponding methods of treatment.

[0020] More particularly, one or more aspects of the present disclosure are set forth in independent claims and advantageous features thereof are set forth in dependent claims, the language of all claims being incorporated herein by reference in their entirety (with any advantageous feature provided with reference to any particular aspect applying mutatis mutandis to all other aspects). [Brief description of the drawings]

[0021] The techniques of the present disclosure, and additional features and advantages thereof, will be best understood by reference to the following detailed description, given solely by way of a non-limiting indication when read in conjunction with the accompanying drawings, in which, for simplicity, corresponding elements are given equal or similar reference numerals, their descriptions will not be repeated, and the name of each entity will generally be used to indicate both its type and its attributes (e.g., value, content, and expression) in which:

[0022] [Figure 1] FIG. 1 shows a schematic block diagram of an imaging system that can be used to practice a technique according to an embodiment of the present disclosure. [Figure 2A] 1 illustrates the general principle of the approach according to one embodiment of the present disclosure. [Figure 2B] 1 illustrates the general principle of the approach according to one embodiment of the present disclosure. [Figure 2C] 1 illustrates the general principle of the approach according to one embodiment of the present disclosure. [Figure 2D] 1 illustrates the general principle of the approach according to one embodiment of the present disclosure. [Figure 3A] 1 illustrates the general principle of the approach according to another embodiment of the present disclosure. [Figure 3B] 1 illustrates the general principle of the approach according to another embodiment of the present disclosure. [Figure 4] 1 illustrates major software components that can be used to implement an approach according to one embodiment of the present disclosure. [Figure 5A] 1 shows an operational diagram describing the flow of operations involved in implementing a technique according to one embodiment of the present disclosure. [Figure 5B] 1 shows an operational diagram describing the flow of operations involved in implementing a technique according to one embodiment of the present disclosure. [Figure 6] 1 illustrates various application examples of the technique according to an embodiment of the present disclosure. [Figure 7] 1 illustrates various application examples of the technique according to an embodiment of the present disclosure. [Figure 8] 1 illustrates various application examples of the technique according to an embodiment of the present disclosure. [Figure 9] 1 illustrates various application examples of the technique according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] In particular, referring to FIG. 1, there is shown a schematic block diagram of an imaging system 100 that can be used to practice techniques according to embodiments of the present disclosure.

[0024] The imaging system 100 allows imaging a scene contained within its field of view 103 (defined by the part of the world within a solid angle for which the imaging system 100 has sensitivity). For example, the imaging system 100 is used to apply a fluorescent imaging technique to assist a surgeon in fluorescence guided surgery (FGS), and in particular in the case of tumors, fluorescence guided resection (FGR). In this particular case, the scene relates to a patient 106 undergoing a surgical procedure in which a fluorescent agent has been administered beforehand (e.g., allowing it to accumulate in the tumor). The scene includes a body part 109 of the patient 106, and a surgical cavity 112 (e.g., a small skin incision in minimally invasive surgery) has been opened to expose a tumor 115 to be resected. The scene may also include one or more foreign objects different from the surgical cavity 112 (not shown), such as surgical instruments, hands, surgical tools, surrounding body parts, background material, etc.

[0025] The imaging system 100 comprises an imaging probe 118 for acquiring images of the field of view 103 and a central unit 121 for controlling its operation.

[0026] Starting with the imaging probe 118, it comprises the following components: An excitation light source 124 and a white light source 127 generate excitation light and white light, respectively. The excitation light has a wavelength and energy suitable for exciting the fluorophores of the fluorescent agent (for example, of the near infrared (NIR) type), while the white light appears substantially colorless to the human eye (for example, containing all wavelengths of the spectrum visible to the human eye with equal intensity).

[0027] The transmission optics 130 and the transmission optics 133 transmit the excitation light and the white light, respectively, to the (same) field of view 103. The collection optics 136 collect the light from the field of view 103 (in an epi-illumination configuration). The collected light comprises the fluorescent light emitted by any fluorophores (illuminated by the excitation light) present in the field of view 103. Indeed, a fluorophore, when it absorbs the excitation light, goes into an excited (electronic) state, which is unstable, so that the fluorophore decays from there to the ground (electronic) state in a very short time, thereby emitting fluorescent light (at a characteristic wavelength longer than that of the excitation light, due to the energy dissipated as heat in the excited state) with an intensity that depends on the amount of illuminated fluorophore.

[0028] Additionally, the collected light includes visible light (within the visible spectrum) reflected by any objects (illuminated by white light) present in the field of view 103. A beam splitter 139 splits the collected light into two channels. For example, the beam splitter 139 is a dichroic mirror that transmits and reflects the collected light at wavelengths above and below a threshold wavelength between the spectrum of visible light and the spectrum of fluorescent light (or vice versa). In the (transmitted) channel of the beam splitter 139, with the fluorescent light defined by the portion of the collected light in its spectrum, an emission filter 142 filters the fluorescent light to remove excitation light (which may be reflected by the field of view) and ambient light (which may be generated by intrinsic fluorescence).

[0029] A fluorescence camera 145 (e.g. of the EMCCD type) receives the fluorescent light from the emission filter 142 and generates a corresponding fluorescence (digital) image representative of the distribution of fluorophores in the field of view 103. In the other (reflected) channel of the beam splitter 139, with the visible light defined by the part of the collected light in its spectrum, a reflectance (or photo) camera 148 (e.g. of the CCD type) receives the visible light and generates a corresponding reflectance (digital) image representative of what the human eye sees in the field of view 103.

[0030] Moving to the central unit 121, it comprises several units connected to each other via a bus structure 151. In particular, one or more microprocessors (μP) 154 provide the logic capabilities of the central unit 121. A non-volatile memory (ROM) 157 stores the basic code for bootstrapping the central unit 121, and a volatile memory (RAM) 160 is used by the microprocessors 154 as working memory. The central unit 121 is provided with a mass memory 163 (e.g. solid state disk (SSD)) for storing programs and data.

[0031] Furthermore, the central unit 121 comprises a number of controllers 166 for peripherals or input / output (I / O) units. In particular, the controller 166 controls the excitation light source 124, the white light source 127, the fluorescence camera 145 and the reflectance camera 148 of the imaging probe 118. Furthermore, the controller 166 controls further peripherals (indicated generally with the reference number 169), such as one or more monitors for displaying the fluorescence / reflectance images, a keyboard for entering commands, a trackball for moving a pointer on the monitor, a drive for reading and writing to a removable storage unit (e.g. a USB key), a network interface card (NIC) for connecting to a (communications) network (e.g. a local area network (LAN)).

[0032] 2A-2D, the general principles of the technique according to one embodiment of the present disclosure are illustrated.

[0033] Starting with Fig. 2A, multiple fluorescence images of one or more body parts of a patient are provided (each one including multiple values ​​representing corresponding locations of the body part). For example, the fluorescence images may relate to the same body part, different regions of the same body part, or different body parts imaged from various (imaging) directions. In the specific application at hand, the fluorescence images relate to a body part 109 undergoing a surgical procedure, acquired from six directions in the illustrated example.

[0034] Moving to Figure 2B, a global range of values ​​for all fluorescent images is determined, the global range extending from the lowest value to the highest value for all fluorescent images (possibly filtered to remove outliers therein).

[0035] Moving to Fig. 2C, a mapping function is determined. The mapping function maps the global range to a dynamic range (e.g., linearly) for displaying the fluorescence images. The dynamic range (common for all fluorescence images) is related to the display used for this purpose (the monitor of the imaging system in the application under consideration, not shown).

[0036] Moving to FIG. 2D, each fluorescence image is mapped to a dynamic range. For this purpose, each value of the fluorescence image is transformed according to a mapping function. These obtained (mapped) fluorescence images are displayed together (on a monitor of the imaging system in the application under consideration, not shown).

[0037] The techniques described above homogenize the representation of body parts in the various fluoroscopic images.

[0038] In effect, the mapped fluorescence images are now normalized to the same dynamic range, which facilitates quantitative evaluation of the mapped fluorescence images (in an absolute sense) and, furthermore, which facilitates comparison between mapped fluorescence images (in a relative sense).

[0039] In particular, in this particular example, the discrimination of the (immobilized) fluorescent agent and therefore of the corresponding target is significantly improved.

[0040] 3A-3B, the general principles of the approach according to another embodiment of the present disclosure are illustrated.

[0041] Starting from FIG. 3A, a segmentation threshold (or higher) is provided. The segmentation threshold is common for all fluorescent images (either in their original form or after mapping to a dynamic range). For example, in one implementation, the segmentation threshold is determined globally according to the entire fluorescent image. In particular, the segmentation threshold is determined according to a statistical distribution of the values ​​of the entire fluorescent image for separating the values ​​of the entire fluorescent image into a (separating) number of different groups (with substantially uniform characteristics). In the particular application under consideration, the segmentation threshold separates the values ​​of the entire fluorescent image into two groups corresponding respectively to detection and non-detection of a fluorescent agent.

[0042] Moving to Fig. 3B, each fluorescent image is segmented into the same (separate) number of different segments representing corresponding regions (with substantially homogeneous characteristics) of the body part. The segments are determined according to a comparison of the values ​​of the fluorescent image with the (same) segmentation threshold. In the particular application under consideration, each fluorescent image is segmented into segments in which the fluorescent agent is detected (detection) and segments in which the fluorescent agent is not detected (non-detection) (and thus representing tumor and healthy tissue, respectively).

[0043] The techniques described above significantly increase the accuracy of segmentation of (possibly mapped) fluorescent images.

[0044] Indeed, since all fluorescence image values ​​are now considered, the influence of possible anomalies in some of them is diluted. Thus, the statistical distribution of all fluorescence image values ​​becomes less biased by anomalies. This is reflected in a lower bias in the segmentation threshold.

[0045] In particular, in this example, ambient light (e.g., due to foreign objects) adversely affects the segmentation threshold to a lesser extent, so that the risk of misclassifying the location of a body part is substantially reduced.

[0046] The above mentioned mapping and / or segmentation of the fluorescent images facilitates recognition of the margins of lesions to be excised in surgical applications, identification / quantification of lesions in diagnostic applications, and delineation of lesions to be treated in therapeutic applications, all of which have beneficial effects on the patient's health.

[0047] Referring now to FIG. 4, there is shown the major software components that can be used to implement the technique according to one embodiment of the present disclosure.

[0048] All software components (programs and data) are generally designated by the reference 400. The software components 400 are typically stored in a mass memory and, when the programs are executed, are loaded (at least partially) into the working memory of a central unit of the imaging system together with the operating system and other application programs not directly related to the disclosed techniques (omitted from the figure for simplicity). The programs are initially installed in the mass memory, for example, from a removable storage unit or from a network. In this regard, each program may be a module, segment or portion of code, which comprises one or more executable instructions for implementing certain logical functions.

[0049] In particular, acquisition unit 403 drives components of an imaging system dedicated to acquiring fluorescence / reflectance images of a field of view suitably illuminated for this purpose (during a surgical procedure in the example at hand). Acquisition unit 403 writes to a fluorescence image repository 406 and a reflectance image repository 409, which contain sets of corresponding fluorescence and reflectance images, respectively, acquired during an ongoing imaging process. Fluorescence image repository 406 and reflectance image repository 409 comprise a corresponding entry for each pair of fluorescence and reflectance images (acquired at the same time and in the same way).

[0050] An entry in the fluorescence / reflectance image repository 406, 409 stores a bitmap of a fluorescence / reflectance image, defined as a matrix of cells (e.g., 512 rows and 512 columns) each containing a value for a pixel (i.e., a basic pixel representing a corresponding location in the field of view). Each (fluorescence) value of a fluorescence image defines the brightness of a pixel as a function of the intensity of fluorescent light emitted at the location, while each (reflectance) value of a reflectance image defines the brightness of a pixel as a function of the intensity of visible light reflected at the location (e.g., from black to white in a grayscale representation). An entry may further store a descriptive label for the fluorescence / reflectance image. For example, the descriptive label indicates the imaging geometry (e.g., its imaging direction, region and / or body part) from which the fluorescence / reflectance image was acquired.

[0051] Optionally, the comparison image repository 412 includes one or more comparison (fluorescence) images of the corresponding comparison entities. For example, the comparison images include one or more reference (fluorescence) images, which represent one or more sites containing known concentrations of a fluorescent agent (e.g., containers filled with liquids containing different concentrations of a fluorescent agent). Additionally or alternatively, the comparison images include one or more evaluation (fluorescence) images of the same type of body part of different patients (e.g., one in a healthy state and one with the same pathology). The comparison image repository 412 has an entry for each comparison image. The entry stores a bitmap of the comparison image, which is defined by a matrix of cells (with the same or different size as the fluorescent image), each containing the (comparison) values ​​of the corresponding pixels. The entry may further store a description label of the comparison image. For example, the description label indicates the concentration of the fluorescent agent in the reference image, the type and / or condition of the body part in the evaluation image.

[0052] A configuration information repository 415 stores configuration information for the imaging process. The configuration information includes an indication of various imaging configurations in which the fluorescence / reflectance images can be acquired. For example, the imaging configurations are imaging directions of the same body part (e.g., all anatomical directions (i.e., anterior, posterior, superior, inferior, medial, lateral)), different regions of the same body part (e.g., healthy tissue and pathological tissue), different body parts (e.g., corresponding organs), etc. The configuration information includes an indication of a dynamic range (for mapping the fluorescence image). The configuration information includes an indication of a parametric function for determining the mapping function, which depends on parameters defined by the global range and the dynamic range. For example, the parametric function is of linear type.

[0053] y=m x+Ld-m Lg m = (Hd-Ld) / (Hg-Lg)

[0054] where Lg and Hg are the lower and upper limits of the global range, respectively, and Hd and Hd are the lower and upper limits of the dynamic range, respectively. The acquisition unit 403 reads the configuration information repository 415 (particularly, the imaging configuration). The configurator 418 exposes a user interface for updating the configuration information. For example, the user interface includes a check box for selecting an imaging configuration (among all available ones) and sliders for changing the lower and upper limits of the dynamic range. The configurator 418 reads and writes the configuration information repository 415 (particularly, the imaging configuration and the dynamic range).

[0055] A mapper 421 determines the global range (of values ​​for all fluorescence images and possibly one or more comparison images) and determines a mapping function (for mapping the fluorescence / comparison images) accordingly. The mapper 421 reads the fluorescence image repository 406, the comparison image repository 412, and the configuration information repository 415 (in particular the dynamic range and parametric function). Additionally, the mapper 421 writes a mapping function repository 424, which stores the mapping function instructions (consisting of an instance of a parametric function defined by the actual global and dynamic ranges).

[0056] The mapper 421 further maps the fluorescence / comparison images according to a mapping function. The mapper unit 421 writes a mapped image repository 427. The mapped image repository 427 stores a set of mapped (fluorescence) images corresponding to the fluorescence images and, if possible, a set of mapped (comparison) images corresponding to the comparison images. Each mapped fluorescence / comparison image is formed by a bitmap, which is defined by a matrix of cells having the same size as the fluorescence image (for the mapped fluorescence image) or the comparison image (for the mapped comparison image), each of which contains the (mapped) value of the corresponding pixel.

[0057] The threshold unit 430 determines segmentation thresholds for segmenting the (possibly mapped) fluorescence images. The threshold unit 430 reads the fluorescence image repository 406 and / or the mapped image repository 427 (particularly the mapped fluorescence images). Additionally, the threshold unit 430 writes the segmentation threshold repository 433. The segmentation threshold repository 433 stores the segmentation thresholds.

[0058] A segmenter 436 segments the fluorescence images (according to the segmentation thresholds) either when initially provided or after their mapping. The segmenter 436 reads the fluorescence image repository 406 and / or the mapped image repository 427 (particularly the mapped fluorescence images) and reads the segmentation threshold repository 433. The segmenter 436 may also expose a user interface for manually changing the segmentation thresholds (e.g., using a slider). Additionally, the segmenter 436 writes a segmentation mask repository 439, which stores a set of segmentation masks corresponding to the fluorescence images.

[0059] Each segmentation mask is formed by a matrix of cells with the same dimensions as the fluorescence image, each containing a segmentation label indicating the classification of the corresponding location. With only one segmentation threshold and only two (detected / non-detected) segments, the segmentation label is, for example, a (binary) segmentation flag that is asserted (activated) (e.g., logic value 1) if the location belongs to the detected segment and deasserted (deactivated) (e.g., logic value 0) if the location belongs to the non-detected segment.

[0060] A processor 442 generates a set of processed (fluorescence) images corresponding to the fluorescence images and possibly a set of processed (comparison) images corresponding to the comparison images. The processed fluorescence images may be mapped fluorescence images, segmented (fluorescence) images obtained by resetting (to black) the values ​​of corresponding non-detected segments of the (possibly mapped) fluorescence images, or overlay images obtained by superimposing a segmented image on a corresponding reflectance image. The processed comparison images may be mapped comparison images or (original) comparison images.

[0061] The processor 442 reads one or more of the fluorescence image repository 406, the reflectance image repository 409, the comparison image repository 412, the mapped image repository 427, and the segmentation mask repository 439. Additionally, the processor 442 writes the processed image repository 445. The processed image repository 445 contains an entry for each processed (fluorescence / comparison) image. The entry stores a bitmap of the processed fluorescence / comparison image, which is defined by a matrix of cells having the same size as the fluorescence image (for processed fluorescence images) or the comparison image (for processed comparison images), each containing the (processed) value of the corresponding pixel.

[0062] The entries further store a descriptive label for the corresponding fluorescence / comparison image. Additionally, in the case of processed fluorescence images, the entries also store a ranking indicator (indicative of the ability of the processed fluorescence image to detect the fluorescent agent) calculated by the processor 442. The display driver 448 drives the display (i.e., the monitor of the imaging system) to display the processed (fluorescence / comparison) image on a display, possibly together with the corresponding descriptive label and / or ranking indicator. The display driver 448 reads the processed image repository 445.

[0063] 5A-5B, an operational diagram is shown illustrating the operational flow associated with implementing a technique according to one embodiment of the present disclosure.

[0064] In particular, the operational diagram depicts an exemplary process that may be used to image one or more body parts of a patient in a medical application (in the example at hand, a surgical procedure) using method 500. In this regard, each block may correspond to one or more executable instructions for implementing the specified logical function on an imaging system.

[0065] Prior to a surgical procedure, a health care operator (e.g., a nurse) administers a fluorescent agent to the patient. The fluorescent agent (e.g., indocyanine green, methylene blue, etc.) is adapted to reach and remain substantially immobilized at a specific (biological) target, such as a tumor to be resected. This result can be achieved by using either a non-targeted fluorescent agent (e.g., adapted to accumulate in the target body without specific interactions, such as passive accumulation), or a targeted fluorescent agent (adapted to attach to the target with specific interactions, e.g., by incorporating target-specific ligands into the fluorescent agent formulation, based on chemical binding properties and / or physical structures capable of interacting with various tissues, vascular properties, metabolic properties, etc.).

[0066] For example, a fluorescent agent is administered to the patient intravenously as a bolus (using a syringe). As a result, the fluorescent agent circulates in the patient's vasculature until it reaches the tumor and binds to it. Instead, the remaining (unbound) fluorescent agent is cleared from the blood pool. After a waiting period (e.g., from a few minutes to 24-72 hours) during which the fluorescent agent accumulates in the tumor and is washed out from the rest of the patient, the surgical procedure can begin. The (healthcare) operator then switches the imaging system.

[0067] In response, the process begins by proceeding from black start circle 503 to block 506. When the operator enters a start command into the imaging system (e.g., using its keyboard), the acquisition unit turns on the excitation light source and the white light source to illuminate the field of view in block 509.

[0068] Then, a loop is performed to acquire fluorescence / reflectance images from various (selected) imaging configurations. The loop starts in block 512, where the acquirer retrieves an indication of the (current) imaging configuration from the configuration information repository (starting with the first one in the corresponding order). The acquirer displays a message on the monitor in block 515, prompting the operator to place the imaging probe close to the area where the surgical cavity was opened by the surgeon according to the imaging configuration (e.g., mutually positioned according to corresponding imaging directions to image corresponding areas of the body part or to image corresponding body parts).

[0069] Once the required imaging geometry has been established, the operator enters a confirming command into the imaging system (e.g., using its keyboard) at block 518, in response to which the acquisition unit simultaneously acquires a (new) pair of fluorescence and reflectance images, which it adds to the corresponding repository. The fluorescence and reflectance images are thus acquired substantially simultaneously, providing different representations (in the fluorescence and visible light sense, respectively) of the same field of view that are spatially coherent (i.e., a predictable correlation exists between their pixels, up to perfect identity).

[0070] The acquirer verifies in block 521 whether the last imaging configuration has been considered. If not, the process returns to block 512 and repeats the same operations for the next imaging configuration. Conversely (once all imaging configurations have been considered), the loop is exited and descends to block 524. At this point, if necessary, one or more comparison images are selected from among all available in the corresponding repository. For example, the comparison images are selected manually in response to a prompt according to configuration parameters, or defined by default (up to all of these).

[0071] The operational flow branches at block 527 according to the imaging system's operating mode (e.g., manually selected at the start of the imaging procedure, defined by configuration parameters, or only one is available). In particular, if the fluorescent image is to be mapped, blocks 539-554 are executed, whereas if the fluorescent image is to be segmented, blocks 557-572 are executed. In both cases, the process rejoins at block 575.

[0072] Considering now block 530 (mapping), the mapper preprocesses the fluorescence images, as needed, by performing one or more (linear or nonlinear) preprocessing operations (e.g., median filtering, low-pass filtering, noise suppression algorithms, based on pixel-vise non-linearity compensation leveraging calibration data, etc.) This preprocessing operation may be applied globally (to all fluorescence images), individually (to each fluorescence image), or locally (to different regions of each fluorescence image).

[0073] In either case, the mapper determines the global range of all (possibly pre-processed) fluorescence images and (selected) comparison images, if any (retrieved from the corresponding repository), in block 533. To this end, the mapper scans the values ​​of all fluorescence / comparison images (in any order) and determines the lowest and highest values ​​that define the lower and upper limits, respectively, of the global range.

[0074] This operation may be applied indiscriminately to all values ​​or by filtering out outliers. For example, the mapper calculates a lower percentile (e.g., 0.2-2.0, 1.0, etc.) and an upper percentile (e.g., 98.0-99.8, 99.0, etc.) for all fluorescence / comparison image values. The mapper then ignores values ​​below the lower percentile or above the upper percentile. The mapper determines a mapping function in block 536. The mapping function is defined by an instance of a parametric function (retrieved from the configuration repository) evaluated according to the global range (just determined) and the dynamic range (retrieved from the configuration repository).

[0075] A loop is then entered at block 539. The mapper considers the (current) fluorescence / comparison image (starting with the first one in any order). The mapper generates a mapped fluorescence / comparison image corresponding to the fluorescence / comparison image at block 542 by setting each value in the mapped fluorescence / comparison image equal to the result of a mapping function applied to the corresponding value in the fluorescence / comparison image. The mapper then stores the resulting mapped fluorescence / comparison image in the corresponding repository.

[0076] The mapper verifies in block 545 whether the last fluorescence / comparison image has been considered. If not, the process returns to block 539 to repeat the same operations for the next fluorescence / comparison image. Conversely (when all fluorescence / comparison images have been considered), the loop is exited and the process descends to block 548. At this point, the processor sets the processed comparison images (in the corresponding repositories) equal to the mapped comparison images, along with the addition of the corresponding comparison image's descriptive labels (from their repositories), if necessary.

[0077] Operational flow further branches at block 551 according to the operational mode of the imaging system. If the mapped fluorescent image is also partitioned, the process continues to block 557 (described below). Conversely, the processor sets the processed fluorescent image (in the corresponding repository) equal to the mapped fluorescent image, along with the addition (from the repository) of the corresponding fluorescent image's descriptive label, at block 554. Operational flow then descends to block 575.

[0078] Considering now block 557 (Segment), the threshold unit determines the segmentation threshold from the values ​​of all relevant images (retrieved from the corresponding repository), i.e. the fluorescence images if this point is reached directly from block 527, or the mapped fluorescence images if this point is reached from block 551 after mapping the fluorescence images (both cases referred to below as starting images). For example, the segmentation threshold is calculated to minimize the intra-class variance of the values ​​of all the starting images among the groups separated by the segmentation threshold, by applying Otsu's algorithm.

[0079] Then, a loop is entered at block 560. The segmenter considers the (current) starting image (starting with the first one in any order). At block 563, the segmenter generates a segmentation mask corresponding to the starting image by asserting or deasserting each segmentation flag in the segmentation mask if the corresponding value in the starting image is higher or lower (possibly strictly) than the segmentation threshold (meaning that the corresponding location belongs to a detected or non-detected segment, respectively). The segmenter then stores the segmentation mask thus obtained in the corresponding repository.

[0080] The processor generates a corresponding processed fluorescence image in block 566 according to the starting image, the segmentation mask, and possibly the reflectance image (retrieved from the repository). For example, if the processed fluorescence image is a segmented image, it is generated by resetting (to black) each value of the starting image if the corresponding segmentation flag of the segmentation mark is deasserted (non-detected segments). Alternatively, if the processed fluorescence image is an overlay image, it is generated by setting each value of the starting image equal to a color representation (e.g., to red with increasing intensity therewith) of the corresponding value of the starting image if the corresponding segmentation flag of the segmentation mark is asserted (detected segments), or equal to the corresponding (black and white) value of the reflectance image if the corresponding segmentation flag of the segmentation mark is deasserted (non-detected segments).

[0081] In either case, the processor then stores the resulting processed fluorescent image in the corresponding repository along with the addition of the descriptive label of the starting image. The segmenter verifies in block 569 whether the last starting image has been considered. If not, the process returns to block 560 to repeat the same operations for the next starting image. Conversely (once all starting images have been considered), the loop is exited and the process descends to block 572. At this point, in the presence of unmapped comparison images, the processor sets the processed comparison images (in the corresponding repositories) equal to the comparison images along with the addition of the corresponding descriptive labels (from their repositories). The flow then descends to block 575.

[0082] Referring now to block 575, a loop is entered for computing a ranking index for the processed fluorescent images. The loop begins with the processor considering the (current) processed fluorescent image (starting with the first one in any order). The processor computes a ranking index for the processed fluorescent images in block 578. In particular, in the case of segmented / overlay images, the ranking index is indicative of the quality of segmentation of the corresponding (possibly mapped) fluorescent image. For example, the ranking index is set to the average of the values ​​of the segmented images (detected segments) where the corresponding segmentation flag is asserted in the corresponding segmentation mask divided by the average of the values ​​of the segmented images (non-detected segments) where the corresponding segmentation flag is deasserted in the corresponding segmentation mask.

[0083] Instead, in case of a mapped fluorescence image, the ranking index is indicative of the quality of mapping of the corresponding fluorescence image. For example, the ranking index is set to the average of all values ​​of the mapped fluorescence image. The processor then adds the ranking index to the processed fluorescence image (in the corresponding repository). The processor verifies in block 581 whether the last processed fluorescence image has been considered. If not, the process returns to block 575 and repeats the same operations for the next processed fluorescence image. Conversely (when all processed fluorescence images have been considered), the loop is exited and the process descends to block 584.

[0084] The display driver then displays the processed fluorescence image and the processed comparison image (if any) on the imaging system monitor (e.g., in the same window) along with explanatory labels. For example, this allows the surgeon to determine the (best) processed fluorescence image that provides the most useful representation of the body part (e.g., highest amount of fluorescent agent). In particular, if the processed fluorescence image is a mapped fluorescence image, their common dynamic range allows for a direct comparison of the detected fluorescent agents.

[0085] Additionally or alternatively, if the processed fluorescent image is a segmentation / overlay image, highlighting of the detected segments facilitates evaluation of the detected fluorescent agent, the representation of which, in the case of an overlay image, is further contextualized in the anatomical structure of the body part. In either case, the ranking indicator associated with the processed fluorescent image further facilitates identification of the best processed fluorescent image, with a corresponding quantification of the ability of the processed fluorescent image to detect the fluorescent agent. For example, the ranking indicator may be displayed by a corresponding label or color associated with its predetermined range, depending on its value (e.g., clearly positive, unknown, clearly negative, or red, yellow and green, etc.).

[0086] As a result, the surgeon can determine which is the most effective (best) imaging direction for the surgical procedure. Additionally or alternatively, the surgeon can thus compare the detected fluorescent agent in various areas of the same body part (e.g., with healthy conditions and pathologies) and / or other body parts (e.g., different associated organs, etc.) of the patient. Furthermore, the processed comparison image allows a quantitative evaluation of the detected fluorescent agent (especially when mapped together with the fluorescent image) to be estimated. For example, if the comparison image includes a reference image, it becomes possible to compare the detected fluorescent agent with a known amount, whereas if the comparison image includes an evaluation image, it becomes possible to compare the detected fluorescent agent in the same type of body part (with a known condition) of other patients.

[0087] The flow of operations then branches at block 587 according to the surgeon's selection. If the surgeon requests the operator to adjust the dynamic range, the operator updates it accordingly at block 590 via the configurator's user interface (e.g., by changing the lower and / or upper limits of the dynamic range by acting on the corresponding sliders with the mouse). Finally, the configurator saves the updated version of the dynamic range in the configuration information repository (by replacing the previous version). The process then returns to block 536 to repeat the same operations with the updated version of the dynamic range.

[0088] If instead the surgeon requests the operator to adjust the segmentation threshold, the operator updates it accordingly via the segmenter's user interface (e.g., by using the mouse to act on the corresponding slider to increase / decrease it) in block 593. The process then returns to block 560 to repeat the same operations with the updated version of the segmentation threshold. Otherwise, once the surgeon has confirmed that the process is complete, the operation flow ends in the concentric black / white stop circles 596 (after the excitation light source and the white light source are turned off by the acquisition unit).

[0089] The results of the above described process can then be used for various purposes. For example, further (standard) imaging procedures may be performed by positioning the imaging probe and the body part back and forth according to the best imaging direction thus determined. This makes it possible to operate in optimized (imaging) conditions, with beneficial effects on the quality of the surgical procedure. Additionally or alternatively, the surgeon can be provided with (comparable) representations of the body part during and at the start of the surgical procedure, or with (comparable) representations of the body part during the surgical procedure and of other areas of the same or other body parts at the start of the surgical procedure. This makes it possible for the surgeon to accurately follow the progress of the surgical procedure.

[0090] 6-9, various examples of application of techniques according to an embodiment of the present disclosure are shown.

[0091] Starting from Fig. 6, two fluorescence images 600a, 600b are acquired from different imaging directions of the same body part undergoing a surgical procedure, in which case comparison of the fluorescence images 600a, 600b is extremely difficult due to their different dynamic ranges.

[0092] 7, from these fluorescence images, corresponding mapped fluorescence images 700a, 700b are generated as described above. Now, comparison of the mapped fluorescence images 700a, 700b is much easier due to their common dynamic range.

[0093] Moving to Figure 8, a reference image 800f is added. Reference image 800f shows different (known) concentrations of fluorescent agent, which increase as one moves counterclockwise from the 12 o'clock position. This allows one to compare the fluorescent agent shown in the mapped fluorescent images 700a, 700b with the known amount shown in reference image 800f.

[0094] 9, from these mapped fluorescent images, corresponding segmented images 900a, 900b are generated as described above. The segmented images 900a, 900b are again shown together with the reference image 800f to further facilitate evaluation of the detected fluorescent agent (i.e., comparison between the segmented images 900a, 900b and its quantification relative to the reference image 800f).

[0095] (Modification) Naturally, in order to meet local and specific requirements, those skilled in the art may apply many logical and / or physical modifications and changes to the present disclosure. More specifically, although the present disclosure has been described with reference to one or more embodiments thereof with a certain degree of detail, it should be understood that various omissions, substitutions and changes in form, details and other embodiments are possible. In particular, various embodiments of the present disclosure may be practiced without the specific details (e.g., numerical values) set forth in the foregoing description to provide a more complete understanding, but conversely, well-known features may be omitted or simplified so as not to obscure the description in unnecessary detail. Furthermore, it is expressly intended that a specific element and / or method step described in connection with any embodiment of the present disclosure may be incorporated in any other embodiment as a matter of general design choice. Moreover, items presented in the same group and various embodiments, examples or alternatives should not be construed as being equivalent to each other in nature (but are separate and autonomous entities). In all cases, each numerical value should be read as modified according to the applicable tolerance, and unless otherwise indicated, the terms "substantially," "about," and "approximately" should be understood to mean within 10%, preferably within 5%, and even more preferably within 1%. Moreover, each numerical range should be intended as explicitly specifying any possible number along a continuum within the range (including its endpoints). Ordinal numbers or other modifiers are merely used as labels to distinguish between elements with the same name and do not, in themselves, imply a priority, preference, or order.The terms "include," "comprise," "have," "contain," "involve," etc. are intended to have an open, non-exhaustive meaning (i.e., not limited to the listed items); the terms "based on," "dependent on," "according to," "function of," etc. are intended to have a non-exhaustive relationship (i.e., including possible additional variables); the term "a / an" is intended to refer to one or more items (unless expressly stated otherwise); and the term "means for" (or any means-plus-function form) is intended to refer to any structure adapted or configured to perform the relevant function.

[0096] For example, one embodiment provides a method for imaging one or more body parts of a patient in a medical application. However, the method can be used to image any number and type of body parts (e.g., each representing one or more organs, e.g., a region of an organ, e.g., a healthy / pathological state, such as the liver, prostate or heart, a region of an organ, such as an abdominal quadrant, tissue, etc.) of any patient (e.g., human, animal, obtained from the patient, obtained from a sample extracted from the patient, etc.) in any medical application (e.g., surgery, diagnosis, treatment, laboratory analysis, etc.). In any case, the method can facilitate the task of the physician, but it does not only provide intermediate results that can assist them, but strictly speaking, involves the medical procedure always performed by the physician himself.

[0097] In one embodiment, the method comprises the following steps under the control of a computer device: However, the computer device may be of any type (see below).

[0098] In one embodiment, the method includes providing (to a computing device) a plurality of luminescent images of the body part. However, the luminescent images may be acquired at any time (e.g., during one or more medical procedures, during one or more laboratory analyses, any combination thereof, etc.) and they may be provided in any manner (e.g., acquired directly, transferred on a removable storage unit, uploaded over a network, etc.). The luminescent images may relate to the body part in any manner (e.g., representing the body part imaged from different imaging directions, different regions of the body part, different body parts, any combination thereof, etc.).

[0099] In one embodiment, each of the luminescence images includes a plurality of values ​​representing the luminescence light emitted by the luminescent material from the corresponding location of the body part. However, each luminescence image may have any size and shape (e.g., the entire frame or its region of interest (ROI)) and may include values ​​of any type and any location (e.g., grayscale or color values ​​for pixels or voxels, etc.). The luminescence light may be of any type (e.g., NIR, infrared (IR), visible light, etc.), emitted in any manner (e.g., in response to a corresponding excitation light, or more generally, any other excitation other than heating), by any exogenous / intrinsic luminescent material (e.g., any luminescent agent based on any luminescence phenomenon, e.g., fluorescence, phosphorescence, chemiluminescence, bioluminescence, stimulated Raman emission, etc., any naturally luminescent component, etc.).

[0100] In one embodiment, the method includes determining (by a computing device) a global range from the lowest to the highest value of all luminescent images, however the global range may be determined in any manner (e.g., indiscriminately from all values ​​of the luminescent images, filtered to remove those outliers, considering only the luminescent images or also the comparison images, etc.).

[0101] In one embodiment, the method includes determining (by a computing device) a mapping function that maps the global range to a dynamic range of a display, however, the mapping function may be of any type (e.g., linear, logarithmic, etc.) and for any display (e.g., monitor, virtual glasses, printer, etc.).

[0102] In one embodiment, the method includes mapping (by a computing device) the luminescent image to a corresponding mapped luminescent image by transforming values ​​of the corresponding luminescent image according to a mapping function. However, the luminescent images may be mapped for any purpose (e.g., scaled, log-compressed, saturated, etc. for their values).

[0103] In one embodiment, the method includes displaying (by a computing device) the processed images, including the mapped luminescent image, together on a display. However, the processed images may be of any type (e.g., including only the mapped luminescent image, as well as (mapped) comparison images, segmentation images and / or overlay images), and they may be displayed in any manner (e.g., locally or remotely, with or without descriptive labels, with or without any ranking indicators, etc.).

[0104] Furthermore, the embodiments provide additional advantageous features, all of which may be omitted in the basic implementation.

[0105] In particular, in one embodiment, the method includes providing (by a computing device) a luminescence image acquired from the patient and / or one or more samples extracted from the patient. However, the luminescence image may be acquired from the patient in any manner (e.g., from a living or deceased patient, in one or more medical procedures of any type, e.g., with one or more luminescence images acquired during a surgical / therapeutic procedure of the body part, with one or more luminescence images acquired during a previous diagnostic procedure of the same body part, with luminescence images acquired during a different therapeutic procedure of the same body part, etc.), from any number and type of samples (e.g., excision biopsy, core biopsy, etc.), or in any combination thereof (e.g., by providing one or more luminescence images acquired from the patient during any medical procedure of the body part together with one or more luminescence images acquired from one or more samples of the same body part extracted from the patient before performing the medical procedure).

[0106] In one embodiment, the method includes determining (by a computing device) a global range from lowest to highest value of all luminescent image values ​​that has been filtered to remove outliers. However, the luminescent image values ​​may be filtered in any manner (e.g., by discarding values ​​below and above any percentile thereof, values ​​below and above any multiple of the interquartile range, values ​​below and above any Z-score threshold, e.g., ±3), at any time (e.g., by ignoring outliers in determining the global range, by pre-resetting outliers in the luminescent images, etc.).

[0107] In one embodiment, the method includes providing (to a computing device) luminescent images representing a common body part, different regions of a common body part, and / or different body parts from various imaging directions, however, the luminescent images may relate to any number and types of imaging directions, regions, body parts, or any combination thereof (e.g., additional imaging directions, regions, and body parts that are partially different from those described above).

[0108] In one embodiment, the method includes prompting (by the computing device) the user to set a corresponding imaging configuration of the patient for sequential acquisition of the luminescence images, however, the user may be prompted in any manner (e.g., by outputting a corresponding visual message, audio message, etc.) to set any imaging configuration of the patient (e.g., different imaging directions of a common body part, different regions of a common body part, different body parts, etc.).

[0109] In one embodiment, the method includes acquiring (by the computing device) each of the luminescent images in response to a user confirmation of the corresponding imaging configuration. However, the confirmation may be provided in any manner (e.g., clicking a button, pressing a key, speaking a command, etc.). In any case, nothing precludes the free acquisition of luminescent images, with or without the possibility of manually entering a corresponding descriptive label.

[0110] In one embodiment, the method includes receiving (by a computing device) a manual adjustment of the dynamic range, however, the manual adjustment of the dynamic range may be provided in any manner (e.g., via any input unit, e.g., slider, up / down button, input box, etc., qualitatively or quantitatively, in a relative or absolute sense).

[0111] In one embodiment, the method includes iterating (by the computing device) in response to the manual adjustment of the dynamic range, determining a mapping function, mapping the luminescent image, and displaying the processed image, although these operations may be repeated in any manner (e.g., by replacing the mapped luminescent images with new versions thereof, by displaying different versions of the mapped luminescent images together for comparison therebetween, etc.).

[0112] In one embodiment, the method includes calculating (by a computing device) corresponding ranking indicators of the mapped luminescent images, each indicating a quality of mapping the corresponding luminescent image according to the content of the corresponding mapped luminescent image. However, the ranking indicators may be of any type (e.g., based on one or more central tendency statistical parameters, one or more variance statistical parameters, any combination thereof, etc.).

[0113] In one embodiment, the method includes displaying (by the computing device) on a display the processed images together with the corresponding ranking indicators of the mapped luminescent images. However, the ranking indicators may be associated with the mapped luminescent images in any manner (e.g., by displaying them in proximity to the corresponding processed images in any manner, e.g., quantitatively / qualitatively using any visual indicator such as numbers, graphs, labels, colors, etc., by simply ordering the processed images according to their ranking indicators, etc.).

[0114] In one embodiment, the method includes calculating (by a computer device) a ranking index for each of the mapped luminescent images according to a central tendency statistical parameter of the values ​​of the mapped luminescent images, however the central tendency statistical parameter may be of any type (e.g., mean, median, mode, etc.).

[0115] In one embodiment, the method includes providing (by a computer device) at least one segmentation threshold common to all luminescence images or starting images equal to the mapped luminescence images, in order to separate each value of the starting image into a separate number of segments. However, the segmentation threshold may be any number and provided in any way (e.g. automatically determined, manually set, etc.). In any case, the possibility of implementing only mapping (without segmentation), only segmentation (without mapping), mapping followed by segmentation, or segmentation followed by mapping (applied separately to the entire fluorescence image or to its segments) is not excluded.

[0116] In one embodiment, the method includes generating (by a computing device) a corresponding segmented image from each starting image by segmenting the corresponding starting image into said separate number of segments according to a comparison of values ​​of the starting image to a segmentation threshold, although each starting image may be segmented in any manner according to the segmentation threshold (e.g., binary, multi-level, multi-band, etc.).

[0117] In one embodiment, the method includes displaying (by a computing device) a processed image, which is further based on the segmented image, together on a display. However, the processed image may be based on the segmented image in any way (e.g., includes a segmented image, which is overlaid on a corresponding reflectance image, etc.). In any case, the possibility of using the segmented image in a different way, even without its display, is not excluded (e.g., by calculating and outputting the integration values ​​of the different segments, any comparisons thereof, etc.).

[0118] In one embodiment, the method includes segmenting (by a computer device) each of the starting images into detected and non-detected segments, representing respectively detected and non-detected luminescent materials, according to a comparison of the values ​​of the starting image with a segmentation threshold. However, the detected / non-detected segments of each segmented image may be used to display the corresponding processed image in any manner (e.g., the values ​​of the non-detected segments are reset to black, the values ​​of the detected segments are colored, the values ​​of the non-detected segments are black and white, etc.). In any case, the possibility of segmenting the starting image in a different manner is not excluded (e.g., a non-detected segment and multiple corresponding detected segments of different luminescent materials, etc.).

[0119] In one embodiment, the method includes determining (by a computer device) the at least one segmentation threshold according to values ​​of all starting images to separate the values ​​of all starting images into the number of separate groups. However, the segmentation threshold may be determined in any manner (e.g., using a histogram shape approach, a clustering approach, an entropy approach, etc.).

[0120] In one embodiment, the method includes receiving (by a computing device) a manual adjustment of the segmentation threshold, however, the manual adjustment of the segmentation threshold may be provided in any manner (which may be the same or different for the dynamic range).

[0121] In one embodiment, the method includes repeating (by the computing device) segmenting the starting image and displaying the processed image in response to manual adjustment of the segmentation threshold, however, these operations may be repeated in any manner (e.g., by replacing the segmented image with a new version, by displaying different versions of the segmented image together for comparison thereof, etc.).

[0122] In one embodiment, the method includes calculating (by a computing device) corresponding ranking indicators of the segmented images, each of which indicates a quality of segmenting the corresponding starting image according to the content of the corresponding segmented image. However, the ranking indicators may be of any type (e.g., based on any comparison of one or more central tendency statistical parameters, one or more variance statistical parameters, any combination thereof, etc.).

[0123] In one embodiment, the method includes displaying (by a computing device) the processed images together on a display in association with the corresponding ranking indicators of the segmented images, however, the ranking indicators may be associated with the segmented images in any manner (e.g., the same or different for the mapped luminescent image).

[0124] In one embodiment, the method includes calculating (by a computing device) a ranking index for each of the segmented images according to a comparison between corresponding central tendency statistical parameters of values ​​of segments of the segmented images, however, the ranking index may be based on any comparison (e.g., ratio, difference, etc.) of any central tendency statistical parameters (e.g., which may be the same or different for the mapped luminescent images).

[0125] In one embodiment, the method includes providing (by a computing device) a plurality of reflectance images corresponding to the luminescence images, however, the reflectance images may be provided in any manner (which may be the same or different relative to the luminescence images).

[0126] In one embodiment, each of the reflectance images includes multiple values ​​for a location of the body part, each representing the visible light reflected from the corresponding location. However, the reflectance images may include any type of value (same or different to the luminescence image) for the same location of the body part, directly or after appropriate upscaling / downscaling. Furthermore, the values ​​of the reflectance images may represent any visible light reflected by the body part (e.g., illuminated by any light that does not produce a significant luminescence phenomenon, etc.).

[0127] In one embodiment, the method includes generating (by a computing device) a plurality of corresponding overlay images by overlaying the segmentation images onto corresponding reflectance images, although the segmentation images may be overlaid on the reflectance images in any manner (e.g., in color and black and white, with different colors, etc.).

[0128] In one embodiment, the method includes displaying (by a computing device) the processed images including the overlay image together on a display, although the possibility of displaying the segmented image is not excluded (as an alternative or in addition to the overlay image).

[0129] In one embodiment, the method includes retrieving (by a computing device) one or more comparison images, however, there may be any number of comparison images, which may be retrieved in any manner (e.g., read from mass memory, downloaded from a network, acquired locally, etc.).

[0130] In one embodiment, each of the comparison images includes a plurality of values ​​representing the luminescent light emitted by the luminescent material from corresponding locations of the comparison entity, however, each comparison image may include any number of values ​​for any location (which may be the same or different relative to the fluorescence image) of any comparison entity (e.g., a reference device, additional body parts of an additional patient, any combination thereof, etc.).

[0131] In one embodiment, the method includes determining (by a computer device) a global range further according to the values ​​of all the comparison images. However, the global range may be determined in any way (e.g., by using the comparison images retrieved or after any pre-processing thereof, it may be the same or different for the luminescent image, etc.). In any case, the possibility of using separate global ranges for the luminescent image and the comparison image is not excluded.

[0132] In one embodiment, the method includes mapping (by a computing device) the comparison images to their corresponding mapped comparison images by transforming values ​​of the comparison images according to a mapping function, however, the comparison images may be mapped in any manner (e.g., the same or different for the luminescent image).

[0133] In one embodiment, the method includes displaying (by a computing device) the processed images, further including the mapped comparison image, together on a display, although the possibility of displaying an original version of the comparison image is not excluded (as an alternative or in addition to the mapped comparison image).

[0134] In one embodiment, the method includes retrieving (by a computing device) a comparison image that includes at least one reference image of a reference device having one or more sites that include corresponding known concentrations of luminescent material. However, the reference images may be any number, each representing any reference device that includes any number and type of sites (fixed / removable containers, e.g., vials, tubes, etc., filled with the same luminescent material at different concentrations and / or with different luminescent materials).

[0135] In one embodiment, the method includes retrieving (by the computing device) a comparison image that includes one or more evaluation images of one or more additional body parts of the additional patient that correspond to the body part of the patient. However, there may be any number of evaluation luminescence images, each representing a body part of the patient (e.g., acquired with the same imaging system, with a different imaging system, at a different location, in any health / pathology state, etc.).

[0136] In one embodiment, the luminescent material is a luminescent agent that is pre-administered to the patient before carrying out the method. However, the luminescent agent may be of any type (e.g., any targeted luminescent agent, e.g., based on specific or non-specific interaction, any non-targeted luminescent agent, etc.), and it may be pre-administered in any manner (e.g., syringe, infusion pump, etc.) and at any time (e.g., beforehand, immediately before carrying out the method, continuously during, etc.). In any case, this is a data processing method that can be carried out independently of any interaction with the patient. Furthermore, the luminescent agent may also be administered to the patient in a non-invasive manner (e.g., orally for imaging the gastrointestinal tract, into the airway by a nebulizer, topical spray application, or local introduction during a surgical procedure, etc.), or in any case without requiring substantial physical intervention of the patient, which does not require professional medical expertise or involve its own health risks (e.g., by intramuscular injection).

[0137] In one embodiment, the luminescent material is a fluorescent material (the luminescent image is a fluorescence image, where each value in the fluorescence image represents the fluorescent light emitted by the fluorescent material from a corresponding location in the body part illuminated by the excitation light of the fluorescent material). However, the fluorescent material may be of any type (e.g., exogenous, endogenous, etc.) and may be responsive to any excitation light (e.g., NIR, IR, visible, etc. type).

[0138] An embodiment provides another method for imaging a patient in a medical application. In an embodiment, the method comprises the following steps under the control of a computer device: In an embodiment, the method comprises providing (by the computer device) a plurality of luminescence images of one or more body parts of the patient. In an embodiment, each of the luminescence images comprises a plurality of values ​​representative of luminescence light emitted by a luminescent material from a corresponding location of the body part. In an embodiment, the method comprises determining (by the computer device) at least one segmentation threshold for separating the values ​​of all the luminescence images into a separate number of groups according to the values ​​of all the luminescence images. In an embodiment, the method comprises partitioning (by the computer device) the luminescence images into a respective said separate number of segments according to a comparison of the values ​​of the luminescence images with the segmentation threshold. However, each of these steps may be performed in any manner and with the addition of any feature as described above.

[0139] In general, similar considerations apply when the same technique is implemented in an equivalent manner (by using more steps or similar steps with the same functionality of some of them, by eliminating some non-essential steps, or by adding further optional steps). Furthermore, steps may be performed (at least partially) in different orders, simultaneously, or in an interleaved manner.

[0140] An embodiment provides a computer program configured to cause a computing device to perform the above method when the computer program is executed on a computing device. An embodiment provides a computer program product, which includes a computer-readable storage medium embodying the computer program, which is loadable into the working memory of the computing device, thereby configuring the computing device to perform the same method. However, the (computer) program may also be implemented as a stand-alone module, as a plug-in to an existing software program (e.g., an imaging system manager), or directly in the latter. In either case, similar considerations apply if the program is configured in a different way, or if additional modules or functions are provided. Similarly, the memory structures may be of other types, or may be replaced by equivalent entities (not necessarily consisting of physical storage media). The program may take any form suitable for use by any computing device (see below), thereby configuring the computing device to perform the desired operations. In particular, the program may be in the form of external or resident software, firmware or microcode (either object code or source code, e.g., compiled or interpreted). Furthermore, it is possible to provide the computer program on any computer-readable storage medium. The storage medium is any tangible medium (as opposed to a transitory signal itself) that can hold and store instructions used by a computer device. For example, the storage medium may be of electronic, magnetic, optical, electromagnetic, infrared or semiconductor type. Examples of such storage media are fixed disks (where the program may be preloaded), removable disks, memory keys (e.g., USB type), etc. The program may be downloaded to the computer device from the storage medium or via a network (e.g., the Internet, a wide area network, and / or a local area network, including transmission cables, optical fibers, wireless connections, and network devices).One or more network adapters in the computing device receive the program from the network and transfer it to one or more storage devices in the computing device for storage. In either case, the techniques according to an embodiment of the present disclosure lend themselves to implementation in a hardware structure (e.g., by electronic circuitry integrated in one or more chips of semiconductor material, such as a field programmable gate array (FPGA) or application specific integrated circuit (ASIC)), or in combination with appropriately programmed or otherwise configured software and hardware.

[0141] An embodiment provides a computing device, comprising means configured to perform the steps of the above-mentioned method. An embodiment provides a computing device including circuitry (i.e., any suitably configured hardware, e.g., by software) for performing each step of the same method. However, the computing device may be of any type (e.g., a central unit of an imaging system, a separate computer, etc.).

[0142] One embodiment provides an imaging system comprising the computing device described above. However, the imaging system may be of any type (e.g., a guided surgical instrument, an endoscope, a laparoscope, etc.).

[0143] In one embodiment, the imaging system comprises an acquisition unit for acquiring the luminescence image, however the acquisition unit may be of any type (e.g., any number and type of lenses, waveguides, mirrors, EMCCD, CMOS, InGaAs, PMT sensors, etc.).

[0144] In one embodiment, the imaging system includes an illumination unit for applying excitation light to the body part, however the illumination unit may be of any type (e.g. in the form of a laser, LED, UV lamp, etc.).

[0145] In one embodiment, the lighting unit is further for applying white light to the body part, however, the lighting unit may apply white light in any manner (e.g., with LEDs, halogen / xenon lamps, etc.).

[0146] In one embodiment, the acquisition unit is further for acquiring a reflectance image. However, the reflectance image may be acquired in any manner (e.g., any number and types of lenses, waveguides, mirrors, CCD, ICCD, CMOS sensors, etc.).

[0147] In general, similar considerations apply when the computing device and imaging system have different structures or include equivalent components, or when they have other operational characteristics. In either case, all of the components may be separated into more elements, or two or more components may be integrated into a single element. Furthermore, each component may be replicated to support the execution of corresponding operations in parallel. Moreover, unless otherwise specified, any interaction between different components generally need not be sequential, but may be direct or indirect through one or more intermediaries.

[0148] An embodiment provides a surgical method comprising the steps of: a body part is imaged according to the method, whereby the processed images are displayed on a display together with the surgical procedure on a patient; the patient is operated on according to the display of the processed images; however, the proposed method may find application in any kind of surgical method in the broadest sense of the term (e.g. for therapeutic purposes, for preventive purposes, for aesthetic purposes, etc.) and for acting on any kind of body part of any patient (see above).

[0149] An embodiment provides a diagnostic method comprising the steps of: a body part is imaged according to the above method, whereby the processed images are displayed together on a display during a patient diagnostic procedure; and the patient's health status is evaluated according to the display of the processed images. However, the proposed method may find application in any kind of diagnostic method in the broadest sense of the term (e.g. for discovering new lesions, for monitoring known lesions, etc.) and for analysing any kind of body part in any patient (see above).

[0150] An embodiment provides a method of treatment comprising the following steps: a body part is imaged according to the method, whereby the processed image is displayed on a display together with the patient during the treatment procedure; the patient is treated according to the display of the processed image; however, the proposed method may find application in any kind of treatment method in the broadest sense of the term (e.g. for treating a pathological condition, avoiding its progression, preventing the occurrence of a pathological condition or simply improving the comfort of the patient) and for acting on any kind of body part of any patient (see above).

Claims

1. A method (500) for imaging one or more body parts (109) of a patient (106) in a medical application, the method (500) comprising, under the control of a computing device (121), the steps of: providing a computer device (121) with a plurality of luminescence images of the body part (109), each of the plurality of luminescence images including a plurality of values ​​representative of luminescence light emitted by a luminescent material from a corresponding location of the body part (109); determining (533) a global range of values ​​from the lowest to the highest of all luminescence images by the computer device (121); determining (536) by the computer device (121) a mapping function that maps the global range to the dynamic range of the display (169); Mapping (539-545) the luminescent images to the corresponding mapped luminescent images by transforming, by the computer device (121), the values ​​of the corresponding luminescent images respectively according to a mapping function; and displaying (584) the processed image, including the mapped luminescence image, together on a display unit (169) by the computer device (121).

2. 2. The method (500) of claim 1, comprising providing (506-521) to a computing device (121) luminescence images obtained from the patient (106) and / or from one or more samples extracted from the patient (106).

3. The method (500) of claim 1 or 2, further comprising a step (533) of determining, by a computer device (121), a global range from the lowest to the highest value of all luminescence images that have been filtered to remove outliers.

4. The method (500) according to any of claims 1 to 3, comprising the step of providing (506-521) to a computer device (121) luminescence images representing a common body part, different regions of a common body part, and / or different body parts from various imaging directions.

5. prompting (515) the user, by the computing device (121), to set a corresponding imaging configuration of the patient (109) for successive acquisition of luminescence images; and acquiring (518) each of the luminescence images by a computing device (121) in response to confirmation by a user of the corresponding imaging configuration.

6. Receiving (590) a manual adjustment of the dynamic range by the computing device (121); The method (500) of any one of claims 1 to 5, comprising repeating, by a computer device (121), the steps of determining (536) a mapping function in response to manual adjustment of the dynamic range, the steps of mapping (539-545) the luminescence image, and the step of displaying (584) the processed image.

7. calculating (575-581) corresponding ranking indicators of the mapped luminescent images, each of which indicates a quality of mapping (539-545) the corresponding luminescent images according to the content of the corresponding mapped luminescent images, by the computer device (121); A method (500) according to any preceding claim, comprising the step of displaying (584) the processed images together on a display (169) in association with corresponding ranking indicators of the mapped luminescence images by the computer device (121).

8. The method (500) of claim 7, comprising the steps of: calculating (575-581) by a computer device (121) a ranking index for each of the mapped luminescent images according to a central tendency statistics parameter of the values ​​of the mapped luminescent images.

9. providing (557) at least one segmentation threshold common to all the luminescence images or the starting image equal to the mapped luminescence images, in order to separate each value of the starting image into a separating number of segments, by the computer device (121); generating (560-569) corresponding segmented images from each starting image by segmenting the corresponding starting image into said separate number of segments according to a comparison of the values ​​of the starting image to a segmentation threshold, said segmented images being segmented by said computer device (121); The method (500) according to any of the preceding claims, further comprising the step of displaying (584) by the computer device (121) together on the display (169) a processed image further based on the segmented image.

10. The method (500) of claim 9, comprising the steps (560-569) of segmenting each of the starting images by a computer device (121) into detected segments and non-detected segments representing detection and non-detection of luminescent material, respectively, according to a comparison of values ​​of the starting image with a segmentation threshold.

11. The method (500) according to claim 9 or 10, comprising a step (557) of determining, by a computer device (121), the at least one segmentation threshold value according to values ​​of all starting images in order to separate the values ​​of all starting images into the number of groups.

12. receiving (593) a manual adjustment of the segmentation threshold by the computing device (121); A method (500) according to any of claims 9 to 11, comprising repeating, by a computer device (121), the steps of segmenting the starting image (560-569) and displaying the processed image (584) in response to manual adjustment of a segmentation threshold.

13. calculating (575-581) corresponding ranking indicators of the segmented images, each indicating a quality of segmenting (560-569) the corresponding starting image according to the content of the corresponding segmented image, by the computer device (121); A method (500) according to any of claims 9 to 12, comprising the step of displaying (584) by the computing device (121) the processed images together in association with the corresponding ranking indicators of the segmented images on the display (169).

14. A method (500) according to claim 13, comprising the step of calculating (575-581) by a computer device (121) a ranking index for each of the segmented images according to a comparison between corresponding central tendency statistical parameters of values ​​of segments of the segmented images.

15. providing (506-521) to a computing device (121) a plurality of reflectance images corresponding to the luminescence image, each reflectance image including a plurality of values ​​for locations of the body part (109) each representing visible light reflected from a corresponding location; generating (566) a plurality of corresponding overlay images by overlaying (566) the segmented images on corresponding reflectance images by a computing device (121); The method (500) according to any of claims 9 to 14, further comprising the step of displaying (584) the processed images, including the overlay image, together on a display (169) by a computing device (121).

16. retrieving (524) one or more comparison images, each of the comparison images including a plurality of values ​​representative of luminescent light emitted by a luminescent material from a corresponding location of the comparison entity, by the computer device (121); determining (533) a global range further according to the values ​​of all the comparison images, by the computer device (121); Mapping (539-545), by the computer device (121), the comparison images to their corresponding mapped comparison images by transforming values ​​of the comparison images according to a mapping function; A method (500) according to any of claims 1 to 15, comprising the step of displaying (584) by the computer device (121) the processed images, further comprising the mapped comparison image, together on the display (169).

17. 20. The method (500) of claim 16, comprising searching (524) by a computing device (121) for a comparison image comprising at least one reference image of a reference device having one or more sites containing corresponding known concentrations of luminescent material.

18. The method (500) according to claim 16 or 17, further comprising a step of searching (524) by the computer device (121) for comparison images including one or more evaluation images of one or more additional body parts of an additional patient corresponding to the body part (109) of the patient (106).

19. The method (500) according to any of the preceding claims, wherein the luminescent substance is a luminescent agent that is pre-administered to the patient before carrying out the method (500).

20. the luminescent material is a fluorescent material, and the luminescent image is a fluorescent image; The method (500) according to any of the preceding claims, wherein each value of the fluorescence image represents the fluorescence light emitted by the fluorescent material from a corresponding location of the body part (109) illuminated by the excitation light of the fluorescent material.

21. A computer program (400) configured to, when the computer program (400) is executed on a computing device (121), cause the computing device (121) to perform a method (500) according to any of claims 1 to 20.

22. A computer program product comprising a computer readable storage medium embodying a computer program, the computer program being loadable into a working memory of a computing device, thereby configuring the computing device to perform the method according to any of claims 1 to 20.

23. A computer device (121) comprising means (400) configured to perform the steps of the method (500) according to any of the claims 1 to 20.

24. A computer apparatus comprising circuitry for carrying out the steps of the method according to any preceding claim.

25. An imaging system (100) comprising a computer device (121) according to claim 23 or 24 and an acquisition unit (136-148) for acquiring a luminescence image.

26. A computer device (121) configured to perform the steps of the method (500) according to claim 19, An imaging system (121) according to claim 25, comprising an illumination unit (124-133) for applying excitation light to the body part (109).

27. A computer device (121) configured to perform the steps of the method (500) according to claim 19 when dependent on claim 15, The lighting units (124-133) are further for applying white light to the body part (109); The imaging system (121) of claim 26, wherein the acquisition unit (136-148) is further for acquiring a reflectance image.

Images