Inspection of a luminescent imager having a tilted container of luminescent material - Patents.com
The inclined container testing device for luminescence imaging devices addresses the challenge of simultaneous testing of illumination and acquisition units, providing accurate and reproducible performance verification, thereby improving diagnostic and surgical imaging reliability.
Patent Information
- Application Number
- JP2022524579
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-11-25
- Filing Date
- 2020-11-19
- Publication Date
- 2024-11-20
- Estimated Expiration
- 2040-11-19
AI Technical Summary
Existing luminescence imaging devices lack a reliable and efficient method for testing their illumination and acquisition units simultaneously, with current methods being inconvenient and prone to manual errors, and existing calibration devices are limited in their ability to simulate actual use conditions.
A testing device with inclined containers filled with luminescent substances, allowing for accurate imaging and verification of luminescence imaging devices by inclining seats to minimize impurities and ensure clear imaging, combined with a holder and luminescence imaging apparatus for precise calibration and verification.
The solution provides a highly accurate and reproducible method for testing luminescence imaging devices, detecting performance degradation and ensuring consistent imaging quality by minimizing impurities and manual errors, thus enhancing diagnostic and surgical outcomes.
Smart Images

Figure 0007587577000001 
Figure 0007587577000002 
Figure 0007587577000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to imaging applications, and more particularly, to luminescence imaging. [Background technology]
[0002] The background of the present disclosure is introduced below with a discussion of technologies relevant to its context. However, even if this discussion refers to documents, acts, artifacts, or the like, it is not intended to imply or represent that the technologies discussed are part of the prior art or are common general knowledge in the field relevant to the present disclosure.
[0003] Imaging generally relates to a multitude of techniques that allow for obtaining images of objects (typically not directly visible) in a substantially non-invasive manner. For example, imaging techniques are routinely used in equipment for medical applications to examine (internal) body parts of a patient for diagnostic, therapeutic and / or surgical purposes.
[0004] A particular imaging technique that is being increasingly considered is luminescence imaging, and in particular fluorescence imaging. Luminescence imaging is based on the phenomenon of luminescence, which consists in the emission of light by luminescent substances when subjected to any excitation, different from heating, and in particular in fluorescent substances (called fluorophores), which emit light when illuminated (with an intensity that depends on the amount of fluorophores illuminated). For example, this phenomenon is exploited in medical applications by administering to the patient fluorescent agents, in particular targeted fluorescent agents, which are adapted to reach and become immobilized on specific molecules of the desired target (for example for specific interaction with tumor tissue).
[0005] For this purpose, (fluorescence) imaging devices are used, which make it possible to illuminate each object to be imaged (with excitation light suitable for exciting the fluorophores) and to obtain a corresponding (fluorescence) image representative of the fluorophores present in the object, often together with a (photographic) image simply representing the object. In particular, in medical applications, the fluorescence image represents the fluorophores immobilized on the corresponding targets, and the photographic image represents the body part under analysis.
[0006] Imaging devices should be tested to verify their performance. This is particularly important in medical applications where the performance of the imaging device affects the corresponding diagnostic, therapeutic and / or surgical outcome.
[0007] The inspection of the imaging device can be carried out using specific metrological equipment. However, this does not allow to simultaneously verify the illumination and acquisition units of the imaging device. Another possibility is to use a curable polyurethane matrix or a composite phantom in which quantum dots (small particles manufactured in semiconductor processes) are embedded in various concentrations, as described for example in US Pat. No. 9,167,240. However, quantum dots show an extremely high absorption of visible light (much higher than the one of the fluorescent agents typically used in medical applications), and can only be used to verify the performance of the imaging device in an environment with controlled illumination.
[0008] To test an imaging device in a close simulation of its real use, it is possible to use samples of the same fluorophores to be imaged, i.e. fluorescent agents in medical applications. Several testing devices are available for this purpose. For example, it is possible to use well plates (commonly used in laboratories for other purposes), loosely arranged tubes, or capillary tubes, filled with fluorescent agents of various concentrations. However, these testing devices require manual intervention (e.g. on-site preparation and selection of the area of interest in the image), which makes them inconvenient and prone to errors.
[0009] Furthermore, the literature ("Setting Standard for Reporting and Quantification in Fluorescence-Guided Surgery" by Hoogstings et al., Mol Imaging Biol (2019) 21:11-18) suggests the use of a testing device (SurgVision, CalibrationDisk™) that is formed of an upper disk (holding eight tubes filled with fluorescent agents of various concentrations) and a base on which the upper disk can rotate.
[0010] US 2012 / 179383 discloses a disk containing a calibration unit for calibrating a measurement unit of a biomaterial testing device. EP 3460457 discloses a calibration reference body containing different fluorophores that emit fluorescence in the same wavelength band when irradiated with excitation light of different wavelength bands (different amounts when the excitation light is equal to each other). Summary of the Invention [Means for solving the problem]
[0011] A simplified summary of the disclosure is presented here in order to provide a basic understanding of the disclosure. However, its sole purpose is to introduce some concepts of the disclosure in a simplified form as a prelude to the more detailed description below. It is not intended to identify key elements or to delineate the scope of the disclosure.
[0012] In general, the present disclosure is based on the idea of tilting a container of luminescent material.
[0013] In particular, one aspect provides an inspection device for inspecting a luminescence imaging apparatus, the inspection device comprising one or more seats and one or more containers, each filled with a liquid containing at least one luminescent material, housed in a corresponding seat, the seats having corresponding windows for imaging the luminescent material of the containers housed therein, the seats being inclined with respect to a rest surface of the inspection device.
[0014] A further aspect provides a holder for use with a testing device.
[0015] A further aspect provides a luminescence imaging apparatus for use with an inspection device.
[0016] A further aspect provides a luminescence imaging system comprising a luminescence imaging apparatus and an inspection device.
[0017] More particularly, one or more aspects of the present disclosure are set forth in independent claims and advantageous features thereof are set forth in dependent claims, the language of all claims being incorporated herein by reference in their entirety (with any advantageous feature provided with reference to any particular aspect applying mutatis mutandis to all other aspects). [Brief description of the drawings]
[0018] The techniques of the present disclosure, and additional features and advantages thereof, will be best understood by reference to the following detailed description, given solely by way of a non-limiting indication when read in conjunction with the accompanying drawings, in which, for simplicity, corresponding elements are given equal or similar reference numerals, their descriptions will not be repeated, and the name of each entity will generally be used to indicate both its type and its attributes (e.g., value, content, and expression) in which:
[0019] [Figure 1] 1 shows an image representation of a fluorescence imaging system according to an embodiment of the present disclosure. [Diagram 2] FIG. 1 shows a schematic block diagram of a fluorescence imaging device that can be used to implement a technique according to an embodiment of the present disclosure. [Diagram 3] 1A-1D show various views of a testing device according to an embodiment of the present disclosure; [Figure 4] 1A-1D show various views of a testing device according to an embodiment of the present disclosure; [Diagram 5] 1 shows details of a fluorescence imaging device according to an embodiment of the present disclosure. [Figure 6] 1 illustrates main software components that can be used to implement an approach according to one embodiment of the present disclosure. [Figure 7A] 1 shows an operational diagram illustrating the flow of operations associated with implementing a technique according to one embodiment of the present disclosure. [Figure 7B] 1 shows an operational diagram illustrating the flow of operations associated with implementing a technique according to one embodiment of the present disclosure. [Figure 7C] 1 shows an operational diagram illustrating the flow of operations associated with implementing a technique according to one embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0020] 1, there is shown an image representation of a (fluorescence) imaging system 100 according to an embodiment of the present disclosure. The imaging system 100 comprises a (fluorescence) imaging apparatus 105 known per se and an inspection device 110 according to an embodiment of the present disclosure.
[0021] The imaging device 105 is used in medical applications, for example to examine a body part of a patient (not shown) for diagnostic, therapeutic and / or surgical purposes. The imaging device 105 comprises the following components: A dolly 115 houses a supply unit and a control unit (not shown) for feeding and controlling the imaging device 105, respectively. Four casters 120 (only three are visible in the figure) are arranged at corresponding lower corners of the dolly 115 to facilitate the movement of the imaging device 105 (with a foot brake (not shown) provided to fix the imaging device 105 in place). A post 125 extends upwards from the rear of the dolly 115. The post 125 has a handle bar 130 for moving the imaging device 105 by its operator. Above the dolly 115, a cantilever 135 protrudes from the post 125. Mounted on the cantilever 135 is a primary monitor 140 (for displaying images to an operator) and a keyboard 145 with a pointing device, e.g., mouse, trackball, etc. (for inputting information / commands by the operator). Mounted on the top of the column 125 (above the cantilever 135) is a swivel arm 150. Mounted on the swivel arm 150 (to allow rotation in either direction) is a secondary monitor 155 (for displaying images to a physician, e.g., a surgeon). Also mounted on the top of the column 125 (adjacent to the swivel arm 150) is an articulated arm 160. Suspended from the articulated arm 160 is an imaging head 165 (for imaging the scene in its field of view, and in particular the body part to be analyzed). The imaging head 165 is provided with two handle bars 170 for positioning by the operator.
[0022] The inspection device 110 is used to inspect the imaging device 105 and verify its performance. For example, inspection may be for the purposes of calibrating the imaging device 105, ensuring that the imaging device 105 operates correctly, monitoring the operation of the imaging device 105 over time, and / or comparing one imaging device 105 with another. To this end, the inspection device 110 is mounted on a support surface 175 and positioned within the field of view of the imaging head 165. In particular, in the exemplary implementation shown in the figures, the support surface 175 is defined by the top surface of the dolly 115.
[0023] Referring now to FIG. 2, there is shown a schematic block diagram of an imaging device 105 that can be used to implement techniques according to embodiments of the present disclosure.
[0024] In particular, the figure shows the functional structure of imaging head 165 and a control unit (designated by reference numeral 205).
[0025] Starting with imaging head 165, it has an illumination unit and an acquisition unit, respectively, that illuminate the scene in its field of view and acquire an image of it.
[0026] The illumination unit comprises the following components: An excitation light source 210 and a white light source 215 generate excitation light and white light, respectively. The excitation light has a wavelength and energy (e.g., of the near infrared (or NIR) type) suitable for exciting the fluorophores of the fluorescent agent. On the other hand, the white light appears substantially colorless to the human eye (e.g., it contains all wavelengths of the spectrum visible to the human eye with equal intensity). Corresponding transmission optics 220 and transmission optics 225 transmit the excitation light and the white light, respectively, to the (same) field of view of the imaging head 165.
[0027] The acquisition unit comprises the following components: The collection optics 230 collect the light from the field of view (in an epi-illumination configuration). The collected light comprises the fluorescence emitted by any fluorophores present in the field of view. Indeed, fluorophores, when they absorb excitation light, enter an excited (electronic) state, which is unstable, so that they decay from there to the ground (electronic) state in a very short time, thereby emitting fluorescent light (at a characteristic wavelength longer than that of the excitation light due to the energy dissipated as heat in the excited state) with an intensity that depends on the amount of illuminated fluorophores. Furthermore, the collected light comprises visible light (visible spectrum) reflected by any objects present in the field of view (illuminated by white light). The beam splitter 235 splits the collected light into two channels. For example, the beam splitter 235 is a dichroic mirror that transmits and reflects the collected light at wavelengths above and below a threshold wavelength between the spectrum of fluorescent light and the spectrum of visible light, respectively. One channel of the beam splitter 235 comprises (a part of) the collected light in the spectrum of fluorescent light (e.g. transmitted), and an emission filter 240 receives the fluorescent light and filters it to remove excitation light (which may be reflected by objects in the field of view) and any ambient light (which may be caused by background / intrinsic fluorescence). A fluorescence camera 245 receives the fluorescent light from the emission filter 240 and generates a corresponding fluorescence (digital) image representing the distribution of fluorophores in the field of view. The other channel of the beam splitter 235 comprises (a part of) the collected light in the spectrum of visible light (e.g. reflected), and a photo camera 250 receives the visible light and generates a corresponding photo (digital) image representing the visualization of objects in the field of view.
[0028] Moving to the control unit 205, it comprises several units connected to each other via a bus structure 255. In particular, one or more microprocessors (μP) 260 provide the processing and organization functions of the control unit 205. A non-volatile memory (ROM) 265 stores the basic code for bootstrapping the control unit 205, and a volatile memory (RAM) 270 is used by the microprocessor 260 as a working memory. The control unit 205 is provided with a mass memory 275 (e.g., a solid-state disk or SSD) for storing programs and data. Furthermore, the control unit 205 comprises a number of controllers 280 for peripherals or input / output (I / O) units, in particular the controller 280 controls the excitation light source 210, the white light source 215, the fluorescence camera 245 and the photo camera 250 of the imaging head 165, and further the controller 280 controls further peripherals (indicated as a whole with the reference number 285), such as a primary monitor, a keyboard, a pointing device, a secondary monitor, a drive for reading and writing a removable storage unit (e.g. of the USB type), a network interface card (NIC) for connecting to a communication network (e.g. a LAN, the Internet, etc.).
[0029] In operation, the imaging head 165 is used to image a body part 290 of a patient 295 during its imaging process (e.g., diagnostic analysis, therapeutic procedure or surgical intervention). For this purpose, a fluorescent agent is administered to the patient 295 (e.g., intravenously or locally). The fluorescent agent is a target-specific fluorescent agent configured to attach to a specific (biological) target (e.g., tumor tissue, nerves, blood vessels, lymph nodes, lymphatic vessels, etc.) by its specific interaction. The fluorescent agent is administered to the patient 295 in advance (e.g., 24-72 hours before the imaging process) to allow the fluorescent agent to circulate in the vasculature of the patient 295 until it reaches the body part 290 and binds to the desired target. During the imaging process, the imaging head 165 is positioned to have the body part 290 in its field of view. At this point, the body part 290 is illuminated with both excitation light and white light, and fluorescent images (representing the distribution of the fluorescent agent and its target within the body part 290) and photographic images (representing the visualization of the body part 290) are acquired successively. The fluorescent / photographic image is then displayed on the imaging device's primary / secondary monitors, typically superimposed on a corresponding composite image (representing the target contextualized with the anatomical structures of body part 290).
[0030] 3-4, various views of an inspection device 110 are shown according to one embodiment of the present disclosure.
[0031] Starting with Fig. 3, a perspective view of the inspection device 110 is shown. The inspection device 110 has a body (e.g. made of a plastic material) defining a holder 305. The holder 305 has a (bottom) resting surface 310 for resting the inspection device 110 on any support surface, e.g. the support surface 175 of a dolly of an imaging apparatus (not shown). The holder 305 has an (top) imaging surface 315 opposite the resting surface 310 for imaging the inspection device 110. One or more seats 320 (four in this particular implementation, only one is visible in the figure) are provided on the holder 305. The seats 320 are configured to receive corresponding containers 325 (one is shown on the outside of the seat 320 and three are shown on the inside of the seat 320 in the figure). Each container 325 is filled with a liquid containing a fluorescent agent(s), for example the containers 325 are of different types each defined by the corresponding fluorescent agent and / or its concentration. The inspection device 110 may be in a basic or complete version. In the basic version, the inspection device 110 is provided without the container 325 (taken separately and inserted in the seat 320 in a removable manner). In the complete version, the inspection device 110 is provided with the container 325 already inserted in the seat 320 (in a removable or non-removable manner). The imaging surface 315 has windows 330 corresponding to the seats 320. Each window 330 exposes a part of the corresponding seat 320. Thus, each window 330 also exposes a corresponding part of the container 325 contained in the seat 320, making it possible to image its fluorescent agent. To this end, at least the part of the container 325 exposed through the window 330 is transparent to both excitation light and fluorescent light (i.e., the excitation / fluorescent light can pass through it without substantial excessive scattering, e.g., the ratio between the radiant power of a beam of excitation / fluorescent light exiting the container 325 in a direction defined by the corresponding refraction angle and the radiant power of a beam of excitation / fluorescent light entering the same container at an angle to its surface is higher than 80%, preferably higher than 85% and even more preferably higher than 90% (e.g., 95% to 100%).
[0032] Moving to FIG. 4, it shows a cross-sectional view of the same inspection device 110, in particular, the cross-sectional view is in a plane of symmetry perpendicular (vertical) to the resting surface 310 of two opposing seats 320 (in this view, on one side the container 325 is on the outside, on the other side the container 325 is on the inside). The seats 320 are inclined with respect to the resting surface 310 (i.e., their longitudinal axis is not parallel to the resting surface 310). Due to the inclination of the seats 320, the containers 325 accommodated therein are also inclined with respect to the resting surface 315. Thus, when the inspection device 110 rests on the support surface 175 (which is substantially horizontal), the containers 325 are not horizontal. Moreover, each window 330 is further from the distal (top) end of the corresponding seat 320 than the other proximal (bottom) end from the resting surface 310.
[0033] As a result, impurities that may be present within the container 325 (e.g., air bubbles and small suspended particles) will naturally flow upward and accumulate away from the corresponding window 330. This ensures that the portion of the container 325 imaged through the window 330 is substantially free of impurities.
[0034] Additionally, the container 325 need not be completely filled, and any air remaining within the container 325 will still flow upward and accumulate away from the corresponding window 330, thereby ensuring that the portion of the container 325 imaged through the window 330 is substantially full of fluorescent agent.
[0035] All of the above significantly increases the quality of imaging of the container 325 , which is reflected in improved accuracy of any inspection of the imaging apparatus performed using the inspection device 110 .
[0036] The particular embodiment of the illustrated inspection device 110 provides additional advantages.
[0037] In particular, the longitudinal axis of the seat 320 forms an inclination angle α of 5 to 30°, preferably 7 to 20°, more preferably 9 to 15°, for example 10°, with respect to the support surface 175. These values of the inclination angle α provide a high velocity upward flow of impurities and air (e.g. allowing the use of a container 325 that is only 70 to 90% full), while at the same time they do not adversely affect imaging of the container 325.
[0038] The distance of the window 330 (i.e., upper edge) from the distal end of the corresponding seat 320 (along its longitudinal axis) is 10-50%, preferably 20-40%, and more preferably 25-35% (e.g., 30%) of the length of the seat 320. These distance values ensure that impurities and / or air within the container 325 are not imaged through the window 330 in most practical situations.
[0039] Each seat 320 has an outer part 405 with a constant cross section (e.g. with a cylindrical shape) and an inner part 410 with a cross section (e.g. with a frusto-conical shape) that decreases moving inwardly into the holder 305. A corresponding window 330 exposes at least a part of the outer part 405 of the seat 320. The container 325 accommodated in the seat 320 has a matching shape. For example, the container 325 is a commercially available pre-made 1.5 ml vial. Each vial 325 comprises a (transparent) elongated bottle 415 (e.g. made of a plastic material) that contains a liquid with a fluorescent agent. The bottle 415 thus has a top part 420 (proximal to its opening) with a constant cross section (e.g. with a cylindrical shape) and a bottom part 425 with a cross section (e.g. with a frusto-conical shape) that decreases moving away from the opening. Each vial 325 further comprises a cap 430 that seals the bottle 415 (e.g. of the screw-on type). Thus, the window 330 exposes at least a portion of the top portion 420 (particularly the lowest portion thereof) of the container 325. The container 325 is thus imaged at a location that is substantially flat.
[0040] One or more magnetic elements 435 (two in this particular implementation) are embedded within the holder 305 adjacent to the mounting surface 310. If the support surface 175 is ferromagnetic (e.g., iron), the magnetic elements 435 generate an attractive force that keeps the inspection device 110 (rested thereon) fixed in place.
[0041] Returning to FIG. 3, the holder 305 has a shape (plan view) with point symmetry, which in this particular implementation is octagonal in shape, with four long edges and four short edges alternating. The holder 305 then has a side surface 335 (extending between the mounting surface 310 and the imaging surface 315) with four large faces and four small faces alternating (corresponding to the respective long and short edges). The seat 320 has a corresponding blind hole, which extends inwardly from the side surface 335, more specifically from its small face. The window 330 has a corresponding through hole, which reaches from the imaging surface 315 to the seat 320. As a result, by placing the illumination center of the imaging head (defining its optical axis (not shown)) at the center point of the holder 305, it is possible to have the same illumination of all the containers 325 via the window 330 (symmetrically thereto).
[0042] The window 330 is open in a part of the imaging surface 315 that is inclined with respect to the mounting surface 310. For example, the part of the imaging surface 315 around the window 330 is oriented toward the inside of the holder 305 moving (downward) toward its center point, and is at an angle of 5 to 15° (e.g., 10°) with the mounting surface 310. This reduces reflections on the imaging surface 315 (at least close to the window 330) when the inspection device 110 is illuminated from above.
[0043] The window 330 has a corresponding edge at the imaging surface 315 that is chamfered. For example, the edge is chamfered to form an angle of 40-50° (e.g., 45°) with the imaging surface 315. This reduces shading of the window 330 when the inspection device 110 is illuminated from above.
[0044] The holder 305 has one or more markers 340, 345 disposed on the imaging surface 315 (e.g., formed by a corresponding label stapled thereon), which are optically machine readable (e.g., a QR code). The markers 340, 345 act as position markers for determining the position (i.e., location and orientation) of the inspection device 110. In particular, in this particular implementation, a (center) marker 340 is disposed at a center point of the holder 305, and four (window) markers 345 are disposed corresponding to the windows 330 (e.g., interleaved with one another).
[0045] One or more of the markers 340, 345 may further operate as information markers that encode (encode) (device) information of the inspection device 110. For example, one marker 340, 345 or a combination of multiple markers 340, 345 encodes (unique) device identifier of the inspection device 110 (e.g., the device identifier is encoded in the marker 340). The device identifier allows tracking the use of the inspection device 110. The inspection device 110 may have either a free configuration or a fixed configuration. In a free configuration, any type of container 325 (with any nature and concentration of fluorescent agent) may be placed in the seat 320. In a fixed configuration, instead, a predefined type of container 325 (with a specific nature and concentration of fluorescent agent) will be placed in the seat 320. In the latter case, one or more of the markers 340, 345 (individually or in combination) encode one or more container identifiers for the type of container 325 to be accommodated in the seat 320 (e.g., each container identifier is encoded on a corresponding marker 345 proximate to that seat 320). The container identifiers allow for the correct configuration of the inspection device 110 to be verified.
[0046] The markers 340, 345 are located on corresponding bottom surfaces (indicated by the same reference numerals) of recesses, which extend (downward) from the imaging surface 315 towards the holder 305. The bottom surfaces of the recesses 340, 345 are parallel to the resting surface 310. Thus, when the inspection device 110 is placed on the support surface 175 (which is substantially horizontal), the bottom surfaces of the recesses 340, 345 are also horizontal. This increases the visibility of the markers 340, 345 (when viewed from above). Furthermore, the recesses 340, 345 have corresponding edges on the imaging surface 315 that are chamfered. For example, the edges are chamfered to form an angle of 40 to 50° (e.g., 45°) with the imaging surface 315. This reduces shadowing of the markers 340, 345 when the inspection device 110 is illuminated from above.
[0047] The inspection device 110 comprises an inspection light source 350 in the imaging plane 315, which generates an inspection light of the same type as the fluorescent light emitted by one or more fluorescent agents when illuminated by an excitation light (i.e. of the NIR type). For example, the inspection light source 350 is based on a frame of LEDs present around the marker 340, the inspection light source 350 is powered by a replaceable / non-replaceable battery enclosed in the holder 305 and is turned on / off by acting on a switch (not shown). The inspection light source 350 can be used to inspect the acquisition unit of the imaging device alone (its illumination unit is turned off).
[0048] In the fixed configuration of the inspection device 110, the holder 305 has a corresponding seat indicator 355 on the imaging surface 315 (e.g., formed by a corresponding label stapled thereto), which is human readable (e.g., in text format). The seat indicator 355 is positioned corresponding to the seat 320 and provides a specification of the type of container 325 housed therein. In particular, the seat indicator 355 is color coded, e.g., the seat indicator 355 includes color names corresponding to the types of containers 325 (e.g., white, yellow, blue and green for increasing concentrations of the same fluorescent agent). The seat indicator 355 facilitates the insertion of the correct type of container 325 into the seat 320 (e.g., when the inspection device 110 is assembled in the field).
[0049] In either (free / fixed) configuration of the inspection device 110, the containers 325 have corresponding container indicators that are human-movable (e.g. color). The container indicators are arranged (visibly) on the parts of the containers 325 that protrude from the seat 320 when the containers 325 are inserted therein and provide a specification of their type. In particular, the container indicators are also color-coded. For example, the caps 430 are colored as described above, i.e. white, yellow, blue and green for increasing concentrations of the fluorescent agent, depending on the type of container 320 (in this case, even people affected by color blindness can distinguish). The container indicators further facilitate the insertion of the correct type of container 325 in the corresponding seat 320 and further make it possible to verify that the inspection device 110 has been correctly assembled at any time.
[0050] Referring now to FIG. 5, details of imaging device 105 are shown according to one embodiment of the present disclosure.
[0051] The imaging device 105 has a holding station 505, which is used to hold the inspection device 110 in a fixed (imaging) position on the support surface 175. The inspection device 110 is removably held in the imaging position. For example, the holding station 505 is formed by a recess that matches the footprint of the inspection device 110 (defined by its resting surface and not visible in the figure). Four lateral cavities can be added to avoid interference with the part of the container 325 protruding from the holder 305, so that the inspection device 110 can be inserted into the holding station 505 by lowering it into the recess. The recess has a depth less than the height of the holder 305, so that the inspection device 110 can be removed from the holding station 505 by gripping and lifting it out of the recess.
[0052] Furthermore, the imaging apparatus 105 has an (additional) holding station 510, which is used to hold the imaging head 165 in the (acquisition) position. The imaging head 165 is also removably held in the acquisition position. For example, the holding station 510 is formed by a ring that matches the body of the imaging head 165 (except for its handle bar 170), which ring is integral with a cantilever 515 fixed to the post 125 of the inspection device 110. The imaging head 165 can thus be inserted into the holding station 510 by sliding it from above into the ring until the handle bar 170 abuts against it. Furthermore, the imaging head 165 can be removed from the holding station 510 by lifting it away from the ring.
[0053] Alternatively (not shown), holding station 505 and holding station 510 may be combined into a single structure for holding together inspection device 110 in the imaging position and imaging head 165 in the acquisition position. For example, this result can be achieved by a cylinder, which is closed at the bottom by a base with a recess for inserting inspection device 110 and is open at the top for sliding imaging head 165 as described above.
[0054] When the inspection device 110 is in the imaging position (defined by holding station 505) and the imaging head 165 is in the capture position (defined by holding station 510), the inspection device 110 is within the field of view of the imaging head 165. In particular, the center point of the holder 305 is on the optical axis of the imaging head 165. This provides controlled and repeatable illumination of the inspection device 110.
[0055] Referring now to FIG. 6, there is shown the main software components that can be used to implement the technique according to one embodiment of the present disclosure.
[0056] All software components (programs and data) are generally indicated with the reference numeral 600. The software components 600 are typically stored in a mass memory and, when the programs are executed, are loaded (at least partially) into the working memory of the control unit of the imaging device together with other software components not directly related to the technique according to the present disclosure (e.g. operating system, medical applications, etc.). These other software components are omitted for the sake of brevity. The programs are initially installed in the mass memory, for example from a removable storage unit or from a communication network (not shown). In this regard, each program may be a module, segment or portion of code, which comprises one or more executable instructions for implementing certain logical functions.
[0057] In particular, corresponding drives generally indicated by reference number 605 are used to drive the peripherals of the imaging device, including its excitation light source, white light source, fluorescence camera, photo camera, keyboard, pointing device, primary / secondary monitors and a network interface card. An imaging manager 610 manages the imaging process of any body part. The imaging manager 610 interfaces with the drives 605. The imaging manager 610 has access (in read / write mode) to an image repository 615, which stores a sequence of fluorescence and photo images acquired during an ongoing imaging process.
[0058] In an approach according to an embodiment of the present disclosure, the Test Manager 620 manages any test of the imaging device. The Test Manager 620 also interfaces with the Drive Device 605. The Test Manager 620 accesses (in read / write mode) the Image Repository 625, the Configuration Repository 630, and the Log Repository 635. The Image Repository 625 stores one or more fluorescent and photographic images acquired during an ongoing test of the imaging device. The Configuration Repository 630 stores configuration information for the test of the imaging device. For example, the configuration information includes a network address (e.g., a domain name) of a remote service provider (e.g., a server of the imaging device manufacturer), a descriptor of the test device, and a descriptor of the container. The descriptor of the test device indicates it by a corresponding device identifier. The descriptor of the test device defines its configuration, i.e., free or fixed state. The descriptor of the test device defines its geometry. For example, the geometry of the inspection device is defined in terms of the shape of its holder, the positions of the window, marker, seat indicator and cap relative to the holder (i.e. their real world coordinates in a reference system integral thereto). The inspection device's descriptor defines the container specifications for the marker, seat indicator and container indicator. For example, for each possible container type, it provides a container identifier for the marker, its color name for the corresponding seat indicator, its color definition for the corresponding container indicator (the latter in terms of the nominal values of one or more statistical parameters associated therewith, e.g. average values of color components such as RGB components). The inspection device's descriptor defines its one or more usage rules (e.g. maximum usage in terms of length of inspection, maximum time since date of manufacture, etc.). The inspection device's descriptor defines one or more characteristics of each inspection light generated by its inspection light source (e.g. wavelength and nominal values of one or more statistical parameters associated therewith, e.g. mean fluorescence intensity or MFI, etc.). The container's descriptor defines each possible type.For example, each type of container (identified by its container identifier) is defined by the nature and / or concentration of the corresponding fluorescent agent, the fluorescence specifications of the fluorescent light emitted thereby (wavelength and nominal value of one or more statistical parameters associated therewith, e.g., mean fluorescence intensity). The log store 635 stores information about tests performed by the imaging device 105. For example, the log store 635 has a record of each test (e.g., identified by its timestamp), including the length of the test, an indication of the result of the test, a change flag (which is asserted if the test is performed with a new test device and / or a new container). The test manager 620 utilizes an object recognition engine 640, which is used to locate the position of the test device within the photograph / fluorescence image. The object recognition engine 640 accesses the configuration store 630 (in read mode), which accesses the transformation store 645 (in write mode), which is also accessed by the test manager 620 (in read mode). The transformation repository 645 stores definitions of transformations between real world coordinates of the inspection device and corresponding image coordinates in the fluorescent / photographic images (eg, in the form of a transformation matrix).
[0059] 7A-7C, an operational diagram is shown illustrating the flow of operations associated with implementing a technique according to one embodiment of the present disclosure.
[0060] In particular, the operational diagram represents an exemplary process that may be used to inspect an imaging device using method 700. In this regard, each block may correspond to one or more executable instructions for implementing a particular logical function in a control unit of the imaging device.
[0061] This process is performed whenever the imaging device is to be inspected: for example, this may occur prior to any imaging process, after installation or any maintenance of the imaging device, on demand, periodically, in response to a corresponding request, or automatically (as described below).
[0062] In this case, the operator places the inspection device on the support surface and the imaging head above (e.g., by inserting the inspection device and imaging head into a corresponding holding station, if available). The operator then enters an inspection command using a keyboard or a pointing device. The inspection command can also specify the type of inspection, chosen between inspection at a single position and inspection over the entire field of view of the imaging head (e.g., the first one is the default). At the same time, the operator can select the corresponding command if the container or the entire inspection device has been changed, in the latter case together with its device identifier. In either case, the inspection command is received in block 702 by the inspection manager via the corresponding drive.
[0063] In response, the process proceeds to block 704, where the test manager initializes a temporary record for the test with its timestamp (set to the current time from an internal clock), start time (set to the same current time) and a change flag (asserted if the container or test device has been changed or deasserted). Furthermore, if the test device has been changed, the test manager downloads a representation of the (free / fixed) configuration of the test device from the service provider (from its network address retrieved from the configuration repository) according to the device identifier, and updates the descriptor of the test device in the configuration repository accordingly. The test manager turns on the white light source and the excitation light source in block 706, which commands the photo camera and the fluorescence camera to acquire photo and fluorescence images of the same field of view, respectively (via corresponding drives), after which the test manager turns off the white light source and the excitation light source. The photographic image is defined by a bitmap comprising a matrix of cells (e.g. 512 rows and 512 columns) each storing a pixel, i.e. a value of a basic pixel element corresponding to a location in the field of view, which pixel value represents the visible light reflected at that location (e.g. its RGB components). The fluorescent image is defined by a bitmap comprising a matrix of cells (having the same or different size relative to the photographic image) each storing a pixel value representing the fluorescent light emitted at the corresponding location in the field of view (e.g. its intensity). Based on the known geometry of the inspection device (defined by its descriptor in the configuration repository), the object recognition engine searches for the inspection device in the photographic image in block 708, i.e. its representation in the corresponding region of interest (ROI), by utilizing image processing techniques known per se. The inspection manager verifies whether the inspection device has been found in block 710. In particular, the image recognition engine can simply search for the holder of the inspection device (according to its shape). Additionally or alternatively, the image recognition engine searches for the markers (according to their specifications) and verifies whether these are correct (i.e. in the right number and in the right format).The markers make the detection of the test device (with respect to the use of a holder) more accurate, especially if they are multiple (such as five markers in the embodiment under consideration). If the test device is not found (i.e., no holder and / or no correct marker), the process returns to block 706 and repeats the same operations continuously until a predefined timeout. The process then returns to block 702 (not shown) and the test manager displays an error message on the primary monitor (via a corresponding drive).
[0064] The same operations can also be implemented to automatically start an inspection in response to the appearance of an inspection device in the field of view of the imaging head. For this purpose, in a non-operational state of the imaging apparatus (i.e., when there is no imaging process in progress), the inspection manager monitors the field of view by continuously executing a corresponding loop. The loop starts in block 712, where the inspection manager turns on the white light source and the excitation light source, which instructs the photo camera and the fluorescence camera to acquire, respectively, a photographic image and a fluorescence image of those same fields of view (via the corresponding drive devices). The inspection manager then turns off the white light source and the excitation light source. The object recognition engine searches for the inspection device in the photographic image as described above in block 714. The inspection manager verifies in block 716 whether the inspection device has been found. If the inspection device has not been found, the process returns to block 712 and repeats the same operations periodically (e.g., every 5 to 10 seconds). Conversely, as soon as an inspection device is found, the process descends to block 718. At this point, the test manager initializes a temporary record as described above with its timestamp and start time, the type of test is set to single position, and the change flag is deasserted, allowing the test to be started by simply presenting the inspection device within the field of view of the imaging head without requiring any additional intervention by the operator.
[0065] In either case, the process continues from block 710 (as soon as the inspection device is located) or from block 718 to block 720. At this point, the inspection manager determines (using image processing techniques known per se) the current position of the inspection device relative to the imaging head according to its representation in the photographic image. For example, the current position is defined by the location of the center point of the inspection device in the imaging plane perpendicular to the optical axis of the imaging head, the distance of the inspection device from the imaging head, and the rotation angle of the inspection device relative to the imaging plane. This operation is fully automatic, fast and accurate. The inspection manager verifies in block 722 whether the current position matches a target position (for example, defined by the center point of the inspection device on the optical axis of the imaging head, the inspection device being at a certain distance from the imaging head and parallel to its imaging plane). For example, the inspection manager calculates the corresponding displacements between the current position and the target position, defined by the translational and rotational components, and compares these with corresponding predefined thresholds (for example, 0.1-1 cm and 1-5°, etc.). If one or more translation / rotation components exceed the corresponding threshold (meaning that the current position does not match the target position), the inspection manager displays a corresponding message on the primary monitor (via the corresponding drive) in block 724. The message indicates the movement (given in displacement) of the inspection device and / or imaging head required to reach the target position. For example, if the center point of the inspection device is not on the optical axis of the imaging head, the operator needs to translate it, while if the inspection device is not at the correct distance / angle to the imaging head, the operator needs to translate / rotate it. The process then returns to block 706 and repeats the same operations. In this way, the operator is provided with a very useful feedback, which allows the inspection device and / or imaging head to be placed in the correct shuttle position even when a holding station is not available.
[0066] Referring to block 722, if all translational / rotational components do not exceed the corresponding threshold (meaning that the current position matches the target position), the process descends to block 726. In particular, this is true whenever the inspection device and imaging head are inserted into the corresponding holding station. At this point, the test manager extracts the device identifier from the marker in the photographic image. The test manager retrieves the usage information of the inspection device from the log repository in block 728 (e.g., the length of the test performed, since the last change of the inspection device or its container). Additionally or alternatively, the test manager downloads (further) usage information of the inspection device from the service provider (from the network address retrieved from the configuration repository) according to its device identifier (assuming it matches what is stored in the configuration repository). For example, this usage information may include an authenticity indicator of the inspection device and its production date. The test manager validates the usage information (retrieved and / or downloaded) against the usage rules (retrieved from the configuration repository) in block 730. For example, the test manager compares the length of the test (since the last change of the test device or its container) and / or the time since the production date with the corresponding maximum allowable values. The test monitor then enables the test according to the result of this verification. If the usage rules are not met (which is always true if the device identifier does not match the one stored in the configuration store), the test manager aborts the test in block 732, displays a corresponding error message on the primary monitor (via the corresponding drive), and the process returns to block 702 to wait for the next test command. Alternatively, as shown by the dashed line in the figure, the test manager simply displays a corresponding warning message on the primary monitor (via the corresponding drive), but the test is still allowed by continuing to block 734. If all usage rules are met, the same point is reached directly from block 730.
[0067] At this point, the test manager generates a transformation matrix (between the real world coordinates of the test device and its image coordinates in the fluorescent / photographic image). For example, the transformation matrix is calculated by minimizing the mapping error between the real world coordinates of the markers in the test device and the image coordinates of the markers in the photographic image (e.g., the mean squared value of their differences). This operation can be based on a single marker with asymmetric readout (providing the location and orientation of the test device according to its specifications). However, the use of multiple markers (e.g., five markers in the present embodiment) adds further precision. The test manager further determines in block 736 the seat indicators and caps in the photographic image and the window in the fluorescent image (i.e., their representation in the corresponding ROI) according to their image coordinates therein, which are calculated by applying the transformation matrix to the corresponding real world coordinates (retrieved from the configuration repository). This operation is fully automatic, and is fast and accurate.
[0068] The test manager now checks the container placed on the seat. For this purpose, in block 738, the test manager calculates the same statistical parameters of the color definition for the container indicator in the configuration store for the pixel values representing each cap in the photographic image, i.e. the average values of their RGB components in the embodiment under consideration. The flow of operations branches in block 740 according to the configuration of the inspection device (retrieved from the configuration store). If the inspection device has a free configuration, the test manager estimates the type of container placed on the seat in block 742. For example, the test manager calculates the distance between the color of the cap in the photographic image and the color definition of all permutations of the four types of container among all possible ones defined in the configuration store (for example equal to the mean squared value of the difference between the average values of the RGB components of each cap and the corresponding nominal values of the color definition of the corresponding type of container). The test manager selects the permutation that provides the lowest distance. Referring to block 740, if the inspection device has a fixed configuration, the test manager extracts the container identifier from the marker in the photographic image (indicating the type of container to be placed on the seat) in block 744. At this stage, the test manager can also read the color name from the seat indicator in the photographic image (indicating the same expected type of container to be placed on the seat). The test manager verifies whether each pair of corresponding color name and container identifier refers to the same type of container (as shown in the configuration store). If not, the process returns to block 702 (not shown) and the test manager displays an error message on the primary monitor (via the corresponding drive). In this way, it is possible to ensure that the inspection device (fixed configuration) has been correctly assembled. Then, the flow of operations merges in block 746 from either block 742 or block 744. At this point, a loop is entered and the test manager considers the (current) seats (starting with the first one in any order).The test manager verifies in block 748 whether the container placed on the seat is of the expected type (i.e. the estimated free configuration or the retrieved fixed configuration). For this purpose, the test manager verifies whether the color of the cap matches the color definition of the container of the expected type (retrieved from the configuration store). For example, the test manager calculates the difference between the average value of each RGB component of the cap and the corresponding nominal value of the color definition and compares them with a predefined threshold value (for example 1-5% with respect to the color definition). If one or more differences exceed the threshold value (meaning the container is not of the expected type), the test manager interrupts the test in block 750 and displays a corresponding error message on the primary monitor (via the corresponding drive). The process then returns to block 702 to wait for the next test command. Conversely, if the difference does not exceed the threshold value (meaning the container is of the expected type), the test manager verifies in block 752 whether the last seat has been processed. If not, the process returns to block 746 and repeats the same operations for the next seat. Conversely, once all the seats have been processed (determining that all containers of the expected type have been placed therein), the loop terminates by descending to block 754 .
[0069] At this point, the test manager verifies the windows in the fluorescence image. For this purpose, the test manager calculates for the pixel values representing each window in the fluorescence image, i.e. the mean fluorescence intensity in the embodiment under consideration, the same statistical parameter of the fluorescence specification for the corresponding type of container in the configuration store. Furthermore, the test manager calculates the same statistical parameter (i.e. the mean fluorescence intensity MFI) for the pixel values representing background areas different from the windows in the photographic image (e.g. corresponding to the central marker). Then, in block 756, a loop is entered in which the test manager considers the (current) window (starting with the first one in any order). In block 758, the test manager verifies whether the window matches the fluorescence specification (retrieved from the configuration store) of the type of container placed on the seat. For example, the test manager calculates the difference between the mean fluorescence intensity of the window and the corresponding nominal value of the type of container and compares it with a predefined threshold value (e.g. 1-5% for the fluorescence specification). Additionally or alternatively, the test manager calculates the ratio of the mean fluorescence intensity of the (current) window to the mean fluorescence intensity of each of the other windows and to the mean fluorescence intensity of the background areas. The Test Manager further calculates the ratio of the corresponding nominal value (retrieved from the configuration repository for other window container types and set to approximately zero for background regions). The Test Manager then calculates the difference between each pair of ratios and compares it to a predefined threshold (e.g., 1-5% for the nominal value ratio). In either case, the Test Manager adds the results of these verifications to a temporary record for the test. The Test Manager verifies in block 760 whether the last window has been processed. If not, the process returns to block 756 and repeats the same operations for the next window. Conversely, once all windows have been processed, the loop ends by descending to block 762.
[0070] At this point, the Test Manager verifies the alignment between the photographic and fluorescent images. For this purpose, the object recognition engine searches for markers in the fluorescent image (i.e., their representation in the corresponding ROIs) (as described above). The Test Manager verifies in block 764 whether the markers in the photographic image match the corresponding markers in the fluorescent image. For example, the Test Manager calculates the distance between each marker in the fluorescent and photographic images, defined by the average value of the corresponding translational components, and compares it with a predefined threshold (e.g., 1-5% of the maximum extent of the marker in the photographic image). The Test Manager adds the result of this verification to the temporary record of the test.
[0071] The inspection manager may perform additional validation of the imaging device in block 766 (according to the photographic image). For example, the inspection manager determines the contrast of the acquisition unit according to the difference between the brightest and least bright pixel values of the mark in the photographic image. If the mark is tilted with respect to the row / column of the photographic image (by an angle known from the geometry of the inspection device retrieved from the configuration repository), the inspection device determines the depth of field of the acquisition unit by applying a slanted edge method. The inspection device may have a spatial resolution target on its imaging plane (e.g., 1951 USAF, IEEE or ISO one), which is further specified in the configuration repository. In this case, the object recognition engine searches for the spatial resolution target in the photographic image (i.e., its representation in the corresponding ROI), and the inspection manager determines the spatial resolution of the acquisition unit accordingly. The inspection device may have a color inspection target (separate or combined with the spatial resolution target) on its imaging plane, which is further specified in the configuration repository. In this case, the object recognition engine searches for the color inspection target in the photographic image (i.e., its representation in the corresponding ROI), and the inspection manager determines the color resolution of the acquisition unit accordingly. The inspection device may have a reflectance reference (separate or combined with the spatial resolution target) in its imaging plane, which is further specified in the configuration repository. In this case, the object recognition engine searches for the reflectance reference in the photographic image (i.e., its representation in the corresponding ROI). The inspection manager determines the ambient light as the difference between the white light generated by the white light source (further defined in the configuration repository in terms of one or more statistical parameters associated therewith, such as its average intensity, etc.) and the corresponding reflected light received from the reflectance reference (defined by the same statistical parameters for the pixel values representing it in the photographic image, i.e., the average intensity in the example under consideration).The test manager then compares the ambient light (defined by the value of the statistical parameter for the reflected light minus the value of the corresponding statistical parameter for white light) with a predefined threshold (e.g. 1-5% of the value of the statistical parameter for white light). Additionally or alternatively, the same operation may be performed by determining the ambient light as the difference between the excitation light generated by the excitation light source (further defined in the configuration store in terms of one or more statistical parameters associated therewith, e.g. its average intensity, etc.) and the corresponding (further) reflected light received from the reflectance reference (defined by the same statistical parameters for the pixel values representing it in the fluorescence image, i.e. the average intensity for the instances in question). This makes it possible to verify that the ambient conditions are suitable for the correct operation of the imaging device. In either case, the test manager adds the results of these verifications to the temporary record of the test.
[0072] The test manager displays a message on the primary monitor (via a corresponding drive) in block 768 and requests the operator to turn on the test light source (by a corresponding switch of the test device). As soon as the test light source is turned on, the process continues to block 770. For example, this can occur in response to a corresponding command entered by the operator using a keyboard or pointing device (received by the test manager via a corresponding drive). Alternatively, this may occur automatically by monitoring the field of view with a corresponding loop that runs continuously (e.g. every 1-2 seconds). In particular, for this purpose, the test manager instructs the fluorescence camera to acquire a fluorescence image of the field of view (via a corresponding drive) with the excitation light source turned off, and calculates the average intensity of the fluorescence image. These operations are repeated until the average intensity exceeds a threshold value (e.g. 2-3 times that corresponding to the typical ambient fluorescence). In both cases, the test manager now instructs the fluorescence camera to acquire (a further) fluorescence image of the field of view (via a corresponding drive) while the white light source and the excitation light source are turned off. The test manager validates only the acquisition unit of the imaging device according to the characteristics of this luminescence image and the test light (retrieved from the configuration store). For example, the test manager calculates the difference between the mean fluorescence intensity of the fluorescence image and its nominal value and compares this difference with a predefined threshold (for example, 5-10% with respect to the nominal value). The test manager adds the result of this validation to the temporary record of the test. The test manager validates only the illumination unit of the imaging device according to the above-mentioned validation of the imaging device (as a whole) and its acquisition unit (alone) in block 772. For example, the test manager conditions the statistical parameter (mean fluorescence intensity) calculated as described above (step 754) for the pixel values representing each window in the previous fluorescence image according to the difference between the same mean fluorescence intensity of the (current) fluorescence image and its nominal value (so as to eliminate the effect of the mismatch of the acquisition unit). The test manager then validates again whether each window matches the fluorescence light emitted by a container placed in the corresponding seat as described above (steps 756-760).The Test Manager adds the results of this verification to the test's temporary record.
[0073] The flow of operations branches in block 774 according to the type of test (indicated in the temporary record). If the test needs to be performed over the entire field of view of the imaging head, the test manager verifies in block 776 whether it is completed (i.e. the imaging devices have already been tested in all predefined sets over the entire field of view, e.g. in a matrix with a pitch of 1-5 cm along all directions). If not, the test manager determines in block 778 the movement of the inspection device (according to the pitch) to reach a further (new) position over the entire field of view. The test manager then displays a corresponding message on the primary monitor (via a corresponding drive). As soon as the inspection device has moved to the new position, the process returns to block 706 to repeat the same test of the imaging device in the new position. For example, this can occur in response to a corresponding command entered by the operator using a keyboard or a pointing device (received by the test manager via a corresponding drive). Alternatively, this may occur automatically by monitoring the field of view using a corresponding loop that runs continuously (e.g. every 1-2 seconds). In particular, for this purpose, the test manager turns on the white light, instructs the photo camera to acquire a photo image of its field of view, and turns off the white light source (via the corresponding drive), and the object recognition engine searches for the inspection device in the photo image. The test manager verifies whether the inspection device has been found, and if so, verifies whether the current position of the inspection device matches the new position (as described above). These operations are repeated until the inspection device is found at the new position. Instead, once the inspection is completed, the process descends from block 776 to block 780, or directly from block 774 if the inspection needs to be performed at a single position. In either case, the test manager determines the length of the inspection from its start time (from the temporary record) to the current time (from the internal clock). The test manager adds the length of the inspection to the temporary record.
[0074] The Test Manager saves the results of the test defined in the temporary record by adding the results of the test to the log repository in block 782. The Test Manager transmits the results of the test to the service provider (to its network address retrieved from the configuration repository) in block 784. This allows a telemetry application to be implemented remotely to track the operation of the imaging device. The Test Manager displays the results of the test on the primary monitor (via the corresponding drive device) in block 786. The operator can then react accordingly. For example, if the results of the test indicate that the imaging device is performing well, the corresponding imaging process can be implemented (with high confidence in the information provided by the imaging device). Conversely, the imaging process can be interrupted (because the information provided by the imaging device may be misleading) and the operator can request intervention from the imaging device manufacturer's support center. The process then returns to block 702 to wait for the next test command.
[0075] All of the above makes it possible to verify the performance of the imaging device in a highly accurate and reproducible way, thus making it possible to detect degradation in the performance of the imaging device (e.g. caused by broken light sources, dirty transmission / collection optics, mechanical wear, parasitic light, etc.) even if the degradation goes unnoticed by the operator.
[0076] (Modification) Naturally, in order to meet local and specific requirements, those skilled in the art may apply many logical and / or physical modifications and changes to the present disclosure. More specifically, although the present disclosure has been described with reference to one or more embodiments thereof with a certain degree of detail, it should be understood that various omissions, substitutions and changes in form, details and other embodiments are possible. In particular, various embodiments of the present disclosure may be practiced without the specific details (e.g., numerical values) set forth in the foregoing description to provide a more complete understanding, but conversely, well-known features may be omitted or simplified so as not to obscure the description in unnecessary detail. Furthermore, it is expressly intended that a specific element and / or method step described in connection with any embodiment of the present disclosure may be incorporated in any other embodiment as a matter of general design choice. Moreover, items presented in the same group and various embodiments, examples or alternatives should not be construed as being equivalent to each other in nature (but are separate and autonomous entities). In all cases, each numerical value should be read as modified according to the applicable tolerance, and unless otherwise specifically indicated, the terms "substantially," "about," and "approximately" should be understood to be in the range of 5-10%. Moreover, each numerical range should be intended as explicitly specifying any possible number along a continuum within the range (including its endpoints). Ordinal numbers or other modifiers are merely used as labels to distinguish between elements with the same name and do not, in themselves, imply a priority, preference, or sequence.The terms "include," "comprise," "have," "contain," "involve," etc. are intended to have an open, non-exhaustive meaning (i.e., not limited to the listed items); the terms "based on," "dependent on," "according to," "function of," etc. are intended to have a non-exhaustive relationship (i.e., including possible additional variables); the term "a / an" is intended to refer to one or more items (unless expressly stated otherwise); and the term "means for" (or any means-plus-function form) is intended to refer to any structure adapted or configured to perform the relevant function.
[0077] For example, one embodiment provides an inspection device for inspecting a luminescence imaging device. However, the inspection device may be of any shape (e.g., point symmetric or not), size and material (e.g., plastic, resin, metal, etc.). Furthermore, the inspection device may be used to inspect any luminescence imaging device for any purpose (see below).
[0078] In one embodiment, the inspection device comprises a resting surface for resting the inspection device on a support surface. The resting surface may however be of any type (e.g. continuous or discontinuous flat, defined by protruding support elements, e.g. feet, balls, etc., with recesses). It may be used to rest the inspection device in any way (e.g. free in a holding station, locked therein) on any support surface (part of the luminescence imaging apparatus or separate therefrom, e.g. table, shelf, etc.).
[0079] In one embodiment, the inspection device includes one or more seats, however the seats may be of any shape (e.g., any cross-section, e.g., circular, square, etc., constant, varying, or both), of any size, and in any position (e.g., laterally open on the bottom, regularly or irregularly arranged, etc.).
[0080] In one embodiment, the testing device includes one or more containers, each filled with a liquid containing at least one luminescent substance, however the containers can be of any shape / size (they may be the same or simply compatible with those of the seat), of any material (e.g. plastic, glass, etc.) and of any type (e.g. vial, tube, bottle, etc.). The container may also be filled at any level with any liquid containing any number of luminescent substances (e.g., based on any luminescence phenomenon, such as fluorescence, phosphorescence, chemiluminescence, bioluminescence, stimulated Raman emission, etc., the containers may be filled with different concentrations of the same luminescent substance and / or different luminescent substances, etc.).
[0081] In one embodiment, each of the receptacles is housed in a corresponding one of the seats, however, there may be any number of receptacles (equal to or less than the number of seats) and they may be housed in the seats in any manner (e.g., removable, non-removable, a combination thereof, etc.).
[0082] In one embodiment, the inspection device includes one or more windows corresponding to the seats, however, the windows may be of any type (e.g., with or without chamfered edges), size and shape (e.g., round, square, etc.).
[0083] In one embodiment, the window opens onto an imaging surface of the inspection device, opposite the mounting surface, however the imaging surface may be of any type (e.g., continuous or discontinuous, planar or non-planar, parallel or angled relative to the mounting surface, etc.).
[0084] In one embodiment, each of the windows exposes a portion of the corresponding seat for imaging the luminescent material of the corresponding portion of the container contained therein, and is transparent to the excitation light of the luminescent material and the luminescence light emitted by the luminescent material when illuminated by the excitation light. However, the exposed portion of each seat may have any extent (up to the entire seat except its distal end). The container may be transparent (to any degree) in any portion, including the one imaged (completely) through the window, to any wavelength including one of the excitation / luminescence lights (e.g., even visible light).
[0085] In one embodiment, the seats extend along a corresponding longitudinal axis from a corresponding first end to a corresponding second end, however, the ends of each seat may be located anywhere (e.g., at or away from the center and borders of the testing device, any combination thereof, etc.).
[0086] In one embodiment, each of the seats is angled relative to the resting surface with the second end closer to the resting surface than the first end, however, the seats may be angled in any manner (e.g., downward or upward moving inwardly of the testing device) and at any angle.
[0087] In one embodiment, the corresponding window is located away from a first end of the seat, however, the window may be any distance from the corresponding end of the seat.
[0088] Further embodiments provide additional advantageous features, which may be omitted altogether in the basic implementation.
[0089] In particular, in one embodiment, the longitudinal axis of the seat forms an angle with the rest surface of between 5 and 30°, although the possibility that the seat forms a different angle with the rest surface is not excluded.
[0090] In one embodiment, the distance from the first end of the seat to the corresponding window is 10-50% of the length of the seat, however, the possibility of having windows at different distances from these ends of the seat is not excluded.
[0091] In one embodiment, the inspection device has sides extending between the mounting surface and the imaging surface, however, the sides may be of any type (e.g., continuous or discontinuous, perpendicular to the mounting surface, slanted inward / outward of the inspection device).
[0092] In one embodiment, the seat is provided with corresponding blind holes extending inwards from the sides, however the possibility of having the seat formed in other ways (e.g. through holes, recesses, etc.) is not excluded.
[0093] In one embodiment, each of the seats includes a first portion with a constant cross-section, however, the first portion may be of any length and in any location (e.g., interior or exterior).
[0094] In one embodiment, each of the seats includes a second portion with a cross-section that decreases as one moves inwardly of the inspection device. However, the second portion may be of any length and in any position (e.g., following that of the first portion). Furthermore, its cross-section may decrease in any manner (e.g., regularly or irregularly, at any rate until it reaches zero).
[0095] In one embodiment, the corresponding window exposes at least a portion of the first portion, however, the window may expose any portion of the first portion (up to the entirety).
[0096] In one embodiment, the window has an edge that corresponds to the imaging surface, which is chamfered, however, the chamfered edge may form any angle with the imaging surface.
[0097] In one embodiment, the inspection device includes one or more optically machine-readable position markers on the imaging surface (to determine the position of the inspection device). However, the position markers may be of any number and type (e.g., codes, symbols, etc.) and may be located in any location (e.g., at the center, site, and / or periphery of the inspection device. The position markers may be used in any manner to determine the position of the inspection device (e.g., its location defined by one or more position markers, its orientation defined by multiple position markers, and / or the format of one or more position markers, any combination thereof, etc.). In any case, this feature may also be implemented independently in an inspection device with a seat that is not inclined relative to the resting surface.
[0098] In one embodiment, the inspection device has point symmetry about a center point. However, the inspection device may have any shape with point symmetry (e.g., octagonal, hexagonal, square, circular, etc.).
[0099] In one embodiment, the location markers include a central location marker corresponding to a center point, however, the central location marker may be of any type (e.g., the center of the inspection device, its periphery, etc.).
[0100] In one embodiment, the position markers comprise one or more window position markers corresponding to the windows, however, the window position markers may be of any type (e.g., each window is between a corresponding pair of window position markers, each window position marker is proximate to a corresponding window).
[0101] In one embodiment, the inspection device includes one or more optically machine-readable information markers on the imaging surface that encode device information about the inspection device. However, the information markers may be of any number and type (e.g., integrated into and / or separate from the position markers). The information markers may encode any device information (e.g., a device identifier for the inspection device, a container identifier for the seat, rules for use of the inspection device, proof of authenticity of the inspection device, type of container for the seat, etc.). The device information may be provided in any manner (e.g., a QR code, an ArUco code, a barcode, etc.).
[0102] In one embodiment, the device information includes a device identifier for the sensing device. However, the device identifier may be of any type (e.g., a serial number, an encryption code, etc.). The device identifier may be provided by any information marker (e.g., a single information marker, a combination of two or more information markers, etc.).
[0103] In one embodiment, the device information includes a container identifier corresponding to an expected type of container to be stored in the seat. However, the container identifier may indicate the type of container in any manner (e.g., a (predetermined) concentration of luminescent material, a (varying) nature and / or concentration of luminescent material, a product number of the container, etc.). The container identifier may be provided by any information marker (e.g., a single information marker, a combination of two or more information markers, a corresponding information marker for each seat, the same or different from the information marker providing the device identifier).
[0104] In one embodiment, the positional and / or informational markers are located on the corresponding bottom surfaces of recesses extending from the imaging surface. The recesses may, however, be of any type (e.g., with or without chamfered edges), size and shape (e.g., round, square, etc., the same or simply a match of one of the markers), depth. In any case, the possibility of having more markers located in each recess or having the markers (or at least some of them) located flush with the imaging surface is not excluded.
[0105] In one embodiment, the bottom surface is parallel to the resting surface, however, it is not excluded that the bottom surface is inclined relative to the resting surface.
[0106] In one embodiment, the recess has an edge that corresponds to the imaging surface, which is chamfered, however, the chamfered edge may form any angle with the imaging surface.
[0107] In one embodiment, the inspection device includes one or more locking elements for locking the inspection device onto a support surface, however, the locking elements may be any number, located in any position, and of any type (e.g., to the resting surface, side, etc., to magnetically, mechanically lock the inspection device, e.g., springs, clips, screws, Velcro® strips, suction cups, multi-purpose adhesive, etc.).
[0108] In one embodiment, the locking elements include corresponding magnetic elements disposed on the mounting surface, however, the magnetic elements may be in any number and in any position and may be used to generate any attractive force with the support surface (if made of a ferromagnetic material).
[0109] In one embodiment, the imaging surface around the window is inclined relative to the mounting surface, however, the imaging surface around the window may form any angle with the mounting surface (up to being parallel to it).
[0110] In one embodiment, the inspection device includes one or more human readable seat indicators corresponding to the seats, however, the seat indicators may be located in any location (e.g., on the imaging surface, on the side, etc.).
[0111] In one embodiment, the seat indicator provides a corresponding specification of the expected type of container that will be accommodated in the seat, however, the seat indicator may designate the type of container in any manner (e.g., by color, name, code, etc.).
[0112] In one embodiment, the inspection device includes an inspection light source at the imaging plane to generate an inspection light corresponding to the luminescent light. However, the inspection light source may be of any type and may be located at any location (e.g., at the center or periphery of the inspection device). The inspection light may be of any type (e.g., fixed or variable, e.g., the inspection light is selected via a wireless command transmitted by the luminescence imaging device, in response to a manual command, or according to a predetermined characteristic of an excitation light source of the luminescence imaging device).
[0113] In one embodiment, the corresponding container is permanently accommodated in the seat, however the container may be accommodated in any permanent manner in the seat (e.g. mechanically fixed, glued, integrated, etc.).
[0114] In one embodiment, the corresponding container is removably housed in the seat, however the container may be housed in any removably manner in the seat (e.g., loose, snap-fit, selective block fastening system, etc.).
[0115] In one embodiment, the container has corresponding ends that protrude from the seat, however the ends may be of any type (e.g. caps, outer ends of bottles / tubes, etc.) and they may protrude from the seat to any extent (up to none).
[0116] In one embodiment, the end is provided with a human readable container indicator that provides the corresponding specification of the container, however the container indicator may be of any type (same or different from the seat indicator).
[0117] In one embodiment, the seat indicators are color coded, however the colors may be of any type and may be indicated in any manner (e.g., by their name, a sample, etc.).
[0118] In one embodiment, the container indicators are color coded, however the color may be of any type and may be indicated in any manner (e.g., the ends themselves are colored, labels with their names, samples, etc.).
[0119] In one embodiment, the container comprises a corresponding bottle that contains the liquid and a cap that seals the bottle, however, the bottle and cap may be of any type (e.g., a bottle shaped like a vial or tube, a screw-on or press-fit cap, etc.).
[0120] In one embodiment, the cap is colored according to the container indicator, however, the cap may be colored in any manner (e.g., completely, laterally, at the top, etc.).
[0121] One embodiment provides a holder for use with the inspection device described above (comprising said mounting surface and said seat for receiving the container and said window), however the holder may also be marketed as a stand-alone product (no container is added later).
[0122] An embodiment provides a method for testing a luminescence imaging device using the above-mentioned testing device. However, the luminescence imaging device may be of any type (see below) and may be tested for any purpose at any time (e.g. for calibration after installation / maintenance, for verification before every use, for monitoring / comparison over time, etc.). Furthermore, the method may be invoked in any way (e.g. automatically in response to any start command entered via any input unit of the fluorescence imaging device, such as a keyboard, a pointing device, a dedicated button, etc., in each case with or without the possibility of entering information such as type of test or change of testing device).
[0123] In one embodiment, the method is performed with the inspection device mounted on a support surface within the field of view of an imaging head of a luminescence imaging apparatus, however the imaging head may be of any type (see below) and the inspection device may be positioned within the field of view in any manner (e.g. by moving either the inspection device and / or the imaging head, by making use of a corresponding holding station at its disposal).
[0124] In one embodiment, the method comprises the following steps under the control of a control unit of the luminescence imaging device: However, the control unit may be of any type (see below).
[0125] In one embodiment, the method includes acquiring a luminescent image of the field of view (using a luminescent camera in the imaging head). However, the luminescent image may be of any type (e.g., any size, color or black and white, 2D or 3D, with any pixel / voxel values, e.g., RGB components, luminance components, single color, or different colors corresponding to multiple fluorescent agents, etc.). It may be acquired using any luminescent camera (see below).
[0126] In one embodiment, the fluorescent image represents luminescence light emitted by the luminescent material of the container in response to excitation light provided by an excitation light source of the imaging head, however, the excitation light may be of any type and provided by any excitation light source (see below).
[0127] In one embodiment, the method includes determining a representation of the windows in the luminescent image, however, the representation of the windows in the luminescent image may be determined in any manner (e.g., by directly locating them in the luminescent image according to the position of the inspection device in the corresponding photographic image, etc.).
[0128] In one embodiment, the method includes inspecting the luminescence imaging device according to the representation of the windows in the luminescence image, although this operation may be performed in any manner (e.g., by comparing the representation of each window to a corresponding nominal value, a representation of one or more other windows, a representation of background regions, any combination thereof, at a single location or across the entire field of view, etc.).
[0129] Further embodiments provide additional advantageous features that may be omitted altogether in the basic implementation.
[0130] In particular, in one embodiment, the method includes acquiring (with a photographic camera of the imaging head) a photographic image of the field of view representative of the reflected light reflected by the field of view. However, the photographic image may be of any type (same or different to the luminescent image, e.g. in terms of size, color or black and white, 2D or 3D, pixel / voxel values, etc.) and it may be acquired with any photographic camera, either simultaneously with or separately from the luminescent image (see below).
[0131] In one embodiment, the method includes retrieving a descriptor of the sensing device, however, the descriptor may be retrieved in any manner (e.g., by reading it locally or downloading it remotely).
[0132] In one embodiment, the descriptor includes a representation of the geometry of the inspection device. However, the geometry of the inspection device may be defined in any manner by the shape of the inspection device alone (e.g., if the shape allows determining both the location and orientation of the inspection device, does not have point symmetry, e.g., comprises a protrusion / depression at the first of the sites defining the sequence, etc.), by positional markers (e.g., of any number, of any type, and placed at any location that allows determining both the location and orientation of the inspection device as described below), by features of the inspection device (e.g., its corners), by any combination thereof (e.g., the shape of the inspection device for determining the location and the positional markers for determining the orientation), etc.
[0133] In one embodiment, the descriptor includes an indication of the location of the window within the sensing device, however, the location of the window within the sensing device may be indicated in any manner (e.g., relative to a position marker, a holder, etc.).
[0134] In one embodiment, the method includes locating the location of the inspection device within the photographic image according to the geometry of the inspection device, however, the location of the inspection device may be located in any manner (e.g., by applying any object recognition technique, e.g., model-based, appearance-based, feature-based, etc., genetic algorithms, etc.).
[0135] In one embodiment, the method includes calculating a position of a window in the photographic image according to a position of the inspection device in the photographic image and a position of the window in the inspection device, however, the position of the window in the photographic image may be calculated in any manner (e.g., by determining and applying any transformation between real world coordinates and image coordinates, of an affine or non-rigid type defined by a matrix, transformation, vector, etc.).
[0136] In one embodiment, the method includes determining a representation of the window in the luminescent image according to the position of the window in the photographic image, however, the representation of the window in the luminescent image may be determined according to the position of the window in the photographic image in any manner (e.g. directly by correcting for possible misalignment between the two images).
[0137] In one embodiment, the method includes searching for a descriptor that includes a specification of the position markers, however, the position markers may be defined in any manner (e.g., by their position, orientation, format, etc.).
[0138] In one embodiment, the method includes retrieving a descriptor that includes an indication of the position of the window relative to the position marker, however, the position of the window relative to the position marker may be indicated in any manner (e.g., by their displacement, by the coordinates of the position marker, and by the coordinates of the window within the inspection device, etc.).
[0139] In one embodiment, the method includes locating the location of the location marker within the photographic image according to the specifications of the location marker, however, this operation may be performed in any manner (see above).
[0140] In one embodiment, the method includes calculating the position of a window in the photographic image according to the position of a position marker in the photographic image and the position of the window relative to the position marker, although this operation may be performed in any manner (see above).
[0141] In one embodiment, the method includes testing the luminescence imaging device according to a comparison of each representation of the window in the luminescence image with at least one nominal value. However, the nominal values may be of any number and type (e.g., any statistical parameter, e.g., mean, variance, standard deviation, min / max, median, etc.). The testing may be performed in any manner accordingly (e.g., by comparing the difference of each statistical parameter individually or the overall difference with any threshold value).
[0142] In one embodiment, the method includes examining the luminescence imaging device according to a comparison of each representation of the window in the luminescence image with at least one other representation of the window in the luminescence image, although the representations of the windows may be compared in any manner (e.g., according to any statistical parameter of the window as described above, by comparing any relationship (e.g., ratio, difference, etc.) to any threshold value, etc.).
[0143] In one embodiment, the method includes determining a representation of a background region (different from a representation of a window) in the luminescent image. However, the background region may be of any type (e.g., corresponding to or independent of any position marker, etc.). It may be determined in any manner (e.g., by searching it directly according to a descriptor that includes an indication of the position of the inspection device and the position of the background region within the inspection device).
[0144] In one embodiment, the method includes testing the luminescence imaging device according to a comparison of the representation of each of the windows in the luminescence image with a representation of the background region in the luminescence image, although this operation may be performed in any manner (which may be the same or different with respect to the comparison with other windows).
[0145] In one embodiment, the method includes estimating a corresponding expected type of container according to a comparison of the representation of the window in the luminescent image with a plurality of predefined specifications of possible types of containers. However, the expected types of containers may be estimated in any manner (e.g., by selecting them together (as the closest combination) or individually (as the closest) according to any criteria).
[0146] In one embodiment, the method includes determining a representation of the informational markers in the photographic image. However, the informational markers may be determined in any manner (e.g., by directly searching for them according to a descriptor that, if matched with them, includes an indication of the location of the inspection device and the location of the informational markers within the inspection device, already given by the location markers).
[0147] In one embodiment, the method includes determining device information according to a representation of the information markers, however the device information may be determined in any manner (e.g. extracted directly from the information markers, retrieved locally or remotely accordingly).
[0148] In one embodiment, the method includes inspecting the luminescence imaging device according to the device information, however, the device information may be used in any manner (e.g., to determine expected types of containers, to look up usage rules, to look up usage information, etc.).
[0149] In one embodiment, the method includes determining a corresponding expected type of container according to the device information, however, the type of container may be determined in any manner (e.g., directly from the device information, retrieved locally or remotely accordingly, e.g., via a corresponding container identifier).
[0150] In one embodiment, the method includes testing the luminescence imaging device according to predetermined specifications for an expected type of container, however the container type specifications may be of any type (e.g., nominal values for any number and type of corresponding statistical parameters), these may be retrieved in any manner (e.g., locally or remotely), and the testing may be performed accordingly in any manner (e.g., by comparing the difference in each statistical parameter individually or the overall difference to any threshold value).
[0151] In one embodiment, the method includes determining a representation of the edges of the container in the photographic image, however the edges may be determined in any manner (e.g. by directly searching for them according to a descriptor that includes an indication of the location of the inspection device and the location of the edges within the inspection device).
[0152] In one embodiment, the method includes validating the configuration of the inspection device according to a matching of the representation of the edge in the photographic image with a predefined definition of the corresponding expected type of container. However, the definition of the type of container may be of any type (e.g. color definition given by any number and type of statistical parameters, color names, etc.), these may be retrieved in any way (e.g. locally or remotely), and the validation of the configuration of the inspection device may be performed accordingly in any way (e.g. by comparing these names, by comparing the difference of each statistical parameter individually or the overall difference with any threshold, with or without the further validation of the seat indicator).
[0153] In one embodiment, the method includes locating the location of the inspection device within the luminescent image, however the location of the inspection device may be found in the luminescent image in any manner (same or different as to the photographic image).
[0154] In one embodiment, the method includes inspecting the luminescent imaging device according to an alignment between the photographic image and the luminescent image determined according to a position of the inspection device in the photographic image and a position of the inspection device in the luminescent image, however, this operation may be performed in any manner (e.g., by comparing the distance between each pair of corresponding markers individually, an overall value based on the distance between all pairs of corresponding markers, the distance between the holders, etc., to any threshold value).
[0155] In one embodiment, the method includes retrieving one or more usage rules for the test device. The usage rules may, however, be of any number and type (e.g. maximum usage in terms of test length, number of tests, up to single if the test device is disposable, time since manufacture date, expiry date, etc.). These may be retrieved in any manner (e.g. by being read locally or downloaded anonymously or remotely depending on a device identifier).
[0156] In one embodiment, the method includes enabling testing of the luminescence imaging device according to the usage rules. However, testing may be enabled according to the usage rules in any manner (e.g., by verifying the usage rules in any manner, e.g., by requiring compliance with all or only some of them, by enabling testing in any manner according to a corresponding result, e.g., preventing it, simply warning an operator, notifying a service provider, any combination thereof, etc.).
[0157] In one embodiment, the method includes retrieving usage information of one or more previous runs of testing the luminescence imaging device, however, the usage information may be of any type (e.g., length of test, number of tests, date of last test, etc.) and it may be retrieved in any manner (e.g., locally or remotely).
[0158] In one embodiment, the method includes enabling testing of the luminescence imaging device according to the usage information, however, testing may be enabled in any manner according to the usage information (e.g., by using usage rules that may be predefined locally or remotely and retrieved according to the device identifier, by validating it against any usage rules as described above, and by enabling testing in any manner according to the corresponding results as described above).
[0159] In one embodiment, the method includes storing usage information for testing the luminescence imaging device, however, the usage information may be stored in any manner (e.g., individually or incrementally, locally or remotely, etc.).
[0160] In one embodiment, the method includes retrieving the usage rules and / or the usage information according to the device information. However, the usage rules and the usage information may be retrieved in any manner (e.g., directly extracted from the device information and determined locally or remotely accordingly, e.g., via a corresponding device identifier).
[0161] In one embodiment, the method includes acquiring an additional luminescence image (with a luminescence camera) of the field of view while the imaging head's excitation light source is off and the inspection light source is on, however, the additional luminescence image may be acquired at any time (either before or after the luminescence image).
[0162] In one embodiment, the method includes testing an acquisition unit of the imaging head (for acquiring the luminescence image) according to the additional luminescence image and the test light source predefined characteristics. However, the acquisition unit may be of any type (see below). The characteristics of the test light source may be of any type (e.g. nominal values of any number and type of statistical parameters). These may be retrieved in any way (e.g. locally or remotely). Furthermore, the testing may be performed in any way (e.g. by comparing the difference of each statistical parameter individually and the overall difference with any threshold value).
[0163] In one embodiment, the method includes testing an illumination unit (for generating excitation light) of the imaging head according to the results of testing the luminescence imaging device and according to the results of testing the acquisition unit. The illumination unit may, however, be of any type (see below). It may be tested in any way (e.g. by adjusting the representation of the window according to the testing of the acquisition unit and repeating the testing of the entire luminescence imaging device, extrapolating it from the previous testing of the entire luminescence imaging device according to the testing of the acquisition unit).
[0164] In one embodiment, the method includes determining a displacement of the inspection device and / or imaging head from a target location according to a location of the inspection device in the photographic image. However, the displacement may be determined in any manner (e.g., for each coordinate or globally, etc.), from a location of the inspection device defined in any manner (e.g., by a holder and / or position marker), to any target location thereof (e.g., locally or remotely located, manually inserted, etc.). Furthermore, the displacement may be defined for the inspection device alone, the imaging head alone, or both.
[0165] In one embodiment, the method includes outputting to an output unit of the luminescence imaging device an indication of the movement of the inspection device and / or the imaging head to reach the target location according to the displacement. However, the movement may be of any type (e.g. translation and / or rotation in a plane or space for the inspection device alone, the imaging head alone, or both). Also, the indication of the movement may be output in any manner (e.g. displayed, vocalized, etc.) to any output unit (e.g. monitor, loudspeaker, etc.). This feature can be used for any purpose (e.g. to correctly position the inspection device, to inspect the fluorescence imaging device over the entire field of view, etc.).
[0166] In one embodiment, the method includes outputting an indication of the results of inspecting the luminescence imaging device to an output unit of the luminescence imaging device. However, the results may be of any type (e.g., simply pass / fail or with general details regarding all verifications). Furthermore, the results may be output in any manner (e.g., displayed, printed, etc.), to any output unit (e.g., monitor, printer, etc.), and for any purpose (e.g., to enable a corresponding imaging process, manually or automatically, e.g., to request maintenance of the luminescence imaging device by message, email, etc.).
[0167] In one embodiment, the method includes transmitting an indication of the results of inspecting the luminescence imaging device to a remote computer system over a telecommunications network. However, the results may be of any type (same or different as described above). It may be transmitted to the remote computer system in any manner (e.g., by uploading it via email, etc.), over any network (e.g., Internet, LAN, etc.), to any remote computer system.
[0168] In one embodiment, the method includes repeating the following loop in a non-operational state of the luminescence imaging device: However, the loop may be repeated with any frequency and in any non-operational state (e.g., while the imaging process is waiting rather than in progress as indicated by corresponding start and stop commands entered by an operator via any input unit):
[0169] In one embodiment, the loop includes acquiring an additional photographic image of the field of view using a photographic camera. However, the additional photographic image may be of any type (same or different with respect to the photographic image). It may be acquired in any manner (e.g., alone or together with a corresponding fluorescent image that is used for inspection after exiting the loop).
[0170] In one embodiment, the loop involves searching for a representation of the inspection device in the additional photographic images according to the geometry of the inspection device, however, the inspection device may be searched in any manner according to its descriptors (same or different as described above to determine its location).
[0171] In one embodiment, the loop is performed until a representation of the inspection device in an additional photographic image is found, however, the exit condition for the loop may be defined in any manner (e.g., according to a match of the inspection device's shape, a match of position markers, both, etc.).
[0172] In one embodiment, the method includes triggering an inspection of the luminescence imaging apparatus in response to finding a representation of the inspection device in the additional photographic image, however, the inspection may be triggered in any manner (e.g., automatically or requiring manual confirmation, with or without prompting an operator to enter information).
[0173] In general, similar considerations apply when the same technique is implemented in an equivalent manner (by using more steps or similar steps with the same functionality of some of them, by eliminating some non-essential steps, or by adding further optional steps). Furthermore, steps may be performed (at least partially) in different orders, simultaneously, or in an interleaved manner.
[0174] An embodiment provides a computer program configured to cause a control unit of a luminescence imaging device to perform the above method when the computer program is executed on the control unit. An embodiment provides a computer program product including a computer readable storage medium embodying the computer program. The computer program is loadable into a working memory of a control unit of a luminescence imaging device, thereby configuring the control unit to perform the same method. However, the software program may also be implemented as a stand-alone module, as a plug-in to an existing software program (e.g., an imaging manager), or directly in the latter. In either case, similar considerations apply if the software program is configured in a different way or if additional modules or functions are provided. Similarly, the memory structures may be of other types or may be replaced by equivalent entities (not necessarily consisting of physical storage media). The program may take any form suitable for use by any control unit (see below), thereby configuring the control unit to perform the desired operations. In particular, the program may be in the form of external or resident software, firmware or microcode (either object code or source code, e.g., compiled or interpreted). Furthermore, it is possible to provide the program on any computer readable storage medium. The storage medium is any tangible medium (as opposed to a transitory signal itself) capable of holding and storing instructions used by the control unit. For example, the storage medium may be of electronic, magnetic, optical, electromagnetic, infrared or semiconductor type. Examples of such storage media are fixed disks (where the program may be preloaded), removable disks, memory keys (e.g. USB type), etc. The program may be downloaded to the control unit from the storage medium or via a network (e.g. the Internet, wide area networks and / or local area networks, including transmission cables, optical fibers, wireless connections, network devices).One or more network adapters in the control unit receive the program from the network and forward it to one or more storage devices in the control unit for storage. In any case, the techniques according to an embodiment of the present disclosure lend themselves to implementation in a hardware structure (e.g., by electronic circuitry integrated in one or more chips of semiconductor material), or in a combination of appropriately programmed or otherwise configured software and hardware.
[0175] An embodiment provides a luminescence imaging device comprising a control unit for carrying out each step of the method described above. However, the luminescence imaging device may be of any type (medical equipment for use in any luminescence application, such as fluorescence applications in diagnosis, therapy or surgery, industrial equipment, etc.). The luminescence imaging device may comprise any control unit (e.g. any integrated central unit, any separate computer, such as an industrial PC, etc.), any illumination unit (e.g. based on lasers, LEDs, UV / Halogen / Xenon lamps, etc.), any acquisition unit (e.g. based on any number and type of lenses, waveguides, mirrors, CCD, ICCD, EMCCD, CMOS, InGaAs or PMT sensors, etc.), any imaging head (e.g. stand-alone with articulated arm, swivel arm, wireless connection, handheld, etc.), output device (e.g. monitor, printer, network connection, head-mounted projector, etc.).
[0176] Further embodiments provide additional advantageous features, which may be omitted altogether in the basic implementation.
[0177] In particular, in one embodiment, the luminescence imaging apparatus comprises a support surface for placing the inspection device, however the support surface may be of any type (e.g. the top surface of any carriage, cantilever, fixed or hidden, etc.).
[0178] In one embodiment, the luminescence imaging apparatus comprises a holding station for removably holding the inspection device in an imaging position on the support surface, however the holding station may be of any type (e.g. recess, socket, etc.) for holding the inspection device in any removable manner (e.g. loose, snap-fit, selective block fixing system, etc.).
[0179] In one embodiment, the luminescence imaging device comprises an additional holding station for removably holding the imaging head in the acquisition position, however the additional holding station may be of any type (e.g. ring, hook, etc.) for holding the imaging head in any removable manner (e.g. loose, snap-fit, selective block fixing system, etc.).
[0180] In one embodiment, the inspection device in the imaging position is within the field of view of the imaging head in the acquisition position, however, the inspection device may be within the field of view in any manner (e.g., in one or more dimensions, in a fixed or variable manner).
[0181] In one embodiment, the centre of the inspection device in the imaging position is on the optical axis of the imaging head in the acquisition position, however the possibility of having the inspection device in one or more different positions is not excluded.
[0182] One embodiment provides a luminescence imaging system comprising the above-mentioned luminescence imaging apparatus and an inspection device for inspecting the luminescence imaging apparatus. However, the inspection device may also be brought to the market as a stand-alone product for use with an existing luminescence imaging apparatus.
[0183] In general, similar considerations apply when the inspection device, luminescence imaging apparatus, and luminescence imaging system each have different structures or comprise equivalent components or have other operational characteristics. In either case, all of the components may be separated into more elements, or two or more components may be combined together into a single element. Furthermore, each component may be replicated to support the performance of corresponding operations in parallel. Furthermore, unless otherwise specified, any interaction between different components does not generally have to be sequential, but may be direct or indirect via one or more intermediary means.
Claims
1. An inspection device (110) for inspecting a luminescence imaging apparatus (105), comprising: a mounting surface (310) for mounting the inspection device (110) on the support surface (175); One or more seats (320); one or more containers (325) each filled with a liquid containing at least one luminescent material, each of the containers (325) housed in a corresponding one of the seats (320); one or more windows (330) opening into an imaging surface (315) of the inspection device (110) opposite the placement surface (310), each of the windows (330) exposing a portion of a corresponding seat (320) for imaging the luminescent material in a corresponding portion of the container (325) contained therein, and the windows (330) being transparent to excitation light of the luminescent material and luminescence light emitted by the luminescent material when illuminated by the excitation light; The seats (320) extend along corresponding longitudinal axes from corresponding first ends to corresponding second ends; Each of the seats (320) is inclined with respect to the support surface (310) with the second end closer to the support surface (310) than the first end; The inspection device (110) is characterized in that the corresponding window (330) is spaced from the first end of the seat (320).
2. The inspection device (110) of claim 1, wherein the longitudinal axis of the seat (320) forms an angle of between 5 and 30 degrees with the rest surface (310).
3. The inspection device (110) of claim 1 or 2, wherein the distance of the corresponding window (320) from the first end of the seat (320) is between 10 and 50% of the length of the seat (320).
4. The inspection device (110) has a side surface (335) extending between the mounting surface (310) and the imaging surface (315); The inspection device (110) of any of claims 1 to 3, wherein the seat (320) is provided with a corresponding blind hole extending inwardly from the side surface (335).
5. Each of the seats (320) includes a first portion (405) with a constant cross section and a second portion (410) with a cross section that decreases as one moves inwardly of the inspection device (110); The inspection device (110) of any of the preceding claims, wherein the corresponding window (330) exposes at least a portion of the first portion (405).
6. The inspection device (110) of any of claims 1 to 5, wherein the window (330) has a corresponding chamfered edge at the imaging surface (315).
7. An inspection device (110) as described in any one of claims 1 to 6, wherein the inspection device (110) is provided with one or more optically machine-readable position markers (340, 345) on the imaging surface (315) for determining the position of the inspection device (110).
8. The inspection device (110) has point symmetry with respect to a central point; The inspection device (110) of claim 7, wherein the position markers (340, 345) include a central position marker (340) corresponding to a central point.
9. The inspection device (110) of claim 8, wherein the inspection device (110) comprises one or more window position markers (345) corresponding to the windows (330).
10. An inspection device (110) as described in any one of claims 1 to 9, wherein the inspection device (110) comprises one or more optically machine-readable information markers (340, 345) on the imaging surface (315) that encode device information relating to the inspection device (110).
11. The sensing device (110) of claim 10, wherein the device information includes a device identifier of the sensing device (110).
12. The inspection device (110) of claim 10 or 11, wherein the device information includes a corresponding container identifier of an expected type of container (325) to be accommodated in the seat (320).
13. the position markers (340, 345) and / or the information markers (340) are disposed on corresponding bottom surfaces of recesses extending from the imaging surface (315); The inspection device (110) according to any one of claims 7 to 12, wherein the bottom surface is parallel to the mounting surface (310).
14. The inspection device (110) of claim 13, wherein the recess has a corresponding chamfered edge at the imaging surface (315).
15. The inspection device (110) according to any of the preceding claims, wherein the inspection device (110) comprises one or more locking elements (435) for locking the inspection device (110) on a support surface.
16. The inspection device (110) of claim 15, wherein the locking element (435) includes a corresponding magnetic element (435) disposed on the mounting surface (310).
17. The inspection device (110) according to any one of the preceding claims, wherein the imaging surface (315) around the window (330) is inclined with respect to the mounting surface (310).
18. the inspection device (110) includes one or more human readable seat indicators (355) corresponding to the seats (320); The inspection device (110) of any of the preceding claims, wherein the seat indicator (355) provides a corresponding specification of an expected type of container (325) to be accommodated in the seat (320).
19. The inspection device (110) of any of the preceding claims, wherein the inspection device (110) comprises an inspection light source (350) at the imaging plane (315) for generating inspection light corresponding to the emitted light.
20. The inspection device (110) according to any of the preceding claims, wherein the corresponding container (325) is accommodated in the seat (320) in a non-removable manner.
21. The inspection device (110) according to any of the preceding claims, wherein the corresponding container (325) is accommodated in the seat (320) in a removable manner.
22. An inspection device (110) as described in any one of claims 1 to 21, wherein the container (325) has a corresponding end (430) protruding from a corresponding seat (320) provided with a human-readable container indicator providing a corresponding specification of the container (325).
23. The inspection device (110) according to any of claims 18 to 22, wherein the seat indicator (355) is colour coded.
24. 24. The inspection device (110) of claim 22 or 23, wherein the container indicator (430) is color coded.
25. The container (325) comprises a corresponding bottle (415) for containing a liquid and a cap (430) for sealing the bottle (415); The inspection device (110) of any of claims 22 to 24, wherein the cap (430) is coloured according to the container indicator (430).
26. A holder (305) for use in an inspection device (110) according to any one of the preceding claims, comprising The holder (305) has the above-mentioned placement surface (310), The seat (320) houses a container (325) and the window (330), a holder (305).
27. An imaging head (165); A support surface (175) for placing an inspection device (110) according to any one of claims 1 to 25, a holding station (505) for removably holding the inspection device (110) in an imaging position on the support surface (175); an additional holding station (510) for removably holding the imaging head (165) in an acquisition position; The inspection device (110) in the imaging position is within the field of view of the imaging head (165) in the acquisition position, the luminescence imaging apparatus (105).
28. 28. The luminescence imaging apparatus (105) of claim 27, wherein the center of the inspection device (110) in the imaging position is on the optical axis of the imaging head (165) in the acquisition position.
29. A luminescence imaging device (105); A luminescence imaging system comprising an inspection device (110) according to any of claims 1 to 25 for inspecting a luminescence imaging apparatus (105).
