Automated detection of test equipment for luminescent imaging devices
Patent Information
- Application Number
- CN202080075302.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-11-25
- Filing Date
- 2020-11-19
- Publication Date
- 2025-10-10
- Estimated Expiration
- 2040-11-19
AI Technical Summary
Existing imaging device testing equipment requires manual intervention, is complex to operate and prone to errors, cannot simultaneously verify the performance of the irradiation unit and the acquisition unit, and is not suitable for actual use environments.
Provided is an automatic detection test device, including a test device and a software program, which automatically identifies the position of the test device in the image by acquiring a photo and a luminous image, and verifies the performance of the luminous imaging device based on the position.
The system realizes the automated performance test of the imaging device, simplifies the operation process, improves the accuracy and efficiency of the test, and is suitable for actual use environment.
Smart Images

Figure CN114729876B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present disclosure relates to imaging applications. More specifically, the present disclosure relates to luminescence imaging. BACKGROUND
[0002] The background of the present disclosure is introduced below with discussion of technologies related to the context of the present disclosure. However, even if this discussion refers to documents, acts, artefacts etc., it does not imply that the discussed technologies are part of the prior art or that they are common general knowledge within the field concerned with the present disclosure.
[0003] Imaging generally relates to a variety of technologies allowing to acquire images of objects (typically, not directly visible) in a substantially non-invasive way. For example, imaging technologies are commonly used in equipment for medical applications to examine (internal) body parts of patients for diagnostic, therapeutic and / or surgical purposes.
[0004] A particular imaging technology that is increasingly considered is luminescence imaging, and in particular fluorescence imaging. Luminescence imaging is based on a luminescence phenomenon, including the emission of light by a luminescent substance when subjected to any excitation other than heating; in particular, the fluorescence phenomenon occurs in fluorescent substances (called fluorophores) that emit light when they are irradiated (the intensity of which depends on the amount of fluorophores irradiated). This phenomenon is exploited, for example, in medical applications by administering to a patient a fluorescent agent, in particular a targeted fluorescent agent adapted to reach a desired target and then remain fixed thereon (for example, due to a specific interaction with tumour tissue).
[0005] To this end, (fluorescence) imaging devices are used; the imaging devices allow to irradiate each object to be imaged (with excitation light suitable to excite the fluorophores) and to obtain a corresponding (fluorescence) image representative of the fluorophores present in the object, typically together with a (photo) image simply representative of the object; in particular, in medical applications, the fluorescence image is representative of the fluorescent agent fixed on the corresponding target point and the photo image is representative of the body part being analysed.
[0006] The imaging devices should be tested to verify their performance. This is particularly important in medical applications, where the performance of the imaging devices affects the corresponding diagnostic, therapeutic and / or surgical outcome.
[0007] The imaging device can be tested using specific metrological instruments. However, this does not allow for simultaneous verification of both the irradiation unit and the acquisition unit of the imaging device. Another possibility is to embed quantum dots (small particles produced in semiconductor processes) using a curable polyurethane matrix or a composite phantom in varying concentrations, as described, for example, in US-B-9167240. However, quantum dots exhibit very high absorption of visible light (in particular, much higher than a fluorescent agent commonly used in medical applications), making them useful for verifying the performance of imaging devices only in an environment with controlled irradiation.
[0008] To test an imaging device in a close simulation of its actual use, it is possible to instead image samples with the same fluorophore—the fluorescent agent used in medical applications. Several test devices are available for this purpose. For example, well plates (commonly used in laboratories for other purposes), loosely arranged tubes, or capillaries filled with different concentrations of fluorescent agents can be used. However, these test devices require manual intervention (e.g., site preparation and selection of the area of interest in the image), which can be inconvenient and prone to error.
[0009] In addition, Hoogstings et al., "Setting Standard for Reporting and Quantification in Fluorescence-Guided Surgery," Mol Imaging Biol (2019) 21:11-18, proposed the use of a test device called SurgVision's CalibrationDisk (its trademark). This test device consists of an upper disk (holding eight tubes filled with different concentrations of fluorescent agents) and a base on which the upper disk can rotate.
[0010] US-A-2003 / 146663 discloses an optical calibration device comprising an array of low-power light sources, each having a known emission. US-A-2008080781 discloses a fluorescence standard having at least two regions with different fluorescence responses. US-A-2007 / 200058 discloses a phantom device comprising a subject and a fluorescence light source within the subject. Summary of the Invention
[0011] In order to provide a basic understanding of the disclosure, a simplified summary of the disclosure is given herein; however, its sole purpose is to introduce some concepts of the disclosure in a simplified form as a prelude to the more detailed description that follows, and should not be construed as identifying its key elements or delineating its scope.
[0012] Generally speaking, the present disclosure is based on the idea of automatic detection of test equipment.
[0013] In particular, one aspect provides a method for testing a luminescent imaging device. The method includes acquiring a photographic image and locating a test device in the photographic image. The method also includes acquiring a luminescent image and, based on the position of the test device in the photographic image, determining representations of sites of the test device in the luminescent image, each site comprising at least one luminescent substance. The luminescent imaging device is then tested based on the representations of the sites in the luminescent image.
[0014] Another aspect provides a software program for implementing the method.
[0015] Another aspect provides a corresponding software program product.
[0016] Another aspect provides a test device for use in the method.
[0017] Another aspect provides a luminescence imaging system including a luminescence imaging apparatus and a test device. More specifically, one or more aspects of the present disclosure are set out in the independent claims, and advantageous features thereof are set out in the dependent claims, the wording of all claims being incorporated herein verbatim by reference (with any advantageous features provided with reference to any particular aspect applying mutatis mutandis to any other aspect). BRIEF DESCRIPTION OF THE DRAWINGS
[0018] The solutions of the present disclosure and further features and advantages thereof will be best understood with reference to the following detailed description, which is given by way of non-limiting indication only and is to be read in conjunction with the accompanying drawings (in which, for simplicity, corresponding elements are denoted by the same or similar reference numerals and their explanation is not repeated, and the name of each entity is generally used to indicate its type and attributes, such as value, content, and representation). In particular:
[0019] Figure 1 shows a diagram of a fluorescence imaging system according to an embodiment of the present disclosure,
[0020] Figure 2 shows a schematic block diagram of a fluorescence imaging device that can be used to implement the solution according to an embodiment of the present disclosure,
[0021] Figure 3-Figure 4 showing different views of a test device according to an embodiment of the invention,
[0022] Figure 5 shows details of a fluorescence imaging apparatus according to an embodiment of the present disclosure,
[0023] Figure 6 shows the main software components that can be used to implement the solution according to an embodiment of the present disclosure, and
[0024] Figures 7A-7C An activity diagram describing the flow of activities associated with the implementation of a solution according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION
[0025] Special References Figure 1 , shows a diagram of a (fluorescence) imaging system 100 according to an embodiment of the present disclosure. The imaging system 100 comprises a (fluorescence) imaging apparatus 105 known per se and a test device 110 according to an embodiment of the present disclosure.
[0026] In medical applications, the imaging device 105 is used to examine a body part of a patient (not shown in this figure), for example, for diagnostic, therapeutic, and / or surgical purposes. The imaging device 105 includes the following components. A trolley 115 houses a supply unit and a control unit (not shown in this figure) for respectively supplying and controlling the imaging device 105. Four casters 120 (only three visible in this figure) are arranged at corresponding lower corners of the trolley 115 to facilitate movement of the imaging device 105 (with foot brakes, not visible in this figure, for securing the imaging device 105 in place). A support 125 extends upward from the rear surface of the trolley 115. The support 125 has a handle 130 for its operator to move the imaging device 105. An arm 135 extends from the support 125 above the trolley 115. A main monitor 140 (for displaying images to the operator) and a keyboard with a pointing device (such as a mouse or trackball 145) (for the operator to input information / commands) are mounted on the arm 135. A pivoting arm 150 is mounted on top of the support column 125 (above the boom 135). An auxiliary monitor 155 (for displaying images to a physician, such as a surgeon) is mounted on the pivoting arm 150 (to allow it to be rotated in either direction). An articulating arm 160 is also mounted on top of the support column 125 (near the pivoting arm 150). An imaging head 165 (for imaging the scene within its field of view, particularly the body part being analyzed) is suspended from the articulating arm 160. The imaging head 165 is provided with two handles 170 for the operator to position it.
[0027] The test device 110 is used to test the imaging device 105 to verify its performance. For example, the testing is intended to calibrate the imaging device 105, ensure that the imaging device 105 operates correctly, monitor the operation of the imaging device 105 over time, and / or compare the imaging device 105 with different imaging devices. To this end, the test device 110 rests on a support surface 175 so as to be positioned within the field of view of the imaging head 165; in particular, in the exemplary embodiment shown in the figures, the support surface 175 is defined by the top surface of the trolley 115.
[0028] Now refer to Figure 2 , which shows a schematic block diagram of an imaging device 105 that can be used to practice the solution according to an embodiment of the present disclosure.
[0029] In particular, the figure shows the functional structure of the imaging head 165 and the control unit (denoted by reference numeral 205).
[0030] Starting with the imaging head 165, it has an illumination unit and an acquisition unit for illuminating a scene in its field of view and for acquiring an image thereof, respectively.
[0031] The illumination unit includes the following components. An excitation light source 210 and a white light source 215 generate excitation light and white light, respectively. The excitation light has a wavelength and energy suitable for exciting the fluorophores of the fluorescent agent (e.g., near-infrared or NIR type), while the white light appears substantially colorless to the human eye (e.g., encompasses all wavelengths of the spectrum visible to the human eye at equal intensity). Corresponding delivery optics 220 and 225 deliver the excitation light and white light, respectively, to the (same) field of view of the imaging head 165.
[0032] The acquisition unit comprises the following components. The collecting optics 230 collect light from the field of view (in epi-illumination geometry). The collected light comprises fluorescence emitted by any fluorophores present in the field of view. In fact, the fluorophores enter an (electronic) excited state when they absorb the excitation light; the excited state is unstable, so that the fluorophores quickly decay from there to the (electronic) ground state, thereby emitting fluorescence whose intensity depends on the amount of fluorophores illuminated (this fluorescence is emitted at a characteristic wavelength, longer than the wavelength of the excitation light, because the energy is dissipated in the excited state as heat). In addition, the collected light comprises visible light (in the visible spectrum), which is reflected by any object present in the field of view (illuminated by white light). The beam splitter 235 splits the collected light into two channels. For example, the beam splitter 235 is a dichroic mirror that transmits and reflects the collected light at wavelengths above and below the threshold wavelength between the fluorescence spectrum and the visible light spectrum, respectively. In one channel of the beam splitter 235 having (a portion of) light collected in the fluorescence spectrum (such as transmitted light), an emission filter 240 receives the fluorescence light and filters it to remove any excitation light (that may be reflected by objects in the field of view) and any ambient light (that may be generated by background / intrinsic fluorescence). A fluorescence camera 245 receives the fluorescence light from the emission filter 240 and produces a corresponding fluorescence (digital) image representing the distribution of fluorophores in the field of view. In another channel of the beam splitter 235 having (a portion of) light collected in the visible light spectrum (such as reflected light), a photo camera 250 receives the visible light and produces a corresponding photo (digital) image representing a visualization of objects in the field of view.
[0033] Turning to the control unit 205, it comprises several units connected between them via a bus structure 255. In particular, one or more microprocessors (μP) 260 provide the processing and programming functions of the control unit 205. Non-volatile memory (ROM) 265 stores the basic code of the boot program of the control unit 205, and volatile memory (RAM) 270 serves as working memory for the microprocessor 260. The control unit 205 is provided with a mass storage 275 (e.g., a solid state drive or SSD) for storing programs and data. In addition, the control unit 205 includes a plurality of controllers 280 for peripheral devices or input / output (I / O) units; in particular, the controller 280 controls the excitation light source 210, the white light source 215, the fluorescent camera 245 and the photo camera 250 of the imaging head 165; in addition, the controller 280 controls other peripheral devices, which are generally indicated by the reference numeral 285, such as a main monitor, a keyboard, a pointing device, an auxiliary monitor, a drive for reading / writing removable storage units (for example, of USB type) and a network interface card (NIC) for connecting to a communication network (such as a LAN and then the Internet).
[0034] In operation, imaging head 165 is used to image body part 290 of patient 295 during an imaging procedure (e.g., diagnostic analysis, treatment, or surgical intervention). To this end, a fluorescent agent is administered to patient 295 (e.g., intravenously or topically). The fluorescent agent is a target-specific fluorescent agent adapted to attach to a specific (biological) target (such as tumor tissue, nerves, blood vessels, lymph nodes, lymphatic vessels, etc.) through specific interactions with the target. The fluorescent agent is administered to patient 295 in advance (e.g., 24-72 hours prior to the imaging procedure) to allow the fluorescent agent to circulate within the patient's vasculature until it reaches body part 290 and binds to the desired target. During the imaging procedure, imaging head 165 is positioned so that body part 290 is within its field of view. At this point, body part 290 is illuminated simultaneously with excitation light and white light; fluorescence images (representing the distribution of the fluorescent agent and, subsequently, the distribution of its targets within body part 290) and photographic images (representing a visualization of body part 290) are sequentially acquired. The fluorescent / photographic images are then displayed on a primary / secondary monitor of the imaging device, typically superimposed on one another into a corresponding combined image (representing the target point contextualized on the anatomy of the body part 290).
[0035] Now refer to Figure 3-Figure 4 , showing different views of the testing device 110 according to an embodiment of the present disclosure.
[0036] from Figure 3 start, Figure 3A perspective view of the test device 110 is shown. The test device 110 has a (e.g., plastic material) body defining a holder 305. The holder 305 has a (bottom) resting surface 310 for resting the test device 110 on any support surface, such as the support surface 175 of a dolly of the imaging apparatus, not shown in this figure; the holder 305 has a (top) imaging surface 315 opposite the resting surface 310 for imaging the test device 110. The test device 110 has one or more sites, each site comprising at least one luminescent substance. In particular, in the exemplary embodiment shown in the figure, one or more seats 320 (four in this particular embodiment, only one of which is visible in the figure) are provided in the holder 305. The seats 320 are configured to accommodate corresponding containers 325 (one of which is shown outside the seat 320, three of which are shown inside the seat 320) in the figure. Each container 325 is filled with a liquid containing a fluorescent agent (or other); for example, the containers 325 are of different types, each being defined by a corresponding fluorescent agent and / or concentration thereof. The test device 110 can be a basic version or a complete version. In the basic version, the test device 110 is provided without the containers 325 (to be acquired separately and then inserted into the seats 320 in a removable manner). In the complete version, instead, the test device 110 is provided with the containers 325 already inserted into the seats 320 (in a removable manner or in a non-removable manner). Windows 330 corresponding to the seats 320 are opened in the imaging surface 315. Each window 330 exposes a portion of the corresponding seat 320; therefore, each window 330 also exposes a corresponding portion of the container 325 housed in the seat 320 to allow imaging of the fluorescent agent thereof. To this end, at least the portion of the container 325 exposed through the window 330 is transparent both to the excitation light and to the fluorescence (i.e., it is able to allow the excitation light / fluorescence to pass through it substantially without excessive diffusion, such as with a ratio between the radiant power of the excitation light / fluorescence light beam exiting the container 325 in the direction defined by the corresponding refraction angle and the radiant power of the excitation light / fluorescence light beam entering the same container 325 inclined with respect to its surface higher than 80%, preferably higher than 85%, even more preferably higher than 90%, such as between 95% and 100%).
[0037] In a solution according to an embodiment of the present disclosure, the holder 305 has one or more optically machine-readable markings 335, 340 (e.g., QR codes) arranged on the imaging surface 315 (e.g., formed by corresponding labels sewn onto the imaging surface 315). The markings 335, 340 serve as positioning marks for determining the position (i.e., location and orientation) of the test device 110. In particular, in this specific embodiment, the (central) marking 335 is arranged at the center point of the holder 305, and the four (window) markings 340 are arranged corresponding to the windows 330 (e.g., alternating with each other). As described in detail below, the markings 335, 340 can be used to detect the test device in the corresponding photo image; this information then allows determining the representation of the window 330 in the corresponding luminous image for testing the imaging device 105 accordingly.
[0038] In the specific embodiment of the test device 110 shown in the figure, one or more of the markings 335, 340 can also serve as information markings that encode (device) information about the test device 110. For example, one marking 335, 340 or a combination of markings 335, 340 encodes a (unique) device identifier of the test device 110 (e.g., the device identifier is encoded in the marking 335). The device identifier allows tracking the use of the test device 110. The test device 110 can have a free configuration or a fixed configuration. In the free configuration, any type of container 325 (having any properties and concentration of fluorescent agent) can be arranged in the seat 320. In the fixed configuration, instead, a predetermined type of container 325 (having specific properties and concentration of fluorescent agent) will be arranged in the seat 320. In the latter case, one or more of the markings 335, 340 (alone or in combination) encodes a (unique) container identifier of the type of container 325 to be accommodated in the seat 320 (e.g., each container identifier is encoded in a corresponding marking 340 adjacent to its seat 320). The container identifier allows verification of the correct configuration of the test device 110 .
[0039] Markings 335, 340 are arranged at corresponding bottom surfaces of recesses (denoted by the same reference numerals) that extend inward from imaging surface 315 to holder 305 (downward). The bottom surfaces of recesses 335, 340 are parallel to resting surface 310. Therefore, when test device 110 rests on support surface 175 (substantially horizontal), the bottom surfaces of recesses 335, 340 are also horizontal. This increases the visibility of markings 335, 340 (when viewed from above). In addition, recesses 335, 340 have corresponding chamfered edges at imaging surface 315. For example, the edges are chamfered to form an angle of 40-50° (such as 45°) with imaging surface 315. This reduces any shadowing of markings 335, 340 when test device 110 is illuminated from above.
[0040] Holder 305 has a point-symmetrical shape (in plan view); in this particular embodiment, the shape is an octagon, in which four long sides and four short sides alternate with each other. Holder 305 then has a side surface 345 (extending between resting surface 310 and imaging surface 315), in which four large faces and four small faces (corresponding to the long sides and short sides, respectively) alternate with each other. Seat 320 includes corresponding blind holes extending inward from side surface 345 (more specifically, from its small faces). Window 330 includes corresponding through-holes extending from imaging surface 315 to seat 320. Therefore, by placing the illumination center of the imaging head at the center point of holder 305 to define its optical axis (not shown in this figure), all containers 325 can be illuminated equally through window 330 (symmetrical thereto).
[0041] Window 330 opens in a portion of imaging surface 315 that is tilted relative to rest surface 310. For example, the portion of imaging surface 315 surrounding window 330 is oriented to move inward (downward) toward the center point of holder 305 so as to form an angle of 5-15 degrees (e.g., 10 degrees) with rest surface 310. This reduces reflections from imaging surface 315 (at least near window 330) when test device 110 is illuminated from above.
[0042] Window 330 has a corresponding chamfered edge at imaging surface 315. For example, the edge is chamfered to form an angle of 40-50° (such as 45°) with imaging surface 315. This reduces any shadowing of window 330 when testing device 110 is illuminated from above.
[0043] The test device 110 includes a test light source 350 at the imaging surface 315 that generates the same type of test light as the fluorescent light emitted by one or more fluorescent agents when illuminated by excitation light (i.e., near-infrared type). For example, the test light source 350 is based on an LED frame surrounding the marking 335; the test light source 350 is powered by a replaceable or non-replaceable battery enclosed in the holder 305 and is turned on and off by actuating a switch (not visible in this figure). The test light source 350 can be used to test the acquisition unit of the imaging device alone (with its illumination unit turned off).
[0044] In the fixed configuration of the test device 110, the holder 305 has a corresponding seat indicator 355 (e.g., formed by a corresponding label sewn thereon) on the imaging surface 315 that is human-readable (e.g., in text form). The seat indicator 355 is arranged corresponding to the seat 320 and provides a specification of the type of container 325 to be accommodated therein. In particular, the seat indicator 355 is color-coded; for example, the seat indicator 355 includes a color designation corresponding to the type of container 325 (such as white, yellow, blue, and green for increasing concentrations of the same fluorescent agent). The seat indicator 355 facilitates inserting the correct type of container 325 into the seat 320 (particularly when the test device 110 is assembled in the field).
[0045] In any (free / fixed) configuration of the test device 110, the container 325 has a corresponding container indicator that is human-readable (e.g., color). The container indicator is arranged on the portion of the container 325 that protrudes from the seat 320 when the container 325 is inserted therein (so as to remain visible) and provides an indication of their type. In particular, the container indicator is also color-coded. For example, the corresponding cover 360 of the container 325 is colored according to the type of container 320 mentioned above, i.e., white, yellow, blue and green, for increasing concentrations of fluorescent agent (in this case, it can also be discerned by people affected by red color blindness). The container indicators further facilitate the insertion of the correct type of container 325 into the corresponding seat 320; in addition, they allow verification at any time whether the test device 110 has been correctly assembled.
[0046] Go to Figure 4 , Figure 4A cross-sectional view of the same test device 110 is shown; specifically, the cross-sectional view is taken in a (vertical) plane of symmetry perpendicular to the resting surface 310 of two opposing seats 320 (one of which has a container 325 on its exterior and the other on its interior). Seats 320 are tilted relative to resting surface 310 (i.e., their longitudinal axes are not parallel to resting surface 310). Due to the tilt of seats 320, containers 325 housed therein are also tilted relative to resting surface 315. Therefore, when test device 110 rests on support surface 175 (which is generally horizontal), containers 325 are not horizontal. Furthermore, each window 330 is spaced from the distal end (top end) of the corresponding seat 320, which is further from the resting surface 310 than its proximal end (bottom end). Consequently, any impurities that may be present in containers 325 (such as bubbles and small floating particles) naturally flow upward and accumulate there, away from the corresponding window 330. This ensures that the portion of container 325 imaged through window 330 is substantially free of impurities. Furthermore, container 325 may not be completely full; in this case, the remaining air in container 325 flows upward and accumulates there, away from the corresponding window 330. This ensures that the portion of container 325 imaged through window 330 is substantially full of phosphor. All of the above significantly improves the quality of imaging of container 325, which is reflected in improved accuracy of any test of the imaging device performed using test equipment 110.
[0047] In particular, the longitudinal axis of the seat 320 forms an inclination angle α of 5°-30°, preferably 7°-20° and even more preferably 9°-15°, such as 10°, with the support surface 175. These values of the inclination angle α provide a rapid upward flow of impurities and air (e.g., thereby allowing the use of a container 325 even when it is only 70%-90% filled); at the same time, they do not adversely affect the imaging of the container 325.
[0048] The windows 330 (i.e., their upper boundaries) are located 10%-50% away from the distal end of the corresponding seat 320, preferably 20%-40%, more preferably 25%-35%, such as 30% of the length (along their longitudinal axis) of the seat 320. These distance values ensure that any impurities and / or air in the container 325 will not be imaged through the windows 330 in most practical cases.
[0049] Each seat 320 has an outer portion 405 and an inner portion 410. The outer portion 405 has a constant cross-section (e.g., a cylindrical shape) and the inner portion 410 has a cross-section that decreases as one moves toward the interior of the holder 305 (e.g., a frustoconical shape). A corresponding window 330 exposes at least a portion of the outer portion 405 of the seat 320. The container 325 housed in the seat 320 has a matching shape. For example, the container 325 is a 1.5 ml commercially available vial. Each vial includes a (transparent) elongated bottle 415 (e.g., made of plastic material) containing a liquid containing a fluorescent agent, which is closed by a (e.g., screw-on) cap 360. Thus, the bottle 415 has a top portion 420 (proximal to its opening) having a constant cross-section (e.g., a cylindrical shape) and a bottom portion 425 (away from the opening) having a cross-section that decreases as one moves away from the opening (e.g., a frustoconical shape). Thus, the windows 330 expose at least a portion of the top portions 420 of the containers 325 (particularly their lowest portions). In this way, the containers 325 are imaged where they are substantially flat.
[0050] One or more magnetic elements 430 (two in this embodiment) are embedded in the holder 305, adjacent to the resting surface 310. When the support surface 175 is a ferromagnetic material (such as iron), the magnetic elements 430 create an attractive force that holds the test device 110 (resting thereon) in place.
[0051] Now refer to Figure 5 , showing details of the imaging device 105 according to an embodiment of the present disclosure.
[0052] The imaging apparatus 105 has a holding platform 505 for holding the test device 110 in a fixed (imaging) position on the support surface 175; the test device 110 is removably held in the imaging position. For example, the holding platform 505 is formed by a recess that matches the footprint of the test device 110 (defined by its resting surface, not visible in this figure), and may have four additional transverse hollows to avoid any interference with the portion of the container 325 protruding from the holder 305; in this way, the test device 110 can be inserted into the holding platform 505 by dropping it into the recess. The depth of the recess is lower than the height of the holder 305; in this way, the test device 110 can be removed from the holding platform 505 by grasping it and lifting it from the recess.
[0053] Furthermore, the imaging device 105 has a (further) holding platform 510 for holding the imaging head 165 in the (acquisition) position; the imaging head 165 is also removably held in the acquisition position. For example, the holding platform 510 is formed by a ring that fits over the body of the imaging head 165 (excluding its handle 170); this ring is integral with a cantilever 515 that is fixed to the support 125 of the test device 110. In this manner, the imaging head 165 can be inserted into the holding platform 510 by sliding it from above into the ring until the handle 170 rests against it; furthermore, the imaging head 165 can be removed from the holding platform 510 by lifting it until it is free of the ring.
[0054] Alternatively (not shown in this figure), the holding table 505 and the holding table 510 can be combined into a single structure for holding the test device 110 in the imaging position and the imaging head 165 in the acquisition position. For example, this result can be achieved by a cylinder that is closed at the bottom by a base having a groove for inserting the test device 110 and is open at the top for sliding the imaging head 165 as described above.
[0055] When the test device 110 is in the imaging position (defined by the holding stage 505) and the imaging head 165 is in the acquisition position (defined by the holding stage 510), the test device 110 falls within the field of view of the imaging head 165. In particular, the center point of the holder 305 is on the optical axis of the imaging head 165. This provides controlled and repeatable illumination of the test device 110.
[0056] Now refer to Figure 6 , shows the main software components that can be used to implement the solution according to an embodiment of the present disclosure.
[0057] All software components (programs and data) are denoted as a whole by reference numeral 600. Software components 600 are typically stored in a mass storage device and are (at least partially) loaded into the working memory of the control unit of the imaging device when the program is run, together with other software components not directly related to the solution according to the present disclosure (such as an operating system, a medical application, etc.), which are omitted for simplicity. The program is initially installed into the mass storage device, for example, from a removable storage unit or from a communication network (not shown in this figure). In this regard, each program can be a module, a segment, or a portion of code, which includes one or more executable instructions for implementing a specified logical function.
[0058] In particular, corresponding drivers, generally designated by reference numeral 605, are used to drive the peripheral devices of the imaging apparatus, including its excitation light source, white light source, fluorescence camera, still camera, keyboard, pointing device, primary / secondary monitors, and network interface card. An imaging manager 610 manages the imaging process of any body part. The imaging manager 610 interfaces with the drivers 605. The imaging manager 610 accesses (in read / write mode) an imaging repository 615, which stores sequences of fluorescence images and still images acquired during the ongoing imaging process.
[0059] In the solution according to the embodiments of the disclosure, the test manager 620 manages any test of the imaging device. The test manager 620 also interfaces with the driver 605. The test manager 620 accesses (in read / write mode) the image repository 625, the configuration repository 630 and the log repository 635. The image repository 625 stores one or more fluorescent images and photo images acquired during the ongoing test of the imaging device. The configuration repository 630 stores configuration information for the test of the imaging device. For example, the configuration information includes the network address (such as a domain name) of a remote service provider (e.g. a server of the imaging device manufacturer), the descriptors of the test equipment and the descriptors of the containers. The descriptor of the test equipment is indicated by a corresponding equipment identifier. The descriptor of the test equipment defines its configuration, i.e. free or fixed. The descriptor of the test equipment defines its geometry; for example, the geometry of the test equipment is defined according to the shape of its holder and the positions of the windows, the markers, the seat indicators and the cover relative to the holder (e.g. their real-world coordinates in a reference system integral to them). The descriptor of the test equipment defines the specifications of the containers of the markers, the seat indicators and the container indicators; for example, for each possible container type, the container identifier for the marker, the color name for the corresponding seat indicator and the color definition for the corresponding container indicator are provided (the latter according to the nominal values of one or more statistical parameters related to it, such as the average values of the color components like the RGB components). The descriptor of the test equipment defines one or more usage rules of it (e.g. maximum amount of usage of the test duration, maximum elapsed time from the production date, etc.). The descriptor of the test equipment defines one or more characteristics of each test light produced by its test light source (e.g. the wavelength and the nominal values of one or more statistical parameters related to it, such as the average fluorescent intensity or MFI). The descriptor of the containers defines each possible type of them; for example, each type of container (identified by its container identifier) is defined by the properties and / or the concentration of the corresponding fluorescent agent and by the fluorescent specifications of the fluorescence emitted by it (about the wavelength and the nominal values of one or more statistical parameters related to it, such as the average fluorescent intensity). The log repository 635 stores information about the tests that have been performed by the imaging device 105. For example, the log repository 635 has a record (e.g. identified by its timestamp) for each test; the record includes the duration of the test, the indication of the test result and a change flag (asserted when the test is performed with a new test equipment and / or with new containers). The test manager 620 makes use of the object recognition engine 640, which is used to find the location of the test equipment in its photo / fluorescent images. The object recognition engine 640 accesses (in read mode) the configuration repository 630 and it accesses (in write mode) the transformation repository 645, which is also accessed by the test manager 620 (in read mode).Transformation repository 645 stores definitions (eg, in the form of a transformation matrix) of transformations between real-world coordinates of the test device and corresponding image coordinates in the fluorescence / photographic image.
[0060] Now refer to Figures 7A-7C , shows an activity diagram describing the flow of activities related to the implementation of a solution according to an embodiment of the present disclosure.
[0061] In particular, the activity diagram represents an exemplary process that may be used to test an imaging device using the method 700. In this regard, each block may correspond to one or more executable instructions for implementing a specified logical function on a control unit of the imaging device.
[0062] This process is performed whenever the imaging device must be tested. For example, this can occur before any imaging process, after installation or any maintenance of the imaging device, upon request, periodically, etc., in response to a corresponding request, or automatically (as described below).
[0063] In this case, the operator places the test device on a support surface and positions the imaging head above it (e.g., by inserting the test device and imaging head into a corresponding holding station, if one is available). The operator then enters a test command using a keyboard or pointing device; the test command may also specify the type of test, selecting between testing a single location or testing the entire imaging head field of view (e.g., the first is the default). Also, when a change occurs to the container or the entire test device, the operator may select a corresponding command, along with its device identifier in the case of a change to the entire test device. In any case, at block 702, the test manager receives the test command via the corresponding driver.
[0064] In response, the process proceeds to block 704, where the test manager initializes a temporary record of the test with its timestamp (set to the current time from an internal clock), start time (set to the same current time), and change flag (asserted if the container or test device has changed, deasserted otherwise). Furthermore, if the test device has changed, the test manager downloads an indication of the (free / fixed) configuration of the test device from the service provider (from its network address retrieved from the configuration repository) based on the device identifier, and then updates the descriptor of the test device in the configuration repository accordingly. At block 706, the test manager turns on the white light source and the excitation light source, and commands the photographic camera and the fluorescence camera to acquire a photographic image and a fluorescence image, respectively, of the same field of view (via corresponding drivers), after which the test manager turns off the white light source and the excitation light source. The photographic image is defined by a bitmap, comprising a matrix of cells (e.g., having 512 rows and 512 columns), each cell storing the value of a pixel, i.e., a basic picture element corresponding to a location in the field of view, the pixel value representing the visible light reflected by that location (e.g., its RGB components). The fluorescence image is defined by a bitmap comprising a matrix of cells (of the same or different dimensions relative to the photographic image), each cell storing a pixel value representing the fluorescence emitted by the corresponding location in the field of view (e.g., its intensity). At block 708, the object recognition engine searches the photographic image for the test device, i.e., its representation within the corresponding region of interest (ROI), based on the known geometry of the test device (as defined by its descriptor in the configuration repository) by utilizing image processing techniques known per se. At block 710, the test manager verifies whether the test device has been found. In particular, the image recognition engine may simply search for the holder of the test device (based on its shape). Additionally or alternatively, the image recognition engine searches for the markers (based on their specifications) and verifies that they are correct (i.e., in the correct number and format). The markers make the detection of the test device more accurate (relative to the use of a holder), especially when there are multiple markers (e.g., five markers in the example discussed). If the test device is not found (i.e., no holder and / or not properly labeled), the process returns to block 706 to continuously repeat the same operations until a predetermined timeout, after which the process returns to block 702 (not shown in this figure) where the test manager displays an error message on the primary monitor (via a corresponding driver).
[0065] The same operations can also be performed to automatically initiate testing in response to the appearance of a test device within the imaging head's field of view. To this end, during the imaging device's non-operating conditions (i.e., when no imaging process is in progress), the test manager monitors the field of view by continuously executing a corresponding loop. The loop begins at block 712, where the test manager turns on the white light source and the excitation light source. It then commands the photo camera and the fluorescence camera to acquire a photographic image and a fluorescence image, respectively, of the same field of view (via corresponding drivers). The test manager then turns off the white light source and the excitation light source. At block 714, the object recognition engine searches for the test device within the photographic image. At block 716, the test manager verifies whether the test device has been found. If the test device has not been found, the process returns to block 712 to repeat the same operations periodically (e.g., every 5-10 seconds). Conversely, if the test device has been found, the process proceeds to block 718. At this point, the test manager initializes a temporary record with its timestamp and start time, sets the test type to single location, and deasserts the change flag. This allows testing to be initiated by simply presenting the test device into the field of view of the imaging head, without requiring any additional intervention by an operator.
[0066] In any case, the process continues from block 710 (once the test device is found) or from block 718 to block 720. At this point, the test manager determines the current position of the test device relative to the imaging head based on its representation in the photographic image (using image processing techniques known per se); for example, the current position is defined by the location of the test device's center point in an imaging plane perpendicular to the imaging head's optical axis, the test device's distance from the imaging head, and the test device's rotation angle relative to the imaging plane. This operation is fully automatic, fast, and accurate. At block 722, the test manager verifies whether the current position matches the target position (e.g., defined by the test device's center point being on the imaging head's optical axis, the test device being at a distance from the imaging head, and being parallel to its imaging plane). For example, the test manager calculates the corresponding displacement between the current position and the target position, as defined by translational and rotational components, and compares them to corresponding predetermined thresholds (e.g., 0.1-1 cm and 1-5°). If one or more translation / rotation components exceed corresponding thresholds (meaning that the current position does not match the target position), then at block 724, the test manager displays a corresponding message on the primary monitor (via the corresponding driver). The message indicates the movement (given by the displacement) required for the test device and / or imaging head to reach the target position; for example, if the center point of the test device is not on the optical axis of the imaging head, the operator is required to translate it, while if the distance / angle of the test device relative to the imaging head is incorrect, the operator is required to translate / rotate the imaging head. The process then returns to block 706 to repeat the same operations. In this way, very useful feedback is provided to the operator, allowing the test device and / or imaging head to be placed in the correct relative position even when no holding table is available.
[0067] Referring back to block 722, if none of the translation / rotation components exceeds the corresponding threshold value (meaning that the current position matches the target position), then the process proceeds to block 726; in particular, this is always true when the test device and imaging head are inserted into the corresponding holding station. At this point, the test manager extracts the device identifier from the markings in the photo image. At block 728, the test manager retrieves usage information for the test device from the log repository (e.g., the duration of tests that have been performed since the last change of the test device or its container). Additionally or alternatively, the test manager downloads (further) usage information for the test device from the service provider (from its network address retrieved from the configuration repository) based on the device identifier of the test device (assuming it matches the identifier stored in the configuration repository); for example, this usage information may include an authenticity indicator of the test device and its production date. At block 730, the test manager validates the (retrieved and / or downloaded) usage information against the usage rules (retrieved from the configuration repository); for example, the test manager compares the duration of the test (since the last change to the test device or its container) and / or the time elapsed since the manufacturing date to the corresponding maximum allowed values. The test monitor then enables the test based on the results of this validation. If any usage rules are not met (always true when the device identifier does not match the identifier stored in the configuration repository), the test manager aborts the test at block 732 and displays a corresponding error message on the primary monitor (via the corresponding driver); the process then returns to block 702 to await the next test command. Alternatively, as indicated by the dashed line in the figure, the test manager only displays a corresponding warning message on the primary monitor (via the corresponding driver) but still allows the test by continuing to block 734. If all usage rules are met, the same point is also reached directly from block 730.
[0068] At this point, the test manager generates a transformation matrix (between the real-world coordinates of the test device and its image coordinates in the fluorescence / photographic image); for example, the transformation matrix is calculated by minimizing the mapping error (such as the mean square of their differences) between the real-world coordinates of the markers in the test device (retrieved from the configuration repository) and the image coordinates of the markers in the photographic image. This operation can be based on a single marker with an asymmetric reading (providing the location and orientation of the test device according to its specifications); however, using multiple markers (such as five markers in the example discussed) will further improve accuracy. At box 736, the test manager further determines the seat indicator and cover in the photographic image and the window in the fluorescence image (i.e., their representation in the corresponding ROI) based on their image coordinates, where the image coordinates are calculated by applying the transformation matrix to the corresponding real-world coordinates (retrieved from the configuration repository).
[0069] Automatic detection of the position of the test device in the photographic image and automatic determination of the window representation in the luminescence image accordingly avoid any human intervention in selecting the desired region of interest. This speeds up the test and makes it less prone to error, with a beneficial effect on its cost and quality.
[0070] The test manager now verifies the container placed in the seat. To do this, at block 738, the test manager calculates the same statistical parameters as the color definitions of the container indicators in the configuration repository for the pixel values representing each lid in the photo image—that is, the average values of their RGB components in the example in question. Depending on the configuration of the test device (retrieved from the configuration repository), the flow of activity branches at block 740. If the test device has a free configuration, then at block 742, the test manager estimates the type of container placed in the seat. For example, the test manager calculates the distance between the color of the lid in the photo image and the color definitions of each arrangement of four types of containers from all possible containers defined in the configuration repository (e.g., equal to the mean squared difference between the average values of the RGB components of each lid and the corresponding nominal values of the color definitions of the corresponding type of container); the test manager selects the arrangement that provides the smallest distance. Referring back to block 740, if the test device has a fixed configuration, then at block 744, the test manager extracts the container identifier (indicating the type of container to be placed in the seat) from the markings in the photo image. At this stage, the test manager can also read the color name from the seat indicator in the photo image (indicating the same expected type of container that should be arranged on the seat). The test manager verifies whether each pair of corresponding color name and container identifier refers to the same type of container (as indicated in the configuration repository). If not, the process returns to box 702 (not shown in this figure), where the test manager displays an error message on the main monitor (via the corresponding driver). In this way, it can be ensured that the test equipment (in the fixed configuration) has been assembled correctly. The activity flow then merges from box 742 or box 744 at box 746; at this point, a loop is entered in which the test manager takes the (current) seat into account (starting with the first one in any order). At box 748, the test manager verifies whether the container arranged in the seat is of the expected type (i.e., the container estimated in the free configuration or the container read in the fixed configuration). To this end, the test manager verifies whether the color of the lid matches the color definition of the expected container type (retrieved from the configuration repository); for example, the test manager calculates the difference between the average value of each RGB component of the lid and the corresponding nominal value of the color definition and compares them to a predetermined threshold (e.g., 1-5% relative to the color definition). If one or more of the differences exceeds the threshold (meaning that the container is not the expected type), the test manager aborts the test at block 750 and displays a corresponding error message on the primary monitor (via the corresponding driver); the process then returns to block 702 to await the next test command. Conversely, if no difference exceeds the threshold (meaning that the container is the expected type), the test manager verifies at block 752 whether the last seat has been processed. If not, the process returns to block 746 to repeat the same operation for the next seat.Conversely, once all seats have been processed (determined to have all expected types of containers disposed therein), the loop is exited by descending to block 754 .
[0071] At this point, the test manager verifies the windows in the fluorescence image. To do this, the test manager calculates the same statistical parameter as the fluorescence specification for the corresponding type of container in the configuration repository, i.e., the mean fluorescence intensity in the example in question, for the pixel values representing each window in the fluorescence image. In addition, the test manager calculates the same statistical parameter (i.e., mean fluorescence intensity) for the pixel values representing the background area that is different from the window in the photographic image (e.g., coinciding with the center marker). A loop is then entered at block 756, in which the test manager takes the (current) window into account (starting with the first one in any order). At block 758, the test manager verifies whether the window matches the fluorescence specification for the type of container arranged in the seat (retrieved from the configuration repository); for example, the test manager calculates the difference between the mean fluorescence intensity of the window and the corresponding nominal value for the container type and compares it to a predetermined threshold (e.g., 1-5% relative to the fluorescence specification). Additionally or alternatively, the test manager calculates the ratio between the mean fluorescence intensity of the (current) window and the mean fluorescence intensity of each other window and the background area; the test manager further calculates the ratios between corresponding nominal values (retrieving the container types of the other windows from the configuration repository and setting the background area to almost zero). The test manager then calculates the difference between each pair of ratios and compares it to a predetermined threshold (e.g., 1-5% of the ratio relative to the nominal value). In any case, the test manager adds the results of these verifications to the temporary record of the test. At block 760, the test manager verifies whether the last window has been processed. If not, the process returns to block 756 to repeat the same operations for the next window. Conversely, once all windows have been processed, the loop is exited by descending to block 762.
[0072] At this point, the test manager verifies the alignment between the photographic image and the fluorescence image. To do this, the object recognition engine searches for the markers in the fluorescence image (as above) (i.e., their representations in the corresponding ROIs). At block 764, the test manager verifies whether the markers in the photographic image match the corresponding markers in the fluorescence image; for example, the test manager calculates the distance between each marker in the photographic image and the fluorescence image, defined by the average of the corresponding translation components, and compares it to a predetermined threshold (such as 1-5% of the maximum range of the marker in the photographic image). The test manager adds the results of this verification to the temporary record of the test.
[0073] At block 766, the test manager may perform additional validation of the imaging device (based on the photographic image). For example, the test manager determines the contrast of the acquisition unit based on the difference between the brightest and darkest pixel values of the marker in the photographic image. In the case where the marker is tilted relative to the rows / columns of the photographic image (at an angle known to the geometry of the test device retrieved from the configuration repository), the test device determines the depth of field of the acquisition unit by applying the bevel edge method. The test device may have a spatial resolution target (such as a 1951 USAF, IEEE, or ISO one) on its imaging surface, which is further specified in the configuration repository; in this case, the object recognition engine searches the photographic image for the spatial resolution target (i.e., its representation in the corresponding ROI), and the test manager determines the spatial resolution of the acquisition unit based on this. The test device may have a color test target (different from or in combination with the spatial resolution target) on its imaging surface, which is further specified in the configuration repository; in this case, the object recognition engine searches the photographic image for the color test target (i.e., its representation in the corresponding ROI), and the test manager determines the color resolution of the acquisition unit based on this. The test device may have a reflectance standard on its imaging surface (different from or in combination with the spatial resolution target and / or color target), which is further specified in the configuration repository. In this case, the object recognition engine searches the photographic image for the reflectance standard (i.e., its representation in the corresponding ROI). The test manager determines the ambient light as the difference between the white light generated by the white light source (as further defined in the configuration repository according to one or more statistical parameters associated with it (such as its average intensity)) and the corresponding reflected light received from the reflectance standard (as defined by the same statistical parameter representing its pixel values in the photographic image (i.e., average intensity in the example in question)). The test manager then compares the ambient light (defined by the statistical parameter value of the reflected light minus the corresponding statistical parameter value of the white light) with a predetermined threshold value (e.g., 1-5% of the statistical parameter value of the white light). Additionally or alternatively, the same operation can also be performed by determining the ambient light as the difference between the excitation light generated by the excitation light source (as further defined in the configuration repository according to one or more statistical parameters associated therewith, such as its average intensity) and the corresponding (further) reflected light received from the reflectance standard (as defined by the same statistical parameters representing its pixel values in the fluorescence image (i.e., average intensity in the example in question)). This allows verification that the ambient conditions are suitable for correct operation of the imaging device. In any case, the test manager adds the results of these verifications to the temporary record of the test.
[0074] At block 768, the test manager displays a message (via the corresponding driver) on the main monitor, asking the operator to turn on the test light source (via the corresponding switch of the test equipment). Once the test light source has been turned on, the process continues to block 770. This can occur, for example, in response to a corresponding command entered by the operator using the keyboard or pointing device (received by the test manager via the corresponding driver). Alternatively, this can occur automatically by the test manager monitoring the field of view in a corresponding loop executed continuously (e.g., every 1-2 seconds). In particular, to this end, the test manager commands the fluorescence camera to acquire a fluorescence image of its field of view with the excitation light source turned off (via the corresponding driver), and then computes the average intensity of the fluorescence image; these operations are repeated until the average intensity exceeds a threshold, such as 2-3 times the intensity corresponding to typical ambient fluorescence.
[0075] In both cases, the test manager now commands the fluorescence camera (via the corresponding driver) to acquire a (further) fluorescence image of its field of view, with the white light source and the excitation light source turned off. The test manager verifies the acquisition unit of the imaging device in isolation, from the characteristics of the test light (retrieved from the configuration repository); for example, the test manager computes the difference between the average fluorescence intensity of the fluorescence image and its nominal value, and then compares this difference to a predetermined threshold (such as 5-10% with respect to the nominal value). The test manager adds the result of this verification to the provisional record of the test. At block 772, the test manager verifies the illumination unit of the imaging device in isolation, from the above-described verification of the imaging device (as a whole) and its acquisition unit (in isolation). For example, the test manager adjusts the statistical parameters (average fluorescence intensity) computed above for representing the pixel values in each window of the previous fluorescence image (step 754), from the difference between the same average fluorescence intensity of the (current) fluorescence image and its nominal value (to eliminate any mismatch of the acquisition unit); the test manager then verifies again whether each window matches the fluorescence emitted by the container arranged in the corresponding seat as above (steps 756-760). The test manager adds the result of this verification to the provisional record of the test.
[0076] Depending on the test type (as indicated in the temporary log), the flow of activity branches at block 774. If the test must be performed across the entire field of view of the imaging head, then at block 776 the test manager verifies that it has been completed (i.e., the imaging device has been tested in all of a set of predetermined positions across the entire field of view, such as in a matrix spaced 1-5 cm apart in each direction). If not, then at block 778 the test manager determines the movement of the test device (based on the spacing) to reach another (new) position within the entire field of view; the test manager then displays a corresponding message on the primary monitor (via a corresponding driver). Once the test device has been moved to the new position, the process returns to block 706 to repeat the same test of the imaging device at its new position. This can occur, for example, in response to a corresponding command entered by an operator using a keyboard or pointing device (received by the test manager via a corresponding driver). Alternatively, this can occur automatically by monitoring the field of view in a corresponding loop that is executed continuously (e.g., every 1-2 seconds). Specifically, to do this, the test manager turns on the white light, instructs the camera to acquire a photo image of its field of view, then turns off the white light source (via a corresponding driver), the object recognition engine searches for the test device in the photo image, and the test manager verifies whether the test device has been found and, if so, whether the current position of the test device matches the new position (as above); these operations are repeated until the test device is found in the new position. Once the test has been completed (in all positions throughout the field of view), the process then proceeds from block 776 to block 780, or directly from block 774 to block 780 if the test must be performed at a single position. In any case, the test manager now determines the duration of the test, from its start time (according to the temporary record) to the current time (according to the internal clock); the test manager adds the duration of the test to the temporary record.
[0077] At box 782, the test manager saves the test result defined in the temporary record by adding it to the log repository. At box 784, the test manager transmits the test result to the service provider (transmitted to its network address retrieved from the configuration repository). This allows the implementation of a telemetry application for remote tracking of the operation of the imaging device. At box 786, the test manager displays the test result on the main monitor (via the corresponding driver). The operator can then react accordingly. For example, if the test result indicates that the performance of the imaging device is good, the corresponding imaging process can be executed (with high confidence in the information provided by the imaging device). On the contrary, the imaging process is suspended (because the information provided by the imaging device may be misleading) and the operator can request intervention from the support center of the imaging device manufacturer. The process then returns to box 702 to wait for the next test command.
[0078] All the above allows to verify the performance of the imaging device in a highly accurate and reproducible manner. In this way, any degradation of the performance of the imaging device (e.g. caused by a broken light source, dirty transport / collection optics, mechanical wear, parasitic light, etc.) can be detected, even if these degradations are not noticed by the operator.
[0079] Revise
[0080] Naturally, in order to satisfy local and specific requirements, a person skilled in the art can apply many logical and / or physical modifications and alterations to the present disclosure. More specifically, although the present disclosure has been described with a certain degree of particularity with reference to one or more embodiments thereof, it should be understood that various omissions and substitutions and changes in the form and details of the methods and embodiments illustrated, can be made by those skilled in the art, without departing from the spirit of the disclosure. In particular, different embodiments of the disclosure can even be practiced without the specific details (such as values) set forth in the preceding description, to provide a more thorough understanding thereof; on the contrary, well-known features can have been omitted or simplified in order not to obscure the description with unnecessary particulars. Furthermore, it is expressly intended that specific elements and / or method steps described in connection with any disclosed embodiment of the present disclosure can be incorporated in any other embodiment as a general matter of design choice. Furthermore, items presented in the same group or similar groups should not be interpreted as factually equivalent (on the contrary, they are separate and autonomous entities); in any case, each numerical value should be modified according to the applicable tolerances; in particular, the terms "substantially", "about", "approximately" and the like should be understood within 5-10%; moreover, each numerical range should be intended to explicitly specify any possible number along the continuum of the range (including its endpoints). Ordinal or other qualifiers are used merely as labels to distinguish elements having the same name but they do not in themselves connote any priority, precedence, or order. The terms "comprising", "including", "having", "containing", "involving", and the like, shall be intended to be open-ended, non- exhaustive in meaning (i.e., not limited to the elements listed); the terms "based on", "dependent on", "in accordance with", "function of", and the like, shall be intended as non-exclusive relationships (i.e., involving just possible other variables); the term "one" shall be intended as one or more items (unless explicitly indicated otherwise); and the term "means for" (or any part thereof) shall be intended as any structure adapted to perform the relevant function, regardless of its structure.
[0081] For example, an embodiment provides a method for testing a luminescence imaging device. However, the luminescence imaging device can be of any type (see below) and can be tested at any time for any purpose (e.g., for calibration after installation / maintenance, for verification before each use, for monitoring / comparison over time, etc.); furthermore, the method can be invoked in any manner (e.g., in response to any start command input via any input unit of the fluorescence imaging device (such as its keyboard, any pointing device, dedicated buttons, etc.), automatically, in any case with or without the possibility of inputting information (such as a change in test type or test device), etc.).
[0082] In an embodiment, the method is performed using a test device placed within the field of view of an imaging head of a light emitting imaging device. However, the test device can be of any type (e.g., with or without any position markings); furthermore, the imaging head can be of any type (see below) and can be placed within its field of view in any manner (e.g., by utilizing a corresponding holding station, freely, by moving the test device and / or imaging head, etc.).
[0083] In an embodiment, the test device has an imaging surface for imaging the test device. However, the imaging surface may be of any type (see below).
[0084] In an embodiment, the imaging surface is provided with one or more sites, each site comprising at least one luminescent substance. However, the sites may be of any number and of any type (see below).
[0085] In an embodiment, the method comprises the following steps under the control of a control unit of the luminescence imaging device. However, the control unit may be of any type (see below).
[0086] In an embodiment, the method includes acquiring (using a camera of the imaging head) a photographic image of the field of view representing reflected light reflected by the field of view. However, the photographic image can be of any type (e.g., of any size, in color or black and white, in 2D or 3D, with any pixel / voxel values, such as RGB components, luminance components, etc.) and can be acquired using any camera (see below).
[0087] In an embodiment, the method includes retrieving a descriptor of the test device. However, the descriptor may be retrieved in any manner (eg, by reading locally, downloading remotely, etc.).
[0088] In an embodiment, the descriptor includes an indication of the geometry of the test device. However, the geometry of the test device may be defined in any manner by the shape of the test device alone (e.g., when the shape allows the position and orientation of the test device to be determined, such as without point symmetry, such as having a protrusion / groove at the first site defining its sequence), by position markings alone (e.g., any number, any type, and arrangement in any position that allows the position and orientation of the test device to be determined, as described below), by characteristic points of the test device (e.g., its corners), by any combination thereof (e.g., the shape of the test device for determining location and position markings for determining orientation), etc.
[0089] In an embodiment, the descriptor includes an indication of the location of the site in the test device. However, the location of the site in the test device may be indicated in any manner (eg, relative to a position marker, a holder, etc.).
[0090] In an embodiment, the method includes finding the position of the test device in the photographic image based on the geometry of the test device. However, the position of the test device may be found in any manner (e.g., by applying any object recognition technique, such as model-based, appearance-based, feature-based, etc., genetic algorithms, etc.).
[0091] In an embodiment, the method includes calculating the position of the site in the photographic image based on the position of the test device in the photographic image and the position of the site in the test device. However, the position of the site in the photographic image can be calculated in any manner (e.g., by determining and applying any transformation between real-world coordinates and image coordinates, such as affine or non-rigid type, defined by matrices, transformations, vectors, etc.).
[0092] In an embodiment, the method includes acquiring (using a luminescence camera of the imaging head) a luminescence image of the field of view. However, the luminescence image can be of any type (such as the same or different from the luminescence image in terms of size, color / black and white, 2D / 3D, pixel / voxel values, in a single color or in corresponding different colors for multiple fluorophores), and can be acquired simultaneously with or separately from the photographic image using any luminescence camera (see below).
[0093] In an embodiment, the fluorescence image represents luminescence light emitted by the luminescent substance of the site in response to excitation light provided by an excitation light source of the imaging head. However, the excitation light can be of any type and can be provided by any excitation light source (see below).
[0094] In an embodiment, the method includes determining a representation of the site in the luminescence image based on the location of the site in the photographic image. However, the representation of the site in the luminescence image can be determined in any manner based on the location of the site in the photographic image (e.g., directly, by correcting for possible misalignment between the two images, etc.).
[0095] In an embodiment, the method includes testing a luminescence imaging device based on representations of sites in a luminescence image. However, this operation can be performed in any manner (e.g., by comparing the representation of each site to a corresponding nominal value, to representations of one or more other sites, to a representation of a background area, any combination thereof, at a single location or across the entire field of view, etc.).
[0096] Further embodiments provide additional advantageous features, but these features may be omitted entirely from the basic embodiment.
[0097] In an embodiment, the method comprises retrieving a descriptor comprising a specification of a position marker. However, the position markers may be defined in any manner (eg, by their position, orientation, format, etc.).
[0098] In an embodiment, the method includes retrieving a descriptor including an indication of the location of the site relative to the location marker. However, the location of the site relative to the location marker may be indicated in any manner (e.g., by their displacement, coordinates of the location marker and the coordinates of the site in the test device, etc.).
[0099] In an embodiment, the method comprises finding the position of the position marker in the photographic image according to the specifications of the position marker. However, this operation may be performed in any other way (see above).
[0100] In an embodiment, the method comprises calculating the position of the location in the photographic image based on the position of the location marker in the photographic image and the position of the location relative to the location marker. However, this operation may be performed in any other way (see above).
[0101] In an embodiment, the method includes testing the luminescence imaging device based on a comparison of the representation of each site in the luminescence image with at least one nominal value. However, the nominal value can be any number and any type (e.g., any statistical parameter such as mean, variance, standard deviation, minimum / maximum value, median, etc.); the test can be performed accordingly in any manner (e.g., by comparing the difference of each statistical parameter to any threshold value individually or comparing the global difference to any threshold value, etc.).
[0102] In an embodiment, the method includes testing the luminescence imaging device based on a comparison of a representation of each site in the luminescence image with a representation of at least one other site in the luminescence image. However, the representations of the sites may be compared in any manner (e.g., based on any statistical parameter of the sites, by comparing any relationship (such as a ratio, difference, etc.) to any threshold, etc.).
[0103] In embodiments, the method comprises determining a representation of the background area in the luminescence image (distinct from the representation of the sites). However, the background area can be of any type (e.g. corresponding to any position marker or independent from it, etc.) and can be determined in any way (e.g. already given by the position marker when coinciding with one of them, from a descriptor comprising an indication of the position of the test device and of the position of the background area in the test device, by directly searching it, etc.).
[0104] In embodiments, the method comprises testing the luminescence imaging device according to a comparison of the representation of each site in the luminescence image with the representation of the background area in the luminescence image. However, this operation can be performed in any way (same or different relative to the comparison with the other sites).
[0105] In embodiments, the test device comprises one or more containers corresponding to the sites, each container being filled with a liquid containing a corresponding luminescent substance. However, the containers can be of any type and filled with any luminescent substance (see below).
[0106] In embodiments, the method comprises estimating the corresponding expected type of the containers according to a comparison of the representation of the sites in the luminescence image with a plurality of predetermined specifications of possible types of containers. However, the expected type of the containers can be estimated in any way (e.g. by selecting them together (as the closest combination) or separately (as the closest one) according to any criterion, etc.).
[0107] In embodiments, the test device has one or more optically machine-readable information markers at the imaging surface. However, the information markers can be of any number and of any type (see below).
[0108] In embodiments, the method comprises determining a representation of the information markers in the photograph image. However, the information markers can be determined in any way (e.g. already given by the position markers when coinciding with one of them, from a descriptor comprising an indication of the position of the test device and of the position of the information markers in the test device, by directly searching them, etc.).
[0109] In embodiments, the method comprises determining device information related to the test device according to the representation of the information markers. However, the device information can be of any type (see below) and can be determined in any way (e.g. directly extracted from the information markers, retrieved locally or remotely from them, etc.).
[0110] In embodiments, the method comprises testing the luminescence imaging device according to the device information. However, the device information can be used in any way (e.g. for determining the expected type of the containers, retrieving usage rules, retrieving usage information, etc.).
[0111] In an embodiment, the method includes determining the expected type of the container based on the device information. However, the type of the container can be determined in any manner (e.g., directly from the device information, retrieved locally or remotely, such as via a corresponding container identifier, etc.).
[0112] In an embodiment, the method includes testing the luminescence imaging device according to predetermined specifications for a container of an expected type. However, the specifications for the container type can be of any type (e.g., any number and type of nominal values of corresponding statistical parameters), and they can be retrieved in any manner (e.g., locally or remotely); furthermore, the testing can be performed accordingly in any manner (e.g., by comparing the difference of each statistical parameter individually to any threshold value or comparing the global difference to any threshold value, etc.).
[0113] In an embodiment, the method comprises determining a representation of a corresponding end of the container in the photographic image that protrudes from a corresponding seat of the test device. However, the ends may be of any type (see below) and they may be determined in any manner (e.g., based on the location of the test device and a descriptor including an indication of the location of the end in the test device, by searching for them directly, etc.).
[0114] In an embodiment, the method includes verifying the configuration of the test device based on a match between the representation of the end in the photographic image and a predetermined definition of a container of the expected type. However, the definition of the container type can be of any type (e.g., a color definition given by any number and type of statistical parameters, a color name, etc.), and can be retrieved in any manner (e.g., locally or remotely); verification of the configuration of the test device can be performed accordingly in any manner (e.g., by comparing the difference of each statistical parameter individually or globally to any threshold, by comparing names, with or without further verification of a seat indicator, etc.).
[0115] In an embodiment, the method comprises finding the position of the test device in the luminescence image.However, the position of the test device in the luminescence image may be found in any manner (same or different with respect to the photographic image).
[0116] In an embodiment, the method includes testing the luminescence imaging device based on an alignment between the photographic image and the luminescence image determined based on a position of the test device in the photographic image and a position of the test device in the luminescence image. However, this operation can be performed in any manner (e.g., by individually comparing the distance between each pair of corresponding markers, based on any global value of the distance between all pairs of corresponding markers, based on a distance between a retainer, etc. and any threshold, etc.).
[0117] In an embodiment, the method includes retrieving one or more usage rules for the test device. However, the usage rules can be of any number and type (e.g., maximum usage in terms of test duration or number of tests, reduction to a single unit when the test device is disposable, time elapsed from a manufacturing date, expiration date, etc.), and can be retrieved in any manner (e.g., by local reading, remote downloading, indiscriminately or based on a device identifier, etc.).
[0118] In an embodiment, the method includes enabling the test luminescent imaging device in accordance with usage rules. However, the test may be enabled in any manner in accordance with the usage rules (e.g., by validating the usage rules in any manner, such as requiring compliance with all or only some of the rules, by enabling the test in any manner based on the corresponding result, such as blocking it, simply alerting the operator, notifying the service provider, any combination thereof, etc.).
[0119] In an embodiment, the method includes retrieving usage information for one or more previous executions of the test luminescence imaging device. However, the usage information can be of any type (e.g., duration of test, number of tests, date of last test, etc.), and can be retrieved in any manner (e.g., locally or remotely, etc.).
[0120] In an embodiment, the method includes enabling the test luminescent imaging device based on the usage information. However, the test may be enabled in any manner based on the usage information (e.g., by validating it against any of the usage rules described above, using usage rules that may be predetermined locally or remotely, retrieving based on a device identifier, and enabling the test in any manner based on the corresponding results described above, etc.).
[0121] In an embodiment, the method includes saving usage information of the test luminescence imaging device. However, the usage information may be saved in any manner (eg, individually or incrementally, locally or remotely, etc.).
[0122] In an embodiment, the method includes retrieving usage rules and / or usage information based on the device information. However, the usage rules and usage information may be retrieved in any manner (e.g., directly extracted from the device information, determined locally or remotely therefrom, such as via a corresponding device identifier, etc.).
[0123] In an embodiment, the test device comprises a test light source located at the imaging surface for generating a test light corresponding to the luminous light. However, the test light source may be of any type (see below).
[0124] In an embodiment, the method comprises acquiring another luminescence image of the field of view (using a luminescence camera) while the excitation light source is turned off and the test light source is turned on. However, another luminescence image may be acquired at any time (before or after the luminescence image).
[0125] In an embodiment, the method includes testing an acquisition unit of an imaging head (for acquiring a luminescence image) based on another luminescence image and predetermined characteristics of a test luminescence source. However, the acquisition unit can be of any type (see below); the characteristics of the test luminescence source can be of any type (e.g., nominal values of any number and type of statistical parameters), and they can be retrieved in any manner (e.g., locally or remotely); furthermore, the test can be performed accordingly in any manner (e.g., by comparing the difference of each statistical parameter individually to any threshold value or comparing the global difference to any threshold value, etc.).
[0126] In an embodiment, the method includes testing an illumination unit (for generating excitation light) of an imaging head based on the results of said testing of the luminescence imaging device and the results of said testing of the acquisition unit. However, the illumination unit may be of any type (see below) and may be tested in any manner (e.g., by adjusting the representation of the site based on the testing of the acquisition unit and then repeating the testing of the entire luminescence imaging device, by extrapolating the testing of the acquisition unit based on a previous test of the entire luminescence imaging device, etc.).
[0127] In an embodiment, the method includes determining a displacement of the test device and / or imaging head from a target position based on the position of the test device in the photographic image. However, the displacement from a position of the test device defined in any manner (e.g., by a holder and / or position markers) to any target position thereof (e.g., local or remote retrieval, manual insertion, etc.) can be determined in any manner (e.g., for each coordinate or globally, etc.); furthermore, the displacement can be defined solely for the test device, solely for the imaging head, or for both.
[0128] In an embodiment, the method includes outputting an indication of movement of the test device and / or imaging head to a target location on an output unit of the luminescence imaging apparatus based on the displacement of the test device and / or imaging head. However, the movement can be of any type (e.g., translation and / or rotation of the test device alone, the imaging head alone, or both in a plane or space, etc.); furthermore, the indication of the movement can be output on any output unit (e.g., a monitor, a speaker, etc.) and in any manner (e.g., displayed, audible, etc.). This feature can be used for any purpose (e.g., properly positioning the test device, testing the fluorescence imaging apparatus across its entire field of view, etc.).
[0129] In an embodiment, the method includes outputting an indication of the result of testing the luminescence imaging device on an output unit of the luminescence imaging device. However, the result can be of any type (e.g., a simple pass / fail or more or less detailed information about each verification); furthermore, the result can be output in any manner (e.g., displayed, printed, etc.) to any output unit (e.g., a monitor, printer, etc.) and for any purpose (e.g., to initiate a corresponding imaging process, manually or automatically request maintenance of the luminescence imaging device, such as via a message, email, etc.).
[0130] In an embodiment, the method includes transmitting an indication of the result of testing the luminescence imaging device to a remote computing system via a telecommunications network. However, the result can be of any type (same or different than those described above), and it can be transmitted to any remote computing system via any network (e.g., the Internet, a LAN, etc.) in any manner (e.g., by uploading it, via email, etc.).
[0131] In an embodiment, the method includes repeating the following cycle under a non-operating condition of the luminescence imaging device. However, the cycle may be repeated at any frequency under any non-operating condition (e.g., when an operator inputs corresponding start and stop commands via any input unit indicating that no imaging process is in progress, in a standby state, etc.).
[0132] In an embodiment, the loop includes acquiring another photographic image of the field of view with a photographic camera. However, the other photographic image can be of any type (same as or different from the photographic image) and can be acquired in any manner (e.g., alone or together with a corresponding fluorescent image for testing after exiting the loop, etc.).
[0133] In an embodiment, the loop includes searching for a representation of the test device in another photo image based on its geometry. However, the test device may be searched for in any manner based on its descriptor (similar to or different from determining its location as described above).
[0134] In an embodiment, the loop is executed until a representation of the test device in another photo image has been found. However, the exit condition of the loop may be defined in any manner (e.g., based on a shape match of the test device, a match of a position marker, both, etc.).
[0135] In an embodiment, the method includes triggering the test luminescence imaging device in response to finding a representation of the test device in another photographic image. However, the test may be triggered in any manner (e.g., automatically or requiring manual confirmation, with or without prompting for operator input, etc.).
[0136] In general, similar considerations apply if equivalent methods are used to achieve the same solution (by using similar steps with the same functionality of more steps or parts thereof, removing some unnecessary steps or adding other optional steps); moreover, these steps may be performed in a different order, concurrently or (at least partially) in an interleaved manner.
[0137] Embodiments provide a computer program configured to cause a control unit of a luminescent imaging device to perform the above-described method when the computer program is executed on the control unit. Embodiments provide a computer program product comprising a computer-readable storage medium embodying the computer program, which can be loaded into the working memory of the control unit of the luminescent imaging device, thereby configuring the control unit to perform the same method. However, the software program can be implemented as a standalone module, as a plug-in to a pre-existing software program (e.g., an imaging manager), or even directly within the software program. In any case, similar considerations apply if the structure of the software program is different, or if additional modules or functionality are provided; similarly, the memory structure can be of other types, or can be replaced with equivalent entities (not necessarily consisting of physical storage media). The program can take any form suitable for use with any control unit (see below) to configure the control unit to perform the desired operation; in particular, the program can be in the form of external or resident software, firmware, or microcode (e.g., in object code or source code, to be compiled or interpreted). Furthermore, the program can be provided on any computer-readable storage medium. A storage medium is any tangible medium (other than the transient signal itself) that can retain and store instructions for use by the control unit. For example, the storage medium may be of electronic, magnetic, optical, electromagnetic, infrared or semiconductor type; examples of such storage media are fixed disks (in which the program may be preloaded), removable disks, memory keys (for example of USB type), and the like. The program may be downloaded to the control unit from the storage medium or via a network (for example, the Internet, a wide area network and / or a local area network including transmission cables, optical fibers, wireless connections, network devices); one or more network adapters in the control unit receive the program from the network and forward it to be stored in one or more storage devices of the control unit. In any case, the solution according to an embodiment of the present disclosure lends itself to being implemented in a hardware structure (for example, by electronic circuits integrated in one or more chips of semiconductor material), or in a combination of appropriately programmed or otherwise configured software and hardware.
[0138] The embodiments provide a test device for testing a luminescent imaging device. However, the test device can be of any shape (e.g., with or without point symmetry), size, and material (e.g., plastic, resin, metal, paper, etc.); furthermore, the test device can be used to test any luminescent imaging device for any purpose (see above).
[0139] In an embodiment, the test device has an imaging surface for imaging the test device. However, the imaging surface can be of any type (e.g., continuous or discontinuous, flat or non-flat, parallel or tilted relative to the resting surface, etc.).
[0140] In an embodiment, the imaging surface is provided with one or more sites, each site comprising at least one luminescent substance. However, the sites may be of any number and type. For example, the sites may be containers arranged on corresponding seats and exposed through their windows (see below); alternatively, the sites may be rigid / solid fluorescent samples or substrates (such as paper, fabric, or any other porous material in which the fluorescent substance is deposited (such as by printing) and which may be protected by a laminate / sealing layer) that are removably or non-removably arranged in corresponding seats or permanently embedded in a holder, etc. Each site may contain any number and type of luminescent substances (e.g., based on any luminescence phenomenon, such as fluorescence, phosphorescence, chemiluminescence, bioluminescence, induced Raman radiation, wherein the sites contain different concentrations of the same luminescent substance and / or have different luminescent substances, etc.).
[0141] In an embodiment, the test device includes one or more optically machine-readable position markings on the imaging surface (for determining the position of the test device). However, the position markings can be of any number, of any type (e.g., codes, logos, etc.) and arranged in any position (e.g., centrally, at sites, and / or at the periphery of the test device); the position markings can be used to determine the position of the test device in any manner (e.g., its location defined by one or more position markings, its orientation defined by multiple position markings, and / or the format of one or more position markings, any combination thereof, etc.).
[0142] Further embodiments provide additional advantageous features, but these features may be omitted entirely from the basic embodiment.
[0143] In an embodiment, the test device includes a resting surface opposite the imaging surface for resting the test device on a support surface. However, the resting surface can be of any type (e.g., continuous or discontinuous, flat, defined by protruding support elements such as feet, balls, etc., with grooves, etc.) and can be used to rest the test device on any support surface (part of the luminescent imaging device or separate from it, such as a table, shelf, etc.) in any manner (e.g., free, in a holding station, locked thereto, etc.).
[0144] In an embodiment, the test device includes one or more seats. However, the seats can be of any shape (e.g., having any cross-section, such as circular, square, etc., being constant, varying, or both), of any size, and in any position (e.g., open to the side, on the bottom, regularly or irregularly arranged, etc.).
[0145] In an embodiment, the test device includes one or more containers, each of which is filled with a liquid containing a corresponding luminescent substance. However, the container can be of any shape / size (the same as a portion of the base or simply compatible therewith), any material (e.g., plastic, glass, etc.), and any type (e.g., vial, tube, bottle, etc.); furthermore, the container can be filled with any liquid containing any amount of luminescent substance at any level.
[0146] In an embodiment, each container is housed in a corresponding seat. However, there may be any number of containers (the same or fewer than the number of seats), and they may be housed in the seats in any manner (e.g., removable, immovable, a combination thereof, etc.).
[0147] In an embodiment, the test device includes one or more windows corresponding to the seat (defining corresponding sites). However, the windows can be of any type (e.g., with or without chamfered edges), size, and shape (e.g., round, square, etc.).
[0148] In an embodiment, the window opens in the imaging surface. However, the window may open at any location (eg, in a central region of the seat, at an end thereof, along all seats, etc.).
[0149] In an embodiment, each window exposes a portion of a corresponding seat for imaging a corresponding portion of the luminescent material in the container housed therein, the corresponding portion being transparent to the excitation light of the luminescent material and the luminescent light emitted by the luminescent material when illuminated by the excitation light. However, the exposed portion of each seat can be of any degree (up to the entire seat). Any portion of the container can be transparent (to any degree) to any wavelength (e.g., including visible light) including the portion to be imaged through the window (up to the entire portion).
[0150] In an embodiment, the seats extend from corresponding first ends to corresponding second ends along corresponding longitudinal axes. However, the ends of each seat can be arranged at any position (e.g., at the center and the periphery of the test device, spaced apart from them, any combination thereof, etc.).
[0151] In an embodiment, each seat is tilted relative to the resting surface with the second end closer to the resting surface than the first end. However, the seat can be tilted in any manner (e.g., moved downward or upward into the test device) and at any angle.
[0152] In an embodiment, the corresponding windows are spaced apart from the first end of the seat. However, the windows may be located at any distance from the corresponding ends of the seat. In any case, the feature of the tilted seat with spaced apart windows may also be implemented independently in a test device without any position markings.
[0153] In an embodiment, the longitudinal axis of the seat forms an angle of 5°-30° with the resting surface. However, the possibility of the seat forming a different angle with the resting surface is not excluded.
[0154] In an embodiment, the distance between the corresponding window and the second end of the seat is 10%-50% of the length of the seat. However, the possibility of having the windows at different distances from these ends of the seat is not excluded.
[0155] In an embodiment, the test device has a side surface extending between the resting surface and the imaging surface. However, the side surface can be of any type (e.g., continuous or discontinuous, perpendicular to the resting surface, inclined inwardly / outwardly toward the test device, etc.).
[0156] In an embodiment, the seat comprises a corresponding blind hole extending inwardly from the side surface. However, the possibility of forming the seat in other ways (eg, by a through hole, a groove, etc.) is not excluded.
[0157] In an embodiment, each seat comprises a first portion having a constant cross-section. However, the first portion may be of any length and in any position (eg, inside or outside).
[0158] In an embodiment, each seat includes a second portion having a cross-section that decreases as it moves toward the interior of the test device. However, the second portion can be of any length and in any position (depending on the length and position of the first portion); furthermore, its cross-section can decrease in any manner (e.g., regularly or irregularly, at any rate until it becomes zero, etc.).
[0159] In an embodiment, the corresponding window exposes at least a portion of the first portion. However, the window may expose any portion (up to the entirety) of the first portion.
[0160] In embodiments, the window has a corresponding edge with a chamfer at the imaging surface. However, the chamfered edge can form any angle with the imaging surface.
[0161] In embodiments, the test device has point symmetry with respect to the center point. However, the test device can have any point-symmetric shape (e.g., octagonal, hexagonal, square, circular, etc.).
[0162] In embodiments, the position markers include a center position marker corresponding to the center point. However, the center position marker can be of any type (e.g., at the center of the test device, around it, etc.).
[0163] In embodiments, the position markers include one or more site position markers corresponding to the sites. However, the site position markers can be of any type (e.g., each site between a pair of corresponding site position markers, each site position marker close to a corresponding site, etc.).
[0164] In embodiments, the test device includes one or more optically machine-readable information markers at the imaging surface that encode device information related to the test device. However, the information markers can be of any number and any type (e.g., contained in the position markers and / or separate from them); the information markers can encode any device information (e.g., a device identifier of the test device, a container identifier for the seat, usage rules for the test device, a proof of authenticity of the test device, a type of container for the seat, etc.); the device information can be provided in any way (e.g., QR code, ArUco code, bar code, etc.).
[0165] In embodiments, the device information includes a device identifier of the test device. However, the device identifier can be of any type (e.g., serial number, encrypted code, etc.); the device identifier can be provided by any information marker (e.g., a single information marker, a combination of two or more information markers, etc.).
[0166] In embodiments, the device information includes a corresponding container identifier of an expected type of container housed in the seat. However, the container identifier can indicate the type of container in any way (e.g., concentration of a (predetermined) luminescent substance, property and / or concentration of a (varying) luminescent substance, product number of the container, etc.); the container identifier can be provided by any information marker (e.g., a single information marker, a combination of two or more information markers, a corresponding information marker for each seat, the same or different information marker that provides the device identifier, etc.).
[0167] In an embodiment, the position marks and / or information marks are arranged on the corresponding bottom surfaces of grooves extending from the imaging surface. However, the grooves can be of any type (e.g., with or without chamfered edges), size and shape (e.g., circular, square, etc., identical to or simply compatible with a portion of the mark), and depth; in any case, the possibility of arranging more marks in each groove or even arranging the mark (or at least a portion of the mark) flush with the imaging surface is not excluded.
[0168] In the embodiment, the bottom surface is parallel to the resting surface. However, the possibility that the bottom surface is inclined relative to the resting surface is not excluded.
[0169] In an embodiment, the groove has a corresponding chamfered edge at the imaging surface. However, the chamfered edge may form any angle with the imaging surface.
[0170] In an embodiment, the test device includes one or more locking elements for locking the test device to the support surface. However, the locking elements can be of any number, arranged in any location, and of any type (e.g., at the resting surface, at the side surface, etc., for magnetically, mechanically, such as using springs, clips, screws, Velcro strips, suction cups, multi-purpose adhesives, etc.).
[0171] In an embodiment, the locking element comprises a corresponding magnetic element arranged at the resting surface. However, the magnetic elements may be of any number and in any position, and they may be used to generate any attractive force with the support surface (when the support surface is made of ferromagnetic material).
[0172] In an embodiment, the imaging surface around the window is tilted relative to the resting surface. However, the imaging surface around the window can form any angle with the resting surface (downward to parallel thereto).
[0173] In an embodiment, the test device includes one or more human-readable seat indicators corresponding to the seat. However, the seat indicators may be arranged in any location (eg, on the imaging surface, on a side surface, etc.).
[0174] In an embodiment, the seat indicator provides corresponding specifications of the expected type of container to be accommodated in the seat. However, the seat indicator can specify the type of container in any manner (e.g., with color, name, code, etc.).
[0175] In an embodiment, the test device includes a test light source located on the imaging surface for generating test light corresponding to the luminescent light. However, the test light source can be of any type and can be arranged in any position (e.g., in the center or on the periphery of the test device); the test light can be of any type (e.g., fixed or variable, such as in response to a manual command, or selected based on predetermined characteristics of an excitation light source of the luminescent imaging device, such as via a wireless command transmitted via the luminescent imaging device).
[0176] In an embodiment, the corresponding container is housed in the seat in a non-removable manner. However, the container can be housed in the seat in any non-removable manner (e.g., mechanically fixed, glued, integrally integrated, etc.).
[0177] In an embodiment, the corresponding container is removably received in the seat. However, the container can be received in the seat in any removable manner (e.g., freely, snap fit, using a selective blocking system, etc.).
[0178] In an embodiment, the container has corresponding ends that protrude from the seat. However, the ends can be of any type (e.g., caps, outer ends of bottles / tubes, etc.), and they can protrude from the seat to any extent (up to none).
[0179] In an embodiment, the end portion has a human readable container indicator that provides the corresponding specifications of the container. However, the container indicator can be of any type (same or different with respect to the seat indicator).
[0180] In an embodiment, the seat indicators are color-coded. However, the colors can be of any type and indicated in any manner (e.g., by their name, sample, etc.).
[0181] In an embodiment, the container indicator is color-coded. However, the color can be of any type and indicated in any manner (e.g., by a colored end itself, by a label with its name, sample, etc.).
[0182] In an embodiment, the container comprises a corresponding bottle containing a liquid and a cap for closing the bottle. However, the bottle and the cap can be of any type (e.g., the bottle is shaped like a vial or a tube, the cap is screwed or press-fitted, etc.).
[0183] In an embodiment, the lid is colored according to the container indicator. However, the lid can be colored in any manner (e.g., completely colored, colored on the sides, colored on the top, etc.).
[0184] An embodiment provides a luminescence imaging device comprising a control unit configured to perform each step of the above method. However, the luminescence imaging device can be of any type (e.g., medical equipment, industrial equipment, etc., for any luminescence application, such as fluorescence applications in diagnosis, treatment or surgery, etc.); the luminescence imaging device can include any control unit (e.g., any integrated central unit, any separate computer, such as an industrial PC, etc.), any irradiation unit (e.g., based on laser, LED, UV / halogen / xenon lamp, etc.), any acquisition unit (e.g., based on any number and type of lenses, waveguides, mirrors, CCD, ICCD, EMCCD, CMOS, InGaAs or PMT sensors, etc.), any imaging head (e.g., mounted on an articulated arm, a pivoting arm, a stand-alone unit with wireless connection, a handheld unit, etc.) and any output device (e.g., a display, a printer, a network connection, a head-mounted projector, etc.).
[0185] Further embodiments provide additional advantageous features, but these features may be omitted entirely from the basic embodiment.
[0186] In particular, in an embodiment, the luminescence imaging apparatus comprises a support surface for resting the test device. However, the support surface may be of any type (eg, the top surface of any trolley, cantilever, fixed or hidden, etc.).
[0187] In an embodiment, the luminescence imaging apparatus includes a holding station for removably holding the test device in an imaging position on a support surface. However, the holding station can be of any type (e.g., a groove, a socket, etc.) for removably holding the test device in any manner (e.g., freely, snap-fit, using a selective blocking system, etc.).
[0188] In an embodiment, the luminescence imaging apparatus includes another holding station for removably holding the imaging head in the acquisition position. However, the other holding station can be of any type (e.g., a ring, a hook, etc., separate from the holding station or combined with the holding station) for removably holding the imaging head in any manner (e.g., freely, snap-fit, using a selective blocking system, etc.).
[0189] In an embodiment, the test device in the imaging position falls within the field of view of the imaging head in the acquisition position. However, the test device can fall within the field of view in any manner (e.g., in a fixed or variable manner in one or more dimensions, etc.).
[0190] In an embodiment, the center of the test device in the imaging position is located on the optical axis of the imaging head in the acquisition position. However, the possibility of placing the test device in one or more different positions is not excluded.
[0191] The embodiment provides a luminescence imaging system, which includes the above-mentioned luminescence imaging device and a testing device (for testing the luminescence imaging device). However, the testing device can be put on the market as a stand-alone product for use with any existing luminescence imaging device.
[0192] In general, similar considerations apply if the test equipment, luminescence imaging apparatus, and luminescence imaging system each have different structures, include equivalent components, or have other operational characteristics. In any case, each component can be separated into multiple elements, or two or more components can be combined into a single element; furthermore, each component can be replicated to support parallel execution of corresponding operations. Furthermore, unless otherwise specified, any interaction between different components generally need not be continuous and may be direct or indirect through one or more intermediaries.
Claims
1. A method (700) for testing a luminescent imaging device (105), wherein a test device (110) is placed within a field of view of an imaging head (165) of the luminescent imaging device (105), the test device (110) having an imaging surface (315) for imaging the test device (110) having one or more sites (330), each site (330) comprising at least one luminescent substance, wherein the method (700) comprises: Under the control of the control unit (205) of the luminescent imaging device (105): using a photographic camera (250) of an imaging head (165) to acquire a photographic image of the field of view representing reflected light reflected from the field of view, retrieving a descriptor of the test device, the descriptor including an indication of the geometry of the test device (110) and the location of the site (330) in the test device (110), Finding the position of the test device (110) in the photo image based on the geometric shape of the test device (110), calculating (734) the position of the site (330) in the photographic image based on the position of the test device (110) in the photographic image and the position of the site (330) in the test device (110), acquiring a luminescence image of the field of view using a luminescence camera (245) of the imaging head (165), the luminescence image representing luminescence light emitted by the luminescent substance of the site (330) in response to its excitation light provided by the excitation light source (210) of the imaging head (165), determining a representation of the site (330) in the luminescence image based on the location of the site (330) in the photographic image, and The luminescence imaging device (105) is tested (754-772) based on the representation of the site (330) in the luminescence image.
2. The method (700) of claim 1, wherein the test device (110) has one or more optical machine-readable position markings (335, 340) at the imaging surface (315), the method comprising, under the control of the control unit (205): retrieving a descriptor comprising a specification of the position marker (335, 340) and a position of the site (330) relative to the position marker (335, 340), Find the location of the position marker (335, 340) in the photo image according to the specifications of the position marker (335, 340), and The position of the site (330) in the photographic image is calculated (734) based on the position of the position markers (335, 340) in the photographic image and the position of the site (330) relative to the position markers (335, 340).
3. The method (700) according to claim 1 or 2, wherein the method (700) comprises, under the control of the control unit (205): The luminescence imaging device (105) is tested (754-772) based on a comparison of the representation of each site (330) in the luminescence image with at least one nominal value.
4. The method (700) according to claim 1 or 2, wherein the method (700) comprises, under the control of the control unit (205): The luminescence imaging device (105) is tested (754-772) based on a comparison of the representation of each site (330) in the luminescence image with the representation of at least one other site (330) in the luminescence image.
5. The method (700) according to claim 1 or 2, wherein the method (700) comprises, under the control of the control unit (205): determining a representation of a background region in the luminescence image that is distinct from the representation of the site (330), and The luminescence imaging device (105) is tested (754-772) based on a comparison of the representation of each site (330) in the luminescence image with the representation of a background area in the luminescence image.
6. The method (700) according to claim 1 or 2, wherein the test device (110) comprises one or more containers (325) corresponding to the sites (330), each container (325) being filled with a liquid containing a corresponding luminescent substance, and the method (700) comprises, under the control of the control unit (205): Based on a comparison of the representation of the site (330) in the luminescence image with a plurality of predetermined specifications of possible types of the container (325), an expected type of the corresponding container (325) is estimated (742).
7. The method (700) according to claim 1 or 2, wherein the test device (110) has one or more optical machine-readable information marks at the imaging surface (315), the method comprising, under the control of the control unit (205): determining the representation of informational markers in a photographic image, determining device information associated with the test device (110) based on the indication of the information tag, and The luminescent imaging device (105) is tested (754-772) according to the device information.
8. The method (700) according to claim 7, wherein the test device (110) comprises one or more containers (325) corresponding to the sites (330), each container (325) being filled with a liquid containing a corresponding luminescent substance, the method comprising, under the control of the control unit (205): The expected type of container (325) is determined based on the device information.
9. The method (700) according to claim 6, wherein the method (700) comprises, under the control of the control unit (205): The luminescent imaging device (105) is tested (754-772) according to predetermined specifications for the intended type of container (325).
10. The method (700) according to claim 6, wherein the method (700) comprises, under the control of the control unit (205): determining a representation of a corresponding end portion (360) of the container (325) protruding from a corresponding seat (320) of the test device (110) in the photographic image, and The configuration of the test device (110) is verified (746-752) based on a match between the representation of the end portion (360) in the photographic image and a predetermined definition of a corresponding expected type of container (325).
11. The method (700) according to claim 1 or 2, wherein the method (700) comprises, under the control of a control unit (205): Finding the location of the test device (110) in the luminescence image, and The luminescent imaging device (105) is tested (764) based on an alignment between the photographic image and the luminescent image determined based on a position of the test device (110) in the photographic image and a position of the test device (110) in the luminescent image.
12. The method (700) according to claim 7, wherein the method (700) comprises, under the control of the control unit (205): retrieving one or more usage rules for the test device (110), and The test (754-772) luminescent imaging device (105) is enabled (730-732) according to the usage rules.
13. The method (700) according to claim 1 or 2, wherein the method (700) comprises, under the control of a control unit (205): retrieving usage information of one or more previously performed tests (746-764) of the luminescence imaging device (105), enabling (730-732) said testing (746-764) luminescent imaging device (105) according to the usage information, and The usage information of the test (746-764) luminescent imaging device (105) is saved (782).
14. The method (700) according to claim 12, wherein the method (700) comprises, under the control of the control unit (205): Retrieve usage rules and / or usage information based on the device information.
15. The method (700) according to claim 1 or 2, wherein the test device (110) comprises a test light source (350) located at the imaging surface (315) for generating test light corresponding to the luminous light, the method (700) comprising, under the control of the control unit (205): With the excitation light source (210) turned off and the test light source (350) turned on, another luminescence image of the field of view is acquired using the luminescence camera (245), and The acquisition unit of the testing (770) imaging head (165) is configured to acquire a luminous image based on the other luminous image and predetermined characteristics of the testing light source (350).
16. The method (700) of claim 15, wherein the method (700) comprises: The irradiation unit of the test (772) imaging head (165) is used to generate excitation light according to the results of the test (746-764) luminescent imaging device (105) and the results of the test (762) acquisition unit.
17. The method (700) according to claim 1 or 2, wherein the method (700) comprises, under the control of a control unit (205): determining the displacement of the test device (110) and / or imaging head (165) from the target location based on the location of the test device in the photographic image, and An indication of movement of the test device (110) and / or the imaging head (165) to a target position is outputted on an output unit (140) of the luminescent imaging apparatus (105) according to the displacement of the test device (110) and / or the imaging head (165).
18. The method (700) according to claim 1 or 2, wherein the method (700) comprises, under the control of a control unit (205): An indication of the result of testing the luminescence imaging device (105) is outputted on an output unit (140) of the luminescence imaging device (105).
19. The method (700) according to claim 1 or 2, wherein the method (700) comprises, under the control of a control unit (205): An indication of the results of testing the luminescence imaging device (105) is transmitted to a remote computing system via a telecommunications network.
20. The method (700) according to claim 1 or 2, wherein the method (700) comprises, under the control of a control unit (205): Repeat under non-operating conditions of the luminescence imaging device (105): capturing another photographic image of the field of view with a camera (250), and searching (714) for a representation of the test device (110) in another photographic image based on the geometry of the test device (110), until a representation of the test device (110) is found in another photographic image, and In response to finding a representation of the test device (110) in another photographic image, the test luminescence imaging apparatus (105) is triggered (718).
21. A computer program product comprising a computer-readable storage medium embodying a computer program, the computer program being loadable into a working memory of a control unit of a luminescence imaging device, thereby configuring the control unit to perform the method according to any one of claims 1 to 20.
22. A luminescence imaging device (105), comprising a control unit (205), the control unit (205) being configured to perform the method (700) according to any one of claims 1 to 20.
23. The luminescent imaging device (105) according to claim 22, wherein the luminescent imaging device (105) comprises: Imaging head (165), a support surface (175) for resting the test equipment (110), a holding station for removably holding the test device (110) in an imaging position on a support surface (175), and Another holding station is used to removably hold the imaging head (165) in an acquisition position, and the test device (110) in the imaging position falls into the field of view of the imaging head (165) in the acquisition position.
24. The luminescent imaging apparatus (105) according to claim 22 or 23, wherein the center of the test device (110) in the imaging position is located on the optical axis of the imaging head (165) in the acquisition position.
25. A luminescent imaging system comprising a luminescent imaging device (105) and a test device (110) for testing the luminescent imaging device (105), wherein the luminescent imaging device (105) comprises a control unit (205), the control unit (205) being configured to perform the method (700) according to any one of claims 1 to 20, and the test device (110) comprising an imaging surface (315) for imaging the test device (110), the imaging surface (315) being provided with one or more sites (330), each site (330) comprising at least one luminescent substance.
26. The luminescent imaging system of claim 25, wherein the test device (110) comprises one or more optical machine-readable position markings (335, 340) at the imaging surface (315) for determining the position of the test device (110).
Citation Information
Patent Citations
Fluorescent phantom device
US20070200058A1
Calibration Apparatus and Method for Fluorescent Imaging
US20080080781A1
Methods and compositions for validation of fluorescence imaging and tomography devices
US9167240B1
Light calibration device for use in low level light imaging systems
US20030146663A1