Systems and methods of viewing a biological sample

The method and system enhance sample navigation by generating a low-resolution scan and displaying a real-time high-resolution feed, addressing the challenge of identifying biologically meaningful areas during optical imaging.

WO2025210482A1PCT designated stage Publication Date: 2025-10-09THERMO FISHER SCIENTIFIC OY
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
PCT/IB2025/053372
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-04-05
Filing Date
2025-03-31
Publication Date
2025-10-09

AI Technical Summary

Technical Problem

Users face difficulties in identifying and navigating to biologically meaningful areas within a sample during optical imaging, making sophisticated navigation during imaging challenging.

Method used

A method and system that enables live navigation by generating a low-resolution scan of a sample and displaying a real-time high-resolution feed of the area of interest within a window on a computing device interface, allowing users to easily locate and analyze areas of interest using different magnifications and channels.

Benefits of technology

Facilitates efficient navigation and detailed analysis of sample areas by providing a live feed that updates in real-time, enabling users to identify and inspect biologically relevant regions with ease.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure IB2025053372_09102025_PF_FP_ABST
    Figure IB2025053372_09102025_PF_FP_ABST
Patent Text Reader

Abstract

Disclosed herein is a live navigation tool. A scan of a sample is generated based on a first channel. The scan of the sample is acquired at a first magnification. Data relating to a camera feed of an imaging device during imaging of the sample is received from the imaging device. The data is received in real time. The camera feed is associated with at least one of a second magnification and a second channel. The second magnification is different from the first magnification and / or the second channel is different from the first channel. The scan and a window are displayed via an interface of a computing device. The camera feed of the imaging device is displayed in the window.
Need to check novelty before this filing date? Find Prior Art

Description

SYSTEMS AND METHODS OF VIEWING A BIOLOGICAL SAMPLEBackground

[0001] During optical imaging of a sample, a user may want to focus on areas of interest, such as biologically meaningful areas, within the sample. It can, however, be difficult for the user to identify and / or navigate to the areas of interest.Accordingly, improvements to allow for more sophisticated navigation during imaging of a sample are needed.Summary of the Invention

[0002] In meeting the described needs, the present disclosure first provides a method, comprising: generating, based on a first channel, a scan of a sample acquired at a first magnification; receiving, in real time from an imaging device, data relating to a camera feed of the imaging device during imaging of the sample, wherein the camera feed is associated with at least one of a second magnification and a second channel, the second magnification being different from the first magnification and / or the second channel being different from the first channel; and displaying, via an interface of a computing device, a window and the scan of the sample acquired at the first magnification, wherein the camera feed associated with the at least one of the second magnification and the second channel is displayed in the window.

[0003] Also provided is a computer-readable medium storing instructions that, when executed, cause: generating, based on a first channel, a scan of a sample acquired at a first magnification; receiving, in real time from an imaging device, data relating to a camera feed of the imaging device during imaging of the sample, wherein the camera feed is associated with at least one of a second magnification and a second channel, the second magnification being different from the first magnification and / or the second channel being different from the first channel; and displaying, via an interface of a computing device, a window and the scan of the sample acquired at the first magnification, wherein the camera feed associated with the at least one of the second magnification and the second channel is displayed in the window.

[0004] Also provided is an imaging system comprising: an imaging device and a computing device, the computing device comprising: one or more processors; and memory storing instructions that, when executed by the one or more processors,cause the computing device to: generate, based on a first channel, a scan of a sample acquired at a first magnification; receive, in real time from the imaging device, data relating to a camera feed of the imaging device during imaging of the sample, wherein the camera feed is associated with at least one of a second magnification and a second channel, the second magnification being different from the first magnification and / or the second channel being different from the first channel; and display, via an interface of a computing device, a window and the scan of the sample acquired at the first magnification, wherein the camera feed associated with the at least one of the second magnification and the second channel is displayed in the window.Brief Description of the Drawings

[0005] Embodiments will be readily understood by the following detailed description in conjunction with the accompanying drawings. To facilitate this description, like reference numerals designate like structural elements. Embodiments are illustrated by way of example, not by way of limitation, in the figures of the accompanying drawings.

[0006] FIG. 1 shows an example system for live navigation during imaging of a sample, in accordance with various embodiments.

[0007] FIG. 2 shows an example interface of a live navigation tool, in accordance with various embodiments.

[0008] FIG. 3 shows another example interface of a live navigation tool, in accordance with various embodiments.

[0009] FIG. 4 shows another example interface of a live navigation tool, in accordance with various embodiments.

[0010] FIG. 5 is a flow diagram of an example method of live navigation during imaging of a sample, in accordance with various embodiments.

[0011] FIG. 6 is an example computing device, in accordance with various embodiments.Detailed Description

[0012] Disclosed herein is a live navigation software tool, as well as related methods and devices. In some embodiments, the live navigation tool facilitates live navigation, viewing, and image acquisition within a large area of a sample that has been pre-scanned, such as with a low resolution, a low magnification objective, and / or select fluorescent channel(s). The scan can be displayed on an interface of a computing device. The scan can provide a user with, for example, crude histological information about the sample that can help the user to navigate within the sample and locate morphologically interesting areas within the sample.

[0013] In response to identifying an area of interest within the sample, the user can control a position of a camera of an imaging device, such as a microscope, to focus the camera on the area of interest. A live feed of the camera can be displayed within a window on the interface. The live feed displayed within the window can provide a higher magnification view of the area of interest and / or more detailed data associated with the area of interest, such as detailed data associated with one or more selected fluorescent channels. The user can use the higher magnification and / or more detailed view of the area of interest to look for biologically meaningful areas within the sample, such as areas with high biomarker expression, different cell types or tissues, etc. The live camera feed displayed within the window can be constantly and / or intermittently updated with data from the imaging device as the user changes the position of the camera.

[0014] FIG. 1 shows an exemplary system 100 for live microscopy navigation. The system 100 includes an imaging device 102 and a computing device 110. The imaging device 102 can be a microscope. The imaging device 102 can be in communication with the computing device 110. The imaging device 102 can include a camera 104 and a sample stage 106. A sample, such as a sample disposed on or in a vessel, such as a slide, substrate, or sample carrier, can be positioned on the sample stage 106 for imaging of the sample by the camera 104. The sample can be, for example, a tissue sample. The computing device 110 can include one or more processors 111 and a display 112.

[0015] In embodiments, the processor(s) 111 can generate a scan, such as a crude background scan, of the sample. The processor(s) 111 can generate the scan of the sample based on acquiring the scan of the sample at a first magnification, such as a first magnification objective. The first magnification can be selected by a user. For example, the processor(s) 111 can generate the scan of the sample based on receiving data indicating a user selection of the first magnification.

[0016] The processor(s) 111 can additionally, or alternatively, generate the scan of the sample based on at least one first channel. The at least one first channel can beselected by a user. For example, the processor(s) 111 can generate the scan of the sample based on receiving data indicating a user selection of the at least one first channel. The at least one first channel can include at least one fluorescent channel, such as at least one nuclear channel, and / or at least one transmitted channel.

[0017] The processor(s) 111 can generate the scan of the sample by generating a scan of the vessel containing the sample. Alternatively, the processor(s) 111 can generate the scan of the sample by generating a scan of a large portion of the sample. Generating the scan of the sample can include generating an image of the sample (or a portion of the sample). The image of the sample can include a plurality of layers. Each of the plurality of layers can correspond to different image resolutions. The image of the sample can be, for example, a pyramidal image.

[0018] The scan of the sample can be displayed via the display 112. The display 112 can be an interface of the computing device 110. The user can view the scan of the sample. Viewing the scan of the sample can provide the user with an overview of the morphology of the sample, even if the scan of the sample is generated using a low magnification objective or resolution. As such, the scan of the sample can enable the user to easily navigate the sample and / or to find areas of interest within the sample.

[0019] The processor(s) 111 can cause display of a window on the display 112. The processor(s) 111 can cause display of the window based on receiving data indicating that the user has “turned on” the live navigator tool. For example, the user can select, via the display 112, a button corresponding to the live navigator tool. By selecting the button, the user can “turn on” the live navigator tool. The processor(s) 111 can cause display of the window based on receiving data based on receiving data indicating user selection of the button corresponding to the live navigator tool. The window can be displayed such that it surrounds a portion of the scan. Alternatively, the processor(s) 111 can cause display of the window based on overlaying the window on a portion of the scan.

[0020] The processor(s) 111 can cause display of a real-time feed of the camera 104 in the window. For example, the processor(s) 111 can receive, from the imaging device 102, real-time data relating to the live camera feed of the imaging device 102 during imaging of the sample. The processor(s) 111 can cause display of the realtime feed of the camera 104 based on the real-time data.

[0021] The real-time feed of the camera 104 displayed in the window can be associated with a second magnification, such as a second magnification objective.For example, the processor(s) 111 can display the real-time feed of the camera 104 in the window based on the second magnification. The second magnification can be selected by the user. For example, the processor(s) 111 can display the real-time feed of the camera 104 in the window based on the second magnification in response to receiving data indicating user selection of the second magnification. The second magnification can be different than the first magnification at which the scan of the sample was acquired. The second magnification can be higher than the first magnification. As one example, the first magnification can be associated with a 2.5x objective and the second magnification can be associated with a 10x or 20x objective (or any other objective higher than 2.5x).

[0022] The real-time feed of the camera 104 displayed in the window can be associated with at least one second channel. For example, the processor(s) 111 can display the real-time feed of the camera 104 in the window based on the second channel(s). The second channel(s) can be selected by the user. For example, the processor(s) 111 can display the real-time feed of the camera 104 in the window based on the second channel(s) in response to receiving data indicating user selection of the second channel(s). The second channel(s) can include at least one fluorescent channel, such as at least one nuclear channel, and / or at least one transmitted channel. The second channel(s) can be different than the at least one first channel used to generate the scan of the sample.

[0023] As discussed above, the user can view the scan of the sample to find areas of interest within the sample. The user can control the position of the camera 104, such as via the computing device 110. For example, the processor(s) 111 can control the position of the camera 104 by moving the sample stage 106, which can be a motorized stage, in response to receiving data indicating user control of the camera position.

[0024] The user can control the position of the camera 104 so that the camera 104 is focused on an area of interest in the sample. If the user controls the position of the camera 104 so that the camera 104 is focused on an area of interest in the sample, the area of interest can be displayed in the window, such as at the second magnification and / or based on the second channel(s). As such, the user can easily view and inspect the area of interest in more detail. The user can move the position of the camera 104 to focus on different areas of interest in the sample. The livecamera feed displayed within the window can be constantly updated with data from the imaging device 102 as the user changes the position of the camera 104.

[0025] As described above, the scan of the sample can include an image of the sample. The image of the sample can include a plurality of layers. Each of the plurality of layers can correspond to different image resolutions. The user can zoom in on or zoom out of the real-time feed of the camera 104 displayed in the window. If the user zooms in on the real-time feed of the camera 104 displayed in the window, the processor(s) 111 can cause the real-time feed of the camera 104 to be displayed in the window with increased magnification. The processor(s) 111 can cause the real-time feed of the camera 104 to be displayed in the window with increased magnification by displaying, in the window, a layer of the plurality of layers that corresponds to the increased magnification. If the user zooms out of the real-time feed of the camera 104 displayed in the window, the processor(s) 111 can cause the real-time feed of the camera 104 to be displayed in the window with decreased magnification. The processor(s) 111 can cause the real-time feed of the camera 104 to be displayed in the window with decreased magnification by displaying, in the window, a layer of the plurality of layers that corresponds to the decreased magnification.

[0026] The user can change the second magnification and / or the second channel(s). For example, the user can select, via the display 112, a button or other interface element indicating that the portion of the scan should be displayed in the window at a different second magnification. The processor(s) 111 can display the real-time feed of the camera 104 in the window based on the different second magnification, such as in response to receiving data indicating the user selection of the different second magnification. As another example, the user can select, via the display 112, a button or other interface element indicating that the portion of the scan should be displayed in the window using one or more different second channels. The processor(s) 111 can display the real-time feed of the camera 104 in the window based on the different second channel(s), such as in response to receiving data indicating the user selection of the different second channel(s).

[0027] The user can adjust exposure times associated with the camera 104. For example, the user can select, via the display 112, a button or other interface element indicating a desired exposure time associated with the camera 104. The processor(s) 111 can display the real-time feed of the camera 104 in the windowbased on the desired exposure time, such as in response to receiving data indicating the user selection of the desired exposure time. The user can adjust a light intensity of the real-time camera feed displayed in the window. For example, the user can select, via the display 112, a button or other interface element indicating a desired light intensity of the real-time camera feed displayed in the window. The processor(s) 111 can display the real-time feed of the camera 104 in the window based on the desired light intensity, such as in response to receiving data indicating the user selection of the desired light intensity. By adjusting the second magnification, the second channel(s), the exposure time, and / or the light intensity, the user can be able to easily identify and analyze areas of interest within the sample.

[0028] FIGS. 2-4 provide example interfaces of a live navigation tool, in accordance with various embodiments disclosed herein. As shown on the interface 200 of FIG. 2, a user can select a button 201 . If the user selects the button 201 , the live navigation tool can generate a background scan 202 of a sample. The live navigation tool can generate the background scan 202 by generating a scan of the vessel containing the sample. Alternatively, the live navigation tool can generate the background scan 202 of the sample by generating a scan of a large portion of the sample. The background scan 202 can be generated based on a first magnification and / or a first channel. For example, the background scan 202 can be acquired at a 2.5x objective with transmitted illumination. The background scan 202 can be displayed on the interface 200.

[0029] The user can view the background scan 202. Viewing the background scan 202 can provide the user with an overview of the morphology of the sample, even if the background scan 202 is generated using a low magnification objective or resolution. Based on viewing the background scan 202, the user can identify an area of interest within the sample. The user can turn on “turn on” the live navigator tool to view the area of interest in more detail, such as at a higher magnification, or using different channels. To “turn on” the live navigator tool, the user can select a button 206.

[0030] If the user selects the button 206 and / or switches on a desired channel, the live navigator tool can cause display of a window 204 on the interface 200. The window 204 can be displayed such that it surrounds a portion of background scan 202 and / or such that it is overlaid on a portion of the background scan 202. A realtime feed of a camera of an imaging device can be displayed in the window 204. Forexample, the window 204 can surround or be overlaid on top of a portion of the background scan 202 corresponding to a current position of the camera, such as a portion of the sample on which the camera is focused.

[0031] The user can control the position of the camera so that the camera is focused on an area of interest within the sample. As shown on the interface 300 of FIG. 3, a user can zoom in on the real-time feed displayed in the window 204. The user can select a second magnification associated with the real-time feed displayed in the window 204, such as by selecting a second magnification via a button or interface element 302. The selected second magnification can be different than the first magnification at which the scan of the sample was acquired. The second magnification can be higher than the first magnification. For example, the first magnification can be associated with a 2.5x objective and the second magnification can be associated with a 10x or 20x objective (or any other objective higher than 2.5x). The real-time feed can be displayed in the window based on the selected second magnification.

[0032] The user can additionally, or alternatively, select one or more second channels associated with the real-time feed displayed in the window 204, such as by selecting the second channel(s) via a button or interface element 306. The second channel(s) can include at least one fluorescent channel, such as at least one nuclear channel, and / or at least one transmitted channel. The second channel(s) can be different than the at least one first channel used to generate the background scan 202.

[0033] As shown in the example of FIG. 3, the user can select the interface element 306 to turn on or illuminate the DARI channel in the real-time feed displayed in the window 204. The user can select any number of channels to be illuminated or turned on in the real-time feed displayed in the window 204. The user can adjust camera exposure times and / or a level of light intensity associated with the second channel(s). By adjusting the second magnification, the second channel(s), the exposure time, and / or the light intensity, the user can identify and analyze areas of interest within the sample.

[0034] As shown by the interface 400 of FIG. 4, the user can adjust the position of the window 204. For example, the user can adjust the position of the window 204 dragging the window 204 to a new position on the background scan 202. If the user adjusts the position of the window 204, the position of the camera can automaticallyadjust to correspond to the position of the window 204. The live camera feed displayed within the window 204 can be constantly updated with data from the as the user changes the position of the window 204 (and / or the camera).

[0035] The user can change the second magnification and / or the second channel(s) associated with the live camera feed displayed within the window 204. For example, the user can select a higher or lower second magnification. The user can change the second channel(s) by selecting an additional second channel or an alternative second channel. As shown in the example of FIG. 4, the user can select the interface element 402 to turn on or illuminate the CFP channel in addition to the DAPI channel in the real-time feed displayed in the window 204. The real-time feed displayed in the window 204 can be updated based on the updated second magnification and / or the updated second channel(s).

[0036] FIG. 5 is a flow diagram of an exemplary method 500 for live navigation during imaging of a sample, in accordance with various embodiments. The method 500 can be a computer-implemented method. For example, a computing device can include one or more processors and memory storing instructions that, when executed by the one or more processors, cause the device to perform the method 500. The method 500 can be used in any suitable setting to perform any suitable support operations. Operations are illustrated once each and in a particular order in FIG. 5, but the operations can be reordered and / or repeated as desired and appropriate. Different operations performed can be performed in parallel, as suitable.

[0037] At 502, a scan of a sample can be generated. The scan of the sample can be generated based on at least one of a first magnification and at least one first channel. The first magnification can be selected by a user. For example, the scan of the sample can be generated based on receiving data indicating a user selection of the first magnification. Generating the scan of the sample can include acquiring the scan of the sample at the first magnification. The at least one first channel can be selected by the user. The scan of the sample can be generated based on receiving data indicating a user selection of the at least one first channel. The at least one first channel can include at least one fluorescent channel, such as at least one nuclear channel, and / or at least one transmitted channel.

[0038] Generating the scan of the sample can include generating a scan of a vessel, such as a slide, containing the sample. Generating the scan of the sample can include generating a scan of a large portion of the sample. Generating the scan ofthe sample can include generating an image of the sample (or a portion of the sample). The image of the sample can include a plurality of layers. Each of the plurality of layers can correspond to different image resolutions. The image of the sample can be, for example, a pyramidal image.

[0039] At 504, data can be received. The data can be received from an imaging device, such as a microscope. The data can be received in real time. The data can be received continuously as the data is captured by the imaging device. The data can relate to a camera feed of the imaging device during imaging of the sample. At 506, the scan and the window can be displayed. The scan and the window can be displayed via an interface of a computing device. The camera feed of the imaging device can be displayed in the window.

[0040] The real-time camera feed of the imaging device displayed in the window can be associated with a second magnification, such as a second magnification objective. The second magnification can be selected by the user. For example, the camera feed of the imaging device can be displayed in the window based on the second magnification in response to receiving data indicating user selection of the second magnification. The second magnification can be different than the first magnification at which the scan of the sample was acquired. The second magnification can be higher than the first magnification. The camera feed of the imaging device displayed in the window can be associated with at least one second channel. For example, the real-time camera feed of the imaging device can be displayed in the window based on the second channel(s). The second channel(s) can be selected by the user. For example, the real-time camera feed of the imaging device can be displayed in the window in response to receiving data indicating user selection of the second channel(s). The second channel(s) can include at least one fluorescent channel, such as at least one nuclear channel, and / or at least one transmitted channel. The second channel(s) can be different than the at least one first channel used to generate the scan of the sample.

[0041] FIG. 6 depicts a computing device 600 that can be used in various aspects, such as the devices, components, or systems depicted in FIG. 1 . Regarding the example architecture of FIG. 1 , any of the components or devices can each be implemented in an instance of a computing device 600 of FIG. 6.

[0042] The computer architecture shown in FIG. 6 shows a conventional server computer, workstation, desktop computer, laptop, tablet, network appliance, PDA, e-reader, digital cellular phone, or other computing node, and can be utilized to execute any aspects of the computers described herein, such as to implement the methods described in relation to FIG. 5.

[0043] The computing device 600 can include a baseboard, or “motherboard,” which is a printed circuit board to which a multitude of components or devices can be connected by way of a system bus or other electrical communication paths. One or more central processing units (CPUs) 604 can operate in conjunction with a chipset 606. The CPU(s) 604 can be standard programmable processors that perform arithmetic and logical operations necessary for the operation of the computing device 600.

[0044] The CPU(s) 604 can perform the necessary operations by transitioning from one discrete physical state to the next through the manipulation of switching elements that differentiate between and change these states. Switching elements can generally include electronic circuits that maintain one of two binary states, such as flip-flops, and electronic circuits that provide an output state based on the logical combination of the states of one or more other switching elements, such as logic gates. These basic switching elements can be combined to create more complex logic circuits including registers, adders-subtractors, arithmetic logic units, floatingpoint units, and the like.

[0045] The CPU(s) 604 can be augmented with or replaced by other processing units, such as GPU(s) 605. The GPU(s) 605 can comprise processing units specialized for but not necessarily limited to highly parallel computations, such as graphics and other visualization-related processing.

[0046] A chipset 606 can provide an interface between the CPU(s) 604 and the remainder of the components and devices on the baseboard. The chipset 606 can provide an interface to a random access memory (RAM) 608 used as the main memory in the computing device 600. The chipset 606 can further provide an interface to a computer-readable storage medium, such as a read-only memory (ROM) 620 or non-volatile RAM (NVRAM) (not shown), for storing basic routines that can help to start up the computing device 600 and to transfer information between the various components and devices. ROM 620 or NVRAM can also store other software components necessary for the operation of the computing device 600 in accordance with the aspects described herein.

[0047] The computing device 600 can operate in a networked environment using logical connections to remote computing nodes and computer systems through local area network (LAN) 616. The chipset 606 can include functionality for providing network connectivity through a network interface controller (NIC) 622, such as a gigabit Ethernet adapter. A NIC 622 can be capable of connecting the computing device 600 to other computing nodes over a network 616. It should be appreciated that multiple NICs 622 can be present in the computing device 600, connecting the computing device to other types of networks and remote computer systems.

[0048] The computing device 600 can be connected to a mass storage device 628 that provides non-volatile storage for the computer. The mass storage device 628 can store system programs, application programs, other program modules, and data, which have been described in greater detail herein. The mass storage device 628 can be connected to the computing device 600 through a storage controller 624 connected to the chipset 606. The mass storage device 628 can consist of one or more physical storage units. A storage controller 624 can interface with the physical storage units through a serial attached SCSI (SAS) interface, a serial advanced technology attachment (SATA) interface, a fiber channel (FC) interface, or other type of interface for physically connecting and transferring data between computers and physical storage units.

[0049] The computing device 600 can store data on a mass storage device 628 by transforming the physical state of the physical storage units to reflect the information being stored. The specific transformation of a physical state can depend on various factors and on different implementations of this description. Examples of such factors can include, but are not limited to, the technology used to implement the physical storage units and whether the mass storage device 628 is characterized as primary or secondary storage and the like.

[0050] For example, the computing device 600 can store information to the mass storage device 628 by issuing instructions through a storage controller 624 to alter the magnetic characteristics of a particular location within a magnetic disk drive unit, the reflective or refractive characteristics of a particular location in an optical storage unit, or the electrical characteristics of a particular capacitor, transistor, or other discrete component in a solid-state storage unit. Other transformations of physical media are possible without departing from the scope and spirit of the present description, with the foregoing examples provided only to facilitate this description.The computing device 600 can further read information from the mass storage device 628 by detecting the physical states or characteristics of one or more particular locations within the physical storage units.

[0051] In addition to the mass storage device 628 described above, the computing device 600 can have access to other computer-readable storage media to store and retrieve information, such as program modules, data structures, or other data. It should be appreciated by those skilled in the art that computer-readable storage media can be any available media that provides for the storage of non-transitory data and that can be accessed by the computing device 600.

[0052] By way of example and not limitation, computer-readable storage media can include volatile and non-volatile, transitory computer-readable storage media and non-transitory computer-readable storage media, and removable and non-removable media implemented in any method or technology. Computer-readable storage media includes, but is not limited to, RAM, ROM, erasable programmable ROM (“EPROM”), electrically erasable programmable ROM (“EEPROM”), flash memory or other solid- state memory technology, compact disc ROM (“CD-ROM”), digital versatile disk (“DVD”), high definition DVD (“HD-DVD”), BLU-RAY, or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage, other magnetic storage devices, or any other medium that can be used to store the desired information in a non-transitory fashion.

[0053] A mass storage device, such as the mass storage device 628 depicted in FIG. 6, can store an operating system utilized to control the operation of the computing device 600. The operating system can comprise a version of the LINUX operating system. The operating system can comprise a version of the WINDOWS SERVER operating system from the MICROSOFT Corporation. According to further aspects, the operating system can comprise a version of the UNIX operating system. Various mobile phone operating systems, such as IOS and ANDROID, can also be utilized. It should be appreciated that other operating systems can also be utilized. The mass storage device 628 can store other system or application programs and data utilized by the computing device 600.

[0054] The mass storage device 628 or other computer-readable storage media can also be encoded with computer-executable instructions, which, when loaded into the computing device 600, transforms the computing device from a general-purpose computing system into a special-purpose computer capable of implementing theaspects described herein. These computer-executable instructions transform the computing device 600 by specifying how the CPU(s) 604 transition between states, as described above. The computing device 600 can have access to computer- readable storage media storing computer-executable instructions, which, when executed by the computing device 600, can perform the methods described in relation to FIGS. 6-11 .

[0055] A computing device, such as the computing device 600 depicted in FIG. 6, can also include an input / output controller 632 for receiving and processing input from a number of input devices, such as a keyboard, a mouse, a touchpad, a touch screen, an electronic stylus, or other type of input device. Similarly, an input / output controller 632 can provide output to a display, such as a computer monitor, a flatpanel display, a digital projector, a printer, a plotter, or other type of output device. It will be appreciated that the computing device 600 need not include all of the components shown in FIG. 6, can include other components that are not explicitly shown in FIG. 6, or can utilize an architecture completely different than that shown in FIG. 6.

[0056] As described herein, a computing device can be a physical computing device, such as the computing device 600 of FIG. 6. A computing node can also include a virtual machine host process and one or more virtual machine instances. Computerexecutable instructions can be executed by the physical hardware of a computing device indirectly through interpretation and / or execution of instructions stored and executed in the context of a virtual machine.

[0057] The following Aspects are illustrative only and do not limit the scope of the present disclosure or the appended claims. Any part or parts of any one or more Aspects can be combined with any part or parts of any one or more other Aspects.

[0058] Aspect 1 : A method comprising, consisting of, or consisting essentially of generating, based on a first channel, a scan of a sample acquired at a first magnification; receiving, in real time from an imaging device, data relating to a camera feed of the imaging device during imaging of the sample, wherein the camera feed is associated with at least one of a second magnification and a second channel, the second magnification being different from the first magnification or the second channel being different from the first channel; and displaying, via an interface of a computing device, a window and the scan of the sample acquired at the firstmagnification, wherein the camera feed associated with the at least one of the second magnification and the second channel is displayed in the window.

[0059] Aspect 2: The method of Aspect 1 , wherein the window is displayed such that it surrounds a portion of the scan.

[0060] Aspect 3: The method of Aspect 1 , wherein displaying the window comprises overlaying the window on a portion of the scan.

[0061] Aspect 4: The method of any one of Aspects 1 -3, wherein the portion of the scan corresponds to a portion of the sample corresponding to the camera feed.

[0062] Aspect 5: The method of any one of Aspects 1 -4, wherein the first channel comprises at least one first fluorescent channel or at least one first transmitted channel.

[0063] Aspect 6: The method of any one of Aspects 1 -5, wherein the second channel comprises at least one second fluorescent channel or at least one second transmitted channel.

[0064] Aspect 7: The method of any one of Aspects 1 -6, wherein the second channel is different from the first channel.

[0065] Aspect 8: The method of any one of Aspects 1 -7, further comprising receiving data indicating a user selection of at least one of the second magnification and the second channel.

[0066] Aspect 9: The method of any one of Aspects 1 -8, further comprising: generating an image of the sample, wherein the image comprises a plurality of layers corresponding to different image resolutions; and representing increased or decreased magnification of the camera feed of the imaging device by displaying in the window a layer of the plurality of layers that corresponds to the increased or decreased magnification.

[0067] Aspect 10: The method of any one of Aspects 1 -9, further comprising receiving data indicating a user selection of an exposure; and adjusting the exposure of the camera feed displayed in the window in response to the user selection of the exposure.

[0068] Aspect 11 : The method of any one of Aspects 1 -10, further comprising: receiving data indicating a user selection of a light intensity; and adjusting the light intensity of the camera feed displayed in the window in response to the user selection of the light intensity.

[0069] Aspect 12: The method of any one of Aspects 1 -11 , wherein generating the scan of the sample comprises generating a scan of a vessel containing the sample.

[0070] Aspect 13: The method of any one of Aspects 1 -12, wherein the second magnification is higher than the first magnification.

[0071] Aspect 14: A computer-readable medium storing instructions that, when executed, cause generating, based on a first channel, a scan of a sample acquired at a first magnification; receiving, in real time from an imaging device, data relating to a camera feed of the imaging device during imaging of the sample, wherein the camera feed is associated with at least one of a second magnification and a second channel, the second magnification being different from the first magnification or the second channel being different from the first channel; and displaying, via an interface of a computing device, a window and the scan of the sample acquired at the first magnification, wherein the camera feed associated with the at least one of the second magnification and the second channel is displayed in the window.

[0072] Aspect 15: The computer-readable medium of Aspect 14, wherein the window is displayed such that it surrounds a portion of the scan.

[0073] Aspect 16: The computer-readable medium of Aspect 14, wherein displaying the window comprises overlaying the window on a portion of the scan.

[0074] Aspect 17: The computer-readable medium of any one of Aspects 14-16, wherein the portion of the scan corresponds to a portion of the sample corresponding to the camera feed.

[0075] Aspect 18: The computer-readable medium of any one of Aspects 14-17, wherein the first channel comprises at least one first fluorescent channel or at least one first transmitted channel.

[0076] Aspect 19: The computer-readable medium of any one of Aspects 14-18, wherein the second channel comprises at least one second fluorescent channel or at least one second transmitted channel.

[0077] Aspect 20: The computer-readable medium of any one of Aspects 14-19, wherein the second channel is different from the first channel.

[0078] Aspect 21 : The computer-readable medium of any one of Aspects 14-20, wherein the instructions, when executed, further cause receiving data indicating a user selection of at least one of the second magnification and the second channel.

[0079] Aspect 22: The computer-readable medium of any one of Aspects 14-21 , wherein the instructions, when executed, further cause: generating an image of thesample, wherein the image comprises a plurality of layers corresponding to different image resolutions; and representing increased or decreased magnification of the camera feed of the imaging device by displaying in the window a layer of the plurality of layers that corresponds to the increased or decreased magnification.

[0080] Aspect 23: The computer-readable medium of any one of Aspects 14-22, wherein the instructions, when executed, further cause: receiving data indicating a user selection of an exposure; and adjusting the exposure of the camera feed displayed in the window in response to the user selection of the exposure.

[0081] Aspect 24: The computer-readable medium of any one of Aspects 14-23, wherein the instructions, when executed, further cause: receiving data indicating a user selection of a light intensity; and adjusting the light intensity of the camera feed displayed in the window in response to the user selection of the light intensity.

[0082] Aspect 25: The computer-readable medium of any one of Aspects 14-24, wherein generating the scan of the sample comprises generating a scan of a vessel containing the sample.

[0083] Aspect 26: The computer-readable medium of any one of Aspects 14-25, wherein the second magnification is higher than the first magnification.

[0084] Aspect 27: An device comprising, consisting of, or consisting essentially of one or more processors; and memory storing instructions that, when executed by the one or more processors, cause the device to: generate, based on a first channel, a scan of a sample acquired at a first magnification; receive, in real time from an imaging device, data relating to a camera feed of the imaging device during imaging of the sample, wherein the camera feed is associated with at least one of a second magnification and a second channel, the second magnification being different from the first magnification or the second channel being different from the first channel; and display, via an interface of a computing device, a window and the scan of the sample acquired at the first magnification, wherein the camera feed associated with the at least one of the second magnification and the second channel is displayed in the window.

[0085] Aspect 28: The device of Aspect 27, wherein the window is displayed such that it surrounds a portion of the scan.

[0086] Aspect 29: The device of Aspect 27, wherein displaying the window comprises overlaying the window on a portion of the scan.

[0087] Aspect 30: The device of any one of Aspects 27-29, wherein the portion of the scan corresponds to a portion of the sample corresponding to the camera feed.

[0088] Aspect 31 : The device of any one of Aspects 27-30, wherein the first channel comprises at least one first fluorescent channel or at least one first transmitted channel.

[0089] Aspect 32: The device of any one of Aspects 27-31 , wherein the second channel comprises at least one second fluorescent channel or at least one second transmitted channel.

[0090] Aspect 33: The device of any one of Aspects 27-32, wherein the second channel is different from the first channel.

[0091] Aspect 34: The device of any one of Aspects 27-33, wherein the instructions, when executed by the one or more processors, further cause the device to receive data indicating a user selection of at least one of the second magnification and the second channel.

[0092] Aspect 35: The device of any one of Aspects 27-34, wherein the instructions, when executed by the one or more processors, further cause the device to: generate an image of the sample, wherein the image comprises a plurality of layers corresponding to different image resolutions; and represent increased or decreased magnification of the camera feed by displaying in the window a layer of the plurality of layers that corresponds to the increased or decreased magnification.

[0093] Aspect 36: The device of any one of Aspects 27-34, wherein the instructions, when executed by the one or more processors, further cause the device to: receive data indicating a user selection of an exposure; and adjust the exposure of the camera feed displayed in the window in response to the user selection of the exposure.

[0094] Aspect 37: The device of any one of Aspects 27-36, wherein the instructions, when executed by the one or more processors, further cause the device to: receive data indicating a user selection of a light intensity; and adjust the light intensity of the camera feed displayed in the window in response to the user selection of the light intensity.

[0095] Aspect 38: The device of any one of Aspects 27-37, wherein generating the scan of the sample comprises generating a scan of a vessel containing the sample.

[0096] Aspect 39: The device of any one of Aspects 27-38, wherein the second magnification is higher than the first magnification.

[0097] In the above detailed description, reference is made to the accompanying drawings that form a part hereof wherein like numerals designate like parts throughout, and in which is shown, by way of illustration, embodiments that can be practiced. It is to be understood that other embodiments can be utilized, and structural or logical changes can be made, without departing from the scope of the present disclosure. Therefore, the detailed description is not to be taken in a limiting sense.

[0098] Various operations can be described as multiple discrete actions or operations in turn, in a manner that is most helpful in understanding the subject matter disclosed herein. The order of description, however, should not be construed as to imply that these operations are necessarily order dependent. In particular, these operations need not be performed in the order of presentation. Operations described can be performed in a different order from the described embodiment. Various additional operations can be performed, and / or described operations can be omitted in additional embodiments.

[0099] For the purposes of the present disclosure, the phrases "A and / or B" and "A or B" mean (A), (B), or (A and B). For the purposes of the present disclosure, the phrases "A, B, and / or C" and "A, B, or C" mean (A), (B), (C), (A and B), (A and C), (B and C), or (A, B, and C). Although some elements can be referred to in the singular, such as “a processing device”, any appropriate elements can be represented by multiple instances of that element, and vice versa. For example, a set of operations described as performed by a processing device can be implemented with different ones of the operations performed by different processing devices.

[0100] The description uses the phrases "an embodiment," “various embodiments,” and "some embodiments," each of which can refer to one or more of the same or different embodiments. Furthermore, the terms "comprising," "including," "having," and the like, as used with respect to embodiments of the present disclosure, are synonymous. When used to describe a range of dimensions, the phrase "between X and Y" represents a range that includes X and Y. As used herein, an “apparatus” can refer to any individual device, collection of devices, part of a device, or collections of parts of devices. The drawings are not necessarily to scale.

Claims

Claims1 . A method, comprising: generating, by a computing device and based on a first channel, a scan of a sample acquired at a first magnification; receiving, by the computing device in real time from an imaging device, data relating to a camera feed of the imaging device during imaging of the sample, wherein the camera feed is associated with at least one of a second magnification and a second channel; and displaying, by the computing device via an interface of the computing device, a window and the scan of the sample acquired at the first magnification, wherein the window displays the camera feed associated with the at least one of the second magnification and the second channel.

2. The method of claim 1 , wherein the window is displayed such that it surrounds a portion of the scan.

3. The method of claim 1 , wherein displaying the window comprises overlaying the window on a portion of the scan.

4. The method of any one of claims 1 -3, wherein the second magnification is different from the first magnification or the second channel is different from the first channel.

5. The method of any one of claims 1 -4, wherein the portion of the scan corresponds to a portion of the sample corresponding to the camera feed.

6. The method of any one of claims 1 -5, wherein the first channel comprises at least one first fluorescent channel.

7. The method of any one of claims 1 -6, wherein the first channel comprises at least one first transmitted channel.

8. The method of any one of claims 1 -7, wherein the second channel comprises at least one second fluorescent channel or at least one second transmitted channel.

9. The method of any one of claim 1 -8, wherein the second channel is different from the first channel.

10. The method of any one of claim 1 -9, further comprising receiving data indicating a user selection of at least one of the second magnification and the second channel .11 . The method of any one of claims 1 -10, further comprising: generating an image of the sample, wherein the image comprises a plurality of layers corresponding to different image resolutions; and representing increased or decreased magnification of the camera feed of the imaging device by displaying in the window a layer of the plurality of layers that corresponds to the increased or decreased magnification.

12. The method of any one of claims 1 -11 , further comprising: receiving data indicating a user selection of an exposure; and adjusting the exposure of the camera feed displayed in the window in response to the user selection of the exposure.

13. The method of any one of claims 1 -12, further comprising: receiving data indicating a user selection of a light intensity; and adjusting the light intensity of the camera feed displayed in the window in response to the user selection of the light intensity.

14. The method of any one of claims 1 -13, wherein generating the scan of the sample comprises generating a scan of a vessel containing the sample.

15. The method of any one of claims 1 -14, wherein the second magnification is higher than the first magnification.

16. A computer-readable medium storing instructions that, when executed, cause: generating, by a computing device and based on a first channel, a scan of a sample acquired at a first magnification;receiving, by the computing device in real time from an imaging device, data relating to a camera feed of the imaging device during imaging of the sample, wherein the camera feed is associated with at least one of a second magnification and a second channel; and displaying, by the computing device via an interface of the computing device, a window and the scan of the sample acquired at the first magnification, wherein the window displays the camera feed associated with the at least one of the second magnification and the second channel.

17. The computer-readable medium of claim 16, wherein the window is displayed such that it surrounds a portion of the scan.

18. The computer-readable medium of claim 16, wherein displaying the window comprises overlaying the window on a portion of the scan.

19. The computer-readable medium of any one of claims 16-18, wherein the second magnification is different from the first magnification or the second channel is different from the first channel20. The computer-readable medium of any one of claims 16-19, wherein the portion of the scan corresponds to a portion of the sample corresponding to the camera feed.21 . The computer-readable medium of any one of claims 16-20, wherein the first channel comprises at least one first fluorescent channel.

22. The computer-readable medium of any one of claims 16-21 , wherein the first channel comprises at least one first transmitted channel.

23. The computer-readable medium of any one of claims 16-22, wherein the second channel comprises at least one second fluorescent channel or at least one second transmitted channel.

24. The computer-readable medium of any one of claims 16-23, wherein the second channel is different from the first channel.

25. The computer-readable medium of any one of claims 16-24, wherein the instructions, when executed, further cause receiving data indicating a user selection of at least one of the second magnification and the second channel.

26. The computer-readable medium of any one of claims 16-25, wherein the instructions, when executed, further cause: generating an image of the sample, wherein the image comprises a plurality of layers corresponding to different image resolutions; and representing increased or decreased magnification of the camera feed of the imaging device by displaying in the window a layer of the plurality of layers that corresponds to the increased or decreased magnification.

27. The computer-readable medium of any one of claims 16-26, wherein the instructions, when executed, further cause: receiving data indicating a user selection of an exposure; and adjusting the exposure of the camera feed displayed in the window in response to the user selection of the exposure.

28. The computer-readable medium of any one of claims 16-27, wherein the instructions, when executed, further cause: receiving data indicating a user selection of a light intensity; and adjusting the light intensity of the camera feed displayed in the window in response to the user selection of the light intensity.

29. The computer-readable medium of any one of claims 16-28, wherein generating the scan of the sample comprises generating a scan of a vessel containing the sample.

30. The computer-readable medium of any one of claims 16-29, wherein the second magnification is higher than the first magnification.

31. An imaging system comprising: an imaging device; anda computing device comprising: one or more processors; and memory storing instructions that, when executed by the one or more processors, cause the computing device to: generate, based on a first channel, a scan of a sample acquired at a first magnification; receive, in real time from the imaging device, data relating to a camera feed of the imaging device during imaging of the sample, wherein the camera feed is associated with at least one of a second magnification and a second channel; and display, via an interface of the computing device, a window and the scan of the sample acquired at the first magnification, wherein the window displays the camera feed associated with the at least one of the second magnification and the second channel..

32. The imaging system of claim 31 , wherein the window is displayed such that it surrounds a portion of the scan.

33. The imaging system of claim 31 , wherein displaying the window comprises overlaying the window on a portion of the scan.

34. The imaging system of any one of claims 31 -33, wherein the second magnification is different from the first magnification or the second channel is different from the first channel35. The imaging system of any one of claims 31 -34, wherein the portion of the scan corresponds to a portion of the sample corresponding to the camera feed.

36. The imaging system of any one of claims 31 -35, wherein the first channel comprises at least one first fluorescent channel.

37. The imaging system of any one of claims 31 -36, wherein the first channel comprises at least one first transmitted channel.

38. The imaging system of any one of claims 31 -37, wherein the second channel comprises at least one second fluorescent channel or at least one second transmitted channel.

39. The imaging system of any one of claims 31 -38, wherein the second channel is different from the first channel.

40. The imaging system of any one of claims 31 -39, wherein the instructions, when executed by the one or more processors, further cause the computing device to receive data indicating a user selection of at least one of the second magnification and the second channel.41 . The imaging system of any one of claims 31 -40, wherein the instructions, when executed by the one or more processors, further cause the computing device to: generate an image of the sample, wherein the image comprises a plurality of layers corresponding to different image resolutions; and represent increased or decreased magnification of the camera feed by displaying in the window a layer of the plurality of layers that corresponds to the increased or decreased magnification.

42. The imaging system of any one of claims 31 -41 , wherein the instructions, when executed by the one or more processors, further cause the computing device to: receive data indicating a user selection of an exposure; and adjust the exposure of the camera feed displayed in the window in response to the user selection of the exposure.

43. The imaging system of any one of claims 31 -42, wherein the instructions, when executed by the one or more processors, further cause the computing device to: receive data indicating a user selection of a light intensity; andadjust the light intensity of the camera feed displayed in the window in response to the user selection of the light intensity.

44. The imaging system of any one of claims 31 -43, wherein generating the scan of the sample comprises generating a scan of a vessel containing the sample.

45. The imaging system of any one of claims 31 -44, wherein the second magnification is higher than the first magnification.

Citation Information

Patent Citations

  • Integrated Data Visualization for Multi-Dimensional Microscopy

    US20110141103A1

  • Methods, systems and circuits for generating magnification-dependent images suitable for whole slide images

    US20150055844A1

  • Method and apparatus for imaging unsectioned tissue specimens

    US20180259762A1