System and method for displaying medical imaging data

Abstract

The invention relates to a system and method for displaying medical imaging data. The system includes one or more data inputs configured to receive first image data generated by a first medical imaging device, where the first image data includes a field-of-view (FOV) portion and a non-FOV portion, and one or more displays configured to display the FOV portion and the non-FOV portion. And the one or more processors are configured to identify a non-FOV portion of the first image data and generate cropped first image data by removing at least a portion of the non-FOV portion of the first image data, and transmitting the cropped first image data for display in a first portion of the display and transmitting additional information for display in a second portion of the display.

Description

[0001] This application is a divisional application of U.S. Patent Application No. 201980091235.7, filed on December 4, 2019, entitled "System and Method for Displaying Medical Imaging Data". This application claims the benefit of U.S. Provisional Application No. 62 / 775,622, filed on December 5, 2018, the entire contents of which are hereby incorporated herein by reference. Technical Field

[0002] This disclosure generally relates to medical imaging, and more particularly, to medical imaging processing for tissue visualization. Background Technology

[0003] With the advent of high-definition (HD) and ultra-HD / 4K resolutions in surgical visualization, 16:9 aspect ratio surgical monitors have become increasingly common. However, many minimally invasive surgical procedures still rely on optical endoscopes, which result in a field of view smaller than the image sensor's sensing area at the image sensor. This leads to a circular field of view for images and videos over a large portion of the black pixels. For example, in many cases, utilization is only 44% of the available imager area, which can result in only 44% utilization of the available display area. This is especially true for smaller diameter endoscopes, typically the 4mm endoscopes used in arthroscopy and ENT / neuroscopic procedures.

[0004] When surgeons need to view multiple sources of information, such as multiple underutilized optical endoscope images, they may have to switch inputs on their main surgical monitor between various imaging feeds, use picture-in-picture or frame-by-frame mode on the surgical monitor, or look at two different monitors that may be in two different locations in the operating room. All of these options can lead to suboptimal use of the area that can be viewed on the surgical monitor, or cause surgeons to switch contexts between focusing on one monitor and another. Summary of the Invention

[0005] According to some embodiments, a medical imaging processing system is configured to process and combine medical imaging data to generate a display feed that provides an enhanced display of the medical imaging. According to some embodiments, the medical imaging processing system can combine multiple imaging data streams into one or more display streams for displaying data from multiple imaging sources and other imaging session-related information sources together in a single display layout. According to some embodiments, the utilization of the display layout can be optimized by removing unused portions of the imaging data, such as data generated by the imager outside the captured field of view. In some embodiments, the display feed can be generated based on imaging session-specific preferences tailored to a particular type of imaging session and / or a specific imaging system user. In some embodiments, a reconfigurable hardware processor of the medical imaging processing system can be reconfigured from one imaging session to another to provide imaging data processing customized for the next imaging session. Through one or more of these capabilities, the imaging processing system can provide enhanced medical imaging visualization customized to user preferences.

[0006] According to some embodiments, a method of configuring a medical imaging processing system includes: configuring a reconfigurable hardware processor of the medical imaging processing system to a first configuration for a first medical imaging session based on first configuration data stored in a memory, wherein the first configuration implements at least a first medical imaging processing algorithm; receiving first medical imaging data generated during the first medical imaging session; generating enhanced first medical imaging data by processing the first medical imaging data at least in part using the first medical imaging processing algorithm implemented in the first configuration; displaying the enhanced first medical imaging data for observation during the first medical imaging session; reconfiguring the reconfigurable hardware processor to a second configuration for a second medical imaging session based on second configuration data stored in a memory, wherein the second configuration implements at least a second medical imaging processing algorithm not implemented in the first configuration; receiving second medical imaging data generated during the second medical imaging session; generating enhanced second medical imaging data by processing the second medical imaging data at least in part using the second medical imaging processing algorithm implemented in the second configuration; and displaying the enhanced second medical imaging data for observation during the second medical imaging session on a display.

[0007] In any of these embodiments, the method may include receiving input indicating a second medical imaging session, and in response to receiving the input, automatically reconfiguring a reconfigurable hardware processor to a second configuration.

[0008] In any of these embodiments, the input may include a selection of the type of medical procedure.

[0009] In any of these embodiments, the input may include selection of a user profile.

[0010] In any of these embodiments, the input may include a selection of a default configuration profile.

[0011] In any of these embodiments, the default configuration profile may be based on one or more connections from one or more external devices to the medical imaging processing system.

[0012] In any of these embodiments, the default configuration profile may be based on the field of view of the connected external device.

[0013] In any of these embodiments, the first configuration may be associated with a first type of medical procedure, and the second configuration may be associated with a second type of medical procedure.

[0014] In any of these embodiments, a first medical imaging session may include performing a first type of medical procedure on a patient, and a second medical imaging session may include performing a second type of medical procedure on a patient.

[0015] In any of these embodiments, the first configuration may be associated with a first user profile, and the second configuration may be associated with a second user profile.

[0016] In any of these embodiments, a first medical imaging session may include imaging of a patient, and a second medical imaging session may include imaging of a patient.

[0017] In any of these embodiments, the first configuration data and the second configuration data can be associated with the same type of medical procedure.

[0018] In any of these embodiments, the first medical imaging session may be a first surgical session, and the second medical imaging session may be a second surgical session.

[0019] In any of these embodiments, at least one medical imaging processing algorithm implemented in the second configuration may include a smoke detection algorithm, and generating enhanced second medical imaging data may include enhancing the clarity of one or more portions of one or more images associated with smoke.

[0020] In any of these embodiments, the first medical imaging processing algorithm can be configured to detect features of the imaged tissue.

[0021] In any of these embodiments, the features of the imaged tissue may be tissue perfusion, location of blood vessels, blood flow, size of the imaged tissue, or a combination thereof.

[0022] In any of these embodiments, the enhanced second medical imaging data may include an overlay on at least a portion of the second medical imaging data.

[0023] In any of these embodiments, the reconfigurable hardware processor can be reconfigured before imaging begins.

[0024] In any of these embodiments, one or more medical imaging processing algorithms may be implemented in both the first and second configurations.

[0025] In any of these embodiments, the second medical imaging data may include at least one of video frames and images.

[0026] In any of these embodiments, the second medical imaging data can be received from the endoscopic imaging system.

[0027] In any of these embodiments, the second medical imaging data can be received from the camera control unit.

[0028] In any of these embodiments, the reconfigurable hardware processor may be an FPGA or a GPU.

[0029] In any of these embodiments, the method may include receiving second medical imaging data from a first device, receiving data from the second medical device, and outputting a display feed to a display, the display feed including at least a portion of the enhanced second medical imaging data and data from the second medical device.

[0030] In any of these embodiments, the method may include receiving second medical imaging data and data from a second medical device at a first processor, transferring the second medical imaging data from the first processor to a reconfigurable hardware processor, receiving enhanced second medical imaging data from the reconfigurable hardware processor at the first processor, and generating a display feed by the first processor by combining the enhanced second medical imaging data with at least a portion of the data associated with the second medical device.

[0031] In any of these embodiments, the first configuration data may be stored in a remote memory and received via a network connection.

[0032] According to some embodiments, a method for displaying medical imaging data includes receiving first image data generated by a first medical imaging device, wherein the first image data includes a field of view (FOV) portion and a non-FOV portion; identifying the non-FOV portion of the first image data; generating cropped first image data by removing at least a portion of the non-FOV portion of the first image data; and displaying the cropped first image data in a first portion of a display and displaying additional information in a second portion of the display.

[0033] In any of these embodiments, edge detection can be used to identify non-FOV portions.

[0034] In any of these embodiments, the first image data may include a series of video frames, and edge detection may be performed on more than one frame.

[0035] In any of these embodiments, a non-FOV portion may be identified using one or more of the center location of the FOV portion and measurements associated with the size of the FOV portion.

[0036] In any of these embodiments, the center position of the FOV portion and measurements associated with the size of the FOV portion can be determined during the imaging session initialization process.

[0037] In any of these embodiments, the imaging session initialization process can be a white balance process.

[0038] In any of these embodiments, the first image data may include a rectangular image or video frame, and the FOV portion may be a circular portion of the rectangular image or video frame.

[0039] In any of these embodiments, the first image data may include video frames.

[0040] In any of these embodiments, the first image data may be received at a first input of the medical imaging processing system, and additional information may be based on data received at a second input of the medical imaging processing system.

[0041] In any of these embodiments, the method may include transmitting a display feed from a medical imaging processing system to a display, the display feed comprising a combination of cropped first image data and additional information.

[0042] In any of these embodiments, the method may include receiving second image data generated by a second medical imaging device; identifying non-FOV portions of the second image data; generating cropped second image data by removing at least a portion of the non-FOV portions of the second image data; and displaying the cropped second image data in a second portion of a display.

[0043] In any of these embodiments, the first image data may be received at a first input of the medical imaging processing system, and the second image data may be received at a second input of the medical imaging processing system.

[0044] In any of these embodiments, the method may include transmitting a display feed from a medical imaging processing system to a display, the display feed comprising a combination of cropped first image data and cropped second image data.

[0045] In any of these embodiments, the cropped first image data and additional information may be located on the display based on configuration data stored in memory.

[0046] In any of these embodiments, the configuration data may include user-specified configuration data.

[0047] In any of these embodiments, configuration data can be received via a network connection.

[0048] In any of these embodiments, the first image data can be received from an endoscopic imaging system, an intraoperative C-arm imaging system, or an ultrasound system.

[0049] In any of these embodiments, the first image data can be received from the camera control unit.

[0050] In any of these embodiments, additional information may include one or more of patient data, metrics, charts, images, device status, and video feeds.

[0051] According to some embodiments, a reconfigurable medical imaging processing system includes a display; a memory; a reconfigurable hardware processor; and a second processor configured to: configure the reconfigurable hardware processor to a first configuration for a first medical imaging session based on first configuration data stored in the memory, wherein the reconfigurable hardware processor in the first configuration is configured to implement at least a first medical imaging processing algorithm and to process first medical imaging data at least in part using the first medical imaging processing algorithm to generate enhanced first medical imaging data for display on the display; and reconfigure the reconfigurable hardware processor to a second configuration for a second medical imaging session based on second configuration data stored in the memory, wherein the reconfigurable hardware processor in the second configuration is configured to implement at least a second medical imaging processing algorithm and to process second medical imaging data at least in part using the second medical imaging processing algorithm to generate enhanced second medical imaging data for display on the display.

[0052] In any of these embodiments, the second processor may be configured to receive input indicating a second medical imaging session, and in response to receiving the input, automatically reconfigure the reconfigurable hardware processor to a second configuration.

[0053] In any of these embodiments, the input may include a selection of the type of medical procedure.

[0054] In any of these embodiments, the input may include selection of a user profile.

[0055] In any of these embodiments, the input may include a selection of a default configuration profile.

[0056] In any of these embodiments, the default configuration profile may be based on one or more connections from one or more external devices to the medical imaging processing system.

[0057] In any of these embodiments, the default configuration profile may be based on the field of view of the connected external device.

[0058] In any of these embodiments, the first configuration may be associated with a first type of medical procedure, and the second configuration may be associated with a second type of medical procedure.

[0059] In any of these embodiments, a first medical imaging session may include performing a first type of medical procedure on a patient, and a second medical imaging session may include performing a second type of medical procedure on a patient.

[0060] In any of these embodiments, the first configuration may be associated with a first user profile, and the second configuration may be associated with a second user profile.

[0061] In any of these embodiments, a first medical imaging session may include imaging of a patient, and a second medical imaging session may include imaging of a patient.

[0062] In any of these embodiments, the first configuration data and the second configuration data can be associated with the same type of medical procedure.

[0063] In any of these embodiments, the first medical imaging session may be a first surgical session, and the second medical imaging session may be a second surgical session.

[0064] In any of these embodiments, at least one medical imaging processing algorithm implemented in the second configuration may include a smoke detection algorithm, and generating enhanced second medical imaging data may include enhancing the clarity of one or more portions of one or more images associated with smoke.

[0065] In any of these embodiments, the first medical imaging processing algorithm can be configured to detect features of the imaged tissue.

[0066] In any of these embodiments, the features of the imaged tissue may be tissue perfusion, location of blood vessels, blood flow, size of the imaged tissue, or a combination thereof.

[0067] In any of these embodiments, the enhanced second medical imaging data may include an overlay on at least a portion of the second medical imaging data.

[0068] In any of these embodiments, the system can be configured to reconfigure the reconfigurable hardware processor before imaging begins.

[0069] In any of these embodiments, one or more medical imaging processing algorithms may be implemented in both the first and second configurations.

[0070] In any of these embodiments, the second medical imaging data may include at least one of video frames and images.

[0071] In any of these embodiments, the system may be configured to receive second medical imaging data from an endoscopic imaging system.

[0072] In any of these embodiments, the system can be configured to receive second medical imaging data from a camera control unit.

[0073] In any of these embodiments, the reconfigurable hardware processor may be an FPGA or a GPU.

[0074] In any of these embodiments, the system may be configured to receive second medical imaging data from a first device, receive data from a second medical device, and display enhanced second medical imaging data and at least a portion of the data from the second medical device.

[0075] In any of these embodiments, the system may be configured to receive second medical imaging data and data from a second medical device at a second processor, transfer the second medical imaging data from the second processor to a reconfigurable hardware processor, receive enhanced second medical imaging data from the reconfigurable hardware processor at the second processor, and generate a display feed for display by the second processor by combining the enhanced second medical imaging data with at least a portion of the data associated with the second medical device.

[0076] In any of these embodiments, the first configuration data may be stored in a remote memory and received via a network connection.

[0077] According to some embodiments, a system for displaying medical imaging data includes one or more data inputs; one or more processors; and one or more displays, wherein the one or more data inputs are configured to receive first image data generated by a first medical imaging device, wherein the first image data includes a field of view (FOV) portion and a non-FOV portion, and the one or more processors are configured to identify the non-FOV portion of the first image data, generate cropped first image data by removing at least a portion of the non-FOV portion of the first image data, and transmit the cropped first image data for display in a first portion of the displays and transmit additional information for display in a second portion of the one or more displays.

[0078] In any of these embodiments, the one or more processors may be configured to use edge detection to identify non-FOV portions.

[0079] In any of these embodiments, the first image data may include a series of video frames, and the one or more processors may be configured to identify non-FOV portions using edge detection performed on more than one frame.

[0080] In any of these embodiments, the one or more processors may be configured to identify non-FOV portions using one or more of the center location of the FOV portion and measurements associated with the size of the FOV portion.

[0081] In any of these embodiments, the one or more processors may be configured to determine the center position of the FOV portion and measurements associated with the size of the FOV portion during the imaging session initialization process.

[0082] In any of these embodiments, the imaging session initialization process can be a white balance process.

[0083] In any of these embodiments, the first image data may include a rectangular image or video frame, and the FOV portion may be a circular portion of the rectangular image or video frame.

[0084] In any of these embodiments, the first image data may include video frames.

[0085] In any of these embodiments, the one or more data inputs may be configured to receive first image data at a first input of the medical imaging processing system, and additional medical imaging data may be based on data received at a second input of the medical imaging processing system.

[0086] In any of these embodiments, the medical imaging processing system can be configured to transmit a display feed from the medical imaging processing system to a display, the display feed including a combination of cropped first image data and additional medical imaging data.

[0087] In any of these embodiments, the one or more data inputs may be configured to receive second image data generated by a second medical imaging device; and the one or more processors may be configured to: identify non-FOV portions of the second image data, generate cropped second image data by removing at least a portion of the non-FOV portions of the second image data, and transmit the cropped second image data for display in a second portion of the one or more displays.

[0088] In any of these embodiments, the one or more data inputs may be configured to receive first image data at a first input of the medical imaging processing system and second image data at a second input of the medical imaging processing system.

[0089] In any of these embodiments, the medical imaging processing system can be configured to transmit a display feed from the medical imaging processing system to a display, the display feed comprising a combination of cropped first image data and cropped second image data.

[0090] In any of these embodiments, based on configuration data stored in memory, cropped first image data and additional medical imaging data may be located on the display.

[0091] In any of these embodiments, the configuration data may include user-specified configuration data.

[0092] In any of these embodiments, the system is configured to receive configuration data via a network connection.

[0093] In any of these embodiments, the one or more data inputs may be configured to receive first image data from an endoscopic imaging system, an intraoperative C-arm imaging system, or an ultrasound system.

[0094] In any of these embodiments, the one or more data inputs may be configured to receive first image data from the camera control unit.

[0095] In any of these embodiments, additional information may include one or more of patient data, metrics, charts, images, device status, and video feeds.

[0096] According to some embodiments, a non-transitory tangible computer-readable medium includes computer-executable program code embedded thereon for performing any of the above methods.

[0097] According to some embodiments, a kit for processing time series of fluorescence images of subject tissue includes any of the above systems and / or any of the above non-transitory tangible computer-readable media, as well as a fluorescence imaging agent.

[0098] According to some embodiments, a fluorescent imaging agent is provided for use in any of the above methods, in any of the above systems, or in any of the above kits for imaging an object.

[0099] In any of these embodiments, imaging the object may include imaging the object during blood flow imaging, tissue perfusion imaging, lymphatic imaging, or a combination thereof.

[0100] In any of these embodiments, blood flow imaging, tissue perfusion imaging, and / or lymphatic imaging may be included during invasive surgical procedures, minimally invasive surgical procedures, or non-invasive surgical procedures.

[0101] In any of these embodiments, invasive surgical procedures may include cardiac-related surgical procedures or reconstructive surgical procedures.

[0102] In any of these embodiments, cardiac-related surgical procedures may include a coronary artery bypass graft (CABG) procedure.

[0103] In any of these embodiments, the CABG procedure may be extracorporeal or non-extracorporeal.

[0104] In any of these embodiments, the non-invasive surgical procedure may include a wound care procedure.

[0105] In any of these embodiments, lymphatic imaging may include lymph node identification, lymph node drainage, lymph mapping, or a combination thereof.

[0106] In any of these embodiments, lymphatic imaging may involve the female reproductive system.

[0107] Some embodiments include the use of any of the above methods in any of the above systems or in any of the above kits for imaging an object for lymphatic imaging.

[0108] Some embodiments include the use of any of the above methods in any of the above systems or in any of the above kits for imaging an object for blood flow imaging, tissue perfusion imaging, or a combination thereof.

[0109] It should be understood that any variations disclosed herein in conjunction with the methods, systems, kits and other aspects of this disclosure can be combined. Attached Figure Description

[0110] The invention will now be described by way of example only with reference to the accompanying drawings, in which: Figure 1 This is a block diagram of a system for generating and displaying medical imaging data during a medical imaging session, according to some embodiments; Figure 2 The illustration depicts a method for displaying medical imaging data according to some embodiments; Figure 3A An exemplary image generated by an endoscopic imager is illustrated, and Figure 3B The illustration shows two endoscopic images displayed side-by-side on an exemplary display; Figure 3C An exemplary display showing a cropped endoscopic image is illustrated according to some embodiments; Figure 3D An exemplary display according to some embodiments is illustrated, which displays a cropped endoscopic image and additional imaging session-related data according to some embodiments; Figure 4 This is a block diagram of a medical imaging data processing center according to some embodiments; Figure 5A The diagram shows that it can be made by Figure 4 An example of the first predefined display layout generated by the central generator, and Figure 5B The diagram shows that it can be made by Figure 4 An example of a second predefined display layout generated by the central hub; Figure 6 The illustration shows an example of a medical imaging processing hub configured for a first imaging session according to some embodiments; Figure 7 The illustration depicts a method for configuring a medical imaging processing system according to some embodiments; Figure 8A and 8B Execution according to one embodiment Figure 7 A block diagram of a medical imaging processing system based on the method; Figure 9A and 9B The figure illustrates a graphical user interface for configuring a medical imaging processing system for a new imaging session, according to some embodiments. Figure 10 This is an illustrative depiction of an exemplary fluorescence imaging system according to some embodiments; Figure 11 This is an illustrative depiction of an exemplary illumination module of a fluorescence imaging system according to some embodiments; Figure 12 This is an exemplary camera module of a fluorescence imaging system according to some embodiments; and Figure 13 This is an exemplary endoscopic imaging cart according to some embodiments. Detailed Implementation

[0111] Implementations and embodiments of various aspects and variations of the systems and methods described herein will now be described in detail. While several exemplary variations of the systems and methods are described herein, other variations may include aspects of the systems and methods described herein combined in any suitable manner, having all or some of the described aspects. This document describes systems and methods for generating enhanced medical images for display in conjunction with a medical imaging session (e.g., during a medical imaging session). The systems and methods can process data from multiple imaging systems to generate enhanced images and can stitch multiple imaging datasets together into a single display feed for displaying information from multiple sources on a single display. Imaging data can be processed to maximize display utilization, thereby enabling the presentation of more relevant information to a physician during an imaging session.

[0112] According to some embodiments, the system and method can process and combine imaging data differently based on the needs of each imaging session. Practitioners may be able to define the information displayed during their imaging sessions, thereby ensuring that the data is presented in a manner suitable for the practitioner, which can reduce the amount of time required for the practitioner to adjust the display data.

[0113] In some embodiments, one or more reconfigurable hardware processors are reconfigured for each imaging session to provide imaging processing tailored to each session. Reconfigurable hardware processors, such as field-programmable gate arrays (FPGAs), provide the low latency and high bandwidth required for real-time video processing, and also offer the ability to implement different algorithms or combinations of algorithms on different data inputs or combinations of data inputs, as required in different imaging sessions, thereby providing imaging processing tailored to the different needs of different imaging sessions. This configurability and flexibility in the ability to process and combine different input data, according to the embodiments described herein, enables a single imaging processing system to support a wide variety of imaging sessions, including a wide range of surgical procedures.

[0114] In the following description of various embodiments, reference is made to the accompanying drawings, in which specific embodiments that may be practiced are illustrated by way of example. It is to be understood that other embodiments and examples may be practiced, and changes may be made, without departing from the scope of this disclosure.

[0115] Furthermore, it should be understood that the singular forms “a,” “an,” and “the” used in the following description are also intended to include the plural forms, unless the context clearly indicates otherwise. It should also be understood that the term “and / or,” as used herein, refers to and covers any and all possible combinations of one or more associated listed items. To be further understood, when used herein, the terms “comprising,” “including,” “containing,” and / or “comprising” specify the presence of the declared features, integers, steps, operations, elements, parts, and / or units, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, parts, units, and / or groups thereof.

[0116] Certain aspects of this disclosure include process steps and instructions described herein in algorithmic form. It should be noted that the process steps and instructions of this disclosure may be embodied in software, firmware, or hardware, and when embodied in software, may be downloaded to reside on and operate from different platforms used by various operating systems. Unless specifically stated otherwise as will be apparent from the following discussion, it should be understood that throughout the description, the use of terms such as “processing,” “computing,” “operating,” “determining,” “displaying,” and “generating” refers to the actions and processes of a computer system or similar electronic computing device that manipulates and transforms data represented as physical (electronic) quantities within computer system memory or registers or other such information storage, transmission, or display devices.

[0117] In some embodiments, this disclosure also relates to a device for performing the operations described herein. This device may be specifically constructed for the claimed purpose, or it may comprise a general-purpose computer selectively activated or reconfigured by a computer program stored in a computer. Such a computer program may be stored in a non-transitory computer-readable storage medium, such as, but not limited to, any type of disk, including floppy disks, USB flash drives, external hard disk drives, optical disks, CD-ROMs, magneto-optical disks, read-only memory (ROM), random access memory (RAM), EPROM, EEPROM, magnetic cards or optical cards, application-specific integrated circuits (ASICs), or any type of medium suitable for storing electronic instructions, and each is coupled to a computer system bus. Furthermore, the computer mentioned in the specification may include a single processor, or may be an architecture employing a multiprocessor design for increased computing power.

[0118] The methods, apparatus, and systems described herein are not inherently related to any particular computer or other device. Various general-purpose systems may also be used with procedures based on the teachings herein, or it may prove convenient to construct more specialized devices to perform the required method steps. The required structures of various such systems will become apparent from the following description. Furthermore, the invention is described without reference to any particular programming language. It should be understood that the teachings of the invention as described herein can be implemented using various programming languages.

[0119] Figure 1 A system 100 for generating and displaying medical imaging data during a medical imaging session is illustrated. System 100 includes a medical data processing hub 102 that processes data received from one or more imaging modalities 104 to generate one or more display feeds for displaying enhanced medical imaging on one or more displays 106. The one or more imaging modalities 104 may generate image data associated with patient treatment. Image data may be images or videos generated during patient treatment to support one or more medical procedures, such as video captured by an endoscopic camera during an endoscopic procedure on a patient. Examples of medical imaging modalities include, but are not limited to, endoscopic systems, open-field imaging systems, X-ray systems (such as intraoperative C-arm systems), computed tomography systems, ultrasound systems, magnetic resonance imaging systems, and nuclear medicine systems.

[0120] In some embodiments, the central hub 102 may receive data from one or more non-imaging devices 120, which may be used in conjunction with a medical imaging session (e.g., during a medical imaging session) and may provide information that may be relevant to the display during the medical imaging session. Non-limiting examples of non-imaging devices include blowers, irradiation controllers, and voice control systems.

[0121] Central hub 102 can receive image data from one or more imaging modalities 104 via one or more input ports 108. Central hub 102 uses the received imaging data to generate one or more display feeds and transmits these feeds to one or more displays 106 via one or more output ports 110. For example, central hub 102 can generate display feeds that include enhanced imaging of patient tissue based on imaging generated by one or more imaging modalities 104, and the enhanced imaging can be displayed on one or more displays 106 to assist a physician during patient treatment. Central hub 102 can also transmit the display feeds to one or more recording devices 112 for recording the enhanced imaging for later retrieval. Input ports 108 and output ports 110 can be any suitable type of data transmission port, such as a DVI port, HDMI port, RS232 port, IP port, etc.

[0122] Central hub 102 may be connected to one or more networks 116 via one or more network connections 118. The one or more networks may be a local area network (LAN) such as a hospital information system, or a wider network such as a wide area network (WAN) or the Internet. Network connection 118 may be a wired connection such as an Ethernet connection, or a wireless network connection such as a Wi-Fi connection. In some embodiments, central hub 102 may access one or more networks 116 to retrieve configuration data stored at a network location for configuring the hub for an imaging session, and / or may access one or more networks to receive updated software and / or updated hardware files for processing imaging data.

[0123] One or more user interfaces 114 may be connected to the central hub 102 to allow users to provide input to the central hub 102. Users can input data related to configuring the central hub 102 for an imaging session. User input may include, for example, selection of a physician profile associated with an upcoming imaging session, selection of the imaging session type or the type of procedure to be performed during the imaging session, or any other relevant information. The one or more user interfaces 114 may include a tablet computer, keyboard, mouse, voice control system, keypad, touchscreen, or any combination thereof.

[0124] As described in detail below, the central processing unit 102 processes received medical imaging data and any other relevant data, and generates an enhanced display feed for display on one or more displays 106 during an imaging session. According to some embodiments, the central processing unit 102 may combine multiple imaging sources into a single display feed, process received imaging data to generate richer imaging data, modify imaging data for better display space utilization, and / or reconfigure the processing of imaging data based on the user's needs and preferences in different imaging sessions.

[0125] Figure 2 The illustration depicts a method 200 for displaying medical imaging data according to some embodiments. Method 200 can be executed by a medical imaging data processing hub, such as medical imaging data processing hub 102 of system 100. Method 200 is executed to remove unused portions of received imaging data, thereby making better use of display space, which can provide the ability to display more relevant information to the user during an imaging session.

[0126] In many conventional imaging systems, such as endoscope-based imaging systems, including, for example, endoscopic imaging systems, light from a generally circular area of ​​the scene is projected onto the photosensitive portion of one or more imaging sensors. This is because the area of ​​one or more sensors in the imager is generally larger than the area of ​​the light provided by the mirror optics. Therefore, the image captured by one or more sensors includes a field of view (FOV) portion representing the light received from the scene and a non-FOV portion generated by the portions of the one or more sensors that do not receive light from the scene (i.e., pixels). This typically results in a rectangular image with a circular FOV portion in the middle, showing an imaged scene surrounded by a black non-FOV portion (or nearly black due to sensor noise). When endoscopic imaging is displayed in a conventional manner, most of the display is occupied by the non-FOV portion, which displays black pixels that provide no useful information.

[0127] To illustrate this concept, Figure 3A An imaging system, such as an exemplary endoscopic image 300, is illustrated. Image 300 includes a field of view (FOV) portion 302 generated by a sensor portion that receives light from the imaging scene and a non-FOV portion 304 generated by a sensor portion that does not receive light from the scene. Figure 3B The illustration shows two images 300 displayed side-by-side on an exemplary display 350. As illustrated, a relatively large amount of display space is wasted due to the non-FOV portions of the two images. In some embodiments, the central hub 102 may crop some or all of the non-FOV portions of the received image data.

[0128] return Figure 2 At step 202, the medical imaging data processing center receives the first image data generated by the first medical imaging device. The first image data, which may be an image or video frame, includes both FOV (Field of View) and non-FOV (Field of View) portions. For example, the first image data may be a video frame generated by an endoscopic camera, such as... Figure 3A Image 300. The frame may include a field of view (FOV) portion generated by pixels of one or more camera sensors that receive light incident on one or more sensors from the imaging scene, and may include a non-FOV portion generated by pixels of one or more camera sensors that do not receive light from the imaging scene.

[0129] At step 204, the non-FOV portion of the first image data is identified. According to some embodiments, the non-FOV portion can be identified based on one or more predetermined parameters associated with the FOV portion. Examples of predetermined parameters include the center of the FOV portion, the radius or diameter of the FOV portion, and the pixel position associated with the FOV portion or non-FOV portion. Pixels outside the area defined by the predetermined parameters can be identified as non-FOV portions.

[0130] In some embodiments, parameters associated with the FOV portion of data received from the connected device can be determined once and reused as new image data is received from the device to identify the non-FOV portion of the data received from the connected device. For example, the center and diameter (or radius) of the FOV portion can be determined based on image data received from the connected device, and this center and diameter (or radius) can be used to identify the non-FOV portion in future image data received from the device. In some embodiments, one or more edge detection algorithms are used to detect edges of the FOV portion, and the edge data can be used to identify the non-FOV portion of the image, or it can be used to determine the center and diameter (or radius) of the FOV portion, which in turn is used to identify the non-FOV portion of the image.

[0131] In some embodiments, during an imaging session initialization phase of the connected device, one or more parameters associated with the FOV portion of image data received from the connected device are determined, during which an image with a clear boundary between the FOV portion and the non-FOV portion is captured. This initialization phase may be, for example, a white balance phase, in which the imager is directed to a white surface to allow the imager and / or associated light source to adjust one or more imaging parameters, such as gain and light intensity, based on the amount of light received from the white surface. During the white balance phase, the FOV portion of the image data generated by the imager (pointing to a white background) is relatively bright and thus has high contrast with the black non-FOV portion, thereby providing clear edges that can be easily detected using one or more edge detection algorithms.

[0132] In some embodiments, the medical imaging data processing hub receives an indication from the connected device that the connected device is in an initialization phase (such as a white balance phase). In response to receiving this indication, the medical imaging data processing hub performs an edge detection process to determine the location of the FOV portion of the image data received from the connected device. The determined location of the FOV portion (e.g., center, diameter, pixel position, etc.) can be used to identify non-FOV portions of subsequently received image data.

[0133] In some embodiments, non-FOV portions can be identified by detecting the location of the perimeter of the FOV portion of each received image or frame. In some embodiments, one or more edge detection algorithms can be used, for example, to detect the perimeter of the FOV portion in the first image data.

[0134] At step 206, cropped first image data is generated by removing at least a portion of the non-FOV portions of the first image data. One or more non-FOV portions to be removed can be selected based on any suitable cropping criterion, including the desired aspect ratio of the cropped image or a predefined size of the cropped image. For example, a cropping criterion may specify that the cropped image should be square, and based on this criterion, non-FOV portions outside the square covering the FOV portion can be removed, resulting in a square cropped image. Alternatively, a cropping criterion may specify an aspect ratio, and based on this criterion, rectangular non-FOV portions covering the FOV portion can be removed, resulting in a cropped image with a specified aspect ratio.

[0135] In some embodiments, one or more cropping criteria used in step 206 may be based on one or more attributes of the connected display. For example, the size of the display may be used to determine the boundaries of the cropped image. The display size may be divided into display segments, and the size of the display segments may determine the boundaries of the cropped image. For example, in Figure 3D In the exemplary display, the first display segment 320 can be sized such that the image to be displayed in segment 320 can be cropped to the width of the FOV portion of the image to be displayed in segment 320, while the image to be displayed in the second segment 322 can be cropped to the height of the FOV portion of the image to be displayed in segment 322.

[0136] In some embodiments, the medical imaging data processing center can receive information about the display area (i.e., pixel size, spatial size, etc.) from a connected display. In other embodiments, one or more display area parameters are user-defined.

[0137] At step 208, a display feed is generated based on the cropped first image data. The display feed is transmitted to one or more connected displays, such as display 106 of system 100, via one or more display connections, and the cropped first image data is displayed on the display. In some embodiments, the cropped first image may be displayed in a first portion of the display, and additional information may be displayed in a second portion of the display. Examples of the additional information that may be displayed include one or more images, videos, patient data and / or patient metadata, connected device status, imaging-related metrics or any other connected device-related information, one or more charts, etc. According to some embodiments, by cropping the first image data, the first portion of the display can occupy less space on the display, thereby increasing the amount of display space available for displaying additional information. According to some embodiments, the cropped image data may be displayed in a portion of the screen having the same height and / or width as a portion that would display the uncropped image data, but cropping the image data allows the FOV portion to be larger on the display.

[0138] In some embodiments, image data can be received from multiple connected devices, and image data from each connected device can be cropped according to the method 200 discussed above. A display feed can be generated for displaying multiple cropped images on one or more connected displays. In some embodiments, additional information can be displayed along with one or more cropped images. The additional information can be based on data received from one or more connected devices. For example, an insufflation system connected to a medical imaging data processing hub can transmit insufflation pressure readings to the system, and the pressure readings can be combined with cropped endoscopic images from the display feed for display alongside the cropped endoscopic images on a display.

[0139] Figure 3C The illustration shows two cropped images 310 generated according to method 200. Figure 3B An exemplary display 350. The cropped image 310 includes... Figure 3B The FOV portion 302 of image 300, in which a portion of the non-FOV portion is removed. As illustrated, image cropping allows the image to be displayed much larger. Image cropping can also provide space to display additional information. For example, in Figure 3D In this display, cropped image 310 occupies a first portion 320 of display 350, second cropped image 326 occupies a second portion 322 of display 350, and exemplary chart 328 occupies a third portion 324 of display. Therefore, a medical imaging processing system such as central processing unit 102 can maximize the utilization of the display for displaying medical imaging data and other information.

[0140] Figure 4 This is a block diagram of a medical imaging data processing center 400 according to one embodiment, which can be used in a medical imaging system (such as...). Figure 1 In system 100, multiple data streams from connected medical devices (such as imaging devices) are processed, and an optimized display layout is generated for displaying useful information to a user (such as a surgeon) during medical procedures. A central hub 400 includes one or more input connections 402 for receiving data from connected devices. The central hub 400 includes one or more outputs 404 for connecting to one or more display devices. The central hub 400 includes a main processing unit 406 that processes at least a portion of the data received from the connected devices and generates display feeds for output to one or more connected displays.

[0141] The central processing unit 400 includes a main processing unit 406 for managing the processing of imaging data and generating display feeds using the processed data, a reconfigurable hardware processor 408 for processing the imaging data stream, and an auxiliary processing unit 410 for providing software-based processing of imaging data and other data.

[0142] The reconfigurable hardware processor 408 may be a field-programmable gate array (FPGA), which can be reconfigured by loading a hardware logic file that defines the circuit connections in the FPGA. The reconfigurable hardware processor 408 provides low-latency and high-bandwidth processing of imaging data and can be repeatedly reconfigured to provide different processing of imaging data for different imaging sessions. By utilizing the reconfigurable hardware processor, the hub 400 can provide enhanced imaging data, such as video, in real time, with little or no latency between capturing the image and displaying the enhanced image on a connected display during an imaging session. In some embodiments, the reconfigurable hardware processor 408 is a reconfigurable GPU. The main processing unit 406 and the auxiliary processing unit 410 may each be any suitable processor or combination of processors, such as a central processing unit, graphics processing unit, microcontroller, ASIC, or FPGA, or any combination thereof.

[0143] The central processing unit 400 includes a memory 412, which may be a local memory located within the central processing unit 400 or a remote memory located at a remote location that can be accessed by the central processing unit 400 via a network connection. One or more portions of the memory 412 may be local, and one or more portions may be located remotely. The memory 412 may include one or more configuration files 414 specifying the configuration of the central processing unit 400 for different imaging sessions, one or more software programs for execution by the main processing unit 406 and / or the auxiliary processing unit 410, and one or more hardware logic files 418 for reconfiguring the reconfigurable hardware processor 408. The main processing unit 406 can access the configuration file 414 to determine the processing requirements specified in the configuration file, load the hardware logic file 418 onto the reconfigurable hardware processor 408 defined by the configuration file, and load the software program 416 onto the auxiliary processing unit 410 specified in the configuration file 414. Therefore, the data stored in the memory 412 can be used to configure the central processing unit 400 for different imaging sessions.

[0144] A reconfigurable hardware processor 408 is communicatively connected to a main processing unit 406. The main processing unit 406 can send video data streams to the reconfigurable hardware processor 408 for processing and can receive processed video back from the reconfigurable hardware processor 408 for inclusion in display feeds. The main processing unit can load hardware logic files into the reconfigurable hardware processor 408 for reconfiguring the reconfigurable hardware processor 408.

[0145] The auxiliary processing unit 410 is communicatively coupled to the main processing unit 406. The main processing unit 406 can send data to the auxiliary processing unit 410 for processing and can receive processing results for inclusion in the display feed. The main processing unit 406 can load software for processing imaging data onto the auxiliary processing unit 410.

[0146] The hub 400 is configured to combine information received from multiple connected devices into a display feed for display on connected monitors. Therefore, multiple information sources can be displayed simultaneously on connected monitors. The hub 400 is configured to stitch together information received from connected devices according to a predefined layout. For example, the hub 400 can generate a display feed in which a first video stream is displayed in a first display segment, a second video stream is displayed in a second display segment, and additional information such as data, alarms, device status, and metrics are displayed in a third display segment.

[0147] According to some embodiments, the main processing unit 406 is responsible for receiving data from connected devices and stitching the data together into a composite display feed. The main processing unit 406 may utilize a reconfigurable hardware processor 408 and / or an auxiliary processing unit 410 to process the received data for enhancing the display of the data.

[0148] The main processing unit 406 combines information sources into a display feed according to one or more predefined display layouts, which specify the imaging type of the information to be displayed, as well as the relative size and position of the imaging information and other information used for display. The predefined display layouts can be associated with different types of imaging sessions, such as different types of surgical sessions or different types of surgical or other medical procedures. Different types of procedures may involve different types of imaging equipment and / or different types of imaging processing algorithms, and the predefined display layouts can specify the type of information to be displayed for a given procedure. Depending on the practitioner's preferences, the predefined display layouts can be associated with different practitioners. For example, the same information may be displayed differently for two different practitioners performing the same procedure. The predefined display layouts can be stored as a configuration data file 414 in memory 412.

[0149] Figure 5A The illustration shows an example of the first predefined display layout 500, and Figure 5B An example of a second predefined display layout 520 is illustrated. A first layout 500 includes three segments for three different sources—502, 504, and 506. The term "source" refers to different data outputs generated by the central hub 400. A source may include data received from one or more connected devices, enhanced data generated by processing data received from one or more connected devices, or any combination thereof. Multiple sources may include or be based on the same data received from connected devices. For example, a first source may include a video stream received from a connected device, and a second source may include the same video stream enhanced using information extracted from the video stream or information received from another connected device.

[0150] In addition to defining the sources to be displayed, the predefined display layout also defines the relative positions and sizes of the different sources on the display. For example, in the first layout 500, the first source 502 is located above the second source 504 on the left half of the display, where sources 502 and 504 are equal in size. The third source 506 is located on the right half of the display and is larger than the first and second sources. In contrast, layout 520 includes six different sources of equal size arranged in two rows and three columns. In addition to the three other sources, layout 520 includes the first source 502, the second source 504, and the third source 506. The first source 502 and the second source 504 are in different positions relative to layout 500, and the third source 506 has a different size relative to layout 500. Layout 500 can be associated with a first practitioner who configures layout 500 according to their preferences, and layout 520 can be associated with a second practitioner. Layouts 500 and 520 can be associated with different types of imaging sessions, such as different types of surgical procedures, or they can be associated with the same type of surgical procedure. In some embodiments, both layouts are used in the same imaging session. For example, layout 500 may define the layout of the first display of the imaging system, and layout 520 may define the layout of the second display of the imaging system.

[0151] The central processing unit 400 can configure the display feed according to one or more parameters associated with the imaging session. The central processing unit 400 can be used for a variety of different types of medical procedures and / or by multiple different practitioners. As used herein, a medical procedure can refer to a single (e.g., surgical) procedure with various tasks performed by a practitioner (e.g., a surgeon), or to more than one procedure performed in a single session with a patient (e.g., a single surgical session with a patient). For example, an orthopedic surgical session involving the performance of an orthopedic procedure (e.g., drilling and / or implantation of a medical device) along with imaging procedures (e.g., visualization of tissue space and / or blood flow / tissue perfusion) can be a single medical procedure or can be multiple medical procedures. Different types of medical procedures can utilize different types of imagers and other equipment. A display layout designed for one type of procedure may not be suitable for another type of procedure. Furthermore, different practitioners may have different preferences regarding what type of information should be displayed and how it should be displayed. Therefore, the central processing unit 400 can process the received data and generate the display feed differently based on the specific requirements or preferences of each medical imaging session.

[0152] The central processing unit 400 can be configured to process input data and generate display feeds based on one or more predefined configurations. These predefined configurations can be associated with one or more parameters of an imaging session. Examples of imaging session parameters may include the user (e.g., a physician), the procedure type, information associated with one or more connected input devices, and information associated with one or more connected output devices.

[0153] The central hub 400 can receive user input specifying one or more parameter values ​​(such as via...). Figure 1 The user interface 114 allows selection of predefined configurations based on one or more parameter values. The hub 400 then reconfigures the processing of one or more inputs and the generation of one or more display feeds based on the selected predefined configuration.

[0154] The predefined configuration can define a predefined display layout and can also define one or more data processing algorithms. The algorithms can be implemented, for example, in a reconfigurable hardware processor 408 and / or an auxiliary processing unit 410. In some embodiments, the reconfigurable hardware processor 408 can be reconfigured according to the predefined configuration to perform imaging data processing specified by the predefined configuration.

[0155] As explained above, different sources can be included in different layouts. Different sources can be data from different connected devices, or different information extracted from the same connected device. To facilitate the generation of different data depending on the connected devices and layout preferences from one imaging session to the next, the hub 400 can automatically reconfigure the processing of data received from connected devices according to the requirements specified in the configuration data associated with the imaging session.

[0156] The central processing unit 400 can receive instructions for an imaging session associated with a predefined configuration and can automatically configure the processing of input data and the generation of display feeds accordingly. For example, when preparing for a surgical session, a nurse can input one or more parameters associated with the surgical session into the central processing unit 400 via a keyboard, mouse, touchscreen, or other input device, and the central processing unit 400 can configure itself accordingly. This may include reconfiguring a reconfigurable hardware processor by loading one or more hardware logic files stored in memory 412, and loading one or more software programs or modules onto the auxiliary processing unit 410. Parameters may include the type of surgical procedure to be performed and the practicing physician performing the procedure. One or more predefined layouts may be associated with the type of surgical procedure and / or the practicing physician, and the central processing unit 400 can reconfigure itself to generate display feeds based on the predefined layouts.

[0157] Figure 6 An example of a medical imaging processing hub (such as hub 400) configured for a first imaging session is illustrated. The configured hub 600 includes a main processor 602, a reconfigurable hardware processor 604, and an auxiliary processor 606. Hub 600 includes multiple data inputs 608, three of which are connected to three different devices (630, 632, and 634), which may be a camera, camera control unit, instrument control unit, illumination control unit, blowpipe, ablation device, or any other device or system used during the imaging session to generate data relevant to the imaging session. Hub 600 includes multiple video outputs 610. In the illustrated embodiment, two displays 640 and 642 are connected to two of the video outputs 610.

[0158] In the first configuration, one or more algorithms have been loaded onto a reconfigurable hardware processor 604 for processing imaging data received from device 632. The reconfigurable hardware processor 604 processes the data received from device 632 and transmits the processed data to main processor 602. The reconfigurable hardware processor 604 may receive imaging data directly from input 608 or may receive data via main processor 602. In some embodiments, main processor 602 may, according to the above, [further details regarding the algorithm would be needed]. Figure 2Method 200 describes the principle of cropping image data and providing the cropped image data to a reconfigurable hardware processor 604 and / or auxiliary processor 606. This can be advantageous in reducing the amount of imaging data that needs to be processed.

[0159] The auxiliary processor 606 executes a software-based program for processing data from the third connection device 634. The auxiliary processor 606 can output the processing results to the main processor 602 via, for example, a video output 612 (such as a video output on the motherboard of the CPU).

[0160] The main processor 602 is responsible for combining different data sources into display feeds for transmission to the connected display 640. The main processor combines processed data from the reconfigurable hardware processor 604, the auxiliary processor 606, and directly from the first connected device 630. For example, the main processor can generate display feeds that locate these three sources in different segments of the display.

[0161] In some embodiments, the main processor 602 may be configured to provide multiple different display streams. In the illustrated embodiment, the main processor 602 includes two compositors 614 and 616, which can generate two different display feeds based on configuration data stored, for example, in memory. The first compositor 614 is configured to combine data from a first connected device, a reconfigurable hardware processor 604, and an auxiliary processor 606 into a first display feed for transmission to a display 640. The second compositor 616 receives data input (e.g., video input) from a device 634 and generates a second display feed for transmission to a display 642.

[0162] The compositor can combine data sources differently from one imaging session to the next and generate display feeds. The compositor's handling of data can be modified based on configuration data stored in memory. For example, Figure 6 The data processing illustrated herein can be defined by a first configuration file. A second configuration file can specify changes to this data processing, for example, as follows: a first synthesizer 614 generates a display feed based solely on data from a first device 630 for display on a first display 640, and a second synthesizer 616 generates a display feed based on data from devices 632 and 634 for display on a second display 642. Different configurations can be associated with different types of procedures and / or different practitioners to, for example, support different imaging sessions.

[0163] Figure 7A method 700 for configuring a medical imaging processing system, such as a central hub 400, according to some embodiments is illustrated. As further described below, method 700 includes reconfiguring a reconfigurable hardware processor, such as a reconfigurable hardware processor 408 of the central hub 400, based on predefined configuration data associated with a medical imaging session. The reconfigurable hardware processor is configured to implement an imaging data processing algorithm defined by the configuration data. Utilizing a reconfigurable hardware processor to implement the imaging processing algorithm allows for hardware processor configurations to be customized to process imaging data according to a specified algorithm, and allows for different algorithms to be implemented for different imaging sessions with different imaging inputs and / or display requirements. Therefore, a reconfigurable hardware processor can provide advantages over a general-purpose processor running software-based algorithms, which may not be able to offer the lower latency and higher bandwidth that a reconfigurable processor can provide, which is important for providing real-time processing of video for display during medical procedures.

[0164] At step 702, a reconfigurable hardware processor, such as a reconfigurable hardware processor 408 of the central processing unit 400, is configured in a first configuration for a first medical imaging session. The configuration of the hardware processor may be based on first configuration data stored in memory. The first configuration data may define one or more medical imaging processing algorithms to be implemented by the reconfigurable hardware processor. Once configured in the first configuration, the reconfigurable hardware processor implements one or more medical imaging processing algorithms as defined in the configuration data. The reconfigurable hardware processor can be configured by loading one or more hardware logic files from memory (which may be handled by a second processor such as the main processing unit 406 of the central processing unit 400) onto the reconfigurable hardware processor.

[0165] The first imaging session may include performing one or more medical procedures, such as surgical procedures, on the patient. The first imaging session may begin with a nurse or other user initializing the medical imaging system with a medical procedure or a series of medical procedures performed on the patient. The first medical imaging session may be completed when the medical procedure on the patient or all of a series of medical procedures is completed, or it may be completed when the first of a series of procedures on the patient is completed. As an example of the latter scenario, a first medical procedure on the patient, such as a first surgical procedure, may be completed, which completes the first imaging session, and this may be followed by a second medical procedure, such as a different surgical procedure performed by the same or different surgeons. The second medical procedure may include a second imaging session.

[0166] A reconfigurable hardware processor in its first configuration is configured to receive medical imaging data and process at least a portion of the data using a first imaging processing algorithm. In some embodiments, the first configuration may further include the ability to process the received data using one or more additional processing algorithms. The reconfigurable hardware processor in the first configuration may have the ability to process multiple different imaging datasets (e.g., generated by different devices) using the first imaging processing algorithm and / or additional imaging processing algorithms. For example, the reconfigurable hardware processor in the first configuration may receive a first dataset generated by a first connected device and process the first dataset using the first medical imaging processing algorithm, and may also receive a second dataset generated by a second connected device and process the second dataset using a second medical imaging processing algorithm.

[0167] In some embodiments, a reconfigurable hardware processor is configured in response to input indicating a first medical imaging session. For example, a user, such as an operating room nurse, may provide the medical imaging processing system with information specifying parameters associated with the imaging session, such as the type of medical procedure and / or physician identity. These parameters may be associated with first configuration data, and the system may access the first configuration data and configure the reconfigurable hardware processor according to the specifications of the first configuration data. User input indicating the first medical imaging session may include user selection of a profile. This profile may be associated with one or more types of medical procedures and may define data processing and display layouts tailored to one or more types of medical procedures. Types of medical procedures may include endoscopic medical procedures (such as colonoscopy, sigmoidoscopy, rectoscopy, rhinoscopy, otoscopy, cystoscopy, colposcopy, arthroscopy, thoracoscopic surgery, etc.) and surgical procedures (such as biopsy, carotid endarterectomy, cholecystectomy, coronary artery bypass grafting, skin grafting, hysterectomy, and mastectomy).

[0168] The profile can be a physician profile, defining the data types the physician wants to see in a layout preferred by that physician. The profile can be a default profile that includes a predefined layout and predefined data processing. The default profile can be based on one or more parameters of the medical imaging system detected by the medical imaging processing system, such as the number and type of inputs to the processing system and the number and type of display outputs from the processing system. In some embodiments, the default profile can be based on one or more parameters detected from the received image data, such as the radius or diameter of the field of view (FOV), which can be associated with the type of imager (e.g., endoscope size).

[0169] At step 704, the system receives first medical imaging data generated during a first medical imaging session. The first medical imaging data is received from one or more devices connected to one or more inputs of the system. For example, the first medical imaging data may be a series of video frames received from an imager such as an endoscope imager. The first medical imaging data may include data from multiple devices connected to the system, such as multiple video feeds from multiple imagers.

[0170] At step 706, enhanced first medical imaging data is generated by processing the first medical imaging data, at least in part, using a first medical imaging processing algorithm implemented by a reconfigurable hardware processor in the first configuration. The reconfigurable hardware processor processes at least a portion of the first medical imaging data using the first medical imaging processing algorithm and any other algorithms configured to be implemented by the reconfigurable hardware processor, as defined by the first configuration data. For example, in the first configuration, the reconfigurable hardware processor may implement a smoke detection algorithm that detects portions of the received image associated with smoke in the field of view and enhances the received image to reduce the presence of smoke.

[0171] Some or all of the first medical imaging data can be routed to a reconfigurable hardware processor, such as a main processor, or a main processing unit 406 such as hub 400. The main processor can receive the first medical imaging data and can route the data to the reconfigurable processor according to first configuration data. The first configuration data may specify that the data received from the connected device should be processed using at least a first medical imaging processing algorithm. Based on this requirement, the main processor can direct the data received from the connected device to the reconfigurable hardware processor. In some embodiments, the reconfigurable processor receives the first medical imaging data directly from the input connection to the connected device—that is, without first routing the data through one or more additional processing units.

[0172] The reconfigurable hardware processor's processing of data can be based on the processing of other processing units in the system. For example, the processing of first medical imaging data by a first medical imaging processing algorithm can be based on information received from a second processing unit. The second processing unit can analyze some or all of the first medical imaging data, and the results of the analysis can be used by the reconfigurable hardware processor in the implementation of the first medical imaging processing algorithm. For example, in the embodiment discussed above that implements a smoke detection algorithm in a reconfigurable processor, an auxiliary processing unit such as auxiliary processing unit 410 of the central processing unit 400 can receive some or all of the first imaging data to determine whether smoke is present in the field of view of the imaging. When smoke is detected, the auxiliary processing unit can notify the reconfigurable hardware processor (directly or via another processing unit, such as the main processing unit 406), and in response, the reconfigurable hardware processor can begin processing the first imaging data to reduce the contribution of smoke in the data.

[0173] At step 708, enhanced first medical imaging data generated by a reconfigurable hardware processor is displayed for observation during a first medical imaging session. For example, the first medical imaging session may include an endoscopic procedure involving the use of a cauterization tool, and the enhanced first medical imaging data may be an enhancement of a video feed generated by an endoscopic camera, wherein the presence of smoke generated by the cauterization tool has been reduced. This enhanced imaging can be displayed to the surgeon in real time, allowing the surgeon to better visualize the surgical field.

[0174] In some embodiments, enhanced first medical imaging data is received from a reconfigurable hardware processor by another processing unit (such as the main processing unit 406 of the hub 400). The main processor may generate one or more display feeds that include the enhanced first medical imaging data. The main processor may generate the one or more display feeds based at least in part on first configuration data. For example, the main processor may combine the enhanced first medical imaging data with additional information, such as additional imaging received from another connected device, for display in different portions of the display defined by the first configuration data.

[0175] In some embodiments, the display feed includes enhanced first medical imaging data combined with other data. For example, the display feed may include enhanced first medical imaging data for display in a first portion of a connected display, and may include additional information for display in a second portion of a connected display. In some embodiments, the system generates multiple display feeds having different display configurations for displaying the enhanced imaging data, and provides different display feeds to different displays.

[0176] Figure 8AThis is a block diagram of a medical imaging processing system 800 according to one embodiment, illustrating steps 702-708 of method 700. A reconfigurable hardware processor 804 is configured to process imaging data received from a white light imager 810 via a first input port 808 using a first imaging processing algorithm (such as a smoke detection and removal algorithm). In response to user input associated with a first imaging session, a main processor 802 accesses first configuration data stored in memory 812, and based on the specifications in the first configuration data, the main processor 802 reconfigures the reconfigurable hardware processor 804 by loading a hardware logic configuration file for the smoke reduction algorithm. Furthermore, the main processor 802 loads a smoke detection software program or module from memory 812 into an auxiliary processor 806. The auxiliary processor 806, running the smoke detection software program or module, can detect the presence of smoke in the received imaging data and can instruct the reconfigurable hardware processor 804 to process the imaging data to reduce the impact of smoke in the imaging data. Before the auxiliary processor 806 detects smoke, the reconfigurable hardware processor can simply pass the imaging data through for display without first processing the data for smoke removal. The main processor can provide one or more portions (such as one or more frames) of the received imaging data to the auxiliary processor 806 on a periodic basis to detect smoke and trigger smoke removal processing of the reconfigurable hardware processor 804. The system 800 outputs a display feed to the display 816 comprising imaging data received from the white light imager 810, which has been enhanced by removing contributions from smoke when smoke is detected in the imaging data.

[0177] Returning to method 700, at step 710, the reconfigurable hardware processor is reconfigured to a second configuration for the second medical imaging session based on second configuration data stored in memory. The second configuration implements at least one medical imaging processing algorithm not implemented in the first configuration.

[0178] In some embodiments, a reconfigurable hardware processor is reconfigured in response to input instructing a second medical imaging session. For example, a user, such as an operating room nurse, may provide the medical imaging processing system with information specifying parameters associated with the second imaging session, such as the type of medical procedure and / or the physician's identity. These one or more parameters may be associated with second configuration data, and the system may access the second configuration data and configure the reconfigurable hardware processor according to the specifications of the second configuration data. As discussed above, user input instructing a second medical imaging session may include user selection of a profile. Depending on the selected profile, the second imaging session may be associated with the same physician as the first imaging session—for example, in a case where the same physician is transitioning from one type of medical procedure to another that may require a different display layout (e.g., due to different equipment connected to the medical imaging processing system or different enhancement algorithms). The second imaging session may be associated with the same type of medical procedure but with a different physician. For example, a first surgeon may perform one type of surgery (e.g., cholecystectomy) on a first patient in the first imaging session, and a second surgeon may (e.g., later that day or the following day) perform the same type of surgery (e.g., cholecystectomy) on a second patient.

[0179] The first imaging session may have already been completed (e.g., surgery or procedures associated with the first imaging session have been completed), and the imaging system can be configured for use in a subsequent second imaging session. The second imaging session may involve one or more different types of procedures and / or may include one or more different users, for which different imaging processing may be beneficial. Therefore, the second configuration implements one or more image processing algorithms that were not implemented in the first imaging session. The reconfigurable hardware processor is reconfigured to implement one or more image processing algorithms as required for the second imaging session, as defined by the second configuration data.

[0180] In some embodiments, the second imaging session may be a second surgical session for which the imaging system will be used. An operating room can be set up for the second surgical session after the first imaging session is completed. The second surgical session may involve different types of surgical procedures, different practitioners, different patients, etc. During the setup for the second surgical session, the imaging processing system may receive input instructing the second surgical session. This input may be, for example, a selection of a surgical procedure type or a selection of a profile (e.g., a practitioner profile) made via a user interface to the imaging processing system. Based on this selection, the system may automatically reconfigure the reconfigurable processor based on configuration data associated with the second surgical session.

[0181] At step 712, the medical imaging processing system receives second medical imaging data generated during the second medical imaging session. This second medical imaging data can be received from one or more connected devices that are the same as the first medical imaging data, or from one or more different connected devices.

[0182] At step 714, enhanced second medical imaging data is generated by processing the second medical imaging data, at least in part, using a second medical imaging processing algorithm implemented in a second configuration of the reconfigurable hardware processor. The reconfigurable hardware processor processes at least a portion of the first medical imaging data using the second medical imaging processing algorithm (which is not implemented in the first configuration) and any other algorithms configured to be implemented by the reconfigurable hardware processor, which may or may not be implemented in the first configuration, as defined by the second configuration data. For example, in the second configuration, the reconfigurable hardware processor may implement an algorithm that processes a fluorescence image (e.g., a video frame) to determine one or more features of blood flow through tissue (such as tissue perfusion, vessel location, blood flow rate or velocity, size of the imaged tissue, or any combination thereof), and generates an enhanced image of the fluorescence image based on the determined features (modifying image shading, overlaying data on the image, overlaying contours on the image, etc.).

[0183] In the first configuration described above, some or all of the second medical imaging data can be routed to a reconfigurable hardware processor via, for example, a main processor (such as the main processing unit 406 of the hub 400). The main processor can receive the second medical imaging data and can route the data to the reconfigurable processor according to second configuration data. The second configuration data may specify that at least a second medical imaging processing algorithm should be used to process the data received from the connected device. Based on this requirement, the main processor can direct the data received from the connected device to the reconfigurable hardware processor. In some embodiments, the reconfigurable processor receives the first medical imaging data directly from the input, i.e., without first routing the data through one or more additional processing units.

[0184] At step 716, enhanced second medical imaging data generated by a reconfigurable hardware processor is displayed for observation during a second medical imaging session. The display of the enhanced second medical imaging data can assist a physician, such as a surgeon, during one or more procedures executed during the second medical imaging session. By utilizing the low latency and high bandwidth of the reconfigurable processor, the enhanced second medical imaging data can be displayed in real time.

[0185] In some embodiments, enhanced second medical imaging data can be transferred from a reconfigurable hardware processor to another processing unit, such as... Figure 4The main processing unit 406 can generate a display feed that includes enhanced second medical imaging data. The display feed can be transmitted by the main processor to one or more connected displays. In some embodiments, a reconfigurable hardware processor can transmit the enhanced second medical imaging data directly to an output connection with one or more connected displays.

[0186] Figure 8A This is a block diagram of a medical imaging processing system 800 according to one embodiment, illustrating steps 710-716 of method 700. A reconfigurable hardware processor 804 is reconfigured to process imaging data received from a white light imager 810 and a fluorescence imager 818 (which may be part of the same imaging system and may receive data on the same or different input ports) using a second imaging processing algorithm. This second imaging processing algorithm analyzes the fluorescence imaging to characterize tissue portions according to, for example, tissue health, the degree of blood flow in the tissue, or the degree of perfusion in the tissue, and overlays the characterization onto the white light imaging. In response to user input associated with a second imaging session (e.g., input indicating a surgical session for a new patient or an input indicating a new procedure for the same patient as in the first imaging session), a main processor 802 accesses second configuration data stored in memory 812, and based on the specifications in the first configuration data, the main processor 802 reconfigures the reconfigurable hardware processor 804 by loading a hardware logic configuration file for the tissue characterization algorithm. Furthermore, the main processor 802 loads reference marker software programs or modules from memory 812 to an auxiliary processor 806. An auxiliary processor 806, running a reference marking program or module, can determine, for example, the locations of maximum and / or minimum perfusion in fluorescence imaging data. Reference marks generated by the auxiliary processor 806 are added to an overlay generated by a reconfigurable hardware processor (this can be done by a reconfigurable hardware processor 804, by the main processor 802, or by a different processor in the system). The resulting enhanced imaging data is output to a display 816 for visualization during a second imaging session.

[0187] According to some embodiments, tissue characterization algorithms implemented in a reconfigurable hardware processor can provide an enhanced visual representation of a subject's tissues, which may be more accurate in terms of data representation and intuitive for clinicians to use in their clinical decision-making. The generated enhanced visual representation of tissues can be adapted to various tissue types (e.g., various wounds, including chronic, acute, pressure ulcers, and cancerous tissue) and can provide a framework for automatically classifying tissues (e.g., wound tissue, cancerous tissue) and / or predicting clinical outcomes (e.g., wound healing timeline, cancerous tissue healing).

[0188] Tissue characterization algorithms can leverage machine learning or deep learning. Machine learning-based methods and systems facilitate solving problems for which no algorithmic solution exists or where the solution is too complex to be found. Due to the complex nature of physiological processes occurring within the human body, tissue imaging-based medical diagnosis and tissue characterization are particularly well-suited tasks for machine learning algorithms. Machine learning can be used to discover medically relevant features and patterns in large datasets, helping clinicians make more accurate, faster, and more consistent medical diagnoses, regardless of their experience. In some embodiments, the tissue characterization algorithm includes identifying one or more attributes of data relevant to the clinical characterization of a tissue and classifying the data into multiple clusters based on one or more attributes, such that data in the same cluster are more similar to each other than data in different clusters, wherein the clusters characterize tissue. In some variations, the algorithm may further include associating the corresponding clusters with each of multiple sub-regions in an image time series, such as, for example, a fluorescence image, and generating a subject space (clustering) map based on the associated clusters of multiple sub-regions in the subject time series of the fluorescence image. The algorithm may further include receiving multiple subject spatial maps and receiving metadata associated with each subject spatial map, storing each subject spatial map and its associated clinical data in records of a database, and using the records of the database as input to a supervised machine learning algorithm for generating a predictive model. The predictive model can be used to predict clinical data associated with subject time series of fluorescence images.

[0189] Figure 9A and 9B The illustration depicts a graphical user interface for configuring a medical imaging processing system, such as Central 400, for a new imaging session. The user interface can be provided, for example, on a tablet computer connected to the system or on the system's touchscreen. Figure 9A The user interface 900 allows users to configure the system as a processing system by selecting a specialty 902, a procedure 904, and / or a physician 906. Each selection can be associated with a different configuration, or a combination of selections can be associated with a configuration. For example, each physician selection can be associated with a different configuration previously specified by the physician, and selecting a configuration may require choosing both a specialty and a procedure. The configuration can be stored locally in the system's memory or remotely in, for example, a hospital information system accessible via a network connection.

[0190] Figure 9BThe illustration depicts a user interface 910 for defining data sources and their layout. Two display layouts (912 and 914) are associated with the illustrated configuration. Each display layout defines a data source, as well as its size and location. The first display layout 912 includes three distinct sources. As described above, a source can define the type of data displayed, which can be based on both the system generating the data and the type of processing performed on the data, such as by a reconfigurable processor and / or other system modules. Accordingly, different sources can be based on data from the same imaging system or other devices. For example, source 1 could be a still image from an input video stream (e.g., selected via a voice command from a physician), and source 3 could be a video stream. The user interface 910 allows the user to select, position, and resize the different sources. For example, the user can select available sources from a dropdown list that specifies, for example, all sources the system can generate given input to the system, or all sources the system can generate. The user can reposition a source by dragging the source icon across the screen and can resize a source using, for example, gestures, mouse input, keyboard input, or any other suitable input.

[0191] Once the user completes the selection of the configuration profile, the medical imaging processing system can automatically configure itself according to the requirements defined in the selected configuration profile, using the methods described above.

[0192] Systems used for collecting, enhancing, and displaying medical imaging data (such as...) Figure 1 The system 100 may include one or more imaging systems for acquiring time series of tissue images (e.g., time series of fluorescence images, time series of white light images, etc.). In some embodiments, the imaging system is a fluorescence imaging system. Figure 10This is a schematic example of a fluorescence imaging system 1010 according to one embodiment. The fluorescence imaging system 1010 includes: a light source 1012 for irradiating tissue of a subject to induce fluorescence emission from a fluorescent imaging agent 1014 in the subject's tissue (e.g., in blood, urine, lymph, cerebrospinal fluid, or other bodily fluids or tissues); an image acquisition assembly 1016 arranged to generate time series of fluorescence images and / or subject time series based on the fluorescence emission; and a processor assembly 1018 arranged to process the generated time series / subject time series of fluorescence images according to any variation of the methods described herein. The processor assembly 1018 may include a memory 1068 having instructions thereon, a processor module 1062 arranged to execute the instructions on the memory 1068 to process the time series of fluorescence images and / or subject time series, and a data storage module 1064 storing unprocessed and / or processed time series of fluorescence images and / or subject time series. In some variations, memory 1068 and data storage module 1064 may be embodied in the same storage medium, while in other variations, memory 1068 and data storage module 1064 may be embodied in different storage media. System 1010 may further include communication module 1066 for transmitting images and other data (such as some or all of time series / subject time series or other input data of fluorescence images, spatial maps, subject spatial maps and / or tissue values ​​(quantizers)) to the imaging data processing center, such as... Figure 1 The imaging data processing center 102.

[0193] In some variations, the light source 1012 includes, for example, an illumination module 1020. The illumination module 1020 may include a fluorescence excitation source arranged to generate excitation light of suitable intensity and wavelength for exciting the fluorescent imaging agent 1014. Figure 11 As shown, the irradiation module 1020 may include a laser diode 1022 (e.g., which may include, for example, one or more fiber-coupled diode lasers) arranged to provide excitation light to excite a fluorescent imaging agent (not shown) in the subject's tissue. Examples of other excitation light sources that may be used in various embodiments include one or more LEDs, arc lamps, or other light-emitting techniques of sufficient intensity and appropriate wavelength to excite fluorescent imaging agents in tissue. For example, one or more 793 nm conductively cooled single-bar fiber-coupled laser diode modules from DILAS Diode Laser Co., Germany, may be used to excite fluorescent imaging agents in blood, wherein the fluorescent imaging agent is a fluorescent dye with near-infrared excitation and emission properties.

[0194] In some variations, the light output from the light source 1012 can be projected through one or more optical elements to shape and guide the output being used to irradiate the region of interest. The optical elements may include one or more lenses, light guides, and / or diffraction elements to ensure a flat field across substantially the entire field of view of the image acquisition assembly 1016. The fluorescent excitation source can be selected to emit at a wavelength close to the absorption maximum of the fluorescent imaging agent 1014 (e.g., indocyanine green (ICG)). For example, as... Figure 11 As shown, the output 1024 from the laser diode 1022 can pass through one or more focusing lenses 1026, and then through a homogenizing light tube 1028, such as a light tube typically available from Newport Communications, Inc. Finally, the light can pass through an optical diffraction element 1032 (i.e., one or more optical diffusers), such as a ground glass diffraction element also available from Newport Communications, Inc. The power going to the laser diode 1022 can be provided by, for example, a high-current laser driver (such as those available from Lumina Power, Inc.). During the image acquisition process, the laser can optionally operate in pulsed mode. An optical sensor, such as a solid-state photodiode 1030, can be incorporated into the illumination module 1020 and can sample the illumination intensity generated by the illumination module 1020 via scattering or diffuse reflection from various optical elements. In some variations, additional illumination sources can be used to provide guidance when aligning and positioning the module over the region of interest.

[0195] Refer again Figure 10 In some variations, the image acquisition component 1016 may be a component of the fluorescence imaging system 1010, configured to acquire time-series fluorescence images and / or subject time-series images from fluorescence emission from the fluorescent imaging agent 1014. The image acquisition component 1016 may include a camera module 1040. (e.g.) Figure 12 As shown, camera module 1040 can acquire images of fluorescence emission 1042 from a fluorescent imaging agent in tissue by collecting fluorescence emission using imaging optics (e.g., 1046a, 1046b, 1048, and 1050) and focusing the fluorescence emission onto image sensor assembly 1044. Image sensor assembly 1044 may include at least one 2D solid-state image sensor. The solid-state image sensor may be a charge-coupled device (CCD), CMOS sensor, CID, or similar 2D sensor technology. The charge generated by the optical signal converted by image sensor assembly 1044 is converted into an electro-video signal comprising both digital and analog video signals by appropriate readout and amplification electronics in camera module 1040.

[0196] According to an exemplary variant of the fluorescence imaging system, the light source can provide an excitation wavelength of approximately 800 nm ± 10 nm, and the image acquisition assembly uses an emission wavelength > 820 nm and NIR-compatible optics for, for example, ICG fluorescence imaging. In an exemplary embodiment, the NIR-compatible optics may include a CCD monochrome image sensor with a GigE standard interface and a lens compatible with the sensor in terms of optical and mounting formats (e.g., C / CS mounting).

[0197] In some variations, processor module 1062 includes any computer or computing component, such as, for example, a tablet computer, laptop computer, desktop computer, networked computer, or dedicated standalone microprocessor. For example, processor module 1062 may include one or more central processing units (CPUs). In an exemplary embodiment, processor module 1062 is a quad-core 2.5 GHz processor with four CPUs, where each CPU is a microprocessor, such as a 64-bit microprocessor (e.g., sold as an Intel Core i3, i5, or i7, or in the AMD Core FX series). However, in other embodiments, processor module 1062 may be any suitable processor with any suitable number of CPUs and / or other suitable clock speeds.

[0198] The inputs to processor module 1062 can be taken from, for example... Figure 12 The image sensor 1044 of the camera module 1040 shown is... Figure 11 The solid-state photodiode 1030 in the illumination module 1020, and / or any external control hardware (such as a foot switch or remote control). The output is provided to the laser diode driver and optical alignment aids. Figure 10 As shown, in some variations, processor component 1018 may have a data storage module 1064 capable of storing time series of images / subject time series, or representative data thereof, or other input data to a tangible, non-transitory computer-readable medium (such as, for example, internal memory (e.g., hard disk or flash memory)) to enable recording and processing of acquired data. In some variations, processor module 1062 may have an internal clock to enable control of various components and ensure proper timing of illumination and sensor shutters. In some variations, processor module 1062 may also provide graphical displays of user input and output. The fluorescence imaging system may optionally be configured with a communication unit 1066, such as a wired or wireless network connection or a video output connection, for transmitting the time series of fluorescence images when the time series is acquired or when the time series of fluorescence images is played back after recording. Communication unit 1066 may additionally or alternatively transmit processed data, such as spatial maps, subject spatial maps, and / or tissue values.

[0199] exist Figure 10-12 In the operation of the exemplary system described herein, the subject is positioned relative to the fluorescence imaging system 1010 such that the region of interest (e.g., a target tissue area) is located below the light source 1012 and the image acquisition assembly 1016, such that the illumination module 1020 of the light source 1012 produces a substantially uniform illumination field across the entire region of interest. In some variations, an image of the region of interest may be acquired for background subtraction purposes prior to the administration of the fluorescent imaging agent 1014 to the subject. To acquire the fluorescence image / subject fluorescence image, the operator of the fluorescence imaging system 1010 may initiate the acquisition of the fluorescence image time series / subject time series by pressing a remote switch or foot control, or via a keyboard (not shown) connected to the processor assembly 1018. As a result, the light source 1012 is turned on, and the processor assembly 1018 begins recording the fluorescence image data / subject fluorescence image data provided by the image acquisition assembly 1016. When operating in pulse mode in this embodiment, the image sensor 1044 in the camera module 1040 is synchronized to collect fluorescence emission following laser pulses generated by the diode laser 822 in the illumination module 1020. In this manner, the maximum fluorescence emission intensity was recorded, and the signal-to-noise ratio was optimized. In this embodiment, the fluorescent imaging agent 1014 was administered to the subject and delivered to the region of interest via arterial flow. For example, shortly after the administration of the fluorescent imaging agent 1014, the acquisition of time-series / subject time-series fluorescence images was initiated, and time-series fluorescence images were acquired from substantially the entire region of interest throughout the introduction of the fluorescent imaging agent 1014. Fluorescence emission from the region of interest was collected by the collection optics of the camera module 1040. The remaining ambient and reflected excitation light was collected by subsequent optics in the camera module 1040 (e.g., Figure 12 The optical element 1050 (which may be a filter) is attenuated so that fluorescence emission can be acquired by the image sensor assembly 1044 with minimal interference from light from other sources.

[0200] In some variations, after the acquisition or generation of the time series / subject time series of fluorescence images, processor component 1018 (e.g., processor module 1062 or other processor) can then be activated to execute instructions stored on memory 1068 and process the imaging data before transmission to the imaging data processing system (e.g., central processing unit 102 of system 100). System 1010 can transmit spatial maps / subject spatial maps and / or any clinical relevance or diagnosis derived therefrom, or both, via connection 1066 for display to the user as, for example, grayscale or false-color images in a synthetic display feed, and / or for storage for later use.

[0201] Figure 13 It shows Figure 1 An embodiment of an endoscopic surgical trolley 100. The trolley 10 can be used, for example, in an operating room, for endoscopic imaging and display during endoscopic procedures. The trolley 10 includes an imaging system, such as... Figure 10 A fluorescence imaging system 1010. The imaging system includes a mirror assembly 11 that can be used in endoscopic procedures. The mirror assembly 11 incorporates an endoscope or mirror 12, which is coupled to the camera head 16 via a coupler 13 located at the distal end of the camera head 16. A light source 14 provides light to the mirror via a light guide 26 (such as a fiber optic cable). The camera head 16 is coupled to a camera control unit (CCU) 18 via a cable 15. The CCU 18 is preferably connected to and communicates with the light source 14. Operational portions of the camera 16 are controlled by the CCU 18. The cable 15 transmits video image data from the camera head 16 to the CCU 18 and transmits various control signals bidirectionally between the camera head 16 and the CCU 18. In one embodiment, the image data output by the camera head 16 is digital.

[0202] A control or switch arrangement 17 is provided on the camera head 16, allowing the user to manually control various functions of the cart 10. Voice commands can be input into a microphone 25 mounted on an earpiece 27 worn by the surgeon and coupled to a voice control unit 23. The cart 10 may include a handheld control device 21, such as a tablet computer or PDA with a touchscreen user interface, which can be coupled to the cart 10 as an additional control interface. The cart 10 also includes an imaging data processing hub 31, such as... Figure 1 The central 102 or Figure 4 The central processing unit 400, coupled to the imaging system via one or more cables, is used to receive images and / or video from the imaging system, process the images and / or video, and generate display feeds for display on the display 20 according to the methods described herein. The imaging data processing central processing unit may receive user input via a voice control unit and / or a handheld control device.

[0203] The cart 10 may include one or more additional devices 33, such as imaging recording devices or surgical tool control devices, which may be coupled to an imaging data processing hub. The imaging data processing hub 31 may receive information from one or more additional devices 33, such as device warnings, device status, and device settings. In some embodiments, the additional device 33 is a video recorder, and the imaging data processing hub 31 may transmit one or more display feeds to the video recorder for recording.

[0204] A tangible, non-transitory computer-readable medium having computer-executable (readable) program code embedded thereon can provide instructions for causing one or more processors to perform one or more methods described herein when the instructions are executed. The program code can be written in any suitable programming language and delivered to the processor in many forms, including, but not limited to, information permanently stored on a non-writable storage medium (e.g., read-only memory devices such as ROMs, CD-ROMs, etc.), information reproducibly stored on a writable storage medium (e.g., hard disk drives, etc.), and information transmitted to the processor via a communication medium such as a local area network, a public network (e.g., the Internet), or any type of medium suitable for storing electronic instructions. When carrying computer-readable instructions that implement various embodiments of the methods described herein, such a computer-readable medium represents examples of various embodiments. In various embodiments, a tangible, non-transitory computer-readable medium includes all computer-readable media, and the scope of the invention is limited to computer-readable media that are both tangible and non-transitory.

[0205] The kit may include any part of the system described herein and a fluorescent imaging agent, such as, for example, a fluorescent dye (such as ICG) or any suitable fluorescent imaging agent. In another aspect, the kit may include a tangible, non-transitory computer-readable medium on which computer-executable (readable) program code is embedded, which can provide instructions for causing one or more processors, upon execution of the instructions, to perform one or more methods described herein for characterizing tissues and / or predicting clinical data. The kit may include instructions for using at least some of its components (e.g., for using a fluorescent imaging agent, for mounting the computer-executable (readable) program code on which instructions are embedded, etc.). In yet another aspect, a fluorescent imaging agent, such as, for use in the methods and systems described herein, is provided. In another variation, the kit may include any part or the entire system described herein, as well as a fluorescent agent, such as, for example, a fluorescent dye (such as ICG), or any other suitable fluorescent agent or combination of fluorescent agents.

[0206] Example imaging agent used in generating imaging data According to some embodiments, in fluorescence medical imaging applications, the imaging agent is a fluorescent imaging agent, such as, for example, an ICG dye. When ICG is administered to a subject, it binds to blood proteins and circulates with the blood in the tissue. The fluorescent imaging agent (e.g., ICG) can be administered to the subject as a bolus injection (e.g., into a vein or artery) at a concentration suitable for imaging, allowing the bolus to circulate in the vascular system and pass through microvasculature. In other implementations where multiple fluorescent imaging agents are used, such agents can be administered simultaneously, for example, in a single bolus, or sequentially in separate boluses. In some embodiments, the fluorescent imaging agent can be administered via a catheter. In some embodiments, the fluorescent imaging agent can be administered less than one hour before performing a measurement of the signal intensity generated by the fluorescent imaging agent. For example, the fluorescent imaging agent can be administered to the subject less than 30 minutes before the measurement. In yet another embodiment, the fluorescent imaging agent can be administered at least 30 seconds before performing the measurement. In still another embodiment, the fluorescent imaging agent can be administered simultaneously with performing the measurement.

[0207] According to some embodiments, the fluorescent imaging agent can be administered at various concentrations to achieve a desired circulating concentration in the blood. For example, in embodiments where the fluorescent imaging agent is ICG, it can be administered at a concentration of about 2.5 mg / mL to achieve a blood concentration of about 5 mg / mL. To about 10 The circulating concentration. In various embodiments, the upper limit of the concentration of the applied fluorescent imaging agent is the concentration at which the fluorescent imaging agent becomes clinically toxic in circulating blood, and the lower limit of the concentration is the instrument limit for acquiring signal intensity data generated by the fluorescent imaging agent circulating with the blood to detect the fluorescent imaging agent. In various other embodiments, the upper limit of the concentration of the applied fluorescent imaging agent is the concentration at which the fluorescent imaging agent becomes quenched. For example, the circulating concentration of ICG can range from about 2 To about 10 Within the scope of [the target range], therefore, in one aspect, according to various embodiments, the method includes the steps of administering an imaging agent (e.g., a fluorescent imaging agent) to the subject and acquiring signal intensity data (e.g., video) before processing the signal intensity data. In another aspect, the method excludes any step of administering an imaging agent to the subject.

[0208] According to some embodiments, a suitable fluorescent imaging agent for use in fluorescence imaging applications to generate fluorescence image data is an imaging agent capable of circulating with the blood (e.g., a fluorescent dye that can circulate with, for example, blood components such as lipoproteins in the blood or serum plasma) and through the vascular system of tissues (i.e., large and small blood vessels), and generating a signal intensity from the imaging agent when exposed to appropriate light energy (e.g., excitation or absorption light energy). In various embodiments, the fluorescent imaging agent includes fluorescent dyes, analogues thereof, derivatives thereof, or combinations thereof. Fluorescent dyes include any non-toxic fluorescent dye. In some embodiments, the fluorescent dye optimally emits fluorescence in the NIR spectrum. In some embodiments, the fluorescent dye is or comprises a tricyanine dye. In some cases, the fluorescent dye is or comprises ICG, methylene blue, or combinations thereof. In other embodiments, the fluorescent dye is or comprises fluorescein isothiocyanate, rhodamine, phycoerythrin, phycocyanin, allophycocyanin, phthalaldehyde, fluorescein, rose red, trypan blue, fluorescent gold, or combinations thereof, which are excitable using an excitation wavelength suitable for each dye. In some embodiments, analogues or derivatives of fluorescent dyes may be used. For example, fluorescent dye analogues or derivatives include fluorescent dyes that have been chemically modified but still retain their ability to fluoresce when exposed to light energy of an appropriate wavelength.

[0209] In various embodiments, the fluorescent imaging agent may be provided as a lyophilized powder, solid, or liquid. In some embodiments, the fluorescent imaging agent may be provided in vials (e.g., sterile vials), which allows for reconstitution to a suitable concentration by administration of a sterile fluid using a sterile syringe. Reconstitution can be performed using any suitable carrier or diluent. For example, the fluorescent imaging agent may be reconstituted immediately prior to application with an aqueous diluent. In various embodiments, any diluent or carrier that holds the fluorescent imaging agent in solution may be used. As an example, ICG can be reconstituted with water. In some embodiments, once the fluorescent imaging agent has been reconstituted, it may be mixed with additional diluents and carriers. In some embodiments, the fluorescent imaging agent may be conjugated with another molecule, such as a protein, peptide, amino acid, synthetic polymer, or sugar, for example, to enhance solubility, stability, imaging properties, or combinations thereof. Additional buffers, including Tris, HCl, NaOH, phosphate buffer, and / or HEPES, may be optionally added.

[0210] Those skilled in the art will appreciate that, although fluorescent imaging agents have been described in detail above, other imaging agents may also be used in conjunction with the systems, methods, and techniques described herein, depending on the optical imaging modality. Such fluorescent agents can be applied to bodily fluids (e.g., lymph, cerebrospinal fluid) or body tissues.

[0211] In some variations, fluorescent imaging agents used in conjunction with the methods, systems, and kits described herein can be used for blood flow imaging, tissue perfusion imaging, lymphatic imaging, or combinations thereof, which can be performed during invasive surgical procedures, minimally invasive surgical procedures, non-invasive surgical procedures, or combinations thereof. Examples of invasive surgical procedures that may involve blood flow and tissue perfusion include cardiac-related surgical procedures (e.g., cardiopulmonary bypass or off-pump CABG) or reconstructive surgical procedures. Examples of non-invasive or minimally invasive surgical procedures include wound treatment and / or management (e.g., chronic wounds, such as pressure ulcers). In this regard, for example, changes in the wound over time, such as changes in wound size (e.g., diameter, area), or changes in tissue perfusion within and / or around the wound, can be tracked when the methods and systems described herein are applied. Examples of lymphatic imaging include identifying one or more lymph nodes, lymph node drainage, lymphatic mapping, or combinations thereof. In some variations, such lymphatic imaging may be relevant to the female reproductive system (e.g., uterus, cervix, vulva).

[0212] In cardiac-related variations, imaging agents (e.g., ICG alone or in combination with another imaging agent) can be injected intravenously via, for example, a central venous line, bypass pump, and / or cardioplegic solution line, to enable flow and / or perfusion of the coronary vascular system, microvascular system, and / or graft. ICG can be administered as a diluted ICG / blood / saline solution along the graft vessel such that the final concentration of ICG in the coronary artery is approximately the same as or lower than that produced by injecting approximately 2.5 mg (i.e., 1 ml of 2.5 mg / ml) into a central line or bypass pump. ICG can be prepared by, for example, dissolving 25 mg of solid in 10 ml of sterile aqueous solvent that can be provided by the manufacturer with the ICG. One ml of ICG solution can be mixed with 500 ml of sterile saline (e.g., by injecting 1 ml of ICG into a 500 ml saline bag). Thirty ml of diluted ICG / saline solution can be added to 10 ml of the subject's blood, which can be obtained sterilely from a central arterial line or bypass pump. ICG in the blood binds to plasma proteins and helps prevent leakage from the blood vessels. Mixing ICG with blood can be performed using standard aseptic techniques within the field of aseptic surgery. A 10 ml ICG / saline / blood mixture can be administered for each graft. ICG can be administered using a syringe attached to the (open) proximal end of the graft, rather than by injecting it through the graft wall with a needle. Upon graft harvest, the surgeon routinely attaches adapters to the proximal end of the graft so that they can be attached to a saline-filled syringe, sealing the distal end of the graft and injecting the saline down the graft, pressurizing the graft, and thus assessing catheter integrity before performing the first anastomosis (regarding leakage, lateral branches, etc.). In other variations, the methods, dosages, or combinations thereof described herein in conjunction with cardiac imaging can be used in any vascular and / or tissue perfusion imaging application.

[0213] Lymph node mapping is a crucial part of effective surgical staging for cancers that have spread through the lymphatic system, such as breast cancer, stomach cancer, and gynecological cancers. Removal of multiple lymph nodes from a specific lymph node pelvis can lead to serious complications, including acute or chronic lymphedema, paresthesia, and / or seroma formation. In fact, if the sentinel lymph node is negative for metastasis, the surrounding lymph nodes will most likely also be negative. For example, in breast cancer surgery, the identification of tumor-draining lymph nodes (LNs) has become a vital step in staging cancers that have spread through the lymphatic system. LN mapping involves using dyes and / or radioactive tracers to identify LNs for biopsy or resection and subsequent pathological evaluation for metastasis. The goal of lymph node resection during surgical staging is to identify and remove LNs at high risk of local cancer spread. Sentinel lymph node (SLN) mapping has emerged as an effective surgical strategy in breast cancer treatment. It is generally based on the concept that metastasis (the spread of cancer to the axillary lymph nodes) – if present, should be located in the SLN, which is defined in this field as the first lymph node or group of lymph to which cancer cells are most likely to have spread from the primary tumor. If the SLN is negative for metastasis, then the surrounding secondary and tertiary lymph nodes should also be negative. The main benefit of SLN mapping is a reduction in the number of subjects undergoing conventional partial or complete lymph node dissection, and thus a reduction in the number of subjects suffering from associated pathologies such as lymphedema and lymphoceles.

[0214] Current standards of care for SLN mapping include the injection of a tracer to identify the lymphatic drainage pathway from the primary tumor. The tracer used may be a radioactive isotope (e.g., technetium-99 or Tc-99m) for intraoperative localization using a gamma probe. Radiographic tracing techniques (known as scintillation) are limited to hospitals where access to the radioactive isotope requires the involvement of a nuclear physician and do not provide real-time visual guidance. A colored dye—isosulfur blue—has also been used; however, this dye is not visible through skin and adipose tissue. Furthermore, blue staining has resulted in breast tattoos lasting for months, subcutaneous injections may be associated with skin necrosis, and anaphylactic reactions, even rare, have been reported. Severe anaphylactic reactions have occurred after isosulfur blue injection (approximately 2% of patients). Manifestations include respiratory distress, shock, angioedema, urticaria, and pruritus. Reactions are more likely to occur in subjects with a history of bronchial asthma, or in subjects allergic to triphenylmethane dyes or who have experienced drug reactions. Isosulfur blue is known to interfere with pulse oximetry for oxygen saturation measurement and methemoglobin measurement in gas analyzers. Use of isosulfur blue may result in temporary or permanent (tattoo) blue pigmentation.

[0215] In contrast, the direct, real-time visual identification of LNs and / or afferent lymphatic pathways in fluorescence imaging enhancement techniques used in SLN visualization and mapping, according to various embodiments, facilitates real-time, high-resolution optical guidance, blood flow visualization, tissue perfusion, or combinations thereof through skin and adipose tissue.

[0216] In some variations, visualization, classification, or both of lymph nodes during fluorescence imaging can be based on imaging with one or more imaging agents, which can be further based on visualization and / or classification using a gamma probe (e.g., Technetium Tc-99m is a clear, colorless aqueous solution and is typically injected into the periareolar area according to standard care), another routinely used color imaging agent (isosulfuron-methyl), and / or other assessments (such as, for example, histology). The subject's breast can be injected twice, for example, with approximately 1% isosulfuron-methyl (for comparative purposes), and twice with an ICG solution having a concentration of approximately 2.5 mg / ml. The isosulfuron-methyl injection can precede the ICG injection, or vice versa. For example, using a TB syringe and a 30 G needle, 0.4 ml (0.2 ml at each site) of isosulfuron-methyl can be injected into the periareolar area of ​​the breast in an anesthetized subject. For the right breast, the subject can be injected at the 12 o'clock and 9 o'clock positions, and for the left breast, at the 12 o'clock and 3 o'clock positions. The total dose of isosulfan blue injected intradermally into each breast can be approximately 4.0 mg (0.4 ml of 1% solution: 10 mg / ml). In another exemplary variant, the subject may first receive an ICG injection, followed by isosulfan blue (for comparison). Immediately prior to ICG administration, a 25 mg vial of ICG can be reconstituted with 10 ml of sterile water for injection to produce a 2.5 mg / ml solution. For example, using a TB syringe and a 30G needle, approximately 0.1 ml (0.05 ml at each site) of ICG can be injected into the periareolar region of the breast (for the right breast, injections can be performed at the 12 o'clock and 9 o'clock positions, and for the left breast, at the 12 o'clock and 3 o'clock positions). The total dose of ICG injected intradermally into each breast can be approximately 0.25 mg (0.1 ml of 2.5 mg / ml solution). For example, ICG can be injected at a rate of 5 to 10 seconds per injection. When ICG is injected intradermally, the binding properties of the ICG protein cause it to be rapidly absorbed by the lymphatic system and migrate to the lymph nodes via conduction vessels. In some variants, ICG can be provided as a sterile lyophilized powder containing 25 mg of ICG and no more than 5% sodium iodide. ICG can also be packaged using an aqueous solvent consisting of sterile water for injection, which is used to reconstitute the ICG. In some variants, the ICG dose (mg) in sentinel lymph node mapping for breast cancer can range from about 0.5 mg to about 10 mg, depending on the route of administration. In some variants, the ICG dose can be from about 0.6 mg to about 0.75 mg, from about 0.75 mg to about 5 mg, or from about 5 mg to about 10 mg.The route of application can be, for example, subcutaneous, intradermal (e.g., into the periareolar area), subcutaneous, skin covering the tumor, intradermal in the areola closest to the tumor, subcutaneous into the areola, intradermal above the tumor, periareolar over the entire breast, or a combination thereof. NIR fluorescent positive lymph nodes (e.g., using ICG) can be represented as, for example, one or more black-and-white NIR fluorescence images and / or fully or partially color (white light) images, fully or partially desaturated white light images, enhanced color images, overlays (e.g., fluorescence with any other image), or composite images (e.g., fluorescence incorporated into another image), which can have various colors, various desaturation levels, or various color ranges to highlight / visualize certain features of interest. Further image processing can be performed for further visualization and / or other analyses (e.g., quantification). According to the American Society of Breast Surgeons (ASBrS) Practice Guidelines for SLN biopsies in breast cancer patients, fluorescence imaging systems and methods according to various embodiments of ICG and SLN can be used alone or in combination with a gamma probe (Tc-99m) to visualize lymph nodes and lymphatic vessels (e.g., intraoperatively, in real-time). Fluorescent imaging for the lymph node (LN) can begin at the injection site by tracing the lymphatic pathways leading to the LN in the axilla. Once a visual image of the LN is identified, LN mapping and labeling can be performed through an incision in the skin. LN mapping can be performed until the ICG-visible lymph node is identified. For comparison, mapping can be performed using isosulfan blue until a “blue” lymph node is identified. LNs labeled using ICG alone or in combination with another imaging technique (e.g., isosulfan blue and / or Tc-99m) can be marked for resection. Subjects may have breast cancer at different stages (e.g., IA, IB, IIA).

[0217] In some variants, such as, for example, in gynecological cancers (e.g., malignancies of the uterus, endometrium, vulva, and cervix), ICG can be administered interstitially to visualize lymph nodes, lymphatic tracts, or combinations thereof. Upon interstitial injection, the protein-binding properties of ICG cause its rapid absorption by the lymphatic system and its movement to the SLN via conductive vessels. ICG can be provided for injection in the form of a sterile lyophilized powder containing 25 mg of ICG (e.g., 25 mg / vial) and no more than 5% sodium iodide. The ICG can then be reconstituted using commercially available sterile water for injection prior to use. According to one embodiment, a vial containing 25 mg of ICG can be reconstituted in 20 ml of water for injection to obtain a 1.25 mg / ml solution. A total of 4 ml of this 1.25 mg / ml solution will be injected into the subject (4 × 1 ml injections), resulting in a total ICG dose of 5 mg per subject. Alternatively, four (4) injections of 1 ml of 10 mg / ml 1% isosulfan blue solution into the cervix (for comparative purposes) can be performed, for a total dose of 40 mg. Injections can be performed while the subject is under anesthesia in the operating room. In some variations, the ICG dose (mg) in sentinel lymph node detection and / or mapping for gynecological cancers can range from about 0.1 mg to about 5 mg, depending on the route of administration. In some variations, the ICG dose can be about 0.1 mg to about 0.75 mg, about 0.75 mg to about 1.5 mg, about 1.5 mg to about 2.5 mg, or about 2.5 mg to about 5 mg. Routes of administration can be, for example, cervical injection, peritumoral injection, hysteroscopic endometrial injection, or a combination thereof. To minimize spillage of isosulfan blue or ICG that may interfere with the mapping procedure when removing a lymph node, mapping can be performed on the hemipelvis, and mapping can be performed using both isosulfan blue and ICG prior to the removal of any lymph node. LN mapping for clinical stage I endometrial cancer can be performed according to the following: NCCN guidelines for endometrial tumors, and surgical staging algorithms for SLN in endometrial cancer; and SLN mapping for clinical stage I cervical cancer can be performed according to the following: NCCN guidelines for cervical tumors, and surgical / SLN mapping algorithms for early cervical cancer. Therefore, LN identification can be based solely on ICG fluorescence imaging, or in combination with or in combination with colorimetric dyes (isosulfur blue) and / or radiotracers.

[0218] Lymph node visualization can be qualitative and / or quantitative. Such visualization may include, for example, lymph node detection, detection rate, and anatomical distribution of lymph nodes. Lymph node visualization, according to various embodiments, may be used alone or in combination with other variables, such as vital signs, height, weight, demographics, surgical predictors, relevant medical history and underlying conditions, histological visualization and / or assessment, Tc-99m visualization and / or assessment, and concomitant medications. Follow-up may occur on the date of discharge and subsequent dates (e.g., one month).

[0219] Lymph contains high levels of proteins, so ICG can bind to endogenous proteins upon entering the lymphatic system. When used according to the methods and systems described herein, fluorescence imaging (e.g., ICG imaging) for lymph node mapping offers the following advantages: high signal-to-background ratio (or tumor-to-background ratio) because NIR does not generate significant autofluorescence; real-time visualization for lymph node mapping; tissue definition (i.e., structural visualization); rapid drainage and elimination after entering the vascular system; and avoidance of non-ionizing radiation. Furthermore, NIR imaging has superior tissue penetration (approximately 5-10 mm of tissue) compared to visible light (1-3 mm of tissue). For example, the use of ICG also facilitates visualization through the peritoneum covering para-aortic lymph nodes. Although tissue fluorescence can be observed over a prolonged period with NIR light, it is invisible with visible light and therefore does not affect the pathological assessment or treatment of LNs. Moreover, fluorescence is more easily detected during surgery than the blue staining (isocyanate) of lymph nodes. In other variations, such as the methods, doses, or combinations thereof described herein in conjunction with lymphoimaging, can be used in any vascular and / or tissue perfusion imaging application.

[0220] Tissue perfusion involves the microcirculatory flow of blood per unit tissue volume, where oxygen and nutrients are supplied to the capillary bed of the perfused tissue, and waste products are removed from the capillary bed of the perfused tissue. Tissue perfusion is a phenomenon related to, but distinct from, blood flow in blood vessels. Quantified blood flow through blood vessels can be expressed in terms defining flow rate (i.e., volume / time) or defining velocity (i.e., distance / time). Tissue blood perfusion defines the movement of blood within a tissue volume through a microvascular system, such as arterioles, capillaries, or venules. Quantified tissue blood perfusion can be expressed in terms of blood flow through a tissue volume, i.e., blood volume / time / tissue volume (or tissue mass). Perfusion is associated with nutrient vessels (e.g., microvessels called capillaries), which include vessels associated with the exchange of metabolites between blood and tissue, rather than larger-diameter non-nutrient vessels. In some embodiments, quantification of the target tissue may include calculating or determining parameters or quantities associated with the target tissue (such as rate, size, volume, time, distance / time, and / or volume / time), and / or changing quantities—because they are related to any one or more of the aforementioned parameters or quantities. However, blood movement through individual capillaries can be highly unstable compared to blood movement through larger diameter vessels, primarily due to vascular motion, where spontaneous oscillations of vascular tension manifest as pulsations of red blood cell movement. In some embodiments, the blood flow and tissue perfusion imaging described herein in conjunction with the systems and methods can be used to image tumor tissue and distinguish such tissue from other tissues.

[0221] For illustrative purposes, the foregoing description has been illustrated with reference to specific embodiments. However, the illustrative discussion above is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations are possible in light of the above teachings. Embodiments have been chosen and described in order to best explain the principles of the technology and its practical application. This enables others skilled in the art to best utilize the described technology and various embodiments with various modifications suitable for the particular intended use.

[0222] Although this disclosure and examples have been fully described with reference to the accompanying drawings, it should be noted that various changes and modifications will become apparent to those skilled in the art. These changes and modifications should be understood to be included within the scope of this disclosure and examples as defined by the claims. Finally, the entire disclosure of the patents and publications referenced in this application is incorporated herein by reference.

Claims

1. A method for displaying medical imaging data, comprising: Receive first image data generated by a first medical imaging device, wherein the first image data includes a field of view (FOV) portion and a non-FOV portion; Identify the non-FOV portion of the first image data; The cropped first image data is generated by removing at least a portion of the non-FOV portion of the first image data; as well as The first portion of the display shows the cropped first image data, and the second portion of the display shows additional information.

2. The method of claim 1, wherein edge detection is used to identify non-FOV portions.

3. The method of claim 2, wherein the first image data comprises a series of video frames, and the edge detection is performed on more than one frame.

4. The method according to any one of claims 1-3, wherein non-FOV portions are identified using one or more of the center location of the FOV portion and measurements associated with the size of the FOV portion.

5. The method of claim 4, wherein during the imaging session initialization process, the center position of the FOV portion and measurements associated with the size of the FOV portion are determined.

6. The method of claim 5, wherein the imaging session initialization process is a white balance process.

7. The method according to any one of claims 1-6, wherein the first image data comprises a rectangular image or video frame, and the FOV portion is a circular portion of the rectangular image or video frame.

8. The method according to any one of claims 1-7, wherein the first image data comprises video frames.

9. The method according to any one of claims 1-8, wherein first image data is received at a first input of the medical imaging processing system, and additional information is based on data received at a second input of the medical imaging processing system.

10. The method of claim 9, further comprising transmitting a display feed from a medical imaging processing system to a display, the display feed comprising a combination of cropped first image data and additional information.

Images