Automatic identification, notification and guidance of regions of interest in ultrasound images on devices with limited display area
Patent Information
- Application Number
- CN202210159292.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2021-03-11
- Filing Date
- 2022-02-21
- Publication Date
- 2026-10-16
- Estimated Expiration
- 2042-02-21
AI Technical Summary
当以最初以裁剪方式呈现图像的方式将图像发送到移动或远程设备,使得用户可认为正在显示整个图像并且因此不知道所显示图像的裁剪部分的存在时,这尤其是一个问题
Smart Images

Figure CN115067991B_ABST
Abstract
Description
Background Technology
[0001] The present invention relates generally to imaging systems, and more specifically to structures and methods for displaying images generated by imaging systems.
[0002] An ultrasound imaging system typically includes an ultrasound probe applied to a patient's body and a workstation or device operatively connected to the probe. The probe is controlled by the system operator and configured to transmit and receive ultrasound signals processed into ultrasound images by the workstation or device. The ultrasound images can be displayed on a display device operatively connected to the workstation or device.
[0003] With the advent of portable ultrasound machines and the increased ability of remote devices to display complex images (such as ultrasound and other imaging system images) at high resolution, users of ultrasound and other imaging systems use their remote / mobile devices (such as smartphones and tablets) to pair with and work with ultrasound imaging system hardware.
[0004] However, the display size / area and shape / aspect ratio of these mobile devices vary between devices and are all significantly different from the size and shape / aspect ratio of the display area of a traditional ultrasound imaging system. More specifically, ultrasound imaging systems have a large display area capable of displaying the entire ultrasound image. In contrast, remote / mobile devices have a much smaller display area used to display the ultrasound image.
[0005] While ultrasound images can be easily sent to and displayed on a remote device's screen, the format of the ultrasound image is preserved during transmission. A major problem with displaying the entire image on smartphones / tablets is their relatively smaller display size and higher aspect ratio (typically >1.3) compared to displays associated with traditional ultrasound scanners. Therefore, when a full ultrasound image from a scanner, primarily with an aspect ratio closer to 1.0 and a more square image format, is displayed on these types of remote devices, the image will be too small to perform diagnostics and obtain relevant information. This is a particularly significant problem when the remote device is used in portrait mode.
[0006] Therefore, remote devices typically cannot display the entire image on their monitor without downscaling, effectively reducing the image resolution to an unusable level. To overcome this limitation, the ultrasound image is usually resized manually or automatically and displayed on the screen such that the height of the ultrasound image (which corresponds to the depth of the scanned image) fits within the entire height of the monitor. In this case, while the user can view most of the central portion of the image on the monitor (where finer details are visible), areas on either side of the ultrasound image will be invisible to the user.
[0007] More specifically, when a system or user magnifies an image to increase its size on a remote device for proper resolution for viewing in real-time or offline mode, the ultrasound image on the remote device's monitor is cropped so that the entire ultrasound image is not displayed on the remote device's screen. This cropping of the ultrasound image can prevent an individual from seeing any regions of interest (ROIs) present in the portion of the ultrasound image not displayed on the remote device's screen. These ROIs include (but are not limited to) organs / structures, abnormalities, or other clinically relevant areas, or other artifacts such as needles (used during procedures). This is particularly problematic when images are sent to mobile or remote devices in a manner that initially presents the image in a cropped manner, leading the user to believe that the entire image is being displayed and thus unaware of the existence of the cropped portion of the displayed image.
[0008] Therefore, it is desirable to develop systems and methods for representing Regions of Interest (ROIs) in ultrasound images presented on a remote device screen. These systems and methods inform users of the presence of any ROIs within a cropped area of the ultrasound image not shown on the remote device screen, and directions for navigating to those ROIs within the image on the remote device screen. Furthermore, it is desirable to have systems and methods that provide users with indications regarding the presence / existence of cropped areas of ultrasound images not currently displayed on the screen. Summary of the Invention
[0009] In this disclosure, the imaging system and the method for operating the system to display an image generated by the imaging system are capable of presenting the image, along with various markings and / or indications in the display portion of the image, on a display of a remote device, the markings and / or indications providing information about aspects of the image not presented on the display of the remote device.
[0010] In one aspect, markers are displayed on the remote device's display screen indicating the location and direction of any Regions of Interest (ROIs) within the displayed image but set within a cropped area of the image. This indication provides the user with information about the presence and location of these items, along with other relevant information, enabling the user to operate the remote device, such as by manipulating the display screen in a known manner, to move the area of the image containing the selected item onto the remote device's display screen.
[0011] On another front, an indication of the presence of a cropped portion of the image displayed on the remote device's screen is provided. This indication is provided regardless of the presence of any additional markings that might be necessary to indicate the location and direction of any ROI (Region of Interest) within the cropped portion or area of the displayed image. The indication of the cropped portion notifies the user of the cropped portion, allowing the user to reposition the image on the remote device's display to present it.
[0012] According to an exemplary aspect of this disclosure, an imaging system for displaying an image acquired by an imaging system on a display of a remote device includes: an imaging probe adapted to acquire image data about an object to be imaged; a processor operatively connected to the probe to form an image based on the image data; and a display operatively connected to the processor for presenting the image on the display, wherein the processor is configured to determine a visible portion and one or more cropped portions of the image to be presented on the display, implement an algorithm for identifying the location of at least one region of interest (ROI) among one or more of the cropped portions of the image, and provide at least one ROI marker in the visible portion of the image on the display that is associated with the at least one ROI in the one or more cropped portions.
[0013] According to another exemplary aspect of this disclosure, a method for displaying an image acquired by an imaging system on a display of a remote device includes the steps of: determining a visible portion and one or more cropped portions of the image to be displayed on the remote device; implementing an algorithm for identifying the location of at least one region of interest (ROI) among one or more of the cropped portions of the image; providing at least one ROI marker in the visible portion of the image associated with the at least one ROI in the one or more cropped portions; and presenting the visible portion and the at least one ROI marker on the display of the remote device.
[0014] It should be understood that the above brief description is provided to introduce selected concepts further described in the detailed embodiments in a simplified form. This is not intended to identify key or essential features of the claimed subject matter, the scope of which is uniquely defined by the claims following the detailed embodiments. Furthermore, the claimed subject matter is not limited to embodiments that address any shortcomings mentioned above or in any part of this disclosure. Attached Figure Description
[0015] The invention will be better understood by referring to the following description of non-limiting embodiments, in which:
[0016] Figure 1 It is a schematic block diagram of an imaging system formed according to an implementation plan.
[0017] Figure 2 It is a schematic block diagram of an imaging system formed according to another implementation scheme.
[0018] Figure 3 It is based on an implementation plan for operation. Figure 2 The flowchart shows the method of the imaging system.
[0019] Figure 4 It is a schematic diagram of ultrasound images and indications presented on a display screen of a remote device according to one embodiment.
[0020] Figure 5 It is a schematic diagram of ultrasound images and indications presented on a display screen of a remote device according to another embodiment.
[0021] Figure 6 It is operated on the display screen of a remote device according to the usage instructions of an implementation scheme. Figure 4 A schematic diagram of an ultrasound image.
[0022] Figure 7 It is a schematic diagram of ultrasound images and indications from a linear probe presented on a display screen of a remote device according to one embodiment.
[0023] Figure 8 It is a schematic diagram of ultrasound images and indications from a linear probe presented on a display screen of a remote device according to another embodiment. Detailed Implementation
[0024] The foregoing summary of the invention and the following detailed description of certain embodiments of the invention will be better understood when read in conjunction with the accompanying drawings. For the purposes of the diagrams illustrating the functional blocks of various embodiments, these functional blocks do not necessarily represent a division between hardware circuits. One or more functional blocks (e.g., a processor or memory) may be implemented in a single piece of hardware (e.g., a general-purpose signal processor or random access memory, hard disk, etc.) or in multiple pieces of hardware. Similarly, a program may be a standalone program, may be included as a subroutine in an operating system, may be a function in an installed software package, etc. It should be understood that the various embodiments are not limited to the arrangements and tools shown in the drawings.
[0025] As used herein, elements or steps described in the singular and beginning with the word "a" or "an" should be understood to not exclude a plurality of said elements or steps, unless such exclusion is explicitly stated. Furthermore, references to "one embodiment" of the invention are not intended to be construed as excluding the existence of additional embodiments that also include the referenced features. Moreover, unless explicitly stated to the contrary, embodiments that "comprise" or "have" elements or multiple elements having a particular property may include other such elements that do not have that property.
[0026] Although various implementation schemes have been described relative to ultrasound imaging systems, these schemes can be used in conjunction with any suitable imaging system (e.g., X-ray, computed tomography, single-photon emission computed tomography, magnetic resonance imaging, or similar imaging systems).
[0027] Figure 1 This is a schematic diagram of an imaging system 200 including an ultrasound imaging system 202 and a remote device 230. The remote device 230 can be a computer, tablet, smartphone, etc., and can be an off-the-shelf device or a device specifically designed for use as a remote device 230 in conjunction with the imaging system 202. As used herein, the term "smartphone" refers to a portable device that can operate as a mobile phone and includes a computing platform configured to support operation of a mobile phone, a personal digital assistant (PDA), and various other applications. Such other applications may include, for example, a media player, a camera, a global positioning system (GPS), a touchscreen, an internet browser, Wi-Fi, etc. The computing platform or operating system may be, for example, Google Android. TM Apple iOS TM Microsoft Windows TM Blackberry TM Linux TM Furthermore, the term "tablet device" refers to portable devices, such as the Kindle. TM or iPad TMThe remote device 230 may include a touchscreen display 204 for use as a user input device and a display. The remote device 230 communicates with the ultrasound imaging system 202 to display image 214 on the display 204 based on image data acquired by the ultrasound imaging system 202. The remote device 230 also includes any suitable components for image viewing, manipulation, and storage of information related to image 214.
[0028] Probe 206 communicates with ultrasound imaging system 202. Probe 206 may be mechanically coupled to ultrasound imaging system 202. Alternatively, probe 206 may communicate wirelessly with imaging system 202. Probe 206 includes an array of transducer elements / transducer elements 208 that transmit ultrasound pulses to an object 210 to be scanned (e.g., an organ of a patient). Ultrasound pulses may be backscattered from structures within object 210, such as blood cells or muscle tissue, to generate echoes returning to transducer elements 208. Transducer elements 208 generate ultrasound image data based on the received echoes. Probe 206 transmits ultrasound image data to ultrasound imaging system 202, which operates imaging system 200. The image data of object 210 acquired using ultrasound imaging system 202 may be two-dimensional or three-dimensional image data. In another alternative embodiment, ultrasound imaging system 202 may acquire four-dimensional image data of object 210. When generating image 214, processor 222 is also configured to automatically identify regions of interest (ROIs) 224 within image 214 and provide identification of those ROIs 224 within image 214.
[0029] Ultrasound imaging system 202 includes a memory 212 for storing ultrasound image data. Memory 212 may be a database, random access memory, etc. Processor 222 accesses the ultrasound image data from memory 212. Processor 222 may be a logic-based device, such as one or more computer processors or microprocessors. Processor 222 generates an image based on the ultrasound image data. After being formed by processor 222, the image 214 is optionally presented on display 216 for viewing, either in real-time during the procedure or when accessed after the procedure is completed, such as on the display screen of a cart-based ultrasound imaging system 202 with an integrated display / monitor 216, or on the integrated display / screen 216 of a laptop-based ultrasound imaging system 200.
[0030] In one exemplary embodiment, the ultrasound imaging system 202 may present image 214 along with a graphical user interface (GUI) or other display user interface on an associated display / monitor / screen 216. Image 214 may be a software-based display accessible from multiple locations, such as via a web-based browser, local area network, etc. In such embodiments, image 214 may be remotely accessed and thus displayed on a remote device 230 in the same manner as image 214 is presented on display / monitor / screen 216.
[0031] The ultrasound imaging system 202 also includes a transmitter / receiver 218 that communicates with the transmitter / receiver 220 of the remote device 230. The ultrasound imaging system 202 and the remote device 230 can communicate via a direct peer-to-peer wired / wireless connection or a local area network or via an Internet connection (such as via a web-based browser).
[0032] An operator can remotely access imaging data stored on the ultrasound imaging system 202 from a remote device 230. For example, the operator can log in to a virtual desktop provided on the monitor 204 of the remote device 230. The virtual desktop is remotely linked to the ultrasound imaging system 202 to access the memory 212 of the ultrasound imaging system 202. Once access to the memory 212 is gained, the operator can select image data to view. The image data is processed by the processor 222 to generate an image 214. For example, the processor 222 can generate a DICOM image 214. The ultrasound imaging system 202 transmits the image 214 to the monitor 204 of the remote device 230, making the image 214 visible on the monitor 204.
[0033] Now see Figure 2 In an alternative embodiment, the imaging system 202 is completely omitted, wherein the probe 206 is configured to include a memory 207, a processor 209, and a transceiver 211 for processing ultrasound image data and transmitting the ultrasound image data directly to a remote device 230 via a wired or wireless connection. The ultrasound image data is stored in a memory 234 in the remote device 230 and processed in a suitable manner by a processor 232 operatively connected to the memory 234 to create an image 214 and present the image on a remote display 204.
[0034] In any embodiment, the image 214 generated by processors 222 and 232 is formatted for presentation on the display 216 of the imaging system 202, and this formatting is maintained in embodiments where the image 214 is transmitted to the remote device 230 or when it is generated on the remote device 230 for display in portrait or landscape format. To effectively display the image 214 on the display 204 of the remote device 230, Figure 3In the method, after image 214 is created by processors 222 and 232 in box 300, in box 302, processors 222 and 232 further use known recognition processes and / or algorithms for image generation for ultrasound or other imaging systems to determine the location of regions of interest (ROIs) 224 present within image 214. These ROIs include, but are not limited to, organs / structures, or abnormalities 226, or other clinically relevant areas or other artifacts such as needles (used during procedures). For example, conventional image processing techniques or artificial intelligence (AI)-based methods (including machine learning (ML) and deep learning (DL), or a combination of both) can be used to identify and locate these ROIs 224 and / or abnormalities 226 within image 214. For AI-based recognition methods, the ultimate goal of identifying and locating these ROIs 224 / abnormalities 226 can be categorized as an image segmentation or object localization problem. While ML-based methods (such as Support Vector Machines (SVM), Random Forests (RF), etc.) can be used to solve these problems, Convolutional Neural Networks (CNNs) (a class of DL-based models) are best suited for such tasks, thus producing better accuracy and adaptability under various imaging conditions.
[0035] In block 304, processors 222, 232 further determine the appropriate format for image 214 and convert image 214 to that appropriate format, such as converting from a first display format to a second display format, from an imaging system display format to a remote device display format, from a landscape format to a portrait format, or vice versa, and / or determine the magnification of image 214 required to effectively present image 214 on remote device display 204. As in an exemplary embodiment, image 214 is formatted for presentation on display 216 in a generally square configuration, the size, aspect ratio, and shape of remote device display 204 causing only a portion of image 214 to be presented on remote device display 204 through appropriate format conversion and / or magnification. In performing this analysis, processors 222, 232 determine which portion 250 ( Figure 4 ) will be visible on the remote device display 204, and which part 252 of image 214 ( Figure 4 The data will be cut off or clipped on the remote device display 204.
[0036] Using information from box 302 regarding the locations of ROIs 224 and anomalies 226 in image 214, and information regarding the visible image region 250 and cropped or cut-off image portions or regions 252 of image 214 from box 304, processors 222 and 232 can locate the positions of ROIs 224 and anomalies 226 in the visible image portion 250 and the cropped image portion 252 within box 306. For those ROIs 224 and anomalies 226 located within the visible image portion 250, processors 222 and 232 provide appropriate indications 254 and 256 for identifying the ROIs 224 and anomalies 226 within the visible image portion 250. In addition, processors 222, 232 also provide markings or indications 237 (e.g., dashed lines 239) extending along the edges of display 204, which identify those edges of the visible portion 250 of image 214 on display 204, which has a cropped image portion 252 extending through the associated edges of display 204.
[0037] In contrast to the ROI 224 and anomaly 226 identified by processors 222 and 232 and located in the cropped image portion 252, processors 222 and 232 also provide appropriate indications 254 and 256 in block 306 for identifying the ROI 224 and anomaly 226 in the cropped image portion 252. However, since indications 254 and 256 are not easily visible on the remote device display 204, in block 308, processors 222 and 232 modify the visible image portion 250 to include one or more markers 258 and 260, which are then presented in block 310 together with the visible portion 250 of image 214 on the remote device display 204.
[0038] Markers 258 and 260 are easily visible within the visible image portion 250 and provide indication of the presence and location of the ROI 224 and / or anomaly 226 in one or more of the cropped image portions 252 within the visible image portion 250. Markers 258 and 260 may have any suitable form and any suitable shape and / or color, and Figure 4The exemplary embodiment shown takes the form of arrows 262 and 264. Arrows 262 and 264 are indicated in different ways (e.g., by color) to correspond to the type of region of interest associated with them, which may be ROI 224 or anomaly 226 as identified in image 214. Arrows 262 and 264 are positioned in the visible image portion 250 to align with the location of the associated ROI 224 and / or anomaly 226 in the associated cropped or cut-off image portion 252, wherein arrows 262 and 264 point in the direction of the location of the associated ROI 224 and / or anomaly 226. Markers 258 and 260 may additionally be aligned with ROI 224 / anomaly 226 in the depth direction, wherein the location of markers 258 and 260 in the visible image portion 250 corresponds to the depth of the ROI 224 / anomaly 226 in the associated cropped portion 252. In another exemplary embodiment, other attributes of indicators 254, 256, markers 258, 260, and / or arrows 262, 264 may be modified to provide additional information about the associated ROI 224 and / or anomaly 226. For example, markers 258, 260 may act as links when selected to display annotations or other written or input information about the ROI 224 / anomaly 226 associated with markers 258, 260, or to shift the visible image portion 250 to present the ROI 224 / anomaly 226 associated with markers 258, 260 in the visible display portion 250. Indicators 254, 256, markers 258, 260, and / or arrows 262, 264 may also be made with different shapes corresponding to the type of ROI 224 or anomaly 226 identified by indicators 254, 256, markers 258, 260, and / or arrows 262, 264. Additionally, markers 258 and 260 may flash intermittently or be included on or associated with other markers (such as when markers 258 and 260 can be activated as links for displaying markers on display 204) to indicate the prominence of the ROI 224 / anomaly 226 associated with markers 258 and 260. Furthermore, the dimensions of markers 258 and 260 (such as the size of the heads of arrows 262 and 264 and / or the length of the tails of arrows 262 and 264) can provide information about the distance between the associated ROI 224 / anomaly 226 in the cropped portion 252 and the visible image portion 250.
[0039] Now for reference Figure 5 Even if the image 214 presented on the display screen 204 does not contain any ROI 224 or anomaly 226, the image 214 is still presented with a mark or indication 237 for identifying any cropped portion 252 of the image 214.
[0040] Now see Figure 6Once the image portion 250 is displayed on the remote device monitor 204, the user can manipulate the image 214 using the appropriate user input 270 of the remote device 230. This user input can be any suitable input device, including a keyboard, mouse, or... Figure 6 In the exemplary embodiment shown, a touchscreen interface 272 allows a user to shift the visible portion 250 by sliding it across the interface 272, thereby shifting the area of the visible image portion 250 that forms the image 214. In this embodiment, when the user touches the touchscreen interface 272, the user slides their finger along the screen interface 272 in the direction in which they wish to move the visible image portion 250. Thus, by moving their finger to the right on the interface 272, the visible image portion 250 shifts to the right, causing the cropped portion 252 located on the left side of the visible image portion 250 to move into the visible image portion 250. Furthermore, by touching the screen interface 272 and using two fingers to make contraction or expansion movements, the user can increase or decrease the magnification of the visible image portion 250.
[0041] Alternatively, a user may operate a remote device 230 using user input 270 in a manner similar to that disclosed in U.S. Patent No. 7,274,377 entitled “Viewport Translation Feedback System,” the entire contents of which are expressly incorporated herein by reference for all purposes. In this manner, a user can shift or navigate image 214 relative to remote device display 204 so that the user can locate any ROI 224 and / or anomaly 226 in the cropped or cut-out image portion 252 within the visible image portion 250 presented on remote device display 204. Due to the information provided by references 258 and 260 (e.g., information about the presence and location of the associated ROI 224 or anomaly 226), references 258 and 260 enable the user to quickly locate and view the associated ROI 224 and / or anomaly 226 in the cropped portion 252.
[0042] Furthermore, when a user navigates to the ROI 224 or anomaly 226 associated with markers 258 and 260, markers 258 and 260 may remain aligned with the ROI 224 or anomaly 226 within the visible portion 250 until the ROI 224 or anomaly 226 is positioned within the visible portion 250 of the image 214 on the remote device display 204. Moreover, when a user navigates to the ROI 224 or anomaly 226, markers 258 and 260 may be changed to correspond to changes in the position of the visible portion 250 on the display 204 relative to the cropped portion 252 containing the ROI 224 or anomaly 226. For example, the dimensions of markers 258 and 260 can increase or decrease in size corresponding to the user shifting the visible portion 250 on display 204 away from or towards ROI 224 or anomaly 226. For instance, markers 258 and 260 become larger when the visible portion 250 is shifted towards ROI 224 / anomaly 226, and smaller when the visible portion 250 is shifted away from ROI 224 / anomaly 226. Additionally, when the visible portion 250 of image 214 is shifted on display screen 204, the markers or indications 237 for cropped portions 252 shift along with image 214, changing their length and position along the edges depending on the shape / range of the cropped area still present along those edges, and completely disappearing when there are no cropped portions 252 in the direction of a specific edge of display 204.
[0043] Now see Figure 7 and Figure 8 When the format of image 214 is shifted, the display 204, including ROI 224, anomaly 226, indication 237 and / or markers 258, 260, also applies. For example, when using linear probe 206, instead of the convex / fan-shaped probe 206... Figures 4 to 6 The curved image view, resulting in image 214, is shown below. Figure 7 and Figure 8 Formatted as shown. In this format, image 214 is still presented on display 204, accompanied by any applicable markers 258, 260 for ROI 224 and / or anomaly 226, and markers or indicators 237, even if markers 258, 260 are not present on display 204, as shown. Figure 8 As shown and described relative to the previous embodiment, image 214 can be shifted by the user on display 204 to navigate to and present ROI 224 and / or anomaly 226 (if present in cropped portion 252) within the visible image portion 250, or simply displayed on display 204 as cropped portion 252 identified by marker or indication 237.
[0044] In other alternative embodiments, the remote device 230's capabilities allow a user to zoom in and out of image 214 in any known manner to increase or decrease the size of the visible image portion / area 250. Additionally, image 214 presented on the remote device display 204 can be a recorded and / or stored image, a live image, a three-dimensional or volumetric image, or a video stream, or any suitable combination thereof. In another exemplary embodiment, markers 258, 260 can serve as selectable links or icons on the remote device 230 that, when activated by a user on the remote device display / screen 204, automatically navigate and / or shift image 214 to present the ROI 224 and / or anomaly 226 associated with the selected marker 258, 260 in the visible portion / area 250.
[0045] This written description uses examples to disclose the invention, including the best mode, and also enables those skilled in the art to practice the invention, including making and using any device or system and performing any included methods. The scope of the invention is defined by the claims and may include other examples that would occur to those skilled in the art. Such other examples are intended to fall within the scope of the claims if they have structural elements that are not indistinguishable from the literal language of the claims, or if they include equivalent structural elements that have minor differences from the literal language of the claims.
Claims
1. A method for displaying an image acquired by an imaging system on a display of a remote device, the method comprising the steps of: - Determine the visible portion and one or more cropped portions of the image to be displayed on the remote device; - Implement an algorithm for identifying the location of at least one region of interest (ROI) among one or more of the cropped portions of the image; - Provide at least one ROI marker in the visible portion of the image that is associated with at least one ROI in the one or more cropped portions; and - The visible portion and the at least one ROI marker are displayed on the monitor of the remote device. The step of determining the visible portion of the image and the one or more cropped portions includes: - Compare the display format of the imaging system with the display format of the remote device; as well as - Convert the image from the display format of the imaging system to the display format of the remote device.
2. The method of claim 1, further comprising the step of providing at least one cropping mark associated with the one or more cropping portions in the visible portion of the image.
3. The method of claim 2, wherein the step of providing the at least one cut-out portion mark comprises: - Place at least one cut-out mark along the edge of the visible portion adjacent to the one or more cut-out portions.
4. The method of claim 1, wherein the step of providing the at least one ROI marker comprises: - Place at least one ROI mark along the edge of the visible portion adjacent to each of the one or more cut portions.
5. The method of claim 1, wherein the step of providing at least one ROI marker comprises the following steps: - In the visible portion, the at least one ROI mark is placed in alignment with the position of the at least one associated ROI in the one or more cut portions.
6. The method of claim 1, wherein the at least one ROI marker includes information about the at least one ROI.
7. The method of claim 6, wherein the at least one ROI marker includes information about the distance between the at least one ROI in the one or more cut portions and the visible portion.
8. The method of claim 7, wherein information regarding the distance between the at least one ROI in the one or more cut portions and the visible portion is indicated by the size of at least a portion of the at least one ROI marker.
9. The method of claim 6, wherein the at least one ROI marker includes information about the type of the at least one ROI in the one or more cropped portions.
10. The method of claim 9, wherein information regarding the type of the at least one ROI in the one or more cut portions is indicated by the color of the at least one ROI marker.
11. The method of claim 1, further comprising, after presenting the visible portion and at least one ROI mark on the remote device display, shifting the visible portion on the remote device display such that one of the one or more cropped portions and the at least one ROI is shifted into the visible portion.
12. The method of claim 11, wherein the step of shifting the visible portion on the display of the remote device includes interacting with the remote device.
13. The method of claim 12, wherein the remote device display is a touchscreen, and wherein the step of interacting with the remote device includes swiping the visible portion on the touchscreen.
14. An imaging system for displaying an image acquired by the imaging system on a display of a remote device, the imaging system comprising: - An imaging probe, the imaging probe being adapted to acquire image data about the object to be imaged; and - A processor, operatively connected to the probe, to form an image based on the image data. The display of the remote device is operatively connected to the processor for displaying the image on the display. The processor is configured to determine a visible portion and one or more cropped portions of an image to be presented on the display, implement an algorithm for identifying the location of at least one region of interest (ROI) in one or more of the cropped portions of the image, and provide at least one ROI marker in the visible portion of the image on the display that is associated with the at least one ROI in the one or more cropped portions. The processor is configured to determine the visible portion and the one or more cropped portions of the image to be displayed on the display by comparing a first display format with a second display format, wherein the second display format is associated with the display.
15. The imaging system of claim 14, wherein the at least one ROI marker includes information about the at least one ROI.
16. The imaging system of claim 14, further comprising: - A remote device, wherein the display is a remote device display, and wherein the at least one ROI marker in the visible portion of the remote device display is configured to align with the position of the at least one associated ROI in the one or more cropped portions.
17. The imaging system of claim 16, wherein the processor is disposed within the remote device and operatively connected to the display of the remote device.
18. The imaging system of claim 17, wherein the probe is operatively directly connected to the processor in the remote device.
19. The imaging system of claim 16, comprising: - Ultrasonic imaging system The processor is located within the ultrasound imaging system; The probe is operatively connected to the ultrasound imaging system, and The remote device is operatively connected to the ultrasound imaging system.
Citation Information
Patent Citations
Viewport panning feedback system
US7274377B2
Medical image display apparatus and method of providing user interface
CN107646101A
Sterile field interactive control displays
CN111587459A
Tool position and identification indicator displayed in a boundary area of a computer display screen
US20080004603A1
Modification of images based on orientation
US20160100111A1