Method and system for providing rotational preview for three-dimensional and four-dimensional ultrasound images

By using rotation preview technology related to direction indication of user input device in ultrasonic imaging system, the problem of difficulty for users to control object rotation preview in volume rendering is solved, achieving more precise direction control and better user experience.

CN112568927BActive Publication Date: 2025-02-21GE PRECISION HEALTHCARE LLC
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202010984485.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-09-30
Filing Date
2020-09-18
Publication Date
2025-02-21
Estimated Expiration
2040-09-18

AI Technical Summary

Technical Problem

In ultrasound imaging technology, it is difficult for a user to associate the desired rotation of an object depicted in volume rendering with an appropriate user input device direction input, resulting in difficult control of the direction of the rotation preview.

Method used

A system and method are provided for presenting a rotation preview of an object with respect to a current view of the object at a position corresponding to a user input device orientation indication. The system includes a signal processor and a display system. By processing direction indications of the user input device, a rotation preview of the object is generated and displayed, ensuring that the direction of the preview is consistent with the direction of the user input device.

Benefits of technology

Through this method and system, the user can more intuitively associate the rotation preview of the object in volume rendering with the direction of the user input device, improving the direction control accuracy and user experience of the rotation preview.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112568927B_ABST
    Figure CN112568927B_ABST
Patent Text Reader

Abstract

A system and method for presenting a rotational preview of an object depicted in a volume rendering of 3D image data and / or 4D image data is provided. The method includes presenting a volume rendering of an object having an initial view at a display system. The method includes presenting a volume rendering preview at the display system. Each of the volume rendering previews provides a different rotational view of the object, and each of the volume rendering previews is positioned on the display system relative to the volume rendering at a position associated with a direction indication of a user input device. The method includes receiving a direction indication from the user input device. The method includes presenting an updated volume rendering of the object at the display system. The updated volume rendering includes an updated view of the object rotated from the initial view based on the direction indication from the user input device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Certain embodiments relate to ultrasound imaging. More specifically, certain embodiments relate to methods and systems for providing a rotational preview of an object depicted in a volume rendering of three-dimensional (3D) image data and / or four-dimensional (4D) image data. The rotational preview can be displayed with respect to a current view at a position corresponding to a rotation direction applied via a user input device. Background Art

[0002] Ultrasound imaging is a medical imaging technique used to image organs and soft tissues in the human body. Ultrasound imaging uses real-time, non-invasive, high-frequency sound waves to produce two-dimensional (2D), three-dimensional (3D), and / or four-dimensional (4D) (i.e., real-time / continuous 3D images) images.

[0003] Ultrasound imaging is a valuable non-invasive tool for diagnosing a variety of medical conditions. The acquired ultrasound data can be analyzed and / or processed to detect anatomical structures for evaluation by a medical professional to perform a diagnosis. Where the ultrasound image is a volume rendering of the 3D image data or 4D image data, the user can rotate the objects depicted in the volume rendering to obtain a desired view. However, it may be difficult for the user to associate the desired rotation of the objects depicted in the volume rendering with an appropriate user input device direction input.

[0004] Further limitations and disadvantages of conventional and traditional approaches will become apparent to those skilled in the art by comparing conventional and traditional systems with some aspects of the present disclosure as set forth in the remainder of this application with reference to the accompanying figures. Summary of the invention

[0005] A system and / or method is provided for presenting a rotated preview of an object depicted in a volume rendering of 3D image data and / or 4D image data relative to a current view of the object at a position corresponding to a directional indication of a user input device, substantially as shown and / or described in conjunction with at least one of the accompanying drawings, as more fully set forth in the claims.

[0006] These and other advantages, aspects and novel features of the present disclosure, as well as details of illustrated embodiments thereof, will be more fully understood from the following description and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 is a block diagram of an exemplary ultrasound system operable to present a rotational preview of an object depicted in 3D image data and / or a volume rendering of 4D image data in accordance with various embodiments.

[0008] Figure 2is a block diagram of an exemplary medical workstation operable to present a rotational preview of an object depicted in a volume rendering of 3D image data and / or 4D image data in accordance with various embodiments.

[0009] Figure 3 is an exemplary display of an object depicted in a volume rendering of 3D image data and / or 4D image data in accordance with various embodiments.

[0010] Figure 4 is an exemplary display of a rotational view according to various embodiments, relative to Figure 3 The volume rendering is positioned at a position associated with a directional indication of a user input device providing a corresponding object rotation.

[0011] Figure 5 According to various embodiments, after the object is rotated Figure 3 An exemplary display of an object depicted in a volume rendering.

[0012] Figure 6 is a flow chart illustrating exemplary steps that may be used to rotate a view of an object depicted in a volume rendering of 3D image data and / or 4D image data, in accordance with various exemplary embodiments. DETAILED DESCRIPTION

[0013] Certain embodiments may be found in methods and systems for providing a rotational preview of an object depicted in a volume rendering of three-dimensional (3D) image data and / or four-dimensional (4D) image data. Various embodiments have the following technical effects: a rotational preview of an object is presented at a position corresponding to a direction indication of a user input device relative to a current view of the object depicted in the volume rendering of the 3D image data and / or 4D image data. Aspects of the present disclosure provide a user with an understanding of the relationship between a particular rotational direction of an object depicted in the volume rendering of the 3D image data and / or 4D image data and a corresponding direction indication of a user input device.

[0014] When read in conjunction with the accompanying drawings, the following detailed description of the foregoing invention content and certain embodiments will be better understood. In terms of the functional block diagrams of various embodiments shown in the accompanying drawings, the functional blocks do not necessarily indicate the division between the hardware circuit system. Therefore, for example, one or more functional blocks (e.g., processors or memories) can be implemented in a single hardware (e.g., a block of a general signal processor or random access memory, a hard disk, etc.) or multiple hardware. Similarly, a program can be an independent program, can be incorporated into an operating system as a subroutine, can be a function in an installed software package, etc. It should be understood that the various embodiments are not limited to the arrangements and means shown in the accompanying drawings. It should also be understood that embodiments can be combined or other embodiments can be utilized, and structural, logical and electrical changes can be made without departing from the scope of the various embodiments. Therefore, the following detailed description is not intended to be limiting, and the scope of the present disclosure is defined by the appended claims and their equivalents.

[0015] As used herein, a component or step recited in the singular and preceded by the word "a" or "an" should be understood as not excluding the plural of the component or step, unless such exclusion is explicitly stated. In addition, references to "exemplary embodiments," "various embodiments," "certain embodiments," "representative embodiments," and the like are not intended to be interpreted as excluding the existence of additional embodiments that also include the recited features. Moreover, unless explicitly stated to the contrary, an embodiment "comprising," "including," "having" a component or components having a particular property may include additional components not having that property.

[0016] Also as used herein, the term "image" refers broadly to a visible image and the data representing a visible image. However, many embodiments generate (or are configured to generate) at least one visible image. In addition, as used herein, the phrase "image" is used to refer to an ultrasound mode, such as a sub-mode of a B-mode (2D mode), an M-mode, a three-dimensional (3D) mode, a CF mode, a PW Doppler, a CW Doppler, a MGD and / or a B-mode and / or a sub-mode of a CF, such as shear wave elastography (SWEI), TVI, angiography (Angio), gray-scale blood flow (B-flow), BMI, BMI_angiography (BMI_Angio), and in some cases also MM, CM, TVD, wherein "image" and / or "plane" include a single beam or multiple beams.

[0017] In addition, as used herein, the term "processor" or "processing unit" refers to any type of processing unit that can implement the required calculations required by various embodiments, such as single-core or multi-core: CPU, accelerated processing unit (APU), graphics card (Graphics Board), DSP, FPGA, ASIC or a combination thereof.

[0018] It should be noted that the various embodiments described herein for generating or forming an image may include processing for forming an image, which in some embodiments includes beamforming, and in other embodiments does not include beamforming. For example, an image may be formed without beamforming, such as by multiplying a matrix of demodulated data with a matrix of coefficients such that the product is an image, and wherein the process does not form any "beams." Furthermore, the formation of an image may be performed using a combination of channels that may originate from more than one transmit event (e.g., synthetic aperture techniques).

[0019] In various embodiments, ultrasound processing (e.g., including ultrasound beam imaging, such as receive beamforming) is performed in software, firmware, hardware, or a combination thereof to form an image. One implementation of an ultrasound system having a software beamformer architecture formed in accordance with various embodiments is shown in FIG. Figure 1 middle.

[0020] Figure 1 is a block diagram of an exemplary ultrasound system 100 operable to present a rotational preview of an object depicted in a volume rendering of 3D image data and / or 4D image data in accordance with various embodiments. Figure 1 , an ultrasound system 100 is shown. The ultrasound system 100 includes a transmitter 102, an ultrasound probe 104, a transmit beamformer 110, a receiver 118, a receive beamformer 120, an A / D converter 122, an RF processor 124, an RF / IQ buffer 126, a user input device 130, a signal processor 132, an image buffer 136, a display system 134, and an archive 138.

[0021] The transmitter 102 may include suitable logic, circuitry, interfaces, and / or code that may be operable to drive the ultrasound probe 104. The ultrasound probe 104 may include a two-dimensional (2D) array of piezoelectric elements. The ultrasound probe 104 may include a set of transmit transducer elements 106 and a set of receive transducer elements 108, which are generally constructed of the same elements. In certain embodiments, the ultrasound probe 104 may be operable to acquire ultrasound image data that covers at least a majority of an anatomical structure, such as a heart, a blood vessel, or any suitable anatomical structure.

[0022] The transmit beamformer 110 may include suitable logic, circuitry, interfaces and / or code that may be operable to control the transmitter 102 to drive a set of transmit transducer elements 106 to transmit ultrasound transmit signals into an area of ​​interest (e.g., a human, an animal, an underground cavity, a physical structure, etc.) via a transmit sub-aperture beamformer 114. The transmitted ultrasound signals may be backscattered from structures (e.g., blood cells or tissue) in the object of interest to generate echoes. The echoes are received by the receive transducer elements 108.

[0023] The set of receive transducer elements 108 in the ultrasound probe 104 may be operable to convert received echoes into analog signals, undergo sub-aperture beamforming by the receive sub-aperture beamformer 116, and then transmit to the receiver 118. The receiver 118 may include suitable logic, circuitry, interfaces, and / or code that may be operable to receive the signals from the receive sub-aperture beamformer 116. The analog signals may be transmitted to one or more of the plurality of A / D converters 122.

[0024] The plurality of A / D converters 122 may include suitable logic, circuitry, interfaces, and / or code that may be operable to convert analog signals from the receiver 118 into corresponding digital signals. The plurality of A / D converters 122 are disposed between the receiver 118 and the RF processor 124. However, the present disclosure is not limited thereto. Accordingly, in some embodiments, the plurality of A / D converters 122 may be integrated within the receiver 118.

[0025] The RF processor 124 may include suitable logic, circuitry, interfaces, and / or code that may be operable to demodulate the digital signals output by the plurality of A / D converters 122. According to an embodiment, the RF processor 124 may include a complex demodulator (not shown) that may be operable to demodulate the digital signals to form I / Q data pairs representing corresponding echo signals. The RF or I / Q signal data may then be transferred to the RF / IQ buffer 126. The RF / IQ buffer 126 may include suitable logic, circuitry, interfaces, and / or code that may be operable to provide temporary storage of the RF or I / Q signal data generated by the RF processor 124.

[0026] The receive beamformer 120 may include suitable logic, circuitry, interfaces, and / or code that may be operable to perform digital beamforming processing, such as summing delayed channel signals received from the RF processor 124 via the RF / IQ buffer 126 and outputting a beam-summed signal. The resulting processed information may be a beam-summed signal that is output from the receive beamformer 120 and communicated to the signal processor 132. According to some embodiments, the receiver 118, multiple A / D converters 122, RF processor 124, and beamformer 120 may be integrated into a single beamformer, which may be digital. In various embodiments, the ultrasound system 100 includes multiple receive beamformers 120.

[0027] The user input device 130 may be used to enter patient data, scan parameters, settings, select protocols and / or templates, initiate a rotating preview display, rotate an image view of a depicted object, etc. In an exemplary embodiment, the user input device 130 may be operable to configure, manage, and / or control the operation of one or more components and / or modules in the ultrasound system 100. In this regard, the user input device 130 may be operable to configure, manage, and / or control the operation of the transmitter 102, ultrasound probe 104, transmit beamformer 110, receiver 118, receive beamformer 120, RF processor 124, RF / IQ buffer 126, user input device 130, signal processor 132, image buffer 136, display system 134, and / or archive 138. The user input device 130 may include button(s), rotary encoder(s), touch screen, touch pad, trackball, motion tracking, voice recognition, mouse device, keyboard, camera, and / or any other device capable of receiving user instructions. In some embodiments, one or more of the user input devices 130 may be integrated into other components, such as, for example, the display system 134. As an example, the user input device 130 may include a touch screen display.

[0028] In various embodiments, a rotated preview of an object depicted in the volume rendering of the 3D image data or 4D image data may be displayed in response to an indication received via the user input device 130. In certain embodiments, an object captured in the 3D image data or 4D image data may be rotated to provide a different view in response to an indication received via the user input device 130. For example, the user input device 130 may be manipulated to rotate the viewing angle of the object left, right, up, down, and / or diagonally.

[0029] The RF processor 132 may include suitable logic, circuitry, interfaces and / or code that may be operable to process ultrasound scan data (i.e., summed IQ signals) for generating ultrasound images for presentation on a display system 134. The signal processor 132 may be operable to perform one or more processing operations on the acquired ultrasound scan data according to a plurality of selectable ultrasound modalities. In an exemplary embodiment, the signal processor 132 may be operable to perform display processing and / or control processing, etc. During a scanning session, the acquired ultrasound scan data may be processed in real time as the echo signals are received. Additionally or alternatively, the ultrasound scan data may be temporarily stored in the RF / IQ buffer 126 during the scanning session and processed in less than real time in a live operation or an offline operation. In various embodiments, the processed image data may be presented at the display system 134 and / or may be stored at an archive 138. The archive 138 may be a local archive, a picture archiving and communication system (PACS), or any suitable device for storing images and related information.

[0030] The signal processor 132 may be one or more central processing units, microprocessors, microcontrollers, and / or the like, among others. For example, the signal processor 132 may be an integrated component, or may be distributed across various locations. In an exemplary embodiment, the signal processor 132 may include a volume rendering processor 140 and a preview display processor 150. The signal processor 132 may be capable of: receiving input information from the user input device 130 and / or the archive 138; generating output that can be displayed by the display system 134; and manipulating the output in response to the input information from the user input device 130, among others. For example, the signal processor 132 (including the volume rendering processor 140 and the preview display processor 150) may be capable of executing any of the method(s) and / or instruction set(s) discussed herein according to various embodiments.

[0031] The ultrasound system 100 may be operable to continuously acquire ultrasound scan data at a frame rate suitable for the imaging situation in question. Typical frame rates range from 20-120 but may be lower or higher. The acquired ultrasound scan data may be displayed on a display system 134 at a display rate that may be the same as the frame rate or slower or faster than the frame rate. An image buffer 136 is included for storing processed frames of acquired ultrasound scan data that are not scheduled for immediate display. Preferably, the image buffer 136 has sufficient capacity to store frames of ultrasound scan data for at least several minutes. Frames of ultrasound scan data are stored in a manner that facilitates retrieval of the frame according to the order or time in which they were acquired. The image buffer 136 may be embodied as any known data storage medium.

[0032] The signal processor 132 may include a volume rendering processor 140, which includes suitable logic, circuit systems, interfaces and / or code that can be operable to perform volume rendering on a 3D volume and / or a 4D volume. The volume rendering processor 140 can be used to generate and present a volume rendering (e.g., a 2D projection) of a volume (e.g., 3D and / or 4D) data set. In this regard, rendering a 2D projection of a 3D data set and / or a 4D data set may include setting or defining a perception angle in space relative to an object being displayed, and then defining or calculating necessary information (e.g., opacity and color) for each voxel in the data set. For example, this can be accomplished by using a suitable transfer function for defining RGBA (red, green, blue and alpha) values ​​for each voxel. The resulting volume rendering may include a depth map that associates a depth value with each pixel in the 2D projection.

[0033] In various embodiments, the volume rendering processor 140 may be configured to render the 3D volume and / or 4D volume into multiple perspectives. For example, the volume rendering processor 140 may generate a first volume rendering at a current viewing direction or an initial viewing direction, and may generate additional volume renderings (also referred to as volume rendering previews) at perspectives that deviate from the initial viewing direction. The perspective offset may be, for example, 10 to 60 degrees or any suitable perspective offset that conveys the rotational direction of the object depicted in the volume rendering to the user. The number of additional volume renderings may be two (2), four (4), eight (8), or any suitable number of volume rendering previews associated with the rotational direction indicated by the direction of the user input device 130. As an example, in addition to the first volume rendering in the initial viewing direction, the volume rendering processor 140 may be configured to generate additional volume renderings rotated to the left, additional volume renderings rotated to the right, additional volume renderings rotated upward, additional volume renderings rotated downward, and / or additional volume renderings rotated in a diagonal direction. In some embodiments, the number and / or orientation of perspectives may be predefined. In an exemplary embodiment, the volume rendering processor 140 may be configured to present a first volume rendering at the initial viewing orientation at the display system 134 and / or store the first volume rendering at the archive 138 and / or any suitable storage medium. Additional volume renderings of the rotational orientation of the preview object may be provided to the preview display processor 150 for presentation at the display system 134 as described below. Additionally and / or alternatively, the additional volume renderings may be stored at the archive 138 and / or at any suitable storage medium.

[0034] In a representative embodiment, the volume rendering processor 140 may be configured to generate an additional set of volume renderings. For example, the volume rendering processor 140 may generate an updated or current volume rendering with an updated perspective in response to a user indication provided by the user input device 130, thereby rotating the perspective of the object to the left, right, upward, downward, and / or diagonally. In various embodiments, the volume rendering processor 140 may be configured to generate, store, and / or smoothly display an updated volume rendering of the object when the perspective is rotated via the user input device 130. The volume rendering processor 140 may be configured to generate additional volume rendering previews at perspectives offset from the updated viewing direction. The additional volume rendering previews may be provided to the preview display processor 150 and / or stored at a storage medium such as the archive 138.

[0035] The signal processor 132 may include a preview display processor 150 including suitable logic, circuitry, interfaces and / or code operable to present a volume rendering that previews a rotation of an object relative to a current volume rendered view of the object. The volume rendering preview may be presented by the preview display processor 150 at a location on the display system 134 that corresponds to the direction indication of the user input device 130. The volume rendering preview may provide the user with an understanding of the relationship between a particular rotational direction of an object depicted in the volume rendering and the corresponding direction indication of the user input device 130. The preview display processor 150 may receive from the volume rendering processor 140 a preview of a volume rendering of an object rotated at a perspective that deviates from the current perspective.

[0036] The preview display processor 150 may be configured to present each additional volume rendering preview at a position on the display system 134 with respect to the current volume rendering corresponding to the direction indication of the user input device 130. For example, the preview display processor 150 may receive a volume rendering of the perspective of the preview object rotated to the left, and the leftward manipulation of the user input device 130 may implement the rotation in the direction of the volume rendering preview. Accordingly, the preview display processor 150 may present the volume rendering to the left of the current volume rendering on the display system 134 so that the user understands that the user input device 130 is manipulated to the left to implement the desired rotation direction. As another example, the preview display processor 150 may receive an upwardly rotated volume rendering of the perspective of the preview object, and the upward direction manipulation of the user input device 130 may implement the rotation in the direction of the volume rendering preview. Accordingly, the preview display processor 150 may present the volume rendering above the current volume rendering on the display system 134 so that the user understands that the user input device 130 is manipulated upward to implement the desired rotation direction. The user input device 130 may be a trackball, a touch pad, arrow keys on a keyboard, and / or any suitable user input device 130 capable of receiving a directional indication.

[0037] In various embodiments, the preview display processor 150 may be configured to simultaneously display each of the additional volume rendering previews at an appropriate location on the display 134. The preview display processor 150 may automatically present the additional volume rendering previews together with the current volume rendering. Additionally and / or alternatively, the preview display processor 150 may present the additional volume rendering previews in response to user input received from the user input device 130. For example, the user may actuate a trackball button, place a finger on a touch pad, press a predetermined key on a keyboard, etc., and the preview display processor 150 may present the additional volume rendering preview in response to the user input from the user input device 130. The option of automatically presenting the additional volume rendering preview or presenting the additional volume rendering preview in response to a user indication may be a user-configurable setting. In some embodiments, the preview display processor 150 may update each of the additional volume rendering previews synchronously with updating the initial volume rendering in response to an indication of a direction to rotate the view of the object provided by the user input device 130. Alternatively, the preview display processor 150 may stop presenting the additional volume rendering previews in response to an indication of a direction to rotate the view of the object provided by the user input device 130. The option to continue presenting updated volume rendering previews or to cease displaying additional volume rendering previews in response to the directional indication provided by the user input device 130 may be a user configurable setting.

[0038] Display system 134 may be any device capable of conveying visual information to a user. For example, display system 134 may include one or more liquid crystal displays, light emitting diode displays, and / or any suitable displays. Display system 134 may be operable to display information from signal processor 132 and / or archive 138, such as medical images or any suitable information.

[0039] The archive 138 may be one or more computer-readable memories, such as a picture archiving and communication system (PACS), a server, a hard disk, a floppy disk, a CD, a CD-ROM, a DVD, a compact storage, a flash memory, a random access memory, a read-only memory, an electrically erasable and programmable read-only memory, and / or any suitable memory, that is integrated with and / or communicatively coupled (e.g., via a network) to the ultrasound system 100. For example, the archive 138 may include a database, a library, a collection of information, or other storage accessed by and / or in conjunction with the signal processor 132. For example, the archive 138 may be capable of temporarily or permanently storing data. The archive 138 may be capable of storing medical image data, data generated by the signal processor 132, and / or instructions readable by the signal processor 132, etc. In various embodiments, the archive stores 3D volumes and / or 4D volumes, volume renderings generated by the volume rendering processor 140, preview display parameters and settings, instructions for performing volume rendering, and / or instructions for presenting additional volume rendering previews at appropriate locations on the display system 134, etc.

[0040] Figure 2 is a block diagram of an exemplary medical workstation 200 operable to present a rotational preview of an object depicted in a volume rendering of 3D image data and / or 4D image data in accordance with various embodiments. In various embodiments, components of the medical workstation 200 may share various features with components of the ultrasound system 100, such as Figure 1 As shown in and described above. Figure 2 , the medical workstation 200 includes a display system 134, a signal processor 132, an archive 138, and a user input device 130, etc. The components of the medical workstation 200 can be implemented in software, hardware, firmware, etc. The various components of the medical workstation 200 can be communicatively linked. The components of the medical workstation 200 can be implemented separately and / or integrated in various ways. For example, the display system 134 and the user input device 130 can be integrated into a touch screen display.

[0041] Display system 134 may be any device capable of conveying visual information to a user. For example, display system 134 may include one or more liquid crystal displays, light emitting diode displays, and / or any suitable displays. Display system 134 may be operable to display information from signal processor 132 and / or archive 138, such as medical images or any suitable information.

[0042] The signal processor 132 may be one or more central processing units, microprocessors, microcontrollers, etc. For example, the signal processor 132 may be an integrated component, or may be distributed in various locations. The signal processor 132 includes a volume rendering processor 140 and a preview display processor 150, as shown in FIG. Figure 1 As described above, and may be capable of: receiving input information from the user input device 130 and / or the archive 138; generating output that can be displayed by the display system 134; and manipulating the output in response to the input information from the user input device 130, etc. For example, the signal processor 132, the volume rendering processor 140, and / or the preview display processor 150 may be capable of executing any of the (one or more) methods and / or (one or more) instruction sets discussed herein according to various embodiments.

[0043] The archive 138 may be one or more computer-readable memories, such as a picture archiving and communication system (PACS), a server, a hard disk, a floppy disk, a CD, a CD-ROM, a DVD, a compact storage, a flash memory, a random access memory, a read-only memory, an electrically erasable and programmable read-only memory, and / or any suitable memory, that is integrated with and / or communicatively coupled (e.g., via a network) to the medical workstation 200. For example, the archive 138 may include a database, a library, a collection of information, or other storage accessed by and / or in conjunction with the signal processor 132. For example, the archive 138 may be capable of temporarily or permanently storing data. The archive 138 may be capable of storing medical image data, data generated by the signal processor 132, and / or instructions readable by the signal processor 132, etc. In various embodiments, the archive stores 3D volumes and / or 4D volumes, volume renderings generated by the volume rendering processor 140, preview display parameters and settings, instructions for performing volume renderings, and / or instructions for presenting additional volume rendering previews at appropriate locations on the display system 134, etc.

[0044] The user input device 130 may include any device(s) capable of transmitting information from a user and / or in the direction of a user to the signal processor 132 of the medical workstation 200. Figure 1 As discussed, user input device 130 may include a touch panel, button(s), a mouse device, a keyboard, a rotary encoder, a trackball, a touchpad, a camera, voice recognition, and / or any other device capable of receiving user instructions.

[0045] Figure 3 FIG. 3 is an exemplary display 300 of an object depicted in a volume rendering 302 of 3D image data and / or 4D image data in accordance with various embodiments. Figure 3 , the display 300 includes a volume rendering 302 depicting 3D image data and / or 4D image data of an object at an initial or current viewing direction. In various embodiments, the 3D image data and / or 4D image data may be ultrasound image data.

[0046] Figure 4is an exemplary display 300 of rotated views 304-318 relative to Figure 3 The volume rendering 302 is positioned at a position associated with the direction indication of the user input device 130 that provides the corresponding object rotation. Figure 4 , showing 300 including Figure 3 304, right 306, up 308, and down 310, respectively; and volume rendering previews 312-318 of objects depicted in volume rendering 302 rotated diagonally to the upper left 312, the upper right 314, the lower left 316, and the lower right 318, respectively. Each of volume rendering previews 304-318 is positioned on display 300 at a location corresponding to the direction indication of user input device 130. For example, an object depicted in current volume rendering 302 may be updated to rotate in a left direction as shown in volume rendering preview 304 when user input device 130 provides a direction indication in a left direction. In various embodiments, volume rendering previews 304-318 may be automatically presented on display 300 in response to a user indication and / or at any suitable time and / or based on any suitable trigger. In certain embodiments, the initial volume rendering 302 may be updated to provide an updated volume rendering depicting a rotation of the object in response to a directional indication received from the user input device 130. In an exemplary embodiment, the volume rendering previews 304-318 may be updated synchronously with updating the initial volume rendering 302. Additionally and / or alternatively, once the user input device provides a directional indication for rotating an object depicted in the initial volume rendering or the current volume rendering 302, the volume rendering previews 304-318 may cease to be presented.

[0047] Figure 5 According to various embodiments Figure 3 An exemplary display 300 of an object after rotation of the object is depicted in a volume rendering 302 . Figure 5 , showing 300 including from Figure 3 The initial viewing direction shown in FIG. 3 is a left-rotated viewing direction depicting a volume rendering 302 of 3D image data and / or 4D image data of an object. For example, the volume rendering 302 viewing direction is in a similar direction to the volume rendering preview 304 corresponding to the left rotation.

[0048] Figure 6 is a flow chart 400 showing exemplary steps 402-408 that may be used to rotate a view of an object depicted in a volume rendering of 3D image data and / or 4D image data, according to an exemplary embodiment. Figure 4, which shows a flowchart 400 including exemplary steps 402 to 408. Certain embodiments may omit one or more of the steps, and / or perform the steps in an order different from the order listed, and / or combine certain steps discussed below. For example, some steps may not be performed in certain embodiments. As a further example, certain steps may be performed in a different time order (including simultaneously) than the time order listed below.

[0049] At step 402, the signal processor 132 of the ultrasound system 100 or the medical workstation 200 may present a first volume rendering 302 of an object having a first view. For example, the ultrasound system 100 may acquire a 3D volume and / or a 4D volume using the ultrasound probe 104. The ultrasound system 104 may provide the acquired 3D volume and / or 4D volume to the signal processor 132. The volume rendering processor 140 of the signal processor 132 may render the 3D volume and / or the 4D volume as a first volume rendering 302 in a current or initial view and present the volume rendering 302 at a display system 134 of the ultrasound system 100 or the medical workstation 200. As another example, the signal processor 132 of the medical workstation 200 or the ultrasound system 100 may retrieve the 3D volume and / or the 4D volume from the archive 138 or any suitable data storage medium. The volume rendering processor 140 of the signal processor 132 may render the 3D volume and / or the 4D volume as a first volume rendering 302 in a current or initial view direction and present the volume rendering 302 at the display system 134 of the ultrasound system 100 or the medical workstation 200 .

[0050] At step 404, the signal processor 132 of the ultrasound system 100 or the medical workstation 200 may present a plurality of additional volume renderings 304-318 previewing the object in different rotational views. Each of the volume rendering previews 304-318 may be positioned on the display system 314 relative to the first volume rendering 302 at a location associated with a direction indication of the user input device 130 providing a corresponding rotation of the object. For example, the preview display processor 150 of the signal processor 132 may receive the volume rendering previews 304-318 from the volume rendering processor 140, and may present each of the volume rendering previews 304-318 on the display system 134 at an appropriate location corresponding to the direction indication from the user input device 130 that implements the rotation in the direction depicted in the corresponding volume rendering preview 304-318. The volume rendering previews 304-318 may be presented simultaneously. For example, the volume rendering previews 304-318 may be presented in response to a user indication or automatically.

[0051] At step 406, the signal processor 132 of the ultrasound system 100 or the medical workstation 200 may receive a direction indication from the user input device 130. For example, the volume rendering processor 140 of the signal processor 132 may be configured to receive a direction indication from the user input device 130 to rotate the viewing angle of an object depicted in the volume rendering 302. As an example, a user may wish to observe an object depicted in the initial volume rendering 302 rotated in a direction depicted in one of the volume rendering previews 304-318. The user may provide a direction indication at the user input device 130 that corresponds to the direction of the desired volume rendering preview 304-318 from the initial volume rendering 302 on the display system 134. For example, if the desired rotational direction of the object is depicted in the volume rendering preview 304 on the left side of the initial volume rendering 302, the user may provide a direction indication to the left using the user input device 130.

[0052] At step 408, the signal processor 132 of the ultrasound system 100 or workstation 200 may present a second volume rendering 302 of the object, which is rotated from the first view in the direction of the rotated view of one of the plurality of additional volume renderings located at a location on the display system 134 associated with the directional indication of the user input device 130. For example, at step 406, the volume rendering processor 140 of the signal processor 132 may generate an updated volume rendering 302 with a rotated view angle corresponding to the directional indication received from the user input device 130. As an example, if the user provides a right directional indication at step 406, the volume rendering processor 140 may generate a volume rendering 302 with a right-rotated view angle. Upon receiving the directional indication from the user input device 130, the volume rendering processor 140 may continuously and substantially in real time generate and display the updated volume rendering 302 at the display system 134. The volume rendering processor 140 may present the updated volume rendering 302 at the display system 134 as a smooth rotation of the object depicted in the volume rendering 302.

[0053] Aspects of the present disclosure provide a method 400 and system 100, 200 for presenting a rotation preview 304-318 of an object depicted in a volume rendering 302 of 3D image data and / or 4D image data. According to various embodiments, the method 400 may include presenting 402, by at least one processor 132, 140, a volume rendering 302 of an object having an initial view at a display system 134. The method 400 may include presenting 404, by at least one processor 132, 150, a plurality of volume rendering previews 304-318 at a display system 134. Each of the plurality of volume rendering previews 304-318 may provide a different rotation view of the object. Each of the plurality of volume rendering previews 304-318 may be positioned on the display system 314 relative to the volume rendering 302 at a location associated with a direction indication of a user input device 130. The method 400 may include receiving 406, by at least one processor 132, 140, 150, a direction indication from a user input device 130. The method 400 may include presenting 408, by the at least one processor 132, 140, an updated volume rendering preview 302 of the object at the display system 134. The updated volume rendering 302 may include an updated view of the object rotated from an initial view based on a directional indication from a user input device.

[0054] In an exemplary embodiment, the volume rendering 302 is an ultrasound image. In a representative embodiment, the method 400 may include rendering 402, 408 a three-dimensional (3D) volume or a four-dimensional (4D) volume by at least one processor 132, 140 to generate the volume rendering 302 and the updated volume rendering 302. In various embodiments, a different rotational view of the object is provided for each of the multiple volume rendering previews 304-318 by causing the viewing angle to be offset from the initial view by a predefined amount. In some embodiments, the multiple volume rendering previews 304-318 are automatically presented. In an exemplary embodiment, the multiple volume rendering previews 304-318 are presented in response to a user indication received from the user input device 130. In various embodiments, the multiple volume rendering previews 304-318 can be updated synchronously with the presentation of the updated volume rendering 302. In some embodiments, the multiple volume rendering previews 304-318 are removed from the display system 134 in response to a direction indication received from the user input device 130.

[0055] Various embodiments provide systems 100, 200 for presenting a rotational preview 304-318 of an object depicted in a volume rendering 302 of 3D image data and / or 4D image data. The systems 100, 200 may include a user input device 130, at least one processor 132, 140, 150, and a display system 134. The user input device 130 may be configured to provide a direction indication. The at least one processor 132, 140 may be configured to present a volume rendering 302 of an object with an initial view at the display system 134.

[0056] At least one processor 132, 150 may be configured to present a plurality of volume rendering previews 304-318 at the display system 134. Each of the plurality of volume rendering previews 304-318 may provide a different rotated view of the object. Each of the plurality of volume rendering previews 304-318 may be positioned on the display system 314 relative to the volume rendering 302 at a location associated with one of a plurality of directional indications of the user input device 130. At least one processor 132, 140, 150 may be configured to receive a directional indication from the user input device 130. At least one processor 132, 140 may be configured to present an updated volume rendering 302 of the object at the display system 134. The updated volume rendering may include an updated view of the object rotated from the initial view based on the directional indication from the user input device. The display system 134 may be configured to display 300 the volume rendering 302, the plurality of volume rendering previews 304-318, and the updated volume rendering 302.

[0057] In a representative embodiment, the system 100, 200 is an ultrasound system 100 or a medical workstation 200. In various embodiments, at least one processor 132, 140, 150 is configured to provide a different rotational view of the object for each of the multiple volume rendering previews 304-318 by causing the viewing angle to be offset from the initial view by a predefined amount. In certain embodiments, at least one processor 132, 150 is configured to automatically present the multiple volume rendering previews 304-318. In an exemplary embodiment, the user input device 130 may be configured to provide a user indication. At least one processor 132, 150 may be configured to present the multiple volume rendering previews 304-318 in response to a user indication received from the user input device 130. In a representative embodiment, at least one processor 132, 140, 150 is configured to update the multiple volume rendering previews 304-318 synchronously with the presentation of the updated volume rendering 302. In various embodiments, the at least one processor 132 , 150 is configured to cease displaying the plurality of volume-rendered previews 304 - 318 at the display system 134 in response to a user indication received from the user input device 130 .

[0058] Certain embodiments provide a non-transitory computer-readable storage medium having a computer program stored thereon, the computer program having at least one code segment. The at least one code segment is executable by a machine for causing the machine to perform step 400. Step 400 may include presenting 402 a volume rendering 302 of an object having an initial view at a display system 134. Step 300 may include presenting 404 a plurality of volume rendering previews 304-318 at a display system 134. Each of the plurality of volume rendering previews 304-318 may provide a different rotated view of the object. Each of the plurality of volume rendering previews 304-318 may be positioned on the display system 314 relative to the volume rendering 302 at a position associated with a direction indication of a user input device 130. Step 400 may include receiving 406 a direction indication from a user input device 130. Step 400 may include presenting 408 an updated volume rendering 302 of the object at a display system 134. The updated volume rendering 302 may include an updated view of the object rotated from the initial view based on the direction indication from the user input device.

[0059] In various embodiments, step 400 may include shifting 404 the viewing angle from the initial view by a predefined amount to provide a different rotated view of the object for each of the plurality of volume rendering previews 304-318. In certain embodiments, the plurality of volume rendering previews 304-318 are presented 300 in response to a user indication received from the user input device 130. In an exemplary embodiment, step 400 may include updating 408 the plurality of volume rendering previews 304-318 synchronously with presenting the updated volume rendering 302. In a representative embodiment, step 400 may include removing 408 the plurality of volume rendering previews 304-318 from the display system 134 in response to a directional indication received from the user input device 130.

[0060] As used herein, the term "circuitry" refers to physical electronic components (i.e., hardware) and any software and / or firmware ("code") that can configure hardware, be executed by hardware, and / or otherwise be associated with hardware. As used herein, for example, a specific processor and memory may include a first "circuit" when executing a first line or more lines of code, and may include a second "circuit" when executing a second line or more lines of code. As used herein, "and / or" means any one or more items in the list connected by "and / or". As an example, "x and / or y" means any element in a three-element set {(x), (y), (x, y)}. As another example, "x, y, and / or z" means any element in a seven-element set {(x), (y), (z), (x, y), (x, z), (y, z), (x, y, z)}. As used herein, the term "exemplary" means as a non-limiting example, instance, or diagram. As used herein, the terms "eg" and "for example" list one or more non-limiting examples, instances, or diagrams. As used herein, a circuit system is “operable” or “configured” to perform a function whenever the circuit system includes the necessary hardware and code (if necessary) to perform the function, regardless of whether the performance of the function is disabled or not enabled by some user-configurable setting.

[0061] Other embodiments may provide a computer-readable device and / or a non-transitory computer-readable medium, and / or a machine-readable device and / or a non-transitory machine-readable medium having machine code and / or a computer program stored thereon, the machine code and / or the computer program having at least one code segment executable by a machine and / or a computer, thereby causing the machine and / or the computer to perform the steps as described herein for presenting a rotational preview of an object depicted in a volume rendering of 3D image data and / or 4D image data.

[0062] Accordingly, the present disclosure may be implemented in hardware, software, or a combination of hardware and software. The present disclosure may be implemented in a centralized manner in at least one computer system, or in a distributed manner in which different elements are distributed over several interconnected computer systems. Any type of computer system or other device suitable for implementing the methods described herein is suitable.

[0063] The various embodiments may also be embedded in a computer program product comprising all the features enabling the implementation of the methods described herein and which, when loaded into a computer system, is able to carry out these methods. A computer program in this context means any expression in any language, code or notation of a set of instructions intended to cause a system having information processing capabilities to perform certain functions, either directly or after either or both of the following: a) conversion into another language, code or notation; b) reproduction in a different material form.

[0064] Although the present disclosure has been described with reference to certain embodiments, it will be appreciated by those skilled in the art that various changes may be made and substituted with equivalents without departing from the scope of the present disclosure. In addition, many modifications may be made to adapt specific circumstances or materials to the teachings of the present disclosure without departing from its scope. Therefore, it is intended that the present disclosure is not limited to the specific embodiments disclosed, but that the present disclosure will include all embodiments that fall within the scope of the appended claims.

Claims

1. A method for providing a rotation preview, characterized in that: The method comprises: presenting, by at least one processor, at a display system, a volume rendering of the object having an initial view; presenting, by the at least one processor, a plurality of volume rendering previews at the display system, wherein each of the plurality of volume rendering previews provides a different rotated view of the object, and wherein each of the plurality of volume rendering previews is positioned on the display system relative to the volume rendering at a location associated with a different one of a plurality of directional indications of a user input device; receiving, by the at least one processor, from the user input device a direction indication corresponding to one of the plurality of direction indications, and wherein the direction indication is an instruction to rotate the initial view of the volume rendering of the object in one of a plurality of rotational directions; and An updated volume rendering of the object is presented, by the at least one processor, at the display system, the updated volume rendering having an updated view of the object rotated from the initial view based on the directional indication from the user input device.

2. The method according to claim 1, characterized in that The volume rendering is an ultrasound image.

3. The method according to claim 1, characterized in that The method includes rendering, by the at least one processor, a three-dimensional (3D) volume or a four-dimensional (4D) volume to generate the volume rendering and the updated volume rendering.

4. The method according to claim 1, characterized in that The differently rotated view of the object is provided for each of the plurality of volume rendered previews by offsetting a viewing angle from the initial view by a predefined amount.

5. The method according to claim 1, characterized in that The plurality of volume rendering previews are automatically presented.

6. The method according to claim 1, characterized in that The plurality of volume-rendered previews are presented in response to a user instruction received from the user input device.

7. The method according to claim 1, characterized in that The plurality of volume rendering previews are updated synchronously with presentation of the updated volume rendering.

8. The method according to claim 1, characterized in that The plurality of volume-rendered previews are removed from the display system in response to the directional indication received from the user input device.

9. A system for providing a rotation preview, characterized in that: The system comprises: a user input device configured to provide a directional indication; at least one processor, the at least one processor being configured to: presenting a volume rendering of the object having an initial view at a display system; presenting a plurality of volume rendering previews at the display system, wherein each of the plurality of volume rendering previews provides a different rotated view of the object, and wherein each of the plurality of volume rendering previews is positioned on the display system relative to the volume rendering at a location associated with a different one of a plurality of directional indications of the user input device; receiving the directional indication from the user input device, the directional indication corresponding to one of the plurality of directional indications, and wherein the directional indication is an instruction to rotate the initial view of the volume rendering of the object in one of a plurality of rotational directions; and presenting at the display system an updated volume rendering of the object, the updated volume rendering having an updated view of the object rotated from the initial view based on the directional indication from the user input device; and A display system is configured to display the volume rendering, the plurality of volume rendering previews, and the updated volume rendering.

10. The system according to claim 9, characterized in that The system is an ultrasound system or a medical workstation.

11. The system according to claim 9, characterized in that The at least one processor is configured to provide the differently rotated view of the object for each of the plurality of volume-rendered previews by offsetting a viewing angle from the initial view by a predefined amount.

12. The system according to claim 9, characterized in that The at least one processor is configured to automatically present the plurality of volume rendering previews.

13. The system of claim 9, wherein: The user input device is configured to provide a user indication, and wherein the at least one processor is configured to present the plurality of volume-rendered previews in response to the user indication received from the user input device.

14. The system of claim 9, wherein: The at least one processor is configured to update the plurality of volume rendering previews in synchronization with presentation of the updated volume rendering.

15. The system of claim 9, wherein: The at least one processor is configured to cease displaying the plurality of volume-rendered previews at the display system in response to the direction indication received from the user input device.

16. A non-transitory computer readable medium having a computer program stored thereon, the computer program having at least one code segment executable by a machine to cause the machine to perform steps comprising: presenting a volume rendering of the object having an initial view at a display system; presenting a plurality of volume rendering previews at the display system, wherein each of the plurality of volume rendering previews provides a different rotated view of the object, and wherein each of the plurality of volume rendering previews is positioned on the display system relative to the volume rendering at a location associated with a different one of a plurality of directional indications of a user input device; receiving a directional indication from the user input device, the directional indication corresponding to one of the plurality of directional indications, and wherein the directional indication is an instruction to rotate the initial view of the volume rendering of the object in one of a plurality of rotational directions; as well as An updated volume rendering of the object is presented at the display system, the updated volume rendering having an updated view of the object rotated from the initial view based on the directional indication from the user input device.

17. The non-transitory computer readable medium of claim 16, wherein: The non-transitory computer readable medium includes shifting a viewing angle from the initial view by a predefined amount to provide the different rotated view of the object for each of the plurality of volume rendered previews.

18. The non-transitory computer readable medium of claim 16, wherein: The plurality of volume-rendered previews are presented in response to a user instruction received from the user input device.

19. The non-transitory computer readable medium of claim 16, wherein: The plurality of volume rendering previews are updated synchronously with presentation of the updated volume rendering.

20. The non-transitory computer readable medium of claim 16, wherein: The non-transitory computer-readable medium includes removing the plurality of volume-rendered previews from the display system in response to the directional indication received from the user input device.

Citation Information

Patent Citations

  • Image processing method and computer readable medium for image processing

    US20070154075A1

  • Ultrasound system and method for providing preview image

    US20120123266A1

  • Multiple Volume Renderings in Three-Dimensional Medical Imaging

    US20130329978A1