System for dynamically removing anatomical structures from volume-rendered images based on position of virtual light sources

Abstract

A system (100) may receive three-dimensional (3D) medical imaging data of a region of interest of a subject. The system (100) may generate a first volume rendered image of an anatomical structure of a region of interest of a subject, and display the first volume rendered image. The system (100) may receive user input that selects a position of the virtual light source relative to the anatomical structure in the first volume rendered image. The system (100) may determine respective illumination parameters of the anatomical structure based on a position of the virtual light source relative to the anatomical structure of the region of interest. The system (100) may generate a second volume rendered image by removing one or more of the anatomical structures from the first volume rendered image based on respective illumination parameters of the anatomical structures. The system (100) may simultaneously display the first volume rendered image and the second volume rendered image.

Description

A system for dynamically removing anatomical structures from volumetric rendered images based on the position of a virtual light source. Technical Field

[0001] This disclosure relates to a system for displaying a volumetric rendered image. More specifically, this disclosure relates to a system for receiving user input that selects the position of a virtual light source in a first volumetric rendered image relative to an anatomical structure in a subject's region of interest, and for dynamically generating a second volumetric rendered image by removing one or more anatomical structures from the first volumetric rendered image using appropriate illumination parameters based on the anatomical structures. Background Technology

[0002] Volumetric rendering images can be two-dimensional (2D) representations of three-dimensional (3D) medical imaging data of a subject's region of interest. The subject's region of interest can include various anatomical structures. The system can generate volumetric rendering images using 3D medical imaging data and volumetric rendering techniques such as ray tracing, ray projection, photon mapping, and scanline rendering. Volumetric rendering images can include optical effects such as reflection, refraction, shadows, depth of field, and ambient light occlusion. Furthermore, the system can allow virtual light sources to be positioned relative to the anatomical structure to illuminate it. In this way, volumetric rendering images enable clinicians to assess the shape, structure, and location of anatomical structures displayed in the volumetric rendering image.

[0003] The region of interest (ROI) for a patient may include a variety of anatomical structures. Clinicians may be interested in viewing specific anatomical structures for evaluation. However, in some cases, anatomical structures may be partially or completely obscured or confused by structures that the patient is not interested in or has limited interest in. In these cases, clinicians may find it difficult to evaluate specific anatomical structures. Therefore, volumetric rendering images may be of low quality for the purpose of examination, may be unusable for the purpose of examination, or may be inaccurate for the purpose of examination. In this way, the displayed volumetric rendering images may not allow clinicians to accurately evaluate the ROI, which may affect patient safety, etc. Summary of the Invention

[0004] This invention provides a more detailed description of concepts in specific embodiments. It should not be used to identify essential features of the claimed subject matter, nor should it be used to limit the scope of the claimed subject matter.

[0005] In one aspect, a system may include a memory configured to store instructions; and one or more processors configured to execute instructions to: receive three-dimensional (3D) medical imaging data of a region of interest (ROI) of a subject; generate a first volumetric rendered image of the anatomical structure of the ROI of the subject; display the first volumetric rendered image of the anatomical structure of the ROI of the subject; receive user input selecting a position of a virtual light source in the first volumetric rendered image relative to the anatomical structure of the ROI of the subject; determine appropriate illumination parameters for the anatomical structure of the ROI of the subject based on the position of the virtual light source relative to the anatomical structure of the ROI; generate a second volumetric rendered image by removing one or more anatomical structures from the first volumetric rendered image based on the appropriate illumination parameters of the anatomical structure; and simultaneously display the first volumetric rendered image and the second volumetric rendered image.

[0006] In another aspect, a method may include: receiving three-dimensional (3D) medical imaging data of a region of interest (ROI) of a subject; generating a first volumetric rendered image of the anatomical structure of the ROI of the subject; displaying the first volumetric rendered image of the anatomical structure of the ROI of the subject; receiving user input, the user input selecting a position of a virtual light source in the first volumetric rendered image relative to the anatomical structure of the ROI of the subject; determining corresponding illumination parameters of the anatomical structure of the ROI of the subject based on the position of the virtual light source relative to the anatomical structure of the ROI; generating a second volumetric rendered image by removing one or more anatomical structures from the first volumetric rendered image based on the corresponding illumination parameters of the anatomical structure; and simultaneously displaying the first volumetric rendered image and the second volumetric rendered image.

[0007] In another aspect, a non-transitory computer-readable medium stores instructions that, when executed by one or more processors, cause one or more processors to: receive three-dimensional (3D) medical imaging data of a region of interest of a subject; generate a first volumetric rendered image of the anatomical structure of the region of interest of the subject; display the first volumetric rendered image of the anatomical structure of the region of interest of the subject; receive user input that selects a position of a virtual light source in the first volumetric rendered image relative to the anatomical structure of the region of interest of the subject; determine appropriate illumination parameters for the anatomical structure of the region of interest of the subject based on the position of the virtual light source relative to the anatomical structure of the region of interest; generate a second volumetric rendered image by removing one or more anatomical structures from the first volumetric rendered image based on the appropriate illumination parameters of the anatomical structure; and simultaneously display the first volumetric rendered image and the second volumetric rendered image. Attached Figure Description

[0008] Figure 1 is a diagram of an exemplary system for dynamically removing anatomical structures from a volumetric rendered image based on the position of a virtual light source.

[0009] Figure 2 is a diagram of exemplary components of one or more devices of Figure 1.

[0010] Figure 3 is a diagram of exemplary components of an ultrasound imaging system.

[0011] Figure 4 is a diagram of a computed tomography imaging system.

[0012] Figure 5 is a flowchart of an exemplary process for dynamically removing anatomical structures from a volumetric rendered image based on the position of a virtual light source.

[0013] Figure 6 is a flowchart of an exemplary process for selectively removing anatomical structures from a volumetric rendered image based on illumination parameters for anatomical structures.

[0014] Figure 7 is a flowchart of an exemplary process for dynamically updating a second volumetric rendering image based on adjustments to the position of a virtual light source in a first volumetric rendering image.

[0015] Figures 8A to 8C are exemplary displays of dynamically removing anatomical structures from volumetric rendered images based on the position of a virtual light source.

[0016] Figure 9 is an exemplary display of dynamically removing anatomical structures from a volumetrically rendered image based on the position of a virtual light source. Detailed Implementation

[0017] As mentioned above, volumetric rendering images of the patient's region of interest (ROI) may include various anatomical structures of varying importance for clinician assessment. For example, less important anatomical structures may partially or completely obscure or occlude structures that are crucial for assessment. Clinicians may be unable to accurately assess the RIO based on such obscuring or occlusion. In such cases, diagnostic assessment may be partially or completely affected, potentially impacting patient safety. Furthermore, clinicians may need to spend significant time manipulating or reviewing volumetric rendering images to attempt to assess the RIO.

[0018] Some embodiments of this paper provide a system for dynamically removing anatomical structures from a volumetrically rendered image based on the position of a virtual light source. For example, some embodiments of this paper provide a system that: receives 3D medical imaging data of a region of interest (ROI) of a subject; generates a first volumetrically rendered image of the anatomical structures of the ROI of the subject; displays the first volumetrically rendered image of the anatomical structures of the ROI of the subject; receives user input that selects the position of a virtual light source in the first volumetrically rendered image relative to the anatomical structures of the ROI of the subject; determines corresponding illumination parameters for the anatomical structures of the ROI of the subject based on the position of the virtual light source relative to the anatomical structures of the ROI of the subject; generates a second volumetrically rendered image by removing one or more anatomical structures from the first volumetrically rendered image based on the corresponding illumination parameters of the anatomical structures; and simultaneously displays the first volumetrically rendered image and the second volumetrically rendered image.

[0019] Therefore, the system can remove anatomical structures that partially or completely obscure or obscure the anatomical structures of interest. In this way, the system generates volumetric rendering images that allow clinicians to assess the region of interest more accurately, comprehensively, and / or rapidly. This improves the assessment of the region of interest and / or patient safety by allowing for more accurate or comprehensive diagnosis. Furthermore, the system can simultaneously display a first volumetric rendering image and a second volumetric rendering image, allowing the user to manipulate the position of the virtual light source in the first volumetric rendering image and update the second volumetric rendering image accordingly.

[0020] In this way, some embodiments of this paper provide a technical improvement in the field of medical imaging by generating more accurate or more convincing volumetric rendered images through the removal of low-information-quality anatomical structures that interfere with the region of interest. Furthermore, some embodiments of this paper provide a technical improvement to the user interface associated with the medical imaging system by providing a specific display arrangement that includes the simultaneous display of a first volumetric rendered image and a second volumetric rendered image, and allows the user to interact with and manipulate user interface elements in the first volumetric rendered image to adjust the position of a virtual light source relative to the anatomical structures displayed in the first volumetric rendered image, thereby adjusting the display in the second volumetric rendered image.

[0021] Figure 1 is a diagram of an exemplary system 100 for dynamically removing anatomical structures from a volumetric rendered image based on the position of a virtual light source. As shown in Figure 1, system 100 may include a medical imaging system 110, a medical imaging database 120, and a network 130.

[0022] The medical imaging system 110 can be configured to acquire 3D medical imaging data of the region of interest of the subject. For example, the medical imaging system 110 can be an ultrasound system, a computed tomography (CT) system, a magnetic resonance imaging (MRI) system, an X-ray system, or a positron emission tomography (PET) device.

[0023] The medical imaging database 120 can be configured to store 3D medical imaging data of the patient's region of interest. For example, the medical imaging database 120 can be a cloud database, a hierarchical database, a web database, a centralized database, a picture archiving and communication system (PACS), etc.

[0024] Network 130 can allow communication between medical imaging system 110 and medical imaging database 120. For example, network 130 can be a local area network (LAN), wide area network (WAN), metropolitan area network (MAN), cellular network, private network, ad hoc network, intranet, Internet, fiber-optic network, wired network, wireless network, and / or a combination of these or other types of networks.

[0025] The number and arrangement of systems 100 are provided as examples. In practice, system 100 may include additional devices, fewer devices, different devices, or devices arranged differently from those shown in Figure 1. Additionally or alternatively, a group of devices in system 100 (e.g., one or more devices) may be integrated into a single device and / or perform one or more functions described as being performed by another device or another group of devices in system 100.

[0026] Figure 2 is a diagram of exemplary components of one or more devices 200 of Figure 1. Device 200 may correspond to medical imaging system 110 and / or medical imaging database 120. As shown in Figure 2, device 200 may include bus 210, processor 220, memory 230, storage component 240, input component 250, output component 260, and communication interface 270.

[0027] Bus 210 includes components that allow communication between components of device 200. Processor 220 may be implemented in hardware, firmware, or a combination of hardware and software. Processor 220 may be a central processing unit (CPU), graphics processing unit (GPU), accelerated processing unit (APU), microprocessor, microcontroller, digital signal processor (DSP), field-programmable gate array (FPGA), application-specific integrated circuit (ASIC), or another type of processing component.

[0028] Processor 220 may include one or more processors capable of being programmed to perform functions. Processor 220 may include one or more processors 220 configured to perform the operations described herein. For example, a single processor 220 may be configured to perform all the operations described herein. Alternatively, multiple processors 220 may be collectively configured to perform all the operations described herein, and each of the multiple processors 220 may be configured to perform a subgroup of the operations described herein. For example, a first processor 220 may perform a first subgroup of operations described herein, a second processor 220 may be configured to perform a second subgroup of operations described herein, and so on.

[0029] Memory 230 may include random access memory (RAM), read-only memory (ROM), and / or another type of dynamic or static storage device (e.g., flash memory, magnetic memory, and / or optical memory) that stores information and / or instructions for use by processor 220.

[0030] Storage component 240 may store information and / or software related to the operation and use of device 200. For example, storage component 240 may include hard disk (e.g., magnetic disk, optical disk, magneto-optical disk and / or solid-state disk), compact disc (CD), digital versatile disc (DVD), floppy disk, cassette, magnetic tape and / or another type of non-transitory computer-readable medium and corresponding drives.

[0031] Input component 250 may include components that allow device 200 to receive information, such as via user input (e.g., touchscreen display, keyboard, keypad, mouse, buttons, switches, camera, and / or microphone). Additionally or alternatively, input component 250 may include sensors for sensing information (e.g., Global Positioning System (GPS) components, accelerometers, gyroscopes, and / or actuators). Output component 260 may include components that provide output information from device 200 (e.g., a display, a speaker for outputting sound at an output sound level, and / or one or more light-emitting diodes (LEDs)).

[0032] Communication interface 270 may include transceiver-like components (e.g., a transceiver and / or separate receiver and transmitter) that enable device 200 to communicate with other devices, such as via a wired connection, a wireless connection, or a combination of wired and wireless connections. Communication interface 270 may permit device 200 to receive information from another system and / or provide information to another system. For example, communication interface 270 may include an Ethernet interface, an optical interface, a coaxial interface, an infrared interface, a radio frequency (RF) interface, a universal serial bus (USB) interface, a Wi-Fi interface, or a cellular network interface, etc.

[0033] Device 200 can perform one or more processes described herein. Device 200 can execute these processes based on software instructions stored in a non-transitory computer-readable medium, such as memory 230 and / or storage component 240, executed by processor 220. A computer-readable medium can be defined herein as a non-transitory memory device. A memory device can include memory space within a single physical storage device or memory space distributed across multiple physical storage devices.

[0034] Software instructions can be read from another computer-readable medium or from another system into memory 230 and / or storage component 240 via communication interface 270. When executed, the software instructions stored in memory 230 and / or storage component 240 can cause processor 220 to perform one or more processes described herein. Additionally or alternatively, hardwired circuitry may be used in place of or in combination with software instructions to perform one or more processes described herein. Therefore, the specific implementations described herein are not limited to any particular combination of hardware circuitry and software.

[0035] The number and arrangement of components of device 200 shown in Figure 2 are provided as an example. In practice, device 200 may include additional components, fewer components, different components, or components arranged differently from those shown in Figure 2. Additionally or alternatively, a group of components of device 200 (e.g., one or more components) may perform one or more functions described as being performed by another group of components of device 200.

[0036] Figure 3 is a diagram of exemplary components of a medical imaging system 110. As shown in Figure 3, the medical imaging system 110 may include an ultrasound probe 302, a transmit beamformer 304, a transmitter 306, an element 308, a receiver 310, a receive beamformer 312, a user input device 314, a processor 316, a display 318, a memory 320, and a communication interface 322. The aforementioned components may be connected via wired or wireless connections.

[0037] The ultrasound probe 302 can be configured to acquire ultrasound data of the region of interest (ROI) of a subject. For example, the ultrasound probe 302 can be a linear probe, a phased array probe, a curved linear probe coupled to a positioning and tracking system, a mechanically manipulated linear array transducer, a phased array transducer, a curved linear array transducer, an electronically manipulated 2D transducer array, an electronic 3D (e3D) probe, an electronic 4D (e4D) probe, or a low-profile wearable patch version of any of the aforementioned probes. According to one embodiment, the ultrasound probe 302 can be configured to generate ultrasound signals, emit ultrasound signals toward the RIO of the subject, receive echo ultrasound signals backscattered from the RIO of the subject, generate ultrasound data based on the echo ultrasound signals, and output ultrasound data.

[0038] Transmit beamformer 304 can be configured to apply a delay time to the electrical signal provided to element 308 to focus the corresponding ultrasonic signal at the region of interest. Transmitter 306 can be configured to send an electrical signal to element 308 to drive element 308 to emit an ultrasonic signal toward the region of interest. Element 308 can be configured to receive the electrical signal from transmitter 306, convert the electrical signal into an ultrasonic signal, and emit the ultrasonic signal toward the region of interest. Element 308 can be configured to receive the echo ultrasonic signal backscattered from the region of interest, convert the echo ultrasonic signal into an electrical signal, and provide the electrical signal to receiver 310. Receiver 310 can be configured to receive the electrical signal from element 308 and provide the electrical signal to receiver beamformer 312. Receiver beamformer 312 can apply a delay time to the electrical signal received from element 308.

[0039] User input device 314 may be configured to receive user input and provide the user input to processor 316. For example, user input device 314 may be a touch screen display, keyboard, keypad, mouse, button, switch, or microphone, etc. Additionally or alternatively, user input device 314 may be configured to sense information. For example, user input device 314 may sense information from an electromagnetic positioning system, inertial measurement system, accelerometer, gyroscope, or actuator, etc.

[0040] Processor 316 may be configured to perform the operations as described herein. For example, processor 316 may be a central processing unit (CPU), graphics processing unit (GPU), accelerated processing unit (APU), microprocessor, microcontroller, digital signal processor (DSP), field-programmable gate array (FPGA), application-specific integrated circuit (ASIC), or another type of processing component. Processor 316 may be implemented in hardware, firmware, or a combination of hardware and software. Processor 316 may include one or more processors 316 configured to perform the operations described herein. For example, a single processor 316 may be configured to perform all the operations described herein. Alternatively, multiple processors 316 may be collectively configured to perform all the operations described herein, and each of the multiple processors 316 may be configured to perform a subgroup of the operations described herein. For example, a first processor 316 may perform a first subgroup of operations described herein, a second processor 316 may be configured to perform a second subgroup of operations described herein, and so on.

[0041] Processor 316 can be configured to control ultrasound probe 302 to acquire ultrasound data. Processor 316 can be configured to control which elements in element 308 are active and to control the shape of the beam emitted from ultrasound probe 302. Processor 316 can generate ultrasound images for display. For example, processor 316 can generate B-mode images, color Doppler images, M-mode images, or color M-mode images, etc. Ultrasound images can be 3D images, 2D images, single-plane images, dual-plane images, tri-plane images, or multi-plane images, etc. Ultrasound images can correspond to various anatomical planes (e.g., sagittal, coronal, and transverse) of the region of interest.

[0042] Display 318 can be configured to display information. For example, display 318 can be a monitor, LED display, cathode ray tube, projector display, touch screen, tablet computer, or mobile phone. Display 318 can display ultrasound images based on ultrasound data in real time. For example, display 318 can display ultrasound images within one second, two seconds, five seconds, etc., of ultrasound data acquired by ultrasound probe 302.

[0043] Memory 320 may be configured to store information and / or instructions for use by processor 316. Memory 320 may be a non-transitory computer-readable medium. For example, memory 320 may be RAM, ROM, and / or another type of dynamic or static storage device (e.g., flash memory, magnetic memory, and / or optical memory) for storing information and / or instructions for use by processor 316. Memory 320 may be configured to store instructions that, when executed by processor 316, cause processor 316 to perform the operations described herein.

[0044] The communication interface 322 can be configured to enable the processor 316 to communicate with other systems, such as via a wired connection, a wireless connection, or a combination of wired and wireless connections. For example, the communication interface 322 may include an Ethernet interface, an optical interface, a coaxial interface, an infrared interface, an RF interface, a USB interface, a Wi-Fi interface, or a cellular network interface, etc.

[0045] The number and arrangement of components of the medical imaging system 110 shown in Figure 3 are provided as an example. In practice, the medical imaging system 110 may include additional components, fewer components, different components, or components arranged differently from those shown in Figure 3. Additionally or alternatively, a set of components (e.g., one or more components) of the medical imaging system 110 may perform one or more functions described as being performed by another set of components of the medical imaging system 110.

[0046] Figure 4 is a diagram of exemplary components of a medical imaging system 110. As shown in Figure 4, the medical imaging system 110 may include a rack 402, a rotating frame 404, an X-ray source 406, an X-ray detector 408, an examination table 410, a processor 412, a memory 414, a display 416, a user input device 418, a communication interface 420, a picture archiving and communication system (PACS) 422, and a server 424.

[0047] Processor 412 can be configured to control the operation of medical imaging system 110. For example, processor 412 can be a CPU, GPU, APU, microprocessor, microcontroller, DSP, FPGA, or ASIC. Processor 412 can be implemented in hardware, firmware, or a combination of hardware and software. Processor 412 may include one or more processors 412 configured to perform the operations described herein. For example, a single processor 412 may be configured to perform all the operations described herein. Alternatively, multiple processors 412 may be collectively configured to perform all the operations described herein, and each of the multiple processors 412 may be configured to perform a subgroup of the operations described herein. For example, a first processor 412 may perform a first subgroup of operations described herein, a second processor 412 may be configured to perform a second subgroup of operations described herein, and so on.

[0048] The processor 412 can be configured to control the movement of the rack 402, the rotating frame 404, the X-ray source 406, the X-ray detector 408, and the inspection table 410.

[0049] Memory 414 may be configured to store information and / or instructions for use by processor 412. Memory 414 may be a non-transitory computer-readable medium. For example, memory 414 may be RAM, ROM, flash memory, magnetic memory, or optical memory, etc. Memory 414 may be configured to store instructions that, when executed by processor 412, cause processor 412 to perform the operations described herein.

[0050] Display 416 can be configured to display information. For example, display 416 can be a monitor, LED display, cathode ray tube, projector display, touch screen, tablet computer, or mobile phone, etc.

[0051] User input device 418 may be configured to receive user input and provide the user input to processor 412. For example, user input device 418 may be a touchscreen display, keyboard, keypad, mouse, button, switch, or microphone. Additionally or alternatively, user input device 418 may be configured to sense information. For example, user input device 418 may sense information from an electromagnetic positioning system, inertial measurement system, accelerometer, gyroscope, or actuator.

[0052] Communication interface 420 may be configured to enable processor 412 to communicate with other devices, such as via a wired connection, a wireless connection, or a combination of wired and wireless connections. For example, communication interface 420 may include an Ethernet interface, an optical interface, a coaxial interface, an infrared interface, an RF interface, a USB interface, a Wi-Fi interface, or a cellular network interface. PACS 422 may be configured to communicate with external systems and / or networks to allow users at various locations to access medical images. Server 424 may be configured to store one or more models as described herein. For example, server 424 may be a local server, a cloud server, or a virtual machine.

[0053] The number and arrangement of components of the medical imaging system 110 shown in Figure 4 are provided as an example. In practice, the medical imaging system 110 may include additional components, fewer components, different components, or components arranged differently from those shown in Figure 4. Additionally or alternatively, a set of components (e.g., one or more components) of the medical imaging system 110 may perform one or more functions described as being performed by another set of components of the medical imaging system 110.

[0054] Figure 5 is a flowchart of an exemplary process 500 for dynamically removing anatomical structures from a volumetric rendered image based on the position of a virtual light source. According to an embodiment, a medical imaging system 110 may perform one or more operations of process 500 of Figure 5. Alternatively, one or more other devices may perform one or more operations of process 500 of Figure 5.

[0055] As shown in Figure 5, process 500 may include receiving three-dimensional (3D) medical imaging data of a region of interest (ROI) of a subject (operation 510). For example, medical imaging system 110 may receive 3D medical imaging data of the RIO of a subject. According to embodiments, the 3D medical imaging data can be any type of medical imaging data. For example, 3D medical imaging data can be ultrasound data, CT data, MRI data, X-ray data, PET data, etc. The RIO can be any anatomical region of the subject. For example, the RIO can be the heart, liver, pancreas, brain, etc. The subject can be any type of subject to be imaged. For example, the subject can be a human, animal, or phantom. According to embodiments, the 3D medical imaging data may include voxels. Each voxel may include one or more values. For example, a voxel may include intensity values, color values, opacity values, etc. According to embodiments, medical imaging system 110 may receive 3D medical imaging data based on performing a scan of the subject. In this case, medical imaging system 110 can receive 3D medical imaging data substantially in real time. As used herein, "substantially real-time" received 3D medical imaging data can refer to 3D medical imaging data received within a threshold amount of time (e.g., 10 seconds, 1 minute, 5 minutes, etc.) during which 3D medical imaging data is acquired via scanning. Alternatively, medical imaging system 110 may receive 3D medical imaging data from medical imaging database 120. For example, medical imaging system 110 may request 3D medical imaging data from medical imaging database 120 and receive 3D medical imaging data based on that request.

[0056] As further shown in Figure 5, process 500 may include generating a first volumetric rendered image of the anatomical structure of the region of interest of the subject (operation 520). For example, medical imaging system 110 may generate a first volumetric rendered image of the anatomical structure of the region of interest of the subject. According to an embodiment, medical imaging system 110 may use 3D medical imaging data and rendering techniques to generate the first volumetric rendered image. For example, the rendering techniques may be ray tracing techniques, ray projection techniques, photon mapping techniques, path tracing techniques, scanline rendering techniques, etc. According to an embodiment, the anatomical structure may be any type of structure of the subject. For example, if the region of interest is the heart, the anatomical structure may be the left atrial appendage, mitral valve, aortic valve, pulmonary valve, tricuspid valve, tissue, etc. Additionally or alternatively, the anatomical structure may include a stent, mitral valve clip, pacemaker, etc.

[0057] As further shown in Figure 5, process 500 may include a first volumetric rendered image displaying the anatomical structure of the region of interest of the subject (operation 530). For example, medical imaging system 110 may display a first volumetric rendered image of the anatomical structure of the region of interest of the subject. According to an embodiment, medical imaging system 110 may display the first volumetric rendered image on a first area of ​​a display.

[0058] As further shown in Figure 5, process 500 may include receiving user input that selects the position of a virtual light source relative to the anatomical structure of the region of interest (ROI) of the subject in the first volumetric rendered image (operation 540). For example, medical imaging system 110 may receive user input that selects the position of the virtual light source relative to the anatomical structure of the RIO. According to embodiments, the virtual light source can illuminate the anatomical structure of the RIO. For example, the virtual light source may include an illumination configuration that allows the virtual light source to illuminate the anatomical structure of the RIO. The illumination configuration may include the shape of the virtual light source, the size of the virtual light source, the illumination intensity of the virtual light source, the illumination mode of the virtual light source, etc. According to embodiments, a user can interact with a user interface to select the position of the virtual light source relative to the anatomical structure of the RIO of the subject. For example, a user can interact with a user interface to select the position of the virtual light source by adjusting the position, orientation, etc. of the virtual light source.

[0059] As further shown in Figure 5, process 500 may include determining the corresponding illumination parameters of the anatomical structures in the region of interest of the subject based on the position of the virtual light source relative to the anatomical structures in the region of interest (operation 550). For example, medical imaging system 110 may determine the corresponding illumination parameters of the anatomical structures in the region of interest of the subject based on the position of the virtual light source relative to the anatomical structures in the region of interest. According to the embodiment, the illumination parameters can identify the degree to which the anatomical structure is irradiated. For example, the illumination parameter may be irradiance, which can be the density of radiation incident on a given surface of the anatomical structure. As another example, the illumination parameter may be radiance, which can be the flux density of radiant energy per unit solid angle and per unit projected area of ​​the radiating surface of the anatomical structure. Medical imaging system 110 may determine the corresponding illumination parameters for each anatomical structure in the anatomical structures displayed in the first volumetric rendering image.

[0060] According to the implementation scheme, the medical imaging system 110 can generate a 3D data structure based on 3D medical imaging data of the subject's region of interest. The 3D data structure can store irradiance parameters for each location within the 3D medical imaging data. For example, the medical imaging system 110 can track light energy from a virtual light source in each direction using the 3D medical imaging data and determine the irradiance parameters at any location using the 3D medical imaging data. For example, the medical imaging system 110 can treat the 3D medical imaging data as a translucent material and track light energy from a virtual light source in each direction using the 3D medical imaging data. Furthermore, the medical imaging system 110 can evaluate light absorption, scattering, and reflection to determine the propagation of light energy throughout the 3D medical imaging data. The medical imaging system 110 can store the determined irradiance parameters in the 3D data structure. Additionally, as described below, the medical imaging system 110 can use the 3D data structure to determine which anatomical structures are shown or not shown in the second volumetric rendered image.

[0061] As further shown in Figure 5, process 500 may include generating a second volumetric rendering image by removing one or more anatomical structures from a first volumetric rendering image based on corresponding illumination parameters of the anatomical structure (operation 560). For example, medical imaging system 110 may generate a second volumetric rendering image by removing one or more anatomical structures from a first volumetric rendering image based on corresponding illumination parameters of the anatomical structure. According to an embodiment, the second volumetric rendering image may be a volumetric rendering image similar to the first volumetric rendering image, except that one or more anatomical structures have been removed. According to an embodiment, medical imaging system 110 may compare the illumination parameters of the anatomical structure with an illumination parameter threshold and selectively remove the anatomical structure from the first volumetric rendering image based on whether the illumination parameters meet the illumination parameter threshold. For example, if the illumination parameters are less than the illumination parameter threshold, medical imaging system 110 may remove the anatomical structure from the first volumetric rendering image. Alternatively, as another example, if the illumination parameters are greater than or equal to the illumination parameter threshold, medical imaging system 110 may retain the anatomical structure in the first volumetric rendering image. According to an embodiment, medical imaging system 110 may completely remove the anatomical structure from the first volumetric rendering image to generate the second volumetric rendering image. In this scenario, the anatomical structure may be invisible in the second volumetric rendered image. Alternatively, the medical imaging system 110 may partially remove the anatomical structure from the first volumetric rendered image to generate the second volumetric rendered image. In this case, the anatomical structure may be partially visible in the second volumetric rendered image. For example, the medical imaging system 110 may adjust the opacity value of the voxel corresponding to the anatomical structure, making the anatomical structure opaque or more opaque. According to an embodiment, the medical imaging system 110 may generate the second volumetric rendered image by removing one or more anatomical structures from the first volumetric rendered image using an AI model. For example, the AI ​​model may be a decision tree (e.g., a classification tree or regression tree), a linear regression model, a neural network (e.g., a deep neural network (DNN), a convolutional neural network (CNN), or a recurrent neural network (RNN)), a logistic regression model, a support vector machine, etc. In this case, the medical imaging system 110 may input the first volumetric rendered image and information identifying the corresponding illumination parameters into the AI ​​model, and determine one or more anatomical structures to be removed based on the output of the AI ​​model. According to the implementation scheme, the medical imaging system 110 can generate a second volumetric rendering image by removing one or more anatomical structures from a first volumetric rendering image using information that identifies the target anatomical structure. For example, the medical imaging system 110 can receive user input to select a target anatomical structure. In this case, the medical imaging system 110 can generate the second volumetric rendering image by removing one or more anatomical structures from the first volumetric rendering image based on the user input.For example, the medical imaging system 110 may not remove the target anatomical structure, and may remove one or more anatomical structures that partially or completely obscure the target anatomical structure.

[0062] As further shown in Figure 5, process 500 may include simultaneously displaying a first volumetric rendered image and a second volumetric rendered image (operation 570). For example, medical imaging system 110 may simultaneously display the first volumetric rendered image and the second volumetric rendered image. According to an embodiment, medical imaging system 110 may display the first volumetric rendered image in a first area of ​​the display and the second volumetric rendered image in a second area of ​​the display. For example, the first area and the second area of ​​the display may be adjacent to each other. Medical imaging system 110 may simultaneously display the first volumetric rendered image and the second volumetric rendered image. In this way, the second volumetric rendered image looks similar to the first volumetric rendered image because both the first and second volumetric rendered images show one or more common anatomical structures, except that the second volumetric rendered image does not show one or more anatomical structures removed from the first volumetric rendered image.

[0063] Although Figure 5 depicts specific operations and a specific sequence of operations, it should be understood that in other embodiments, process 500 may include different operations, more operations, fewer operations, and / or different sequences of operations.

[0064] Figure 6 is a flowchart of an exemplary process 600 for selectively removing anatomical structures from a volumetric rendered image based on irradiation parameters of the anatomical structure. According to an embodiment, a medical imaging system 110 may perform one or more operations of the process 600 of Figure 6. Alternatively, one or more other devices may perform one or more operations of the process 600 of Figure 6.

[0065] As shown in Figure 6, process 600 may include determining the illumination parameters of the anatomical structures of the region of interest of the subject based on the position of the virtual light source relative to the anatomical structures of the region of interest (operation 610). For example, medical imaging system 110 may determine the illumination parameters of the anatomical structures of the region of interest of the subject based on the position of the virtual light source relative to the anatomical structures of the region of interest in a manner similar to that described above in conjunction with operation 550 of Figure 5.

[0066] As further shown in Figure 6, process 600 may include determining whether an irradiation parameter meets an irradiation parameter threshold (operation 620). For example, medical imaging system 110 may determine whether an irradiation parameter meets an irradiation parameter threshold. Medical imaging system 110 may compare the irradiation parameter with a corresponding irradiation parameter threshold. For example, if the irradiation parameter is irradiance, the irradiation parameter threshold may be an irradiance threshold. As another example, if the irradiation parameter is radiance, the irradiation parameter may be a radiance threshold. Medical imaging system 110 may determine whether an irradiation parameter meets a threshold based on whether the irradiation parameter is greater than, greater than or equal to, equal to, less than, or less than the irradiation parameter threshold.

[0067] As further shown in Figure 6, if the irradiation parameters meet an irradiation parameter threshold (operation 620 - Yes), then process 600 may include preserving the anatomical structure (operation 630). For example, medical imaging system 110 may preserve the anatomical structure in a second volumetric rendering image based on determining that the irradiation parameters meet the irradiation parameter threshold. In this case, medical imaging system 110 may simultaneously display a first volumetric rendering image and a second volumetric rendering image, and the anatomical structure may be visible in both the first and second volumetric rendering images.

[0068] As further shown in Figure 6, if the irradiation parameters do not meet the irradiation parameter threshold (operation 620 - No), process 600 may include removing the anatomical structure (operation 640). For example, medical imaging system 110 may remove the anatomical structure from the second volumetric rendering image based on determining that the irradiation parameters do not meet the irradiation parameter threshold. In this case, medical imaging system 110 may simultaneously display the first volumetric rendering image and the second volumetric rendering image, and the anatomical structure may be visible in the first volumetric rendering image and invisible in the second volumetric rendering image.

[0069] Although Figure 6 depicts specific operations and a specific sequence of operations, it should be understood that in other embodiments, process 600 may include different operations, more operations, fewer operations, and / or different sequences of operations.

[0070] Figure 7 is a flowchart of an exemplary process 700 for dynamically updating a second volumetric rendered image based on adjustments to the position of a virtual light source in a first volumetric rendered image. According to an embodiment, the medical imaging system 110 may perform one or more operations of the process 700 of Figure 7. Alternatively, one or more other devices may perform one or more operations of the process 700 of Figure 7.

[0071] As shown in Figure 7, process 700 may include simultaneously displaying a first volumetric rendered image and a second volumetric rendered image (operation 710). For example, medical imaging system 110 may simultaneously display the first volumetric rendered image and the second volumetric rendered image in a manner similar to that described above in conjunction with operation 570 of Figure 5.

[0072] As further shown in Figure 7, process 700 may include determining whether to adjust the position of a virtual light source in the first volumetric rendered image (operation 720). For example, medical imaging system 110 may determine whether to adjust the position of a virtual light source in the first volumetric rendered image. A user may interact with a user interface to adjust the position of one or more virtual light sources in the first volumetric rendered image. For example, a user may move a virtual light source relative to an anatomical structure displayed in the first volumetric rendered image. In this case, the corresponding illumination parameters of the anatomical structure may be changed based on the positioning of the virtual light source relative to the anatomical structure. Medical imaging system 110 may detect user input to adjust the position of the virtual light source.

[0073] As further shown in Figure 7, if the position of the virtual light source is adjusted in the first volumetric rendering image (operation 720 - Yes), process 700 may include updating the second volumetric rendering image (operation 730). For example, medical imaging system 110 updates the second volumetric rendering image based on determining that the position of the virtual light source has been adjusted in the first volumetric rendering image. Medical imaging system 110 may update the second volumetric rendering image by, for example, performing one or more of operations 550 to 570 of Figure 5. That is, medical imaging system 110 may determine the corresponding illumination parameters of the anatomical structure in the region of interest based on the adjusted position of the virtual light source relative to the anatomical structure in the first volumetric rendering image, and selectively retain or remove the anatomical structure based on the corresponding illumination parameters.

[0074] As further shown in Figure 7, if the position of the virtual light source has not been adjusted in the first volumetric rendering image (operation 720 - No), then process 700 may include holding the second volumetric rendering image (operation 740). For example, medical imaging system 110 holds the second volumetric rendering image based on the determination that the position of the virtual light source has not been adjusted in the first volumetric rendering image.

[0075] Although Figure 7 depicts specific operations and a specific sequence of operations, it should be understood that in other embodiments, process 700 may include different operations, more operations, fewer operations, and / or different sequences of operations.

[0076] Figures 8A to 8C illustrate an exemplary display 800 for dynamically removing anatomical structures from a volumetric rendered image based on the position of a virtual light source. As shown in Figure 8A, a first volumetric rendered image 802 may include a first anatomical structure 804, a second anatomical structure 806, and a third anatomical structure 808. As shown in Figure 8A, the third anatomical structure 808 may partially occlude the second anatomical structure 806. As shown in Figure 8B, the medical imaging system 110 may simultaneously display the first volumetric rendered image 802 and the second volumetric rendered image 812. As shown in Figure 8B, the medical imaging system 110 may display user interface elements 810 corresponding to the virtual light source in the first volumetric rendered image 802. The medical imaging system 110 may perform operations 550 to 570 of Figure 5, for example, to simultaneously display the first volumetric rendered image 802 and the second volumetric rendered image 812. In this case, it is assumed that the corresponding illumination parameters of the first anatomical structure 804 and the third anatomical structure 808 do not meet the corresponding illumination parameter thresholds. As shown in Figure 8B, the medical imaging system 110 can remove the first anatomical structure 804 and the third anatomical structure 808 from the first volumetric rendering image 802 to generate a second volumetric rendering image 812. In this way, the second volumetric rendering image 812 can display only the second anatomical structure 806, instead of displaying all of the first anatomical structures 804, 806, and 808 as shown in the first volumetric rendering image 802. Therefore, the user can more easily evaluate the second anatomical structure 806 because at least the third anatomical structure 808 has been removed from the first volumetric rendering image 802. As shown in Figure 8C, the user can interact with the user interface element 810 corresponding to the virtual light source in the first volumetric rendering image 802, such as moving the user interface element 810 to the left side of the first volumetric rendering image 802. In this case, the adjusted position of the virtual light source can affect the corresponding illumination parameters of the first anatomical structure 804, the second anatomical structure 806, and the third anatomical structure 808. Therefore, the medical imaging system 110 can perform at least the operations 550 to 570 of Figure 5 to update the second volumetric rendering image 812. In this case, as shown in FIG8C, the medical imaging system 110 can display a first anatomical structure 804 and a second anatomical structure 806, and can remove a third anatomical structure 808 from the first volumetric rendering image 802.

[0077] Figure 9 is an exemplary display 900 of dynamically removing anatomical structures from a volumetric rendered image based on the position of a virtual light source. As shown in Figure 9, the medical imaging system 110 can simultaneously display a first volumetric rendered image 910 of the subject's region of interest (e.g., left atrium) and a second volumetric rendered image 940 of the subject's region of interest. As shown, the first volumetric rendered image 910 may include a first anatomical structure 920 (e.g., tissue) and a second anatomical structure 930 (e.g., left atrial appendage). In this case, assume the user is interested in viewing the second anatomical structure 930 but not the first anatomical structure 920. The medical imaging system 110 can perform at least the operations 550 to 570 of Figure 5 to update the second volumetric rendered image 940. As shown, the medical imaging system 110 can remove the first anatomical structure 920 from the first volumetric rendered image 910 to generate the second volumetric rendered image 940. In this way, the second volumetric rendered image 940 may display only the second anatomical structure 930, instead of both the first and second anatomical structures 920.

[0078] Although the embodiments described herein utilize a single virtual light source, it should be understood that other embodiments may include multiple virtual light sources. In these cases, the medical imaging system 110 may determine the illumination parameters of the anatomical structure based on illumination from multiple virtual light sources.

[0079] While the embodiments described herein depict the simultaneous display of a first volumetric rendered image and a second volumetric rendered image, it should be understood that other embodiments may include displaying a single volumetric rendered image. For example, a user may manipulate user interface elements corresponding to virtual light sources in the volumetric rendered image, and the medical imaging system 110 may selectively remove various anatomical structures from the volumetric rendered image based on the position of the virtual light sources relative to the anatomical structures.

[0080] The embodiments shown in the accompanying drawings and described above are merely exemplary embodiments and are not intended to limit the scope of the appended claims, including any equivalents included within the scope of the claims. Various modifications are possible and will be apparent to those skilled in the art. Any combination of non-mutually exclusive features described herein is intended to be within the scope of the invention. That is, features of the described embodiments may be combined with any suitable aspect described above, and optional features of any aspect may be combined with any other suitable aspect. Similarly, features listed in dependent claims may be combined with non-mutually exclusive features of other dependent claims, particularly where the dependent claims are subordinate to the same independent claim. In some jurisdictions that claim single-claim dependents, such single-claim dependents may have been used in practice, but this should not be construed as meaning that features in dependent claims are mutually exclusive.

Claims

1. A system (100), the system comprising: A memory (230) configured to store instructions; and one or more processors (220), said one or more processors being configured to execute the instructions to: receive three-dimensional (3D) medical imaging data of a region of interest of a subject; Generate a first volumetric rendered image of the anatomical structure of the region of interest of the subject; display the first volumetric rendered image of the anatomical structure of the region of interest of the subject; receive user input, wherein the user input selects the position of a virtual light source in the first volumetric rendered image relative to the anatomical structure of the region of interest of the subject; Based on the position of the virtual light source relative to the anatomical structure of the region of interest, the corresponding illumination parameters of the anatomical structure of the region of interest of the subject are determined; a second volumetric rendering image is generated by removing one or more anatomical structures from the first volumetric rendering image based on the corresponding illumination parameters of the anatomical structure; And simultaneously display the first volumetric rendering image and the second volumetric rendering image.

2. The system (100) of claim 1, wherein the one or more processors (220) are further configured to: determine whether the corresponding illumination parameter satisfies a corresponding illumination parameter threshold; and selectively remove the anatomical structure in the second volumetric rendering image based on the determination that the corresponding illumination parameter satisfies the corresponding illumination parameter threshold.

3. The system (100) according to claim 1, wherein the corresponding irradiation parameter includes irradiance or radiant intensity.

4. The system (100) of claim 1, wherein the one or more processors (220) are further configured to: determine whether the position of the virtual light source in the first volumetric rendering image relative to the anatomical structure of the region of interest of the subject has been adjusted; and selectively update the second volumetric rendering image based on the determination that the position of the virtual light source in the first volumetric rendering image relative to the anatomical structure of the region of interest of the subject has been adjusted.

5. The system (100) of claim 1, wherein the one or more processors (220) are further configured to display user interface elements corresponding to the virtual light source in the first volumetric rendering image.

6. The system (100) of claim 1, wherein the one or more processors (220) are further configured to completely remove the one or more anatomical structures from the first volumetric rendered image.

7. The system (100) of claim 1, wherein the one or more processors (220) are further configured to partially remove the one or more anatomical structures from the first volumetric rendering image by adjusting the corresponding opacity values ​​of the one or more anatomical structures.

8. A method (500), the method comprising: Receive (510) three-dimensional (3D) medical imaging data of the subject's region of interest; Generate (520) a first volumetric rendering image of the anatomical structure of the region of interest of the subject; display (530) the first volumetric rendering image of the anatomical structure of the region of interest of the subject; receive (540) user input, the user input selecting the position of a virtual light source in the first volumetric rendering image relative to the anatomical structure of the region of interest of the subject; (550) The corresponding illumination parameters of the anatomical structure in the region of interest of the subject are determined based on the position of the virtual light source relative to the anatomical structure in the region of interest; (560) A second volumetric rendering image is generated by removing one or more anatomical structures from the first volumetric rendering image based on the corresponding illumination parameters of the anatomical structure. And simultaneously (570) display the first volume rendering image and the second volume rendering image.

9. The method (500) according to claim 8, further comprising: Determine whether the corresponding irradiation parameters meet the corresponding irradiation parameter thresholds; And selectively remove the anatomical structure in the second volumetric rendering image based on determining whether the corresponding illumination parameters meet the corresponding illumination parameter threshold.

10. The method (500) according to claim 8, wherein the corresponding irradiation parameter includes irradiance or radiance.

11. The method (500) according to claim 8, further comprising: Determine whether the position of the virtual light source in the first volumetric rendered image relative to the anatomical structure of the region of interest of the subject has been adjusted; And selectively update the second volumetric rendering image based on whether the position of the virtual light source in the first volumetric rendering image relative to the anatomical structure of the region of interest of the subject has been adjusted.

12. The method (500) according to claim 8, further comprising: Display user interface elements corresponding to the virtual light source in the first volumetric rendered image.

13. The method (500) according to claim 8, further comprising: Completely remove the one or more anatomical structures from the first volumetric rendered image.

14. The method (500) according to claim 8, further comprising: The one or more anatomical structures are partially removed from the first volumetric rendering image by adjusting the corresponding opacity values ​​of the anatomical structures.

15. A non-transitory computer-readable medium (230) storing instructions that, when executed by one or more processors (220), cause the one or more processors (220) to: receive three-dimensional (3D) medical imaging data of a region of interest of a subject; Generate a first volumetric rendered image of the anatomical structure of the region of interest of the subject; Displays a first volumetric rendered image of the anatomical structure of the region of interest of the subject; receives user input, wherein the user input selects the position of a virtual light source in the first volumetric rendered image relative to the anatomical structure of the region of interest of the subject; Based on the position of the virtual light source relative to the anatomical structure of the region of interest, the corresponding illumination parameters of the anatomical structure of the subject's region of interest are determined; a second volumetric rendering image is generated by removing one or more anatomical structures from the first volumetric rendering image based on the corresponding illumination parameters of the anatomical structure; and the first volumetric rendering image and the second volumetric rendering image are displayed simultaneously.

Images