Automated adjustment of undersampling factor

Abstract

Disclosed herein is a method of operating a medical system 100, 300. The method includes receiving 200 pulse sequence commands 124 configured to control a magnetic resonance imaging system 302 to acquire k-space data 330 according to a compressed sensing magnetic resonance imaging protocol. The method further includes receiving 202 magnetic resonance scan parameters describing the configuration of the pulse sequence commands and the configuration of the magnetic resonance imaging system. The method further includes receiving 204 predicted undersampling factors 128 in response to inputting the magnetic resonance scan parameters into a neural network, the neural network being configured to output the predicted undersampling factors in response to receiving the magnetic resonance scan parameters. The method further includes adjusting 206 pulse sequence commands 130 to select or modify sampling of the k-space data based on the predicted undersampling factors.

Description

[Technical Field]

[0001] The present invention relates to magnetic resonance imaging, and more particularly to compressed sensing magnetic resonance imaging. [Background technology]

[0002] A large static magnetic field is used by magnetic resonance imaging (MRI) scanners to align the nuclear spins of atoms as part of the procedure to generate images inside a patient's body. This large static magnetic field is called the B0 field or main magnetic field. Magnetic resonance imaging systems sample data in k-space and reconstruct magnetic resonance images from this k-space data.

[0003] Various quantities or properties of a subject can be measured spatially using MRI. A drawback of MRI is the time it takes to acquire k-space data. It would be difficult for a subject to remain still during the acquisition of k-space data. Compressed sensing magnetic resonance imaging reduces acquisition time by allowing magnetic resonance imaging images to be reconstructed using undersampled k-space data. Currently, an operator selects an undersampling factor (also known as an acceleration factor) that affects how the k-space data is sampled. If too little k-space data is acquired, the acquisition must be repeated with less undersampling.

[0004] U.S. Patent Application Publication No. 2018 / 0203081 discloses a system and method for estimating quantitative parameters of a subject using a magnetic resonance ("MR") system that uses a dictionary. The dictionary may include a plurality of signal templates that sparsely sample acquisition parameters used in acquiring data. The acquired data is compared to the dictionary using a neural network. Thus, a system and method are provided that are computationally more efficient and have reduced data storage requirements than conventional MRF reconstruction systems and methods. U.S. Patent Application Publication No. 2015 / 108978 relates to a strategy for sparse sampling for magnetic resonance imaging. More specifically, this known strategy involves selecting a basic variable-density sampling pattern. The basic variable-density sampling pattern is selected based on user-supplied criteria. The scan time for the basic variable-density sampling pattern is then determined by simulation analysis or from a lookup table. To combat unacceptable scan times, the variable-density sampling pattern is modified to maximize the sampled k-space region without increasing the scan time. Summary of the Invention

[0005] The present invention provides a medical system, a computer program and a method as set forth in the independent claims. Embodiments are set forth in the dependent claims.

[0006] Embodiments may provide an improved means for selecting a predicted undersampling factor. A neural network is configured or trained to output a predicted undersampling factor in response to receiving magnetic resonance scan parameters. The magnetic resonance scan parameters describe the configuration of a magnetic resonance imaging system, including the configuration of pulse sequence commands used to control the magnetic resonance imaging system. The predicted undersampling factor represents a prediction of an appropriate value for undersampling prior to acquisition of magnetic resonance signals. That is, undersampling is predicted or estimated prior to scanning k-space. In this manner, the predicted undersampling factor is already available at the start of sampling magnetic resonance signals by scanning k-space according to a sampling pattern and sampling density function that match the previously predicted undersampling factor. The predicted undersampling factor is available by a neural network trained according to input scan parameters prior to the start of acquisition of MR data by sampling k-space. The neural network can be trained from historical data regarding successful image acquisitions associated with a combination of an appropriate undersampling factor and a set of scan parameters.

[0007] In one aspect, the present invention provides a medical system comprising a memory storing machine-executable instructions, the memory further storing a neural network configured to output a predicted undersampling factor in response to receiving magnetic resonance scan parameters. As used herein, magnetic resonance scan parameters encompass configurations of a magnetic resonance imaging system and / or pulse sequence commands used to control the magnetic resonance imaging system.

[0008] Individual settings or adjustments possible in both the pulse sequence commands and the configuration of the magnetic resonance imaging system can have an effect on the expected undersampling factor, which is the undersampling factor for when a compressed sensing magnetic resonance imaging protocol is performed. The magnetic resonance scan parameters describe the configuration of the magnetic resonance imaging system, which also encompasses the configuration of the pulse sequence commands.

[0009] The medical system further includes a computing system configured to control a magnetic resonance imaging system. Execution of the machine-executable instructions causes the computing system to receive pulse sequence commands configured to control the magnetic resonance imaging system to acquire k-space data according to a compressed sensing magnetic resonance imaging protocol. Execution of the machine-executable instructions further causes the computing system to receive magnetic resonance scan parameters. The pulse sequence commands and magnetic resonance scan parameters can be received in a variety of different ways. In some cases, the pulse sequence commands having specific configurations for the magnetic resonance scan parameters and pulse sequence commands can be received from a user interface. In other cases, the pulse sequence commands and magnetic resonance scan parameters can be received by retrieving them from the memory.

[0010] Execution of the machine-executable instructions further causes the computing system to receive a predicted undersampling factor in response to inputting magnetic resonance scan parameters into the neural network. Execution of the machine-executable instructions further causes the computing system to adjust pulse sequence commands to modify sampling of k-space data based on the undersampling factor. For example, when a magnetic resonance imaging system acquires k-space data, the data is acquired in groups of k-space data as single lines, or what may sometimes be referred to as shots. Adjusting the pulse sequence commands modifies how the k-space data is sampled to match the predicted undersampling factor.

[0011] The undersampling factor is a factor that measures pre-undersampling against the Nyquist theorem. This embodiment may be beneficial because it may provide an improved means of setting the undersampling factor. If the undersampling factor is not reduced sufficiently, there is no adverse effect on the magnetic resonance image. However, it may take longer to acquire k-space data than if the undersampling factor were set optimally. If the undersampling factor is too low, the resulting magnetic resonance image may be deteriorated. The use of a neural network may enable the setting of the undersampling factor using a wider variety of factors, including factors that a human operator may not be able to consider. Typically, a human operator manually adjusts the undersampling factor. A human may examine various factors and then adjust the undersampling factor. This is typically built up based on the operator's experience and is generally a hit-or-miss process.

[0012] In another embodiment, the magnetic resonance scan parameters include radio frequency coil configuration, which may include the number and placement of radio frequency coils.

[0013] In another embodiment, the magnetic resonance scan parameters include a scan mode that specifies a two-dimensional or three-dimensional scan, which essentially identifies how the k-space data is acquired three-dimensionally or for a two-dimensional slice.

[0014] In another embodiment, the magnetic resonance scan parameters include a sequence type that specifies the contrast of the pulse sequence command.Various parameters within the pulse sequence command can be used to modify the contrast of the image.

[0015] In another embodiment, the magnetic resonance scan parameters include the echo time, which is a fundamental value that can be set in the pulse sequence command.

[0016] In another embodiment, the magnetic resonance scan parameters include a pulse repetition time.

[0017] In other embodiments, the magnetic resonance scan parameters include voxel size or three-dimensional spatial resolution.

[0018] In another embodiment, the magnetic resonance scan parameters include a three-dimensional field of view.

[0019] The voxel size or 3D spatial resolution and 3D field of view are somewhat redundant as field of view and voxel size, which together provide information about field of view and matrix size, or voxel size and matrix size, and many of these parameters have some overlapping redundancy when configuring a magnetic resonance imaging system.

[0020] In another embodiment, the magnetic resonance scan parameters include radio frequency bandwidth during k-space sampling.

[0021] The magnetic resonance scan parameters described above may comprise a core of scan parameters that, when used to train a neural network, result in the generation of accurate undersampling factors.

[0022] In another embodiment, the magnetic resonance scan parameters include the number of signal averages to be performed.

[0023] The magnetic resonance scan parameters listed below are magnetic resonance scan parameters that may have the effect of further improving the estimate of the undersampling factor.

[0024] In another embodiment, the magnetic resonance scan parameters further include the type of fat suppression protocol being used.

[0025] In another embodiment, the magnetic resonance scan parameters further include a flip angle specified in the pulse sequence command.

[0026] In another embodiment, the magnetic resonance scan parameters further include scan time.

[0027] In another embodiment, the magnetic resonance scan parameters further include field of view orientation.

[0028] In another embodiment, the magnetic resonance scan parameters further include a folding direction.

[0029] In another embodiment, the magnetic resonance scan parameters further include the number of dynamic scans.

[0030] In other embodiments, the magnetic resonance scan parameters further include the type of contrast agent used. If a contrast agent is used in a particular magnetic resonance imaging protocol, the type of contrast agent used can of course be an important scan parameter. However, not all magnetic resonance imaging protocols use contrast agents.

[0031] In other embodiments, the magnetic resonance scan parameters further include a reconstruction voxel size or a reconstruction matrix size.

[0032] In another embodiment, the magnetic resonance scan parameters further include the type or selection of prepulses used in the pulse sequence command.

[0033] In other embodiments, the magnetic resonance scan parameters further include implementation of a partial Fourier half-scan protocol or selection of implementation of a partial Fourier half-scan protocol.

[0034] In other embodiments, the magnetic resonance scan parameters further include the anatomical part being examined, which may be, for example, a particular view and / or region of the body being examined.

[0035] In another embodiment, the magnetic resonance scan parameters further include the shot type used. A shot is a group of k-space data points acquired as a single acquisition.

[0036] In another embodiment, the magnetic resonance scan parameters further include a k-space profile sequence.

[0037] In another embodiment, the magnetic resonance scan parameters further include a k-space trajectory.

[0038] In another embodiment, the magnetic resonance scan parameters further include a type of physiological synchronization, which may be, for example, synchronization with a cardiac phase or a respiratory phase.

[0039] In another embodiment, the magnetic resonance scan parameters further include a type of diffusion encoding technique.

[0040] In another embodiment, the magnetic resonance scan parameters further include a k-space partitioning factor.

[0041] In another embodiment, the magnetic resonance scan parameters further include the number of echoes used to acquire the same k-space line.

[0042] In another embodiment, execution of the machine-executable instructions further causes the computing system to retrieve archived scan parameter data from a magnetic resonance scan parameter database. This data may include, for example, various parameters used in pulse sequences for various types of scans, which may also include undersampling factors. The method further includes constructing archived training data from the archived scan parameter data. This may be, for example, extracting the values ​​of the undersampling factors and the magnetic resonance scan parameters used. In this case, the training data may include the magnetic resonance scan parameters as input to a neural network, and the sampling factor actually used may be compared to the output of the neural network. Execution of the machine-executable instructions further causes the computing system to train the neural network using the archived training data. This may be performed, for example, using a backpropagation algorithm.

[0043] In another embodiment, the archived training data is received remotely.

[0044] In other embodiments, the archived training data is received remotely via a network connection, allowing, for example, training of neural networks using data from various locations and sites.

[0045] In another embodiment, the medical system further comprises the magnetic resonance imaging system. Execution of the machine-executable instructions further causes the computing system to control the magnetic resonance imaging system with pulse sequence commands to acquire k-space data. Execution of the machine-executable instructions further causes the computing system to reconstruct magnetic resonance image data from the k-space data. The magnetic resonance image data is data that can be rendered two-dimensionally or three-dimensionally to form a magnetic resonance image.

[0046] In another embodiment, the medical system further comprises a user interface. Execution of the machine-executable instructions further causes the computing system to display an undersampling factor and at least a portion of the magnetic resonance scan parameters on the user interface before adjusting the pulse sequence command. Execution of the machine-executable instructions further causes the computing system to receive a predicted undersampling factor from the user interface in response to displaying the undersampling factor. The pulse sequence command is adjusted using the predicted undersampling factor. In this embodiment, the neural network still provides the undersampling factor, but the operator has the opportunity to modify or change the factor using the user interface.

[0047] In another embodiment, execution of the machine-executable instructions further causes the computing system to construct user-specific training data from the magnetic resonance scan parameters and predicted undersampling factors. Execution of the machine-executable instructions further causes the computing system to train a neural network using the user-specific training data. The user-specific training data may include, for example, extracting the magnetic resonance scan parameters and predicted undersampling factors to create data that can then be used for backpropagation to train a neural network. This may be beneficial, for example, because it can be used to train a neural network with respect to local preferences and / or with respect to local pulse sequence commands or protocols being used.

[0048] In another embodiment, the neural network is a multi-layer neural network. Experiments have shown that, when trained, multi-layer neural networks do an excellent job of predicting the undersampling factor.

[0049] In another embodiment, the multilayer neural network includes at least six layers. Each of the at least six layers is fully connected to adjacent layers. In the example described below, the performance of the undersampling factor prediction was achieved with a multilayer neural network using seven layers. A multilayer neural network with six layers would also work well. A multilayer neural network with seven layers performs even better.

[0050] In another aspect, the present invention provides a method for training a neural network, the method including the step of retrieving archived scan parameter data from a magnetic resonance scan parameter database. The method further includes the steps of constructing archived training data from the archived scan parameter data and then training the neural network using the archived training data. This training step can be performed using a backpropagation (error backpropagation) algorithm. The neural network of the medical system described above can be pre-trained using this method.

[0051] In another aspect, the present invention provides a method of operating a medical system, the method including receiving pulse sequence commands configured to control a magnetic resonance imaging system to acquire k-space data according to a compressed sensing magnetic resonance imaging protocol, the method further including receiving magnetic resonance scan parameters describing the configuration of the pulse sequence commands and the configuration of the magnetic resonance imaging system.

[0052] The method further includes receiving a predicted undersampling factor in response to inputting the magnetic resonance scan parameters into a neural network, the neural network being configured to output the predicted undersampling factor in response to receiving the magnetic resonance scan parameters, and adjusting a pulse sequence command to modify a sampling pattern of the k-space data based on the predicted undersampling factor.

[0053] In another aspect, the present invention provides a computer program comprising machine-executable instructions for execution by a computing system configured to control a medical system, the computer program may also include the neural network. Execution of the machine-executable instructions causes the computing system to receive pulse sequence commands configured to control a magnetic resonance imaging system to acquire k-space data according to a compressed sensing magnetic resonance imaging protocol. Execution of the machine-executable instructions further causes the computing system to receive magnetic resonance scan parameters describing the configuration of the pulse sequence commands and the configuration of the magnetic resonance imaging system.

[0054] Execution of the machine-executable instructions further causes the computing system to receive a predicted undersampling factor in response to inputting the magnetic resonance scan parameters into a neural network, the neural network being configured to output the predicted undersampling factor in response to receiving the magnetic resonance scan parameters, and to adjust pulse sequence commands to modify the sampling or sampling pattern of the k-space data based on the predicted undersampling factor.

[0055] It is understood that one or more of the above-described embodiments of the present invention may be combined, provided that the combined embodiments are not mutually exclusive.

[0056] As will be appreciated by one of ordinary skill in the art, aspects of the present invention may be embodied as an apparatus, a method, or a computer program product. Accordingly, aspects of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, microcode, etc.), or an embodiment combining software and hardware aspects, all of which may be generally referred to herein as a "circuit," "module," or "system." Furthermore, aspects of the present invention may take the form of a computer program product embodied in one or more computer-readable medium(s) having computer-executable code embodied thereon.

[0057] Any combination of one or more computer-readable media may be utilized. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. As used herein, "computer-readable storage medium" encompasses any tangible storage medium capable of storing instructions executable by a processor or computing system of a computing device. The computer-readable storage medium may also be referred to as a computer-readable non-transitory storage medium. The computer-readable storage medium may also be referred to as a tangible computer-readable medium. In some embodiments, the computer-readable storage medium may also store data accessible by the computing system of a computing device. Examples of computer-readable storage media include, but are not limited to, floppy disks, magnetic hard disk drives, solid-state hard disks, flash memory, USB thumb drives, random access memory (RAM), read-only memory (ROM), optical disks, magneto-optical disks, and computing system register files. Examples of optical disks include compact discs (CDs), such as CD-ROM, CD-RW, CD-R, DVD-ROM, DVD-RW, or DVD-R discs, and digital versatile discs (DVDs). The term computer-readable storage medium also refers to various types of storage media that can be accessed by a computer device over a network or communications link. For example, data can be obtained via a modem, over the Internet, or over a local area network. Computer-executable code embodied on a computer-readable medium can be transmitted using any suitable medium, including but not limited to wireless, wired, fiber optic cable, RF, etc., or any suitable combination of the above.

[0058] A computer-readable signal medium may include a propagated data signal with computer-executable code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including but not limited to, electromagnetic, optical, or any suitable combination thereof. A computer-readable signal medium is not a computer-readable storage medium but may be any computer-readable medium that can communicate, convey, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

[0059] "Computer memory" or "memory" is one example of a computer-readable storage medium. Computer memory is any memory directly accessible to a computing system. "Computer storage" or "storage" is another example of a computer-readable storage medium. Computer storage is any non-volatile computer-readable storage medium. In some embodiments, computer storage can also be computer memory, and vice versa.

[0060] As used herein, a "computing system" encompasses an electronic component capable of executing a program, machine-executable instructions, or computer-executable code. References to a computing system, including the examples of "computing system" above, should be interpreted as potentially including one or more computing systems or processing cores. The computing system may be, for example, a multi-core processor. A computing system may also refer to a collection of computing systems within a single computer system or distributed across multiple computer systems. The term computing system should also be interpreted as potentially referring to a collection or network of computing devices, each having a processor or computing system. Machine-executable code or instructions may be executed by multiple computing systems or processors, which may be within the same computing device or distributed across multiple computing devices.

[0061] Machine-executable instructions or computer-executable code may include instructions or programs that cause a processor or other computing system to perform aspects of the present invention. Computer-executable code for carrying out processes related to aspects of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, Smalltalk®, C++, and conventional procedural programming languages ​​such as the "C" programming language or similar programming languages, that are compiled into machine-executable instructions. In some cases, the computer-executable code may be in the form of a high-level language or in a pre-compiled form, and may be used in combination with an interpreter that generates machine-executable instructions on the fly. In other cases, the machine-executable instructions or computer-executable code may be in the form of programming a programmable logic gate array.

[0062] The computer executable code may run entirely on the user's computer, partially on the user's computer as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be to an external computer (e.g., via the Internet using an Internet Service Provider).

[0063] Aspects of the present invention will be described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block or portion of the blocks of the flowchart illustrations and / or block diagrams, where applicable, can be embodied by computer program instructions in the form of computer-executable code. It will also be understood that combinations of blocks in different flowchart illustrations and / or block diagrams can be combined, if not mutually exclusive. These computer program instructions can be supplied to a general-purpose computer, special-purpose computer, or other programmable data processing device computing system to form a machine such that the instructions, executing via the computer or other programmable data processing device computing system, generate means for performing the function / acts specified in the block or blocks of the flowchart illustrations and / or block diagrams.

[0064] These machine-executable instructions or computer program instructions may also be stored on a computer-readable medium and may direct a computer, other programmable data processing apparatus, or other device to function in a particular manner, such that the instructions stored on the computer-readable medium produce an article of manufacture including instructions that implement the function / acts specified in the flowchart and / or block diagram block or blocks.

[0065] The machine-executable instructions or computer program instructions may be loaded into a computer, other programmable data processing apparatus or other device to cause a series of process steps to be executed on the computer, other programmable apparatus or other device, thereby generating a computer-implemented process such that the instructions executing on the computer or other programmable apparatus provide a process for performing the function / acts specified in the flowchart and / or block diagram block or blocks.

[0066] As used herein, a "user interface" is an interface that allows a user or operator to interact with a computer or computer system. A "user interface" may also be referred to as a "human interface device." A user interface can provide information or data to an operator and / or receive information or data from an operator. A user interface can allow input from an operator to be received by a computer and can provide output from the computer to a user. In other words, a user interface allows an operator to control or manipulate a computer, while the interface allows the computer to show the effects of the operator's control or manipulation. Displaying data or information on a display or graphic user interface is an example of providing information to an operator. Receiving data via a keyboard, mouse, trackball, touchpad, pointing stick, graphic tablet, joystick, gamepad, webcam, headset, pedals, wired gloves, remote control, and accelerometer are all examples of receiving information or data from an operator.

[0067] As used herein, a "hardware interface" encompasses an interface that allows a computer system's computing system to interact with and / or control external computing devices and / or devices. A hardware interface can allow a computing system to send control signals or commands to external computing devices and / or devices. A hardware interface can also allow a computing system to exchange data with external computing devices and / or devices. Examples of hardware interfaces include, but are not limited to, a universal serial bus, an IEEE 1394 port, a parallel port, an IEEE 1284 port, a serial port, an RS-232 port, an IEEE-488 port, a Bluetooth® connection, a wireless local area network connection, a TCP / IP connection, an Ethernet® connection, a control voltage interface, a MIDI interface, an analog input interface, and a digital input interface.

[0068] As used herein, "display" or "display device" encompasses an output device or user interface adapted to display images or data. A display can output visual, auditory, or tactile data. Examples of displays include, but are not limited to, computer monitors, television screens, touch screens, tactile electronic displays, Braille screens, cathode ray tubes (CRTs), storage tubes, bi-stable displays, electronic paper, vector displays, flat panel displays, vacuum fluorescent displays (VFs), light-emitting diode (LED) displays, electroluminescent displays (ELDs), plasma display panels (PDPs), liquid crystal displays (LCDs), organic light-emitting diode displays (OLEDs), projectors, and head-mounted displays.

[0069] K-space data is defined herein as the recorded measurements of radio frequency signals emitted by atomic spins using the antenna of a magnetic resonance machine during a magnetic resonance imaging scan. Magnetic resonance data is an example of tomographic medical image data.

[0070] A magnetic resonance imaging (MRI) image, MR image, or magnetic resonance imaging data is defined herein as a reconstructed two-dimensional or three-dimensional visualization of anatomical data contained within magnetic resonance imaging data, which visualization can be performed using a computer.

[0071] In the following description, preferred embodiments of the invention are described, by way of example only, with reference to the drawings in which: [Brief explanation of the drawings]

[0072] [Figure 1] Figure 1 shows an example of a medical system. [Figure 2] FIG. 2 is a flow chart illustrating an example method of operating the medical system of FIG. [Figure 3] FIG. 3 shows another example of a medical system. [Figure 4] FIG. 4 is a flow chart illustrating an example method of operating the medical system of FIG. [Figure 5] Figure 5 shows the training of the neural network. [Figure 6] FIG. 6 illustrates the use of the neural network of FIG. [Figure 7] Figure 7 shows the integration of a neural network into a magnetic resonance imaging system. [Figure 8] Figure 8 is a plot showing the neural network test results. [Figure 9] FIG. 9 is a pie chart showing the results of other tests of neural networks. [Figure 10] FIG. 10 is a pie chart showing the results of other tests of neural networks. DETAILED DESCRIPTION OF THE INVENTION

[0073] Like numbered elements in the figures are equivalent elements or perform the same function. An element described earlier is not necessarily described in a later figure if the function is equivalent.

[0074] 1 illustrates an example of a medical system 100. In this example, the medical system 100 includes a computer 102. The medical system 100 further includes a hardware interface 104 connected to a computing system 106. The computing system 106 is intended to represent one or more processors or other computing systems located in one or more locations. The hardware interface 104, if present, may be used to control other components of the medical system 100. For example, the medical system 100 includes a magnetic resonance imaging system. The computing system 106 is further shown connected to a user interface 108 and a memory 110. The memory 110 is intended to represent any type of memory connected to or accessible by the computing system 106.

[0075] The memory 110 is shown as including machine-executable instructions 120. The machine-executable instructions 120 enable the computing system 106 to control other components of the medical system 100 via the hardware interface 104. The machine-executable instructions 120 also enable the computing system 106 to perform various data processing and image processing tasks. The memory 110 is further shown as including a neural network 122. The neural network is trained to output predicted undersampling factors for a compressed sensing magnetic resonance imaging protocol in response to receiving magnetic resonance scan parameters that describe both the configuration of the magnetic resonance imaging system and the configuration of the pulse sequence commands.

[0076] Memory 110 is further shown as including pulse sequence commands 124. Memory 110 is further shown as including magnetic resonance scan parameters 126. Memory 110 is further shown as including predicted undersampling factors 128 received by neural network 122 in response to inputting magnetic resonance scan parameters 126. Undersampling factors 128 may be used, for example, to adjust the k-space pattern or sampling pattern. Memory 110 is further shown as including adjusted pulse sequence commands 130. These are pulse sequence commands 124 after being adjusted to match the predicted undersampling factors 128.

[0077] 2 shows a flowchart illustrating a method of operating the medical system 100 of FIG. 1. First, in step 200, a pulse sequence command 124 is received. The pulse sequence command 124 is configured to control a magnetic resonance imaging system to acquire k-space data according to a compressed sensing magnetic resonance imaging protocol. Next, in step 202, magnetic resonance scan parameters are received. Then, in step 204, a predicted undersampling factor 128 is received by inputting the magnetic resonance scan parameters 126 into the neural network 122. Finally, in step 206, the pulse sequence command is adjusted using the predicted undersampling factor 128. This may include adjusting a sampling pattern in k-space.

[0078] 3 shows another example of a medical system 300. The medical system 300 is similar to the medical system 100 of FIG.

[0079] The magnetic resonance imaging system 302 includes a magnet 304. The magnet 304 is a superconducting cylindrical magnet with a bore 306 extending therethrough. Different types of magnets can be used, including both split cylindrical magnets and so-called open magnets. Split cylindrical magnets are similar to standard cylindrical magnets except that they are divided into two sections to allow a cryostat to access the magnet's equal surface. Such magnets can be used, for example, in conjunction with charged particle beam therapy. Open magnets have two magnet sections, one positioned above the other with a space large enough to accommodate a subject between them, in an arrangement similar to that of a Helmholtz coil. Open magnets are popular because they provide less subject restraint. Inside the cryostat of the cylindrical magnet is a group of superconducting coils.

[0080] Within the bore 306 of the cylindrical magnet 304 is an imaging zone 308, where the magnetic field is strong and uniform enough to perform magnetic resonance imaging. A region of interest 309 is shown within the imaging zone 308. Magnetic resonance data is typically acquired about the region of interest. A subject 318 is shown supported by a subject support 320 such that at least a portion of the subject 318 is within the imaging zone 308 and the region of interest 309.

[0081] Also present within the magnet bore 306 is a set of gradient field coils 310, which are used for preliminary magnetic resonance data acquisition to spatially encode magnetic spins within the imaging zone 308 of the magnet 304. The gradient coils 310 are connected to a gradient coil power supply 312. The gradient coils 310 are intended to be representative. Typically, the gradient coils 310 include three separate sets of coils for spatial encoding in three orthogonal spatial directions. The gradient coil power supply supplies current to the gradient coils. The current supplied to the gradient coils 310 is controlled as a function of time and can be ramped or pulsed.

[0082] Adjacent to the imaging zone 308 is a radio frequency coil 314 for manipulating the orientation of magnetic spins within the imaging zone 308 and for receiving radio frequency transmissions from the spins within the imaging zone 308. A radio frequency antenna (coil) may include multiple coil elements. The radio frequency antenna is also referred to as a channel or antenna. The radio frequency coil 314 is connected to a radio frequency transceiver 316. The radio frequency coil 314 and the radio frequency transceiver 316 may be replaced by separate transmit and receive coils and separate transmitters and receivers. It is understood that the radio frequency coil 314 and the radio frequency transceiver 316 are representative. The radio frequency coil 314 is also intended to represent a dedicated transmit antenna and a dedicated receive antenna. Similarly, the transceiver 316 may represent separate transmitters and receivers. The radio frequency coil 314 may have multiple receive / transmit elements, and the radio frequency transceiver 316 may have multiple receive / transmit channels. For example, if a parallel imaging technique such as SENSE or an acceleration technique such as compressed sensing is implemented, the radio frequency coil 314 will have multiple coil elements.

[0083] The transceiver 316 and gradient controller 312 are shown connected to the hardware interface 104 of the computer system 102 .

[0084] The memory 110 is further shown as containing k-space data 330 acquired by controlling the magnetic resonance imaging system 302 with the coordinated pulse sequence commands 130. The memory 110 is further shown as containing magnetic resonance imaging data 332 reconstructed from the k-space data 330.

[0085] Figure 4 shows a flowchart illustrating a method of operating the medical system 300 of Figure 3. The method of Figure 4 is similar to the method shown in Figure 2. The method of Figure 4 begins with steps 200, 202, 204, and 206 as shown in Figure 2. After step 206 is performed, the method proceeds to step 400. In step 400, the magnetic resonance imaging system 302 is controlled to acquire k-space data 330 with the adjusted pulse sequence commands 130. Finally, in step 402, magnetic resonance image data 332 is reconstructed from the k-space data 330.

[0086] MRI is a highly versatile diagnostic modality with numerous imaging contrasts and capabilities. MR image acquisition is controlled by numerous parameters accessible in clinical routines. Optimization of imaging parameters is performed at each individual site. So far, protocol optimization has not been standardized, and results and image quality depend on the operator's experience.

[0087] The application can use artificial intelligence (AI)-based methods to automatically predict the optimal compressed sensing acceleration factor (128) as the predicted undersampling factor for each protocol, reducing the variability of protocol variations from customer to customer and reducing the dependency of results on the experience of application experts.

[0088] Each example provides a highly efficient way to exploit the correlation of multiple parameters, and the use of training data can allow parameters to be directly related to results (such as image quality).

[0089] For well-defined applications, such as using compressed sensing to speed up image acquisition, neural network techniques such as deep learning can be used to predict optimal compressed sensing coefficients for any given parameter settings by using successful implementations of compressed sensing performed by experienced application experts as training data. The results of these predictions can then be used as a starting point (educated guess) for each application expert, or can directly provide guidance for optimizing their own parameters during or after application training.

[0090] For example, one or more of the following problems and shortcomings may be addressed: 1. Dependence of sequence parameter optimization results on the experience of the application specialist: a. Better intercomparability between protocols in different sites; 2. Increased workload for application experts, especially during the introduction of new products and sequences, leading to a shortage of application experts: a. Reducing the workload for application experts through automated guidance; 3. Personal and ongoing overburden on customers due to protocol optimization: a. Providing automated guidance to customers.

[0091] By way of example, one can use a neural network, such as a deep learning-based computer algorithm trained with appropriately controlled MRI protocol parameters from protocol optimization using compressed sensing, which is then used to predict optimal compressed sensing coefficients depending on other parameter settings for the scan.

[0092] By way of example, an algorithm based on a multi-layer artificial neural network (neural network 122) can be provided.

[0093] Training: In an initial training phase, a set of sequence parameter settings that have been thoroughly evaluated for image quality and maximum compressed sensing acceleration can be collected. These sequence parameter settings (magnetic resonance scan parameters 126) can come from well-trained application experts or from currently used sequence parameter settings. These collected sequence parameter settings are hereinafter referred to as initial training data. A schematic diagram of this training phase of an artificial neural network is shown in FIG. 5.

[0094] In the initial training stage, a subset of sequence parameters from the initial training data are defined as input parameters, and compressed sensing acceleration factors are defined as output parameters for the artificial neural network and used to train the network.

[0095] 5 shows a schematic diagram of an artificial neural network (neural network 122) in an initial training stage. In this stage, selected sequence parameters or magnetic resonance scan parameters 126 and corresponding compressed sensing acceleration factors of estimated or predicted undersampling factors 128 from a previous data set are input to the neural network 122 to train the neural network. Arrows 126 represent the known magnetic resonance scan parameters 126. These are input to an input layer 500, which is connected to a fully connected layer 502. The final fully connected layer 502 is connected to an output 504, which provides the values ​​of the predicted undersampling factors 128 or compressed sensing acceleration factors.

[0096] During the evaluation phase, the sequence parameters are provided as input parameters to the trained artificial neural network, which calculates compressed sensing coefficients as output parameters, as shown in Figure 6. Figure 6 shows the neural network 122 during the evaluation or use phase. At this stage, the neural network 122 has already been trained. During use, the magnetic resonance scan parameters 126 are input to the input layer 500. The fully connected layer 502 then takes the output and, in response, provides a predicted undersampling coefficient 128 at output 504. During this phase, the trained artificial neural network is used to calculate optimal compressed sensing acceleration coefficients from multiple input parameters.

[0097] As an example, a neural network can be integrated directly into the scanning software to enable an "automatic" setting for the selection of the compressive sensing acceleration factor (or "CS-SENSE"). This is shown diagrammatically in FIG. 7. When "automatic" is selected for "CS-SENSE," the parameters of the scan are fed directly to the trained neural network, and the calculated compressive sensing acceleration factor is displayed in the software and used for measurement. If further optimizations are made to the compressive sensing acceleration factor beyond those calculated by the algorithm, these optimizations can be used as additional training data through feedback or reinforcement learning.

[0098] 7 illustrates how a neural network 122 can be integrated into a medical system 300. The user interface 108 of the magnetic resonance imaging system 302 includes a page where scan parameters can be entered. The user interface can provide scan parameters 126, which are then input to the artificial neural network 122. In response, a predicted undersampling factor 128 can be provided. Note in the figure that the magnetic resonance scan parameters 126 in this example are not necessarily the parameters that are actually input to the neural network.

[0099] In Figure 7, when CS-SENSE reduction is set to "Auto," the optimal compressive sensing acceleration factor (CS-SENSE factor) is predicted by a pre-trained artificial neural network. The predicted CS-SENSE factor is displayed and used for testing.

[0100] Proof of Principle: Proof of principle implementation was tested on approximately 3000 datasets. Each of these datasets was an MR sequence parameter setting using compressed sensing optimized by an application expert. For initial training of the artificial neural network, the data was divided into 2934 training datasets (training data) and 227 test datasets (test data). The training data was used to train the artificial neural network. The test data was used to predict optimal compressed sensing acceleration factors based on a set of input parameters. The predicted optimal compressed sensing acceleration factors were then compared with the compressed sensing acceleration factors optimized by the application expert (see Figure 8).

[0101] FIG. 8 illustrates testing of the neural network 122. The plot in FIG. 8 shows predicted coefficients 802 versus true coefficients 800. Approximately 3,000 datasets of optimized MRI sequences (by application experts) were divided into 2,934 training datasets for initial training of the artificial neural network. 227 datasets were used to test the trained artificial neural network by predicting optimal compressed sensing acceleration coefficients based on 17 predefined sequence parameters. The plot shows close agreement between the compressed sensing acceleration coefficients optimized by the application experts and those predicted by the artificial neural network.

[0102] Field Testing: A field test was conducted with application experts. A database of archived scan parameter data was used before performing compressed sensing for this field test. A predicted set of compressive sensing acceleration factors was calculated using a trained artificial neural network. Figure 9 shows the difference between the compressed sensing factors predicted by the artificial neural network and those estimated by the application experts. In approximately 72% of the scans, the difference between the predicted and actually used compressed sensing factors was less than 1, and for 98% of the scans, the difference was less than 1.5, indicating very promising performance of the solution proposed here.

[0103] 9 and 10 were constructed by comparing the output of the neural network with the predicted undersampling factor 128 actually used from clinical data, shown here as "Delta." This is an accurate way to compare the output of the neural network with the predicted undersampling factor 128 used in a clinical setting. The lower the Delta value, the more accurately the neural network corresponds to the predicted undersampling factor 128 actually used clinically.

[0104] Figure 9 shows the delta values ​​in the form of a pie chart for the comparison of 194. The pie chart is divided into various delta levels.

[0105] Figure 10 shows the same data in a format where 72% of the values ​​have a delta less than 1. Together, Figures 9 and 10 show that the neural network provides a predicted undersampling factor 128 that is very comparable to the predicted undersampling factor 128 used clinically. Figures 9 and 10: Field test performance. In 98% of the scans, the difference between the predicted and actually used compressed sensing factor was less than 1.5, and in 72% of the scans, the difference was less than 1.

[0106] MRI parameters that affect image acceleration The magnetic resonance scan parameters listed below may have an impact on the optimal image acceleration (undersampling factor 128). However, in many cases, there may be strong correlations between different parameters. This means that it is not possible to determine which acceleration factor is optimal from a single parameter or even a very limited set of parameters. This makes selecting the optimal acceleration factor a complex multidimensional optimization problem. The parameters listed below are generally generic and independent of the MRI system manufacturer, although naming conventions vary widely between manufacturers. Furthermore, parameter implementations may vary significantly between manufacturers, and not all parameters are accessible to MRI users.

[0107] Some of the magnetic resonance scan parameters are described in more detail below. The magnetic resonance parameters may include one or more of the following parameters: 1. Coil (radio frequency coil configuration) The connected coils provide various information: a. The number of coil elements has an impact on the performance of image acceleration; b. Coil geometry has an impact on image acceleration performance; c. The body part being examined can be partially assumed: knee coil - very likely the knee; head coil - very likely a head / brain examination. 2. Scan Mode (3D vs. 2D) a.3D allows for higher acceleration factors, since the scan can be accelerated in two spatial dimensions. 3. Type of sequence (spin echo, gradient echo, balanced SSFP, inversion recovery, turbo spin echo, FLASH®, EPI) a. Scanning techniques include information on image contrast (T1, T2, T2*, T1 / T2-bSSFP); b. Whether gradient balance, gradient spoiling or RF spoiling sequences are used; c.->Two parameters are used to describe this; d. Fast imaging modes include information about image contrast and how k-space is acquired (one k-space line per excitation vs. multiple k-space lines per radio frequency excitation). 4. Echo time (TE) and repetition time (TR) a.TE is the temporal distance between signal excitation and acquisition of the k-space center; b. TR is the time between two successive radiofrequency excitations of the same imaging volume. 5. Flip angle a. Flip angle is the excitation power of the radio frequency pulse used to excite the spins during the imaging sequence. 6. ACQ voxel size / spatial resolution in all three dimensions (including slice thickness) a. Obtained voxel size in all three spatial dimensions; b. In the tests herein, two parameters were used to describe this. 7. Three-dimensional field of view (FOV) a.FOV is the extent of the scan in all three spatial dimensions; b.->Two parameters were used to describe this. 8. Matrix Size a. Matrix size is the number of voxels or pixels along the three spatial dimensions. 9. Scan Time a. The time the scan takes without acceleration. 10. Fat suppression (this may not be relevant for all MR protocols) a. Depending on the imaging sequence, suppression of the signal from fat may be required; b. Various techniques exist for suppressing fat: mDixon, STIR, SPIR, SPAIR, PROSET, each of which will have a different effect on acceleration performance; c. Three parameters were used to describe this. 11. Water-Fat Shift (WFS): (This may not be relevant to all MR protocols) a. Shift between water and fat signals in the acquired image at a voxel. 12. Bandwidth (BW) a. Bandwidth of data sampling during acquisition. 13. Number of Signal Averages (NSA) a. The number of single scan acquisitions that are averaged to provide a satisfactory image 14. Number of Dynamic Scans a. Number of dynamics in dynamic scan.

[0108] In addition to the magnetic resonance scan parameters described above, it may be beneficial to include one or more of the following parameters: 1. Reconstruction voxel size / reconstruction matrix a.MR images are typically interpolated during image reconstruction; b. The reconstruction voxel size provides the voxel size to be interpolated; c. The reconstruction matrix provides the number of voxels in each of the three spatial dimensions. 2. Prepulse Type a. The use of different types of radiofrequency prepulses prior to radiofrequency signal excitation; b. Different types of prepulses: T2Prep, Inversion, Saturation, MDME, MTC, etc. 3. Partial Fourier (half scan) a. Partial Fourier or half-scan is a technique in which only a portion of k-space is acquired and k-space symmetry is used to reconstruct the complete image. 4. Orientation of imaging volume / slice a. In what orientation the image was acquired: axial, coronal or sagittal 5. Folding direction a. What direction is the phase encoding (folding) and what direction is the frequency encoding (no folding)? 6. Use of contrast agents a. Is contrast used in the scan? If yes, more signal is available and acceleration can be higher. 7.Shot Mode (Single vs. Multi-Shot) Is ak space acquired in one go or in multiple steps? 8.K-space profile order a. In what order are the k-space lines acquired: linearly from one side to the other, starting at the center of k-space, starting at the edge of k-space, asymmetrically, randomly. 9.K space orbit How ak space is obtained: Cartesian, spiral, radial, etc. 10.Physiological synchronization a. The sequence is synchronized to cardiac activity (e.g., via ECG); b. Is the sequence synchronized to respiratory motion (e.g., camera or breathing belt)? 11. Diffusion coding a. Is diffusion coding used for techniques such as DTI or DWI? 12.K spatial division coefficient a. The turbo field echo (TFE) and turbo spin echo (TSE) coefficients describe how many k-space lines are acquired within one set of excitation (TFE) or during one echo train (TSE). 13. Number of Echoes a. Describe how many echoes of the same k-space line are acquired.

[0109] While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description is to be considered illustrative or exemplary and not restrictive, i.e., the invention is not limited to the disclosed embodiments.

[0110] Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other elements or steps, and the singular does not exclude a plurality. A single processor or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain means are recited in mutually different dependent claims does not indicate that a combination of these means cannot be used to advantage. A computer program can be stored / distributed on a suitable medium, such as an optical storage medium or a solid-state medium, supplied together with or as part of other hardware, as well as in other forms of distribution, such as via the Internet or other wired or wireless communication systems. Reference signs in the claims should not be construed as limiting the scope. [Explanation of symbols]

[0111] 100 Healthcare Systems 102 Computer 104 Hardware Interface 106 Computing Systems 108 User Interface 110 memory 120 machine executable instructions 122 Neural Networks 124 Pulse Sequence Commands 126 Magnetic Resonance Scan Parameters 128 predicted undersampling factor 130 Adjusted Pulse Sequence Commands 200 receiving pulse sequence commands configured to control a magnetic resonance imaging system to acquire k-space data according to a compressed sensing magnetic resonance imaging protocol; 202 Receive magnetic resonance scan parameters 204 receiving a predicted undersampling factor in response to inputting the magnetic resonance scan parameters into the neural network. 206 Adjust pulse sequence commands to correct sampling of k-space data based on predicted undersampling factor 300 Healthcare Systems 302 Magnetic Resonance Imaging System 304 Magnet 306 Magnet Bore 308 Imaging Zone 309 Areas of Interest 310 Gradient Magnetic Field Coil 312 Gradient magnetic field coil power supply 314 Radio Frequency Coil 316 Transceiver 318 subjects 320 Subject Support 330 k-space data 332 Magnetic Resonance Imaging Data 400 Acquire k-space data by controlling the magnetic resonance imaging system with pulse sequence commands 402 Reconstructing magnetic resonance image data from k-space data 500 input layers 502 Fully connected layer 504 Output

Claims

1. a memory storing machine-executable instructions, the memory further storing a trained neural network, the neural network having been trained from historical data relating to successful image acquisitions associated with suitable undersampling factors and magnetic resonance scan parameters, the neural network outputting predicted undersampling factors in response to receiving magnetic resonance scan parameters, the magnetic resonance scan parameters describing a configuration of a magnetic resonance imaging system; a computing system for controlling the magnetic resonance imaging system; A medical system comprising: Execution of the machine-executable instructions causes the computing system to: receiving pulse sequence commands for controlling the magnetic resonance imaging system to acquire k-space data according to a compressed sensing magnetic resonance imaging protocol; receiving the magnetic resonance scan parameters; receiving the predicted undersampling factor in response to inputting the magnetic resonance scan parameters into the neural network and prior to acquisition of the k-space data; and adjusting the pulse sequence commands to select or modify sampling of the k-space data based on the predicted undersampling factor; Healthcare system.

2. 2. The medical system of claim 1, wherein the magnetic resonance scan parameters include a radiofrequency coil configuration, a scan mode specifying a two-dimensional scan or a three-dimensional scan, a sequence type specifying a contrast of the pulse sequence command, an echo time, a pulse repetition time, a voxel size or three-dimensional spatial resolution, a three-dimensional field of view, and a radiofrequency bandwidth during k-space sampling.

3. 3. The medical system of claim 2, wherein the magnetic resonance scan parameters further include any one of the type of fat suppression protocol used, flip angle, scan time, field of view orientation, folding direction, number of dynamic scans, type of contrast agent used, number of signal averaging, and combinations thereof.

4. 4. The medical system of claim 3, wherein the magnetic resonance scan parameters further include any one of a reconstruction voxel size or reconstruction matrix size, a type of prepulse used, implementation of a partial Fourier half-scan protocol, an anatomical portion being examined, a shot type used, a k-space profile order, a k-space trajectory, physiological synchronization, a type of diffusion encoding technique, a k-space partitioning factor, a number of echoes used to acquire the same k-space line, and combinations thereof.

5. Execution of the machine-executable instructions further causes the computing system to: retrieving archived scan parameter data from a magnetic resonance scan parameter database; constructing archived training data from the archived scan parameter data; and training the neural network using the archived training data; The medical system according to any one of claims 1 to 4.

6. 6. The medical system of claim 5, wherein the archived training data is obtained remotely, optionally via a network connection.

7. The medical system further comprises the magnetic resonance imaging system, and execution of the machine-executable instructions further causes the computing system to: controlling the magnetic resonance imaging system with the pulse sequence commands to acquire the k-space data; and reconstructing magnetic resonance image data from the k-space data; The medical system according to any one of claims 1 to 6.

8. The medical system has a user interface, and execution of the machine-executable instructions further provides the computing system with: displaying the predicted undersampling factor and at least a portion of the magnetic resonance scan parameters on the user interface before adjusting the pulse sequence commands; and receiving the predicted undersampling factor from the user interface in response to displaying the predicted undersampling factor, wherein the pulse sequence commands are adjusted using the predicted undersampling factor. The medical system of claim 7.

9. Execution of the machine-executable instructions further causes the computing system to: constructing user-specific training data from the magnetic resonance scan parameters and the predicted undersampling factor; and training the neural network using the user-specific training data; The medical system of claim 8.

10. The medical system according to claim 1 , wherein the magnetic resonance imaging protocol is a parallel imaging magnetic resonance imaging protocol.

11. The medical system of claim 1 , wherein the neural network is a multi-layer neural network.

12. 12. The medical system of claim 11, wherein the multi-layer neural network has at least six layers, each of the at least six layers being fully connected to adjacent layers.

13. 1. A method of operating a medical system, the method comprising: receiving pulse sequence commands to control a magnetic resonance imaging system to acquire k-space data according to a compressed sensing magnetic resonance imaging protocol; receiving magnetic resonance scan parameters describing a configuration of the pulse sequence command and a configuration of the magnetic resonance imaging system; receiving a predicted undersampling factor in response to inputting the magnetic resonance scan parameters into a trained neural network, the neural network being trained from historical data regarding successful image acquisitions associated with combinations of appropriate undersampling factors and magnetic resonance scan parameters, and outputting the predicted undersampling factor in response to receiving the magnetic resonance scan parameters and prior to acquisition of the k-space data; adjusting the pulse sequence commands to select or modify sampling of the k-space data based on the predicted undersampling factor; A method comprising:

14. 1. A computer program comprising machine-executable instructions that are executed by a computing system that controls a medical system, the execution of the machine-executable instructions causing the computing system to: receiving pulse sequence commands for controlling a magnetic resonance imaging system to acquire k-space data according to a compressed sensing magnetic resonance imaging protocol; receiving magnetic resonance scan parameters describing a configuration of the pulse sequence command and a configuration of the magnetic resonance imaging system; receiving an undersampling factor in response to inputting the magnetic resonance scan parameters into a trained neural network, wherein the neural network has been trained from historical data regarding successful image acquisitions associated with appropriate undersampling factors and magnetic resonance scan parameter combinations, and outputting a predicted undersampling factor in response to receiving the magnetic resonance scan parameters and prior to acquisition of the k-space data; adjusting the pulse sequence commands to select or modify sampling of the k-space data based on the predicted undersampling factor; Computer program.

Images