Medical imaging and analysis methods

Abstract

A method is provided for analyzing survey imaging data. The method includes the steps of acquiring first image data using a first imaging protocol covering a first FOV, processing the data using an anatomical analysis program or routine to detect at least a portion of a target anatomical structure, and performing a coverage check adapted to determine whether the target anatomical structure is completely covered within the first FOV. A second image is then acquired according to a second imaging protocol defining a second FOV. The second imaging protocol may be the same as the first imaging protocol, but the results of the coverage check are stored for later use and linked to the second image data, or it may differ from the first imaging protocol, and the results of the coverage check are output to a user interface and a user input responsive thereto is used to determine a second scan protocol, or it may differ from the first imaging protocol, and an adjusted second scan protocol is automatically determined.

Description

Technical Field

[0001] The present invention relates to a method for analyzing investigation image data within a medical imaging procedure.

Background Art

[0002] In medical imaging, the planning of clinical scans is routinely performed based in part on an initial Surview ("investigation view") scan. The investigation scan typically has a lower resolution than a full scan and can thus be captured relatively quickly and, in the case of an irradiation modality, apply a lower radiation dose to the patient. The investigation scan can then be used, for example, to set the parameters of a scan protocol to be followed in a subsequent diagnostic scan, including the boundaries of the scan range to be used.

[0003] One of the medical imaging modalities in which investigation scans are routinely used is computed tomography (CT) imaging (e.g., X-ray CT imaging).

[0004] In CT imaging, in addition to dual 2D investigation imaging (frontal and lateral), it is also possible with state-of-the-art technology to acquire 3D investigation images at a significantly lower dose than a typical full 3D scan. Depending on the anatomical structure under consideration, it is necessary to plan the scan based on specific anatomical landmarks within the investigation image to ensure that the target anatomical structure is fully covered within the acquired field of view (FOV).

[0005] Patient positioning and FOV configuration directly affect image quality and thus the diagnostic value of the acquired images. Accurately planning scan parameters to correctly image the target anatomical structure remains a difficult and time-consuming task that requires a qualified technician.

Summary of the Invention

Problems to be Solved by the Invention

[0006] If a 2D or 3D survey image does not fully cover the target anatomical structure within a given FOV, the start and end positions of the scan must be manually adjusted by the technician based on mental estimations in an attempt to capture the complete anatomical structure in subsequent diagnostic scans. This is inherently prone to error. Errors in estimation, or deviations from acquisition guidelines, can lead to significant quality deficiencies, such as incomplete images of the target anatomical structure with parts of the structure missing. If the target anatomical structure is not fully covered within the imaged FOV, the diagnostic image scan may lead to a misdiagnosis, for example, if the area where the anatomical structure is missing contains a lesion. Furthermore, it may necessitate inefficient re-examinations that increase the patient's dose.

[0007] For illustrative purposes, Figure 1 shows several examples of CT images where some of the target's anatomical structures are outside the imaged field of view. Figure 1(a) shows a partially imaged view of the head, Figure 1(b) shows an image of the chest with the upper region of the lungs excluded from the FOV, and Figure 1(c) shows an image of the pelvis with the lower pelvic area outside the image FOV.

[0008] Zhang Le et al.: "Semi-supervised Assessment of Incomplete LV Coverage in Cardiac MRI Using Generative Adversarial Nets" [September 26, 2017, Advances in Biometrcis: International Conference, ICB 2007, Seoul, South Korea, August 27-29, 2007; Proceedings; Lecture Notes in Computer Science; Springer, Berlin, Heidelberg, pp. 61-68, XP047449037, ISBN: 978-3-540-74549-5] describes a semi-supervised method for checking left ventricular coverage from cardiac magnetic resonance imaging using generative adversarial networks.

[0009] A technical solution that can address one or more of the problems identified above is valuable. [Means for solving the problem]

[0010] The present invention is defined by the claims.

[0011] According to one aspect of the present invention, A step of receiving first image data of a patient's anatomical structure from a medical imaging device, wherein the first image data is 2D or 3D image data, the first image data is data acquired according to a first scan protocol which includes a first set of scan parameters of the imaging device, and the first scan protocol is for acquiring image data covering a first FOV, The steps include applying anatomical image analysis to the first image data to detect at least a portion of the anatomical structures of a defined target within the first image data, A coverage check is performed, which includes the step of determining from image analysis whether the anatomical structure of a defined target is completely contained within the first image data. Steps include generating a data representation of the coverage check results, A step of determining a second scan protocol that defines a second set of scan parameters for an imaging device, wherein the second scan protocol is for acquiring image data covering a second FOV, and the second FOV is the same as or different from the first FOV. A step of controlling a user interface to display instructions for the results of a coverage check, the method further comprising the step of receiving user input from the user interface following the display of the coverage check, wherein a second FOV of a second scan protocol is determined depending on the user input, A step of acquiring second image data of a patient's anatomical structure according to a second scan protocol, wherein the second image data covers a second field of view, and the second image data is 2D or 3D image data. A computer implementation method having the above is provided.

[0012] Accordingly, embodiments of the present invention are based on acquiring first imaging data, which may be survey scan data, and processing the data with an anatomical analysis procedure to identify the anatomical structure of a target. This allows for checking whether a predefined anatomical structure of a target is completely covered in the image data (i.e., whether the first FOV completely covers the entirety of the anatomical structure of the target, or whether any part is missing). The results of the coverage check can then be used in various ways, as further outlined below. Subsequently, second image data having a second scan protocol, which may or may not be adjusted according to the results of the coverage check, is applied. User input can be an instruction to continue with the same second scan protocol as the first scan protocol, or it can be an instruction to adjust the scan protocol, for example.

[0013] The method is applicable to both 2D and 3D image data. In some examples, the first and second image data can both be 3D (i.e., volumetric) image data, such as tomography image data, such as CT or MRI image data. In some examples, the first and second image data can both be 2D image data, such as X-ray or ultrasound image data. In some examples, the first image data can be 2D image data and the second image data can be 3D image data, for example, the first image data is a 2D slice acquired using a 3D or volumetric imaging device.

[0014] The target anatomical structure can be a single anatomical object (such as an organ), a part of an anatomical object, or an anatomical region encompassing multiple anatomical objects.

[0015] The first image data is, for example, image data from an investigational scan. The second image data is data from a clinical / diagnostic scan. The first image data may have a lower spatial resolution than the second image data. The first image data may contain less data than the second image data.

[0016] There are at least three ways the method proceeds after the coverage check is performed, and these will be briefly outlined below.

[0017] According to the second embodiment, the data representation of the coverage check results is communicated to a data store for storing the coverage check results, and the second image data is associated with the coverage check results and stored in the same or a different data store.

[0018] According to a third aspect, the method comprises the steps of determining a proposed adjustment to a first scan protocol in response to a negative result of a coverage check to obtain an extended FOV, wherein the proposed adjustment is based on anatomical image analysis, and then, The steps include configuring the second scan protocol according to the proposed modified first scan protocol so that the second FOV is set as an extended FOV, or Steps to communicate proposed adjustments to the first scan protocol and / or proposed extended FOV to the user interface. It also possesses the following:

[0019] Note that these different options regarding the flow of the method after coverage checking are not necessarily mutually exclusive, and it is possible to combine two or more features. For example, the result of the coverage check can be stored in addition to outputting the result to the user interface and / or determining an adjusted scan protocol.

[0020] According to at least one set of embodiments, the method has a step of applying anatomical image analysis to identify at least a partial spatial extent of an anatomical structure or at least a partial boundary of an anatomical structure.

[0021] Spatial extent means the dimension of the volume of the target anatomical structure or the dimension of the cross-sectional plane of the anatomical structure captured within the first image data of the image.

[0022] Anatomical image analysis may include image segmentation, which means an operation to identify the boundary of a pre-defined anatomical object or feature, or an operation to identify the region (2D / 3D region) of image data occupied by at least a part of an anatomical object or feature.

[0023] In some embodiments, the method further has a step of applying anatomical image analysis to estimate a spatial extent of a target anatomical structure that extends beyond at least one boundary of the FOV. In some examples, the method further has a step of controlling a user interface to display a visual representation of the spatial extent. For example, the method has a step of estimating a spatial extent, such as a length in one or more directions or dimensions with respect to the FOV or the target anatomical structure, such as a length in the superior and / or inferior directions with respect to the imaged anatomical structure.

[0024] In some embodiments, the coverage check determines a proposed adjustment to a first scan protocol for obtaining an extended FOV that fully covers the target's anatomical structure, based on the spatial extension of the target's anatomical structure beyond the FOV.

[0025] In some embodiments, the second scan protocol is determined such that the second FOV is set as the extended FOV.

[0026] In some embodiments, the method includes controlling a user interface to display a proposed adjustment to the first scan protocol and / or a representation of the proposed extended FOV, generating a prompt on the user interface to request user approval, receiving user input from the user interface indicating approval or disapproval, and acquiring second image data spanning the extended FOV and according to the proposed adjusted scan protocol only in response to receiving user input indicating approval.

[0027] In other words, the proposed adjustment is sent to the user interface for user confirmation and then used for the second scan only if the user indicates approval.

[0028] In some embodiments, the method includes the steps of: controlling a user interface to display a visual representation of a proposed extended FOV (e.g., the contour of the boundary of the extended FOV superimposed on the first image data) for a rendered view of a first image data; and controlling the user interface to generate a prompt for user input indicating approval of the proposed extended FOV, or a prompt for user input indicating modification to the proposed extended FOV, via user control operations. The method then further includes the steps of: determining a second scan protocol in response to receiving user approval from the user interface, such that a second FOV is set as an extended FOV, or determining a second scan protocol in such that a second FOV is set as a user-modified FOV, the user-modified FOV being defined based on received user input indicating modification to an extended FOV.

[0029] The scan parameters include the boundaries of the scan range along at least one scan axis of the medical imaging device, and the FOV is at least partially defined by the scan range boundaries. In other words, adjustment of the FOV can be achieved by adjusting the scan range. The proposed adjustments to the first scan protocol produced by the method according to a particular embodiment include proposed adjustments to the scan range boundaries along one or more scan axes.

[0030] The above-described step of estimating the spatial extension of the target's anatomical structure outside the FOV includes the step of estimating the contour of the boundary of at least a portion of the target's anatomical structure located outside the FOV. The method further includes the step of generating a visual representation of the contour for the first image data on a user interface display.

[0031] According to any embodiment of the present invention, the scan parameters of the first and second scan protocols include a scan range boundary along at least one scan axis of the medical imaging device, and the first FOV and the second FOV are each at least partially defined by the scan range boundary.

[0032] The scan parameters of the first and second scan protocols further include the physical placement of the subject / patient's anatomical structure relative to the medical imaging device. For example, this includes the physical positioning of the subject support, table, or couch relative to the imaging device (e.g., in the case of MRI or CT imaging). In other cases, for example, in the case of X-ray or ultrasound imaging, it may include the physical placement of the imaging device or probe relative to the patient.

[0033] The proposed adjustments to the first scan protocol include proposed adjustments to the boundaries of the scan range along at least one scan axis; in other words, adjustments to the start and / or end of the scan range. The scan range includes an angular range around the rotation axis of the medical imaging device. The scan range includes an axial range along the axial direction of the medical imaging device.

[0034] In some embodiments, the data representation is communicated to a data store for storing the results of a coverage check, and the method further comprises the step of performing a quality assessment which has the step of deriving a second quality index of acquired image data based on the results of a coverage check associated with the image data.

[0035] Various options exist for image analysis operations. In some embodiments, the image analysis operation applies anatomical image segmentation.

[0036] In some cases, performing image analysis and / or coverage checks involves applying machine learning models.

[0037] In some embodiments, a machine learning model receives image data representing only a portion of an anatomical object as input. To generate an estimate of at least the dimensional range of the remaining parts of the anatomical object outside the field of the image data, and / or The output generates an estimate of the boundary of the remaining anatomical object outside the field of the image data. It is configured in this way.

[0038] The model is trained using training data that includes cropped images of anatomical objects. For example, a machine learning model can be trained using: A first data input for the model includes a first cropped image of an anatomical structure from which part of the image has been removed so that the image shows only a portion of the anatomical object, Ground truth for the model, including at least per-voxel anatomical labeling for voxels in a second, uncropped version of the image showing the whole anatomical object, and Each model is trained using training data entries that contain it.

[0039] In other words, the ground truth for the model includes labeled anatomical voxels, even if they are outside the simulated / cropped field of view of the first image.

[0040] In other words, each training data entry includes a version of the image covering the entire anatomical structure of interest, as well as a version of the same image covering only a portion of the anatomical structure of interest, and voxel-by-voxel annotations for the image with labeled anatomical voxels outside the field of view.

[0041] Even if some of the target's anatomical structure is simulated to be outside the FOV, ground truth still includes voxel-by-voxel annotations for the entire anatomical structure.

[0042] While voxels were mentioned above, images can also be 2D, in which case they contain pixels instead of voxels.

[0043] A cropped image means an incomplete or partial image.

[0044] Another aspect of the present invention provides a processing device comprising inputs / outputs for connection to a medical imaging device during use, and one or more processors. The one or more processors are In the input / output, receiving first image data of a patient's anatomical structure from a medical imaging device, wherein the first image data is 2D or 3D image data, and the first image data is data acquired according to a first scan protocol that includes a first set of scan parameters of the imaging device, and the first scan protocol is for acquiring image data covering a first FOV, Applying anatomical image analysis to the first image data to detect at least a portion of the anatomical structures of a defined target within the first image data, This involves performing a coverage check, which includes determining from image analysis whether the defined target anatomical structure is completely contained within the first image data, To generate a data representation of the coverage check results, Determining a second scan protocol that defines a second set of scan parameters for an imaging device, wherein the second scan protocol is for acquiring image data covering a second FOV, and the second FOV is either the same as or different from the first FOV. Control the user interface to display instructions for the coverage check results, Receiving user input from the user interface following the display of the coverage check, wherein the second FOV of the second scan protocol is determined depending on the user input. In the input / output, a control signal is output to control the imaging device to acquire second image data of the patient's anatomical structure according to a second scan protocol, wherein the second image data covers a second FOV and the second image data is 2D or 3D image data. It is adapted to perform the following actions.

[0045] Further aspects of the present invention provide a system comprising a medical imaging device and a processing device according to any example or embodiment outlined above, or according to any claim of this application.

[0046] According to some embodiments, the medical imaging device is a tomographic imaging device such as an X-ray CT imaging device or an MRI imaging device.

[0047] These and other aspects of the present invention will become apparent and be described by reference to the embodiments described below.

[0048] For a better understanding of the present invention and to more clearly illustrate how the present invention is carried out, the accompanying drawings are referenced hereby only as examples. [Brief explanation of the drawing]

[0049] [Figure 1] This figure shows an example of a medical image acquired using a misplaced field of view (FOV), which leads to incomplete imaging of the target's anatomical structure. [Figure 2] This is a diagram illustrating an example of a medical imaging device. [Figure 3] This figure shows exemplary systems and processing equipment according to one or more embodiments of the present invention. [Figure 4] This figure shows an example graphical user interface display screen that shows the results of an anatomical coverage check in the form of a message indicating a negative (non-coverage) result. [Figure 5]The figure shows an exemplary graphical user interface display screen showing the proposed adjusted FOV in response to a negative anatomical coverage check, wherein the proposed adjusted FOV is in the form of a graphically displayed contour of the extended FOV boundary relative to the initial image data. [Figure 6] This figure shows the same graphical user interface display screen as Figure 5, except that it additionally shows segmented contours of some of the boundaries of the target's anatomical structures outside the first FOV. [Figure 7] This figure shows the same graphical user interface display screen as Figures 5 and 6, with additional displays of various organs present within the FOV listed in text format. [Figure 8] The figure illustrates the creation of training data for training a machine learning model to perform an anatomical coverage check, wherein the training data includes clipped versions of ground truth images, the clipped versions being clipped so that at least a portion of the depicted anatomical structures are excluded from the image field. [Figure 9] This figure shows the results of applying a machine learning algorithm trained to perform anatomical coverage checks. [Figure 10] The figure shows further results of applying a machine learning algorithm trained to perform anatomical coverage checks, where the training was specifically for CT imaging. [Figure 11] The figure shows further results of applying a machine learning algorithm trained to perform anatomical coverage checks, where the training was specifically for CT imaging. [Modes for carrying out the invention]

[0050] The present invention will be described with reference to the figures.

[0051] The detailed descriptions and specific examples illustrate exemplary embodiments of the apparatus, system, and method, but should be understood to be for illustrative purposes only and not intended to limit the scope of the invention. These and other features, aspects, and advantages of the apparatus, system, and method of the invention will be better understood from the following description, the appended claims, and the accompanying drawings. It should be understood that the figures are merely schematic and are not drawn to a specific scale. It should also be understood that the same reference numerals are used throughout the figures to indicate the same or similar parts.

[0052] The present invention provides a method for analyzing survey imaging data. The method comprises the steps of: acquiring first image data using a first imaging protocol covering a first field of view (FOV); processing the data using an anatomical analysis program or routine to detect at least a portion of the target's anatomical structure; and performing a coverage check adapted to determine whether the target's anatomical structure is completely covered within the first FOV. Subsequently, a second image is acquired according to a second imaging protocol defining a second FOV. The second imaging protocol is the same as the first imaging protocol, except that the results of the coverage check are stored for later use and linked to the second image data, or, unlike the first imaging protocol, the results of the coverage check are output to a user interface and the user input in response is used to determine the second scan protocol, or, unlike the first imaging protocol, a modified second scan protocol is automatically determined.

[0053] The various embodiments of the present invention, described in more detail below, include, but are not essential, one or more of the following features.

[0054] In some embodiments, the provided system or method aims to alert the user if a target anatomical structure (such as a target organ) is not entirely within the captured or planned field of view (FOV). This can be achieved by using image classification techniques with machine learning algorithms, such as deep learning artificial neural networks. The analysis is applied to 2D or 3D survey view images.

[0055] In some embodiments, the provided system or method aims to determine the extent of partially missing anatomical structures outside the captured FOV within the investigation image, even if they extend beyond the boundaries of the acquired image data. The system or method generates recommended patient positioning and / or recommended image acquisition parameters (such as the start and end positions of the scan range in one or more scan dimensions) relative to the imaging device to improve anatomical coverage before acquiring the diagnostic image dataset.

[0056] In some embodiments, deep learning methods based on image segmentation or object detection are used to estimate organ ranges based on input survey image data.

[0057] Embodiments of the present invention are applicable to multiple different imaging modalities and also to additional applications such as retrospective image quality evaluation.

[0058] An embodiment of the method of the present invention comprises the steps of receiving image data from a medical imaging device and determining a scan protocol for acquiring image data covering an adjustable field of view.

[0059] The conceptual principles of the present invention are not limited to use in any particular type of medical imaging device. However, they are most advantageously applicable to tomographic imaging such as X-ray computed tomography (CT) scans and MRI scans. Embodiments of the present invention can be applied to 2D image data and / or 3D image data.

[0060] To help illustrate the principle of the present invention, an exemplary medical imaging device is shown in Figure 2. In this figure, the imaging device 10 is an X-ray computed tomography (CT) scanner.

[0061] The imaging device 10 generally includes a fixed gantry 102 and a rotating gantry 104. The rotating gantry 104 is rotatably supported by the fixed gantry 102 and rotates around the inspection area about a longitudinal axis, an axial axis, or a Z-axis.

[0062] A patient support 120, such as a couch, supports an object or subject, such as a human patient, within the examination area. The support 120 is configured to move the object or subject in order to load, scan, and / or unload the object or subject. The support 120 is movable along the axial direction, i.e., along the Z-axis or longitudinal axis. Moving the support changes the axial position of the rotating gantry relative to the support (and therefore relative to the subject supported by the support).

[0063] A radiation source 108, such as an X-ray tube, is rotatably supported by a rotating gantry 104. The radiation source 108 rotates with the rotating gantry 104, emitting radiation across the inspection area 106.

[0064] The radiation detection array 110 traces an angular arc across the inspection area 106 on the opposite side of the radiation source 108. The detector array 110 includes one or more rows of detectors extending along the Z-axis, which detect radiation crossing the inspection area 106 and generate projection data indicating it.

[0065] The rotation of the gantry 104 changes the angle or rotational position of the scanner relative to the subject, and the movement of the support along the Z axis changes the axial position of the scanner relative to the subject.

[0066] A typical scan is pre-configured using a scan protocol. The scan protocol includes several scan parameters. The scan parameters define, among other things, the spatial range of the scan with respect to the axial and rotational axes of the scanner. For example, the scan parameters include the boundaries of the scan range (i.e., start and end points) along one or more of the axes of the imaging device, e.g., the rotational axis and / or the axial axis. The scan range defines the field of view (FOV) from which imaging data is acquired during the scan. The scan parameters typically also include a number of other parameters, such as tube current, tube voltage, scan spatial resolution, scan temporal resolution, and fan angle. The resolution parameter is defined by the rotational speed of the gantry 104 and the axial travel speed of the support 120 through the gantry.

[0067] A general-purpose computing system or computer functions as an operator console 112 and includes input devices 114 such as a mouse and keyboard, and output devices 116 such as a display monitor and filmer. The console, input devices, and output devices form a user interface 10. The console 112 allows the operator to control the operation of the system 100.

[0068] The reconstruction device 118 processes the projection data and reconstructs the volumetric image data. The data can be displayed through one or more display monitors of the output device 116.

[0069] The reconstruction device 118 employs filtered back projection (FBP) reconstruction, a low-noise reconstruction algorithm (e.g., iterative reconstruction) (for the image region and / or projection region), and / or other algorithms. It should be understood that the reconstruction device 118 is implemented via a microprocessor that executes computer-readable instructions encoded or embedded on a computer-readable storage medium such as physical memory and other non-temporary media. Additionally or alternatively, the microprocessor may execute computer-readable instructions carried by a carrier wave, signal, or other temporary (or non-temporary) medium.

[0070] Figure 3 shows a block diagram of an exemplary system 8 according to one or more embodiments of the present invention. The system comprises a processing unit 20 having input / output (I / O) 22 or a communication module for connection when using a medical imaging device 10, and further comprises one or more processors ("proc") 24 adapted to perform steps of the computerized implementation described below. The system comprises a medical imaging device, or the medical imaging device is external to the system and is coupled to the system in a communicative manner.

[0071] The system further comprises a user interface (UI) 32 communicatively coupled to a processing unit 20. The user interface includes a display having a screen for displaying visual output to the user. The user interface provides a graphical user interface. The user interface also includes means for generating other sensory outputs, such as acoustic output. The user interface is a computer console comprising a display screen, a user input device, and a processor. The display screen may be a touchscreen display, thereby integrating the user input device. Alternatively, the user input device comprises a keyboard and / or a pointer device (e.g., a mouse pointer).

[0072] As described above with reference to Figure 2, in some cases the imaging device 10 has its own user interface 30. In some examples, the user interface of the imaging device is used to perform the role of the system's user interface 32. In other examples, the system has its own user interface.

[0073] The processing unit 20 itself constitutes one aspect of the present invention. The aforementioned computer implementation method configured to be carried out by the processing unit also constitutes another independent aspect of the present invention.

[0074] An exemplary computer implementation of the present invention, comprising at least one set of embodiments, will be summarized and outlined before further describing the features of the method and different possible embodiments.

[0075] The method comprises the step of receiving first image data of a patient's anatomical structure from a medical imaging device 10, wherein the first image data is 2D or 3D image data. The first image data is data acquired according to a first scan protocol which includes a first set of scan parameters for the imaging device. The first scan protocol is adapted to result in the acquisition of image data covering a first field of view (FOV). In other words, the first set of scan parameters of the first scan protocol causes the imaging device to acquire image data over a first FOV. In this context, FOV means the area over which image data is acquired. Therefore, the received first image data consists of image data of only the first FOV in this example. Typically, the scan parameters of the scan protocol include defined boundaries of the scan range along at least one scan axis of the medical imaging device, for example, the axial or longitudinal axis and / or rotation axis as described above with reference to Figure 2. The scan range typically defines, at least partially, the FOV over which data is acquired. FOV generally means the FOV defined with respect to the imaging device, for example, with respect to the coordinate system of the imaging device.

[0076] The method further comprises the step of applying anatomical image analysis to first image data in order to detect at least a portion of a defined target anatomical structure within the image data. For example, the anatomical image analysis includes anatomical image segmentation to detect the boundaries of anatomical objects or regions within a scanned area and / or the volume occupied by anatomical objects or regions within a scanned area.

[0077] The method further comprises the step of performing a coverage check, which involves determining from image analysis whether a defined target anatomical structure is completely contained within the first image data. The target anatomical structure may be a single anatomical object or feature (such as an organ), a part of an anatomical object (e.g., a ventricle or valve of the heart), or an anatomical region encompassing multiple anatomical objects (e.g., a specific upper body region containing multiple organs).

[0078] The method further comprises the step of generating a data representation of the results of the coverage check. The data representation is for export from the processing equipment via input / output and / or for further use in further processing performed according to the method.

[0079] The method further comprises the step of determining a second scan protocol that defines a second set of scan parameters of an imaging device, the second scan protocol being adapted to result in the acquisition of image data covering a second FOV, the second FOV being the same as or different from the first FOV.

[0080] The method further comprises the step of acquiring second image data of the patient's anatomical structure according to a second scanning protocol, wherein the second image data covers a second field of view, and the second image data is 2D or 3D image data.

[0081] The first image data is data acquired in an initial investigation scan to acquire 2D image data or 3D image data. The method is to check whether the planned scan parameters result in a field of view (FOV) that fully captures the target anatomical structure. The investigation scan is used to adjust the scan parameters (if necessary) before triggering the execution of a full diagnostic scan, which typically has a higher image resolution and takes more time to perform. The second image data mentioned above is data acquired for the full diagnostic scan. The second image data is either 3D (volume) image data or 2D image data.

[0082] Following the acquisition of the first image data and the execution of the coverage check, there are at least three main modes in which this method proceeds, which are summarized below.

[0083] A first aspect is that the user interface 32 is controlled to display instructions for the results of a coverage check, the method further comprising the step of receiving user input from the user interface following the display of the coverage check, and the second FOV of a second scan protocol is determined in accordance with the received user input. The user interface is controlled to present the user with the option to continue the first scan protocol having the first FOV in order to acquire subsequent second image data. In this case, the second scan protocol and the second FOV are the same as those of the first. The user interface also presents the user with the option to adjust one or more of the scan parameters of the scan protocol to adjust the FOV. In this case, the second scan protocol and the second FOV are different from those of the first and are adjusted in accordance with user input. In some cases, the scan protocol may be adjusted so that the second scan protocol is different from the first scan protocol but the second FOV remains the same (e.g., by changing the radiation dose). As will be outlined in more detail later in this disclosure, adjustments to the scan protocol for second image data acquisition are either fully user-controlled (e.g., using user controls provided on a user interface) or at least semi-automated (e.g., the method has a step of automatically generating one or more suggestions for adjusting the scan protocol and FOV based on the results of a coverage check). In the latter case, user input includes user-instructed acceptance or rejection of the suggested adjustments, or user-instructed modification of the suggested adjustments.

[0084] A second aspect of the method is that the results of a coverage check are communicated to a data store for storing the results of the coverage check, and the second image data is stored in the same or a different data store in association with the results of the coverage check. In other words, the coverage check is stored for later reference, and a data link is generated that can associate the stored coverage check with the corresponding second image data obtained after the results have been derived. In this case, the second scan protocol and the second FOV are the same as the first image protocol and the first FOV, and the coverage check is simply used for subsequent analysis of the potential quality of the second image data.

[0085] A third aspect of the method to which the method may proceed is that the method further has the step of determining a proposed adjustment to the first scan protocol in response to a negative result of a coverage check (i.e., the anatomical structure of the target is not fully covered by the first FOV), such that an extended FOV is obtained, and the proposed adjustment is based on anatomical image analysis. The proposed adjustment aims to result in a new FOV that fully covers the anatomical structure of the target. For example, the proposed adjustment may include adjustments to the start and / or end points of the scan range along one or more scan axes. This may include table motion parameters (such as table speed). The method may optionally automatically set a second scan protocol according to the proposed adjusted first scan protocol so that the second FOV is set as the extended FOV. Alternatively, the method may have the step of communicating the proposed adjustment to the first scan protocol and / or the proposed extended FOV to a user interface. The user interface is controlled to allow the user to input a response to the proposed adjustment, such as a binary acceptance or rejection of the proposed adjustment, or a modification of the proposed adjustment.

[0086] In relation to anatomical image analysis, this involves identifying the spatial extension or boundary of at least a portion of an anatomical structure. In other words, it involves anatomical image segmentation.

[0087] If the coverage check yields a positive result, the processing device simply acquires the second imaging data using the original first scan protocol, after optionally requesting confirmation from the user via the user interface.

[0088] To further illustrate the principle of the present invention, the steps of an exemplary implementation will be outlined in detail with reference to Figures 4 to 7.

[0089] As a first step, one or more 2D or 3D survey images are acquired at the start of the examination. These form the first image data described above. These are generated according to a first scan protocol which results in the acquisition of a first imaging FOV to the imaging device.

[0090] The user interface 32 is controlled to generate a visual representation of the first image data.

[0091] Optionally, additional information can be acquired for subsequent processing to improve prediction accuracy. This includes relevant acquisition and protocol parameters such as the anatomical structure of the target being imaged, scan parameters such as tube voltage and / or current settings, and / or patient demographic information such as age and sex.

[0092] The method further comprises the step of applying image analysis (e.g., anatomical image segmentation) to detect target anatomical structures in the first image data. The user interface 32 is controlled to display a visual representation of the detection of anatomical structures. For example, the contour of at least a portion of the detected target anatomical structure is displayed, or the volume detected as being occupied by the target anatomical structure is highlighted, and the portion of the image FOV containing the target anatomical structure is displayed as a contour.

[0093] Based on the processing of the acquired first image data, and optionally based on one or more of the parameters described above, the method applies a coverage check operation adapted to infer whether the target anatomical structure is fully covered in the current field of view (FOV). As will be described in more detail below, the coverage check operation is performed by a trained machine learning model.

[0094] The user interface 32 is controlled to display a visual representation of the coverage check results.

[0095] In at least some embodiments, if the coverage check returns a negative result (i.e., the coverage check indicates that the target anatomical structure is not fully covered by the current FOV), a warning message is generated using the user interface 32, for example, a visual and / or auditory warning is generated.

[0096] Figure 4 shows an example of a graphical user interface display screen. The screen displays the acquired first image data, in this case, the first survey image view 72 and the second survey image view 74 from the CT scanner. The views are separately acquired 3D image views or slices extracted from 3D survey images. The user interface further displays the results of anatomical detection, such as a visual representation of segmentation. For example, in the example in Figure 5, the region 80 of the image FOV containing the target anatomical structure is highlighted and shown as a translucent overlay on the relevant portion of the image FOV containing the target anatomical structure. For ease of explanation, this is highlighted and shown with a white dashed outline, but in reality, it consists of, for example, simply a color-shaded translucent overlay. In this example, the display screen is controlled to further display a pop-up message 76 indicating a negative (non-coverage) result. For example, in this example, the message warns the user that the upper part of the lung is not covered by the “scout” image (meaning the survey image). The operator has the option of ignoring the message or deciding to take action by modifying the planned scan protocol for the diagnostic scan, for example, to cause an adjustment in the field of view (FOV).

[0097] In some embodiments, the method further comprises the step of applying anatomical image analysis to estimate the spatial extension of an anatomical object beyond at least one boundary of a first FOV. This includes estimating the distance outside the FOV to which the anatomical structure extends, along with its corresponding location (e.g., upper or lower), and communicating this to the operator. The operator may be prompted to change scan parameters, for example, to adjust the start and end positions of the scan range of a diagnostic scan, or be provided with means on the user interface.

[0098] The user interface is controlled to display a visual representation of the estimated spatial extension of the target anatomical structure beyond the FOV. Figure 5 shows an example of displaying a first image view 72 and a second image view 74 from a first (survey) image data, with an overlay on the second image view showing a visual representation of the detected portion 80 of the imaging FOV occupied by the target anatomical structure and the contour of the boundary of the estimated spatial extension 84 of the anatomical structure beyond at least one boundary of the first FOV. The region 80 is represented by a colored, semi-transparent overlay box, which optionally has a solid line contour. The estimated region 84 occupied by the portion of the target anatomical structure not covered in the first FOV is indicated by a different color, such as a contour around the estimated region 84, which is used to highlight the region containing the detected anatomical structure.

[0099] In some cases, the estimated spatial extension 84 of the target's anatomical structure outside the FOV is used to indicate a proposed adjusted FOV that fully captures the target's anatomical structure. In particular, the method further includes the step of determining a proposed adjustment to a first scan protocol to cause the imaging device to acquire an extended FOV that fully covers the anatomical object, based on the detected spatial extension 84 of the anatomical object beyond the FOV.

[0100] Next, the adjusted scan protocol is, in some cases, implemented directly, i.e., the second scan protocol is determined to set the second FOV as an extended FOV, and the second image acquisition is initiated.

[0101] Alternatively, the operator is given the option to accept or reject the proposed adjustments to the field of view of the second scan.

[0102] In particular, the method further comprises the steps of: controlling a user interface to display a proposed adjustment and / or a proposed extended FOV for a first scan protocol; generating a prompt on the user interface requesting user approval; and acquiring a second image data spanning the extended FOV and in accordance with the proposed adjusted scan protocol, in response only to the receipt of user input indicating approval.

[0103] Optionally, in addition to the option to accept or reject the proposed adjustments, the user is also provided with the option to modify the suggested FOV extension, for example, by changing the dimensions of the proposed adjusted FOV, as indicated by the highlighted extension area 84 on the user interface.

[0104] In other words, the method includes the steps of: controlling a user interface to display a visual representation of the proposed extended FOV for a rendered view of the first image data; controlling the user interface to generate prompts for user input indicating approval of the proposed extended FOV or modification of the proposed extended FOV through user control operations; and then, In response to receiving user authorization from the user interface, the second scan protocol is determined so that the second FOV is set as an extended FOV, or A step of determining a second scan protocol such that a second FOV is set as a user-modified FOV, wherein the user-modified FOV is defined based on received user input indicating a modification to the extended FOV, and It further possesses.

[0105] To modify the proposed adjusted FOV or the provided adjusted scan protocol, the user has the option to drag the outline of a box that highlights the proposed FOV extension on the screen, and / or to manually set scan parameters such as the start and end positions of the scan range along one or more scan axes.

[0106] In addition to any of the above, in some embodiments, the estimation of the spatial extension of an anatomical object outside the FOV includes estimating the contour of the boundary of at least a portion of the object outside the FOV, and the method further comprises the step of generating a visual representation of the contour for a first image data on a user interface display. An example in which the contour of the estimated extension of an anatomical structure outside the FOV 88 is presented on the display as a sketch is shown in Figure 6.

[0107] In addition, in some embodiments, anatomical image analysis, such as anatomical image segmentation, is used to generate labeling of different anatomical structures depicted within the first image data FOV. For example, Figure 7 shows an example in which various organs present within the FOV of the first image data are listed in text format. In some examples, further visual indications are provided to show whether each anatomical structure is completely covered or not by the first FOV. Advantageously, this is done by text formatting, such as text color. For example, green text is used to indicate an anatomical structure that is completely covered in the FOV, orange text is used to indicate that the anatomical structure is partially outside the FOV, and red text is used to indicate that the anatomical structure is completely outside the FOV.

[0108] In a modified version of the example described above, instead of providing the user with the option to modify the FOV, in a simpler embodiment, the user is simply presented with the option to accept or reject the proposed adjusted FOV.

[0109] In the modified example described above, instead of showing the proposed adjusted FOV to the user, the processing equipment simply and automatically acquires second imaging data using the adjusted FOV without seeking user approval. A user interface is not essential to the present invention and may not be used at all in simpler embodiments.

[0110] As described above, instead of adjusting the scan protocol in response to the coverage check results (with or without user input), or in addition to doing so, the method includes a step of communicating a data representation of the coverage check results to a data store for storing the coverage check results. This data is then used for imaging quality analysis. In some examples, this is done retrospectively, at a point in time different from when the image data was acquired.

[0111] In some examples, the method includes the steps of retrieving a second stored image data and retrieving a stored coverage check result based on a data link that provides a data pointer between the stored address of the second stored image data and the stored coverage check result of the first image data. The method further includes the step of performing a quality assessment, which includes the step of deriving a quality index of the second image data based on the coverage check result associated with the image data. This can be stored for later retrieval. It can be output to a user interface. In either case, the quality index is useful in informing a clinician viewing the second image data about the reliability of the data for performing diagnostic analysis. If the quality is low, the clinician will deem the data less important and, for example, will not make major treatment decisions based purely on the image data. If the quality is high, the clinician will deem the image data more important.

[0112] In some embodiments, the analysis operation is applied to coverage check results for multiple patients, for example, an entire cohort or population of patients. This can be used to generate statistical information on imaging quality within a group or department. The results are presented on a graphical user interface screen, for example, in the form of a dashboard, to support quality monitoring. In some examples, the quality metrics described above are first generated for each image data of multiple patient imaging datasets to be included in the analysis, and then the analysis is performed on the quality metrics of the multiple datasets.

[0113] As discussed above, embodiments are adapted to perform a coverage check, which involves determining from image analysis whether a defined target anatomical structure is fully contained within a first image data set obtained. For this purpose, according to at least one set of embodiments, the method involves applying a machine learning model, such as a deep learning artificial neural network model. In some examples, the model is adapted to provide a classification output, e.g., a binary output indicating whether a target anatomical structure is covered within the field of view of the input image.

[0114] In some embodiments, for each of several different possible target anatomical structures (e.g., chest, spine, heart, pelvis, abdomen, and combined anatomical structures such as thoracic-abdominal, abdominal-pelvic, and thoracic-abdominal-pelvic), a separate machine learning model is provided, each specifically trained for that anatomical structure. Different models may also exist for different demographic categories, such as different age groups and sexes. Thus, a bundle of machine learning models is provided for each of the sets of possible target anatomical structures and for several different demographic categories. In other examples, only a single machine learning model exists, trained to detect any of several different target anatomical structures.

[0115] According to at least one set of embodiments, one or more machine learning models are configured to receive image data representing only a portion of an anatomical structure of interest as input, and to generate an estimate of at least the dimensional range of the rest of the anatomical structure of interest outside the field of the image data as output, and / or to generate an estimate of the boundary of the rest of the anatomical object outside the field of the image data as output.

[0116] Training data for such machine learning models can be generated by artificially truncating a complete image view of a specific target anatomical structure in order to intentionally exclude parts of the anatomical structure from the resulting image data. The uncropped, complete image can also be used as ground truth for training. The complete version can be segmented before cropping, and the boundary contours (or annotation masks or meshes) of the target anatomical structure both within the remaining portion of the cropped image and within the cropped portion of the image are also stored as ground truth.

[0117] Therefore, in other words, the machine learning model is trained using training data entries, each of which includes a first data input to the model containing a cropped image of an anatomical structure from which a section of the image has been removed so that the image depicts only a portion of the anatomical object, and the ground truth of the model containing voxel-by-voxel anatomical annotations of the image on an uncropped image field containing the entire anatomical structure of interest (i.e., voxel annotations within the portion of the uncropped image and within the portion of the cropped image). For example, annotations are obtained from image segmentation, the output of which indicates, on a voxel-by-voxel basis, whether each voxel is part of an anatomical structure, and if so, which anatomical structure it is part of.

[0118] As an example, Figure 8 shows the generation of training data for an example where the target anatomical structure is the liver. Figure 8(a) shows the original complete image of the liver in addition to a segmentation mask of the liver region. Figure 8(b) shows the configuration of an exemplary set of artificially cropped or clipped images, each image being cropped to exclude the portion of the liver from the resulting image field. The brighter areas within each image are the uncropped portions. In the case of the liver, the image can be clipped at an upper or lower image position to generate several images with different clipping positions from a single case, for example. Each simulated cropped image is processed to have zero image intensity (i.e., black pixels / voxels, i.e., zero padding) above or below the clipped anatomical coordinates, but even though the part of the liver is simulated to be outside the FOV, the ground truth image still contains pixel-by-pixel annotations of the entire liver as metadata.

[0119] During the training phase of a machine learning model, regardless of zero-padding in the cropped image region, the cropped image can be used as the training input entry, and the voxel-by-voxel annotations of the complete anatomical structure can be presented to the model as the ground truth entry.

[0120] The predicted probability mask obtained as output from the model can be post-processed to estimate the extent of partially missing anatomical structures. This information can be used to recommend optimized scan parameters (e.g., start and end positions of the scan range) to the user so that the partially missing anatomical structures are fully covered in the second FOV within the second image data.

[0121] Figure 9 shows the results of applying a machine learning algorithm trained to perform an anatomical coverage check, specifically for the liver in this case, and generate an estimate of the extent of anatomical structures outside the image boundary. Figure 9(a) shows the ground truth annotation (dashed line) around the periphery of the region containing the liver, where the region extends outside the image boundary. The actual image presented to the machine learning algorithm is the brighter region. Figure 9(b) shows the output of the machine learning algorithm (solid line) when applied to this image, compared to the ground truth (dashed line). The illustrated example is one test case where the liver is truncated in the upper position. The network was trained using 2592 images. For this example, a coronal slice with the largest number of voxels in the ground truth is selected.

[0122] Similar algorithms can also be extended to 3D imaging, for example, using CT modalities that include both high-dose and low-dose 3D survey images.

[0123] Figures 10 and 11 show further results of applying a machine learning algorithm trained to perform anatomical coverage checks on the anatomical structures of a liver target in this example, with training specifically for CT imaging. The example in Figure 10 utilizes high-dose CT images, while the example in Figure 11 utilizes low-dose CT images. The network was individually trained on approximately 850 high-dose and low-dose CT images. Figures 10(a) and 11(a) represent ground truth annotations (dashed lines) around the periphery of the region containing the liver, respectively, where the region extends beyond the image boundary. The actual image presented to the machine learning algorithm is the brighter region. Figures 10(b) and 11(b) show the output of the machine learning algorithm (solid lines) when applied to this image, respectively, compared to the ground truth (dashed lines).

[0124] The above overview mentioned the use of machine learning models that include one or more machine learning algorithms.

[0125] A machine learning algorithm is any self-training algorithm that processes input data to generate or predict output data. In the context of the example described above, the input data includes a first image file, and the output data includes either a binary classification of whether the target anatomical structure is inside the field of view (FOV), or an estimate of the spatial extension of the target anatomical structure outside the boundaries of the input image. If the first image file is a 3D image file, the input to the machine learning model is a 2D slice extracted from the 3D image file.

[0126] Suitable machine learning algorithms used in the present invention will be apparent to those skilled in the art. Examples of suitable machine learning algorithms include decision tree algorithms and artificial neural networks. Other machine learning algorithms such as logistic regression, support vector machines, or naive Bayesian models are suitable alternatives.

[0127] In a preferred example, a deep learning-based artificial neural network is used.

[0128] The structure of artificial neural networks (or simply neural networks) is inspired by the human brain. A neural network consists of layers, each containing multiple neurons. Each neuron performs a mathematical operation. Specifically, each neuron contains different weighted combinations of a single type of transformation (e.g., the same type of transformation, such as a sigmoid, but with different weights). In the process of processing input data, the mathematical operations of each neuron are performed on the input data to generate a numerical output, and the output of each layer of the neural network is sequentially fed to the next layer. The final layer provides the output.

[0129] The method for training machine learning algorithms is well known. Typically, such a method involves the step of obtaining a training dataset containing training input data entries and corresponding training output data entries. An initialized machine learning algorithm is applied to each input data entry to generate predicted output data entries. The error between the predicted output data entries and the corresponding training output data entries is used to refine the machine learning algorithm. This process can be repeated until the errors converge and the predicted output data entries are sufficiently similar to the training output data entries (e.g., ±1%). This is generally known as a supervised learning technique.

[0130] For example, if a machine learning algorithm is formed from a neural network, the mathematical operations (or their weightings) of each neuron are modified until the error converges. Known methods for modifying neural networks include gradient descent and backpropagation algorithms.

[0131] The training input data entries correspond to exemplary cropped images of the target anatomical structures discussed above. The training output data entries correspond to annotated, segmented, full versions of the cropped images.

[0132] Therefore, deep learning-based image segmentation techniques can be used to estimate the missing anatomical range. Known image segmentation methods are typically limited to segmenting anatomical structures within a given image FOV, so the method proposed herein differs from known image segmentation methods. In the embodiments proposed herein, segmentation of partially missing anatomical structures is derived, and this segmentation can be extended beyond the image boundary. This allows for the generation of an estimated range of the missing anatomical structures, and the proposed adjustments to the imaging FOV are derived.

[0133] Those skilled in the art are aware of numerous specific architectures suitable for the purposes described above. Exemplary examples include deep learning-based image segmentation methods such as the U-Net architecture or the Foveal-Net architecture. Further examples include deep learning-based object detection methods such as Mask R-CNN or RetinaNet. Such networks can be trained end-to-end and integrated into systems requiring fewer computational resources, even running on a standard desktop CPU.

[0134] For details of the U-Net segmentation network architecture, see, for example, the following paper by O. Ronneberger, P. Fischer, and T. Brox, "U-Net: Convolutional Networks for Biomedical Image Segmentation," arXiv:1505.04597[cs], May 2015.

[0135] Details of the Foveal-Net segmentation network architecture can be found, for example, in the following paper, "Foveal fully convolutional nets for multi-organ segmentation" by Brosch, T. and Saalbach, A., in Medical Imaging 2018: Image Processing, Angelini, ED and Landman, BA, eds., 10574, 198-206, International Society for Optics and Photonics, SPIE (2018).

[0136] Details of the Mask R-CNN architecture can be found in the following paper, "Mask R-CNN" by Kaiming He, Georgia Gkioxari, Piotr Dollar, and Ross Girshick, arXiv eprint 1703.06870, 2017.

[0137] Details of the RetinaNet model architecture can be found in the following paper, Focal Loss for Dense Object Detection by Tsung-Yi Lin, Priya Goyal, Ross Girshick, Kaiming He, and Piotr Dollar, arXiv eprint 1708.02002, 2017.

[0138] For further illustration and explanation, we outline here an example of developing a machine learning model for use according to one or more embodiments for segmentation of anatomical structures outside the imaging FOV. This model utilizes an architecture known as F-Net. Like the U-Net architecture described above, F-Net uses a multi-resolution technique while combining features at multiple scales. However, while the U-Net model uses an encoder with a continuous set of filters, the F-Net model replaces the continuous filters in the encoder with filters that operate at different image resolutions, thus resulting in a reduced number of neural network parameters. Image segmentation is achieved by sequentially segmenting non-overlapping 3D patches, which are then segmented by feeding in larger patches that overlap at coarser scales to integrate contextual features. Features are extracted at each of the multiple resolution levels using a case-based inference (CBR) block consisting of convolutional layers, batch normalization, and a rectified linear activation function. The coarser-resolution feature maps are upsampled and integrated using CBR blocks, except for the finest levels, where a softmax layer follows a convolutional layer to obtain voxel-level class probabilities.

[0139] During the training phase, the network was presented with training data containing multiple cropped images of the target anatomical structure, as discussed above, along with voxel-specific annotations providing ground truth. While low-level features such as intensity or texture convey the least relevant information for segmentation purposes, it was investigated whether high-level contextual features extracted at multiple resolution levels (as described above) could assist the network in learning how far the anatomical structure extended beyond a given FOV.

[0140] Using such a network trained on specific anatomical structures and given test images, probability maps were obtained and processed to generate binary segmentation masks using optimal thresholds calculated on the training dataset.

[0141] Finally, for evaluation and visualization purposes, bounding boxes tightly containing the binary segmentation mask were extracted. The method was evaluated in terms of range detection error, calculated as the distance between the uppermost or lowermost voxel in the GT and the network prediction, depending on the direction in which the anatomical structure was clipped.

[0142] In the example discussed above, the machine learning algorithm produces output in the form of estimated extensions of anatomical structures beyond the boundaries of image frames. Additionally or alternatively, in further examples, the coverage check procedure uses a machine learning algorithm adapted to provide a binary classification of whether the target anatomical structure is completely covered by the first image data or contained within the first image data. As discussed above, the user interface is controlled to provide user output indicating this decision. Various different options regarding the interaction between the system and the user after a negative coverage check have already been discussed above.

[0143] Furthermore, while the examples discussed above referred to deep learning-based artificial neural networks, other types of machine learning algorithms, such as box regression algorithms, can also be used.

[0144] Furthermore, using machine learning algorithms for the purpose of performing coverage checks is not mandatory. In other examples, model-based segmentation can be used to achieve segmentation of anatomical structures within the first image data. From the segmentation results, it can be determined whether the entirety of the target anatomical structure is covered in the first FOV. Those skilled in the art are familiar with numerous model-based segmentation methods that use classical algorithmic techniques such as shape-based object detection. Another possible method for performing coverage checks is to perform mapping of the first image data to a probabilistic anatomical atlas. An example of this method is described, for example, in the following paper, "Annotation-free probabilistic atlas learning for robust anatomy detection in CT images" by Astrid Franz et al., Proc.SPIE9413, Medical Imaging 2015:Image processing, 941338 (March 20, 2015).

[0145] Anatomical image analysis and coverage checks can be performed as separate steps, or both can be performed by a single algorithm or model. For example, a machine learning model can be trained to receive first image data as input and produce coverage check results as output, with anatomical image analysis (e.g., segmentation) being performed as an integral part of the analysis achieved by the model. In another example, it is possible to use a first algorithm or model that performs segmentation, whose output is the anatomical segmentation of the first image data, and a second algorithm or model whose output is the result of a coverage check, the result of which can be a binary classification (covered or not covered) or an indication of the extension of anatomical structures beyond the first FOV in one or more dimensions.

[0146] It is also possible to train a single multitask network with two outputs: one output is segmentation, which indicates, for example, the extent of anatomical structures that extend beyond the field of view (FOV), and the other output is a binary classification indicating whether the anatomical structure is covered or not.

[0147] In addition to or alternative to the various features outlined above, according to one or more embodiments, the method further comprises the step of applying a coverage check operation to the acquired second image data. The user interface is controlled to display the results of this further coverage check. This can be applied, for example, to only a subset of the second image data, or to only one or more image slices from the second image data. This check can be performed as a precautionary measure so that if some of the target anatomical structure is still missed in one or more of the image frames (for example, because the patient shifted position during the scan), acquisition can be repeated before the subject leaves, saving time to reschedule further imaging scans.

[0148] For example, in the context of CT imaging, in a typical imaging workflow, after acquiring the diagnostic CT image (i.e., the second image data), each 2D slice is displayed on the user interface screen as a preview image. Therefore, a coverage check operation can be applied to these 2D preview images to investigate whether the anatomical structure of the target to be imaged is contained within the FOV. In the case of any image that yields a negative coverage check result, a warning is generated using the user interface, optionally along with proposed adjustments to the scan protocol, such as the start and end positions of the scan range, to ensure that the target anatomical structure is contained within the FOV. Then, a new diagnostic image can be acquired before releasing the patient, thus avoiding the need to call the patient back.

[0149] A further aspect of the present invention provides a computer program product comprising a code means configured, when executed by a processor, to cause the processor to be operably coupled to a medical imaging device and to cause the processor to perform a method according to any of the methods outlined in this disclosure.

[0150] The embodiments of the present invention described above utilize a processing device. The processing device generally comprises one or more processors. The processing device may be located within a single housing device, structure, or unit, or it may be distributed across multiple different devices, structures, or units. Therefore, any reference to a processing device being adapted or configured to perform a particular step or task corresponds to that the step or task being performed, either alone or in combination, by any one or more of the processing components. Those skilled in the art will understand how distributed processing devices can be realized. The processing device includes a communication module or input / output for receiving data and outputting data to further components.

[0151] One or more processors in a processing device can be implemented in various ways using software and / or hardware to perform various required functions. Typically, a processor uses one or more microprocessors programmed using software (e.g., microcode) to perform the required functions. A processor is implemented as a combination of dedicated hardware for performing some functions and one or more programmed microprocessors and associated circuits for performing other functions.

[0152] Examples of circuits used in various embodiments of this disclosure include, but are not limited to, conventional microprocessors, application-specific integrated circuits (ASICs), and field-programmable gate arrays (FPGAs).

[0153] In various implementations, a processor is associated with one or more storage media, such as volatile and non-volatile computer memory, including RAM, PROM, EPROM, and EEPROM (registered trademarks). When executed by one or more processors and / or controllers, the storage media are encoded with one or more programs that perform the necessary functions. Various storage media can be fixed within the processor or controller, or they can be portable, so that the one or more programs stored therein can be loaded into the processor.

[0154] Modifications of the disclosed embodiments can be understood and implemented by those skilled in the art who practice the claimed invention, based on a review of the drawings, disclosures, and appended claims. In the claims, the word “including” does not exclude other elements or steps, and singular elements do not exclude plural elements.

[0155] A single processor or other unit performs the functions of several items listed in the claims.

[0156] The mere fact that certain means are enumerated in different dependent claims does not indicate that combinations of these means cannot be used advantageously.

[0157] Computer programs are stored / distributed on appropriate media such as optical or solid-state media supplied together with or as part of other hardware, but they are also distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.

[0158] When the term "conforms to" is used in the claims or description, it should be noted that the term "conforms to" is intended to be equivalent to the term "composed of."

[0159] Any reference numeral in the claims should not be construed as limiting the scope.

Claims

1. A step of receiving first image data of a patient's anatomical structure from a medical imaging device, wherein the first image data is 2D or 3D image data, the first image data is data acquired according to a first scan protocol which includes a first set of scan parameters of the medical imaging device, and the first scan protocol is for acquiring image data covering a first FOV. The steps include applying anatomical image analysis to the first image data in order to detect at least a portion of the anatomical structure of a defined target within the image data, The steps include performing a coverage check, which involves determining from the image analysis whether the anatomical structure of the defined target extends beyond at least one boundary of the first FOV, The steps include generating a data representation of the results of the coverage check, A step of determining a second scan protocol that defines a second set of scan parameters of the imaging device, wherein the second scan protocol is for acquiring image data covering a second FOV, and the second FOV is the same as or different from the first FOV. A step of controlling the user interface to display instructions for the results of the coverage check, A step of receiving user input from the user interface following the display of the coverage check, wherein the second FOV of the second scan protocol is determined depending on the user input. A step of acquiring second image data of the patient's anatomical structure according to the second scan protocol, wherein the second image data covers the second FOV and the second image data is 2D or 3D image data. A computer implementation method having the following characteristics.

2. The method according to claim 1, wherein the data representation of the result of the coverage check is communicated to a data store for storing the result of the coverage check, and the second image data is associated with the result of the coverage check and stored in the same or a different data store.

3. The method described above is A step in which, in response to a negative result of the coverage check, a proposed adjustment to the first scan protocol is determined to obtain an extended FOV, wherein the proposed adjustment is based on the anatomical image analysis, The steps include configuring the second scan protocol according to the proposed adjusted first scan protocol so that the second FOV is configured as the extended FOV, or Steps to communicate the proposed adjustments to the first scan protocol and / or the proposed extended FOV to the user interface. One of the steps and The method according to claim 1, further comprising:

4. The method according to any one of claims 1 to 3, further comprising the step of applying the anatomical image analysis to estimate the spatial extension of the target's anatomical structure beyond at least one boundary of the first FOV, and optionally further comprising the step of controlling a user interface to display a visual representation of the spatial extension.

5. The coverage check includes determining a proposed adjustment to the first scan protocol to obtain an extended FOV that fully covers the anatomical structure of the target, based on the spatial extension of the anatomical structure of the target beyond the first FOV. Optionally, the second scan protocol is determined to configure the second FOV as the extended FOV. The method according to claim 4.

6. Steps include controlling a user interface to display the proposed adjustments to the first scan protocol and / or the proposed extended FOV representation, The steps include generating a prompt on the user interface requesting user approval, The steps include receiving user input indicating approval or disapproval from the user interface, The steps include: acquiring a second image data over the extended FOV in accordance with the proposed adjusted scan protocol, in response only to the receipt of user input indicating approval; The method according to claim 5, having the following characteristics.

7. The steps include controlling the user interface to display the proposed extended FOV visual representation for a rendered view of the first image data, The steps include controlling the user interface to generate a prompt for user input indicating approval of the proposed extended FOV, or a prompt for user input indicating modification to the proposed extended FOV, through user control operations; In response to receiving user authorization from the user interface, the step of determining the second scan protocol such that the second FOV is set as the extended FOV, or A step of determining the second scan protocol such that the second FOV is set as a user-modified FOV, wherein the user-modified FOV is defined based on received user input indicating a modification to the extended FOV. The method according to claim 5, further comprising the above.

8. The method according to any one of claims 5 to 7, wherein the step of estimating the spatial extension of the anatomical structure of the target outside the first FOV includes the step of estimating the contour of the boundary of at least a portion of the anatomical structure of the target outside the first FOV, and the method further includes the step of generating a visual representation of the contour for the first image data on a user interface display.

9. The method according to any one of claims 1 to 8, wherein the scan parameters of the first and second scan protocols include a scan range boundary along at least one scan axis of the medical imaging device, and the first FOV and the second FOV are each at least partially defined by the scan range boundary.

10. The aforementioned data representation is communicated to a data store for storing the results of the coverage check. The method further comprises the step of performing a quality evaluation, which includes the step of deriving a quality index of the acquired second image data based on the results of the coverage check associated with the image data. The method according to any one of claims 1 to 9.

11. Performing the aforementioned coverage check includes applying a machine learning model, and the machine learning model is It receives image data representing only a part of an anatomical object as input. The system generates an output of an estimated value of at least the dimensional range of the remaining portion of the anatomical object outside the field of the image data, and / or The system generates an estimated value as output of the boundary of the remaining portion of the anatomical object outside the field of the image data. The method according to any one of claims 1 to 10.

12. The aforementioned machine learning model, A first data input for the model, including a cropped image of the anatomical structure in which part of the image has been removed so that the image shows only a portion of the anatomical object, Ground truth for the model, including at least per-voxel anatomical labeling for voxels in a second uncropped version of the image showing the whole of the anatomical object. Each is trained using training data entries that include the following: The method according to claim 11.

13. A computer program comprising coding means configured to, when executed by a processor, operably coupled to a medical imaging device, and to cause the processor to perform the method according to any one of claims 1 to 12.

14. Inputs / outputs for connecting to a medical imaging device during use, It comprises one or more processors, and the one or more processors In the aforementioned input / output, the system receives first image data of the patient's anatomical structure from the medical imaging device, wherein the first image data is 2D or 3D image data, the first image data is data acquired according to a first scan protocol including a first set of scan parameters of the imaging device, and the first scan protocol is for acquiring image data covering a first FOV. Applying anatomical image analysis to the first image data in order to detect at least a portion of the anatomical structure of a defined target within the image data, Performing a coverage check, which includes determining from the image analysis whether the anatomical structure of the defined target crosses at least one boundary of the first FOV, To generate a data representation of the results of the coverage check, Determining a second scan protocol that defines a second set of scan parameters for the imaging device, wherein the second scan protocol is for acquiring image data covering a second FOV, and the second FOV is the same as or different from the first FOV. Controlling the user interface to display instructions for the results of the coverage check, The process involves receiving user input from the user interface following the display of the coverage check, wherein the second FOV of the second scan protocol is determined depending on the user input. In the input / output, a control signal is output to control the imaging device to acquire second image data of the patient's anatomical structure according to the second scan protocol, wherein the second image data covers the second FOV and the second image data is 2D or 3D image data. Adapted to perform, Processing equipment.

15. Medical imaging equipment and The processing apparatus described in claim 14 and A system equipped with these features.

Images