Method for providing feedback data in a medical imaging system

Abstract

A method for providing feedback data in a medical imaging system for a medical imaging process, comprising the steps of providing (S10) a simulation model trained to predict the appearance of a medical image acquired by using the medical imaging system 22 from a relationship between subject positioning data related to an acquired positioning of a subject 27, medical device positioning data related to an acquired positioning of at least one medical care and / or monitoring device 28, 30 placed in or at the subject 27 in the medical imaging system 22, and medical image data related to the subject positioning data and the medical device positioning data, by the computation means; The method includes the steps of: acquiring (S20) data and current medical device positioning data of at least one medical care and / or monitoring device 28, 30 positioned relative to a subject 27 in a medical imaging system; determining (S30) feedback data by a calculation unit by supplying the acquired current subject positioning data and the acquired current medical device positioning data to a simulation model that outputs feedback data, the feedback data including at least simulated medical image data predicted by the simulation model from the acquired current subject positioning data and the current medical device positioning data; and providing (S40) the feedback data by a providing unit.

Description

Technical Field

[0001] The present invention relates to a method for providing feedback data in a medical imaging system for a medical imaging process, an apparatus or system for providing feedback data in a medical imaging system for a medical imaging process, the use of an optical measurement unit and / or a pressure-based measurement unit in such an apparatus, and a computer program.

Background Art

[0002] Medical imaging is an important issue in medical diagnosis. There are several commercially available medical imaging systems such as X-ray, MRT, CT, etc. These medical imaging systems are state-of-the-art and thus well-known.

Summary of the Invention

Problems to be Solved by the Invention

[0003] The quality of medical images obtained by such medical imaging systems depends, inter alia, on the quality of the preparation of the medical imaging process. If the quality of the medical images is insufficient, medical imaging may have to be repeated, or, even worse, an incorrect medical diagnosis may be derived from the medical images. In short, this can lead to an increase in the cost of medical imaging, an incorrect medical diagnosis, and a degradation of the image quality.

[0004] Therefore, in medical imaging, it may be necessary to provide feedback, particularly in the preparation phase of medical imaging.

Means for Solving the Problems

[0005] The object of the present invention is solved by the subject matter of the independent claims, and further embodiments are incorporated in the dependent claims.

[0006] According to a first aspect, a method is provided for providing feedback data in a medical imaging system for a medical imaging process. The method includes the steps of: providing a computational unit with a simulation model trained to describe the relationship between positioning data of a subject, positioning data of at least one medical device placed relative to the subject in the medical imaging system, and simulated image data obtained from the positioning data; acquiring the positioning data of a subject and positioning data of at least one medical device placed relative to the subject in the medical imaging system from at least one measuring means, by the computational unit; determining feedback data by utilizing a simulation model and the acquired positioning data supplied to the simulation model, wherein the feedback data comprises at least simulated image data obtained from the acquired positioning data; and providing the feedback data by a providing unit.

[0007] In other words, the method provides a simulation model trained by a computing unit to predict the appearance of medical images acquired by using a medical imaging system based on the relationship between subject positioning data related to the positioning of the subject, medical device positioning data related to the positioning of at least one medical care and / or monitoring device placed in or at the subject in the medical imaging system, and optionally simulated medical image data related to the subject positioning data and the medical device positioning data; and the computing unit provides a simulation model trained to predict the appearance of medical images acquired by using a medical imaging system based on the current subject positioning data of the subject and the positioning of at least one medical care and / or monitoring device placed in or at the subject in the medical imaging system. The process includes: acquiring current medical device positioning data of at least one medical care and / or monitoring device located at a location from at least one measuring means; determining feedback data by supplying the acquired current subject positioning data and the acquired current medical device positioning data to a simulation model for processing using a calculation unit, wherein the feedback data comprises simulated medical image data predicted by the simulation model from at least the acquired current subject positioning data and the current medical device positioning data; and providing the feedback data using a providing unit.

[0008] The term "feedback data" as used herein should be understood broadly to refer to any information configured to describe a medical imaging process. Feedback data may consider any phase of a medical imaging process, such as a preparation phase, execution phase, or acquisition phase, and a follow-up phase, in which the subject is prepared before the actual image acquisition phase. Feedback data may include quality measures relating to the medical imaging process that reveal whether the medical imaging process is under actual settings (i.e., positioning data, exposure data, etc.) that result in sufficient quality, particularly good image quality, or under actual settings (i.e., positioning data, exposure data, etc.) that result in medical images of insufficient quality. Feedback data may include processing parameters that describe the medical imaging process (e.g., positioning data, medical imaging system settings). In at least some embodiments, feedback data may include predictions of images, particularly medical images such as X-ray images, MR image data, and CT image data, that would be acquired under actual imaging conditions (e.g., medical imaging system settings, positioning data, and type or class of medical care and / or monitoring equipment). Feedback data may also include simulated image data.

[0009] The term "medical imaging system" as used herein should be understood broadly and relating to any medical imaging system configured to acquire medical images of a subject. A medical imaging system may be an X-ray system, an MRT system, or a CT system. A medical imaging system may include a medical imaging unit, a control unit, a support structure configured to position the subject to be imaged (e.g., a bed), a display configured to display information (e.g., feedback data), and / or measuring means.

[0010] The term "computational unit" as used herein should be understood broadly and refers to a system configured to run a simulation model. A computational unit may be a hardware unit (e.g., a CPU, workstation, etc.) or a virtual unit (e.g., a virtual machine, software, etc.).

[0011] The term "simulation model" as used herein should be understood broadly to refer to any computational model configured to be trained, for example, by corresponding training data, in order to describe, at least, the relationship between subject positioning data of a subject of medical care and / or monitoring equipment and corresponding medical image data (optionally simulated medical image data), particularly the relationship. A simulation model may be based on a neural network, a deep learning algorithm, or more generally, a machine learning algorithm. A simulation model may be trained by providing measured positioning data as input and corresponding images of the subject actually acquired simultaneously, in particular medical images, as output. The training data may optionally be annotated, labeled, etc. A simulation model may be trained or retrained sequentially. A simulation model may be used to predict the appearance of images acquired under given imaging conditions, in particular medical images such as X-ray images and MR images. A simulation model may be an entity that processes one or more inputs and produces one or more outputs, typically by an internal processing chain having a set of free parameters. The internal processing chain can be comprised of interconnected layers that are continuously traversed as processing proceeds from input to output. In this example, inputs may be subject positioning data, medical care and / or monitoring equipment, medical imaging systems, and exposure data, while outputs may be simulated medical images. The simulation model can be trained using recordings of training data. These recordings include training input data and corresponding training output data. The training output data for a record of training data is the expected result that the simulation model would produce given the same record of training data as training input data. The deviation between this expected result and the actual result produced by the simulation model is observed and evaluated by a “loss function”.This loss function is used as feedback to adjust the parameters of the module's internal processing chain. For example, the parameters can be adjusted with the optimization goal of minimizing the value of the loss function that would occur if all training input data were fed into the module and the results were compared to the corresponding training output data. The result of this training is that, given a relatively small number of records of training data as "ground truth," the simulation model is able to perform its job to provide feedback data, particularly simulated medical images.

[0012] In this example, the term "positioning data" refers to spatial data of one or more central points (i.e., skeletal joint centers or keypoints) of the subject and / or medical care and / or monitoring equipment, as well as spatial data of one or more contour points of the subject and / or medical care and / or monitoring equipment. The positioning data may preferably be related to the coordinate system of the medical imaging system.

[0013] The term "subject" as used herein should be understood broadly and relating to any part of a human or animal. A subject may include bone (e.g., knee), tissue and / or organ (e.g., heart, brain).

[0014] As used herein, the term “medical care and / or monitoring equipment” should be understood broadly and relating to equipment configured to provide medical assistance to a subject (e.g., tubes, lines, etc.) or any equipment used for medical imaging (e.g., support structures for positioning parts of a subject: medical weights or medical expansion devices). For example, medical care and / or monitoring equipment can be configured to be directly incorporated into a subject, such as by contacting the subject or being inserted into the subject at least partially. Medical care and / or monitoring equipment can be used to provide medical assistance to a subject, such as medication, infusion, or oxygen, and / or to monitor vital parameters of a subject, such as heart rate measurement or oxygen measurement. Due to its material and / or its position relative to the subject and / or medical imaging system, medical care and / or monitoring equipment may interfere with the beam path during image acquisition.

[0015] The term "measuring means" as used herein should be understood broadly and relating to any means configured to determine positioning data of a subject and / or medical care and / or monitoring equipment. The term "measuring means" may include optical measuring units, tactile measuring units, pressure-based measuring units, and internal measuring units of imaging systems (e.g., encoders in the drive units of medical imaging systems).

[0016] The term "simulated image data," as used herein, means a simulation of an image that would be acquired using a medical imaging system under measured imaging settings. A simulated image may be essentially identical to a real image acquired without specific features of the subject (e.g., an unknown tumor, deviations from normal bone structure, etc.). It should be noted that simulated image data is not intended to replace an actually acquired medical image of the subject; rather, it should assist the technician in determining whether the imaging settings are appropriate for actually acquiring a reasonable medical image of the subject.

[0017] This invention is based on the understanding that the quality of medical images is crucial for follow-up diagnosis of medical images. For example, in X-ray imaging positioning, the subject or medical care and / or monitoring equipment presents a serious challenge for optimal diagnostic values ​​of the resulting images. For instance, bedside chest radiography (CXR) is an essential diagnostic tool for monitoring critically ill patients in the intensive care unit (ICU). CXR often reveals abnormalities that may not be clinically detectable. Furthermore, bedside CXR is an irreplaceable tool for detecting misplaced tubes and lines and identifying associated complications. Another example is chest radiography screening, where it is often difficult to assess the location and spatial extent of the lungs. Yet another example is mammography, where it is often difficult to achieve a complete field of view extending to the chest wall.

[0018] Many factors affect the quality of medical images, including positioning data of the subject and / or medical care and / or monitoring equipment and medical imaging systems, particularly the alignment of the subject, medical care and / or monitoring equipment and medical imaging systems with respect to each other. For example, the position of essential medical care and / or monitoring equipment (e.g., breathing tubes, infusion tubes, etc.) can negatively impact the quality of medical images depending on their material and / or position relative to the subject and / or medical imaging system (e.g., medical care and / or monitoring equipment may obscure organs, or it may be unclear in the resulting image which parts of the medical image belong to the subject and which belong to the medical care and / or monitoring equipment), and therefore should be adjusted. When a subject is in an intensive care unit (ICU) bed, medical care and / or monitoring equipment may be essential. For diagnostic purposes, it is important to know whether the medical care and / or monitoring equipment is inside or outside the subject. Therefore, technicians preparing the medical imaging process for a subject have a significant influence on the quality of medical images by adjusting the positioning data of the medical imaging system. To evaluate the impact of positioning data, it is important to provide feedback data to the technician, especially simulated images derived from the positioning data. Based on the feedback data of the simulated image morphology, the technician can directly assess whether the image quality may be sufficient with respect to the current positioning data and / or whether adjustment of the current positioning data may be necessary. This can favorably improve image quality and the efficiency of the medical imaging process, as fewer repetitions are required to avoid images with insufficient image quality. Furthermore, in the case of X-ray imaging, the subject may receive only a small amount of X-ray radiation because repeated medical imaging is not required.

[0019] In other words, the method described herein proposes to provide technicians with feedback, particularly visual feedback, regarding the current positioning of a subject and / or equipment. This is done, for example, by simulating medical images, such as X-ray images, that would be produced if medical images were taken under the current circumstances. Thus, the method can be performed without radiation, i.e., without using an actual medical imaging system. From the simulated medical images, the technician can infer whether the subject, particularly the anatomical structure of interest, is optimally imaged by the medical imaging system, i.e., whether it is fully, optimally positioned, and accurately exposed, for example, without overlapping X-ray shadows from medical care and / or monitoring equipment. The simulated medical images can be generated by a software processor using input measuring means such as a video camera, pressure sensors for the position of the subject and / or the position of the medical care and / or monitoring equipment, input from the medical imaging system regarding exposure settings (e.g., source position, detector, etc.), and cataloged knowledge of the medical image characteristics of the medical care and / or monitoring equipment. Cataloged knowledge can, for example, show how an X-ray image would look if medical care and / or monitoring equipment, such as venous lines, were in a specific location and size. Confusion regarding internal / external medical care and / or monitoring equipment is mitigated by this method because external medical care and / or monitoring equipment can be picked up by camera sensors and labeled as such on the simulated X-ray image. Radiologists can then simply compare the labeled simulated image with the actual X-ray image they are interpreting.

[0020] According to one embodiment, a medical care and / or monitoring device may have one or more medical care means configured to provide medical care to a subject. As used herein, medical care means the supply of a substance (e.g., saline solution, oxygen) or the observation of a health function (e.g., measuring electrodes). The medical care and / or monitoring device may be important to the subject and therefore cannot be removed from the subject. Therefore, it may be advantageous to predict the effects of the medical care and / or monitoring device by using simulated image data and taking into account the positioning data of the medical care and / or monitoring device. Furthermore, it may be advantageous to label the identified medical care and / or monitoring device within the simulated image to provide information for subsequent diagnosis using actually obtained medical images.

[0021] According to one embodiment, the medical care and / or monitoring device may have one or more of the following: a venous line, a chest tube, a tracheal tube, a nasogastric tube, an intra-aortic balloon pump, and a catheter.

[0022] According to one embodiment, at least one measuring means may include an optical measuring unit. The optical measuring unit may be a range camera, an optical camera, a laser, or an optical sensor. The optical measuring unit may be located adjacent to or within a medical imaging system. The optical measuring unit may be part of a medical imaging system. The optical measuring unit may be wired (e.g., Ethernet, Profibus, etc.) and / or wireless (e.g., Wi-Fi) to a computing unit. Optical measurement of positioning data can be advantageously efficient in reliably determining positioning data in the visible area of ​​a subject and / or medical care and / or monitoring equipment. The optical measuring means can be advantageously used in combination with other measuring means (e.g., pressure-based measuring means) to cross-check the obtained positioning data.

[0023] According to one embodiment, at least one measuring means may include a pressure-based measuring unit, which is positioned beneath the subject. The pressure-based measuring unit may be a capacitive pressure sensor, an inductive pressure sensor, a Hall effect-based pressure sensor, or a piezoelectric pressure sensor. The pressure-based measuring unit is connected to a computing unit via a wired (e.g., Ethernet, Profibus, etc.) and / or wireless (e.g., Wi-Fi) connection. The pressure-based measuring unit may be mounted beneath the subject on the surface of a support structure (e.g., a bed), with the subject lying on the support structure. If the subject lies on medical care and / or monitoring equipment (e.g., intravenous lines, tubes, etc.), which is invisible, it increases the pressure beneath the medical care and / or monitoring equipment measured by the measuring unit mounted on the support structure. Thus, it is advantageously possible to identify positioning data of invisible medical care and / or monitoring equipment.

[0024] According to one embodiment, the simulation model may further consider exposure data from a medical imaging system. As used herein, the term "exposure data" should be understood broadly and relating to configuration data of a medical imaging system. The term "exposure data" may include collimator aperture width, imaging source voltage values, imaging source positioning data, and imaging detector. Preferably, the exposure data may include X-ray source voltage values. This may be advantageous for accurately simulating the resulting medical image.

[0025] According to one embodiment, the simulated image data can include one or more simulated X-ray images of a subject and at least one healthcare and / or monitoring device, and the at least one healthcare and / or monitoring device is disposed inside and / or outside the subject. This can be advantageous for evaluating whether the healthcare and / or monitoring device affects the quality of the medical image due to its positioning data. This can be further advantageous for distinguishing whether the healthcare and / or monitoring device is inside the subject and / or outside the subject.

[0026] According to one embodiment, the simulation model may further be based on a parametric anatomical model, which describes the relationship between one or more characteristics of the subject and the corresponding morphology of the subject's body, and the characteristics include geometric characteristics and biological characteristics. The parametric anatomical model may be a general anatomical model including at least a geometric model of the human body surface and the corresponding position of the lungs. The parametric anatomical model can be parameterized by characteristics such as the patient's size, the patient's weight, the patient's BMI, lung volume, age, and / or gender. The characteristics can be measured for each subject or simply input into the parametric anatomical model to enable accurate modeling of the individual characteristics of the subject. This can be advantageous for providing accurate feedback information, particularly accurate simulation images.

[0027] According to one embodiment, the feedback data may further include guidance data configured to guide personnel to adapt positioning data and / or exposure data. The method can determine the target and actual quality of the simulated image. Based on the difference between the target and actual quality, the method can determine the guidance data to be used to adapt the positioning data and / or exposure data. The guidance data may be presented to the technician on a display. The simulation model can be trained to recognize the target quality by human input and / or a software evaluator. The guidance data may be continuously updated as a new simulated image is determined. For example, if the lower part of the lung is clipped, the guidance data may include a graphic or text indication that the detector should be lowered. This can be done equivalently for all other directions of positional defects. This may be advantageous in terms of efficiency and quality.

[0028] According to one embodiment, the method may be performed in a preparation phase before the actual medical imaging process, in which case feedback data is provided during the preparation phase and the simulated image is continuously updated based on the acquired positioning data. This can be advantageous as medical images of insufficient quality are not taken, thereby reducing the radiation dose and / or unnecessary work. In other words, the simulation model enables verification of the quality of the medical images to be acquired in the preparation phase without using a medical imaging device, i.e., without using radiation. The continuously updated simulated image may enable the technician to continuously check whether the positioning data and / or exposure data are sufficient or need to be adapted. This can increase efficiency. When the technician adapts the position of the subject or the detector, e.g., an X-ray detector, the simulated image is updated accordingly. The technician can correct the position of the subject until the simulated image meets the expected quality criteria (e.g., the organ is included in the field of view, the at-risk organ is excluded, and external foreign objects do not obstruct the field of view). Once this is achieved, a medical image, e.g., an X-ray image, is acquired.

[0029] According to one embodiment, the medical system is an X-ray system, and the positioning data includes the position of the subject, the X-ray detector, the X-ray source, as well as medical care and / or monitoring devices.

[0030] Further embodiments relate to an apparatus for providing feedback data in a medical imaging system for a medical imaging process, comprising: a providing unit configured to provide a simulation model trained to describe the relationship between positioning data of a subject, positioning data of at least one medical care and / or monitoring device positioned relative to the subject in the medical imaging system, and simulated image data obtained from the positioning data; an acquisition unit configured to acquire positioning data of a subject and positioning data of at least one medical care and / or monitoring device positioned relative to the subject in the medical imaging system from at least one measuring means; a determination unit configured to determine feedback data using a simulation model and acquired positioning data supplied to the simulation model, wherein the feedback data comprises at least simulated image data obtained from the acquired positioning data; and the providing unit providing the feedback data. The first providing unit, the second providing unit, the acquisition unit, and the determination unit may each be separate hardware units or may be implemented in a single hardware unit. Hardware units can be CPUs, PLCs, FPGAs, microcontrollers, or workstations. Furthermore, the first providing unit, the second providing unit, the acquisition unit, and the decision unit may be virtual units operating on a CPU, cloud server, etc. Generally, the first providing unit, the second providing unit, the acquisition unit, and the decision unit relate to computing units.

[0031] A further embodiment relates to a system comprising the above-described apparatus and a medical imaging system. The medical imaging system may be an X-ray system, an MRT system, or a CT system.

[0032] A further embodiment relates to the use of an optical measurement unit and / or a pressure-based measurement unit in the apparatus described above for acquiring positioning data of a subject and positioning data of at least one medical care and / or monitoring device positioned relative to the subject. The optical measurement unit may be a range camera, an optical camera, a laser, or an optical sensor. The pressure-based measurement unit may be a capacitive pressure sensor, an inductive pressure sensor, a Hall effect-based pressure sensor, or a piezoelectric pressure sensor.

[0033] The final aspect relates to a computer program element configured to perform the steps of the method described above when executed by a processor. The processor may be part of a medical imaging system or may be separately provided in another computer device. The computer program element may be stored in a computer unit which may be part of this embodiment. This computing unit may be configured to perform or trigger the steps of the method described above. Furthermore, it may be configured to operate the components of the device described above. The computing unit may be configured to operate automatically and / or to execute user instructions. The computer program may be loaded into the working memory of a data processor. Thus, the data processor may be configured to perform the method according to one of the embodiments described above. This exemplary embodiment of the present invention encompasses both computer programs that use the present invention from the outset and computer programs that, through updates, transform existing programs into programs that use the present invention. Furthermore, the computer program element may provide all the steps necessary to perform the procedure of the exemplary embodiment of the method described above. According to a further exemplary embodiment of the present invention, a computer-readable medium such as a CD-ROM or USB stick is presented, and the computer-readable medium has a computer program element stored thereon, which is described in the previous section. Computer programs may be stored and / or distributed on suitable media such as optical or solid-state media supplied together with or as part of other hardware, but they may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems. However, computer programs may also be presented on a network such as the World Wide Web and downloaded from such a network into the working memory of a data processor.According to a further exemplary embodiment of the present invention, a medium is provided for making a computer program element available for download, and this computer program element is configured to perform a method according to one of the above-described embodiments of the present invention.

[0034] It should be noted that the embodiments described above can be combined with each other, regardless of the aspect involved. Therefore, the method may be combined with the structural features of other embodiments of apparatus and / or systems, and similarly, apparatus and systems may be combined with each other's features, as well as with the features described above with respect to the method.

[0035] These and other aspects of the present invention will become apparent from and be explained with reference to the embodiments described below.

[0036] Hereinafter, embodiments of the present invention will be described based on the drawings. [Brief explanation of the drawing]

[0037] [Figure 1] A schematic diagram of the apparatus according to the first embodiment of this disclosure. [Figure 2] A flowchart of an apparatus according to another embodiment of the present disclosure. [Figure 3] A schematic diagram of an apparatus according to another embodiment of the present disclosure. [Modes for carrying out the invention]

[0038] Figure 1 shows a schematic diagram of apparatus 10 according to a first embodiment of the present disclosure. Apparatus 10 is configured to provide feedback data in a medical imaging system for a medical imaging process.

[0039] The apparatus 10 has a first providing unit 11 configured to provide a simulation model trained to describe the relationship between positioning data of a subject, positioning data of at least one medical care and / or monitoring device positioned relative to the subject in a medical imaging system, and (optionally simulated) medical image data related to and / or derived from the positioning data. The simulation model may be based on a deep learning algorithm. The simulation model is trained by providing measured positioning data and machine configuration data as input and corresponding actually simultaneously acquired X-ray images of the subject as output. The apparatus 10 further has an acquisition unit 12 configured to acquire positioning data of a subject and positioning data of at least one medical care and / or monitoring device positioned relative to the subject in a medical imaging system from at least one measuring means. The measuring means includes an optical measuring unit and a pressure-based measuring unit. In this example, the optical measuring unit is a range camera and the pressure-based measuring unit is a piezoelectric pressure sensor. The range camera is positioned adjacent to the medical imaging system, and the piezoelectric pressure sensor is positioned within the support bed on which the subject lies. In this case, the medical imaging system is an X-ray imaging system. The range camera and the piezoelectric pressure sensor are wired to the acquisition unit 12. The wired connection is an Ethernet-based connection. The apparatus 10 has a determination unit 13 configured to determine feedback data by utilizing a simulation model and acquired positioning data supplied to the simulation model, the feedback data having at least simulated image data obtained from the acquired positioning data. The apparatus 10 further has a second providing unit 14 configured to provide feedback data. The feedback data is further transmitted to a display and shown to a technician preparing the subject for medical imaging.The first and second supply units 11 and 14, the acquisition unit 12, and the decision unit 13 are implemented on separate hardware units of the workstation, namely the CPU.

[0040] Figure 2 shows a flowchart of a method according to a further embodiment of the present disclosure. A method for providing feedback in a medical imaging system for a medical imaging process includes several steps, which do not necessarily have to be performed in the following order.

[0041] In the first step S10, a simulation model is provided, which is trained to predict the appearance of medical images acquired by using a medical imaging system from the relationship between the positioning data of a subject, the positioning data of at least one medical care and / or monitoring device placed on the subject in the medical imaging system, and optionally simulated medical image data related to and / or derived from the positioning data. The simulation model is trained by providing measured positioning data, which is optionally machine configuration data, and corresponding actually simultaneously acquired X-ray images of the subject. These training data can be annotated, labeled, etc. The simulation model may further be based on a parametric anatomical model, which describes the relationship between one or more characteristics of the subject and corresponding forms of the subject's body, and the characteristics include geometric and biological characteristics. The parametric anatomical model may be a general anatomical model including at least a geometric model of the human body surface and corresponding locations of the lungs. Parameterized anatomical models can be parameterized by characteristics such as patient size, patient weight, patient BMI, lung capacity, age, and / or sex. These characteristics can be measured for each subject or simply input into the parametric anatomical model to enable accurate modeling of the subject's individual characteristics. The simulation model can be trained to recognize target quality through human input and / or software evaluators.

[0042] In step S20, positioning data of the subject, i.e., subject positioning data, and medical device positioning data of at least one medical care and / or monitoring device placed relative to the subject in the medical imaging system are acquired from at least one measurement means. In this example, the optical measurement unit is an optical camera or range camera, and the pressure-based measurement unit is a piezoelectric pressure sensor.

[0043] In step S30, feedback data is obtained by utilizing the simulation model and the acquired positioning data supplied to the simulation model, and the feedback data includes at least simulated medical image data obtained from the acquired positioning data, i.e., current or actual subject positioning data and current or actual medical device positioning data.

[0044] In step S40, feedback data is provided. The feedback data may include simulated image data. The feedback can be displayed on a display to the technician. The feedback data may further include guidance data configured to guide the technician in adapting positioning data and / or exposure data. The method can determine the target quality and actual quality of the simulated image. Based on the difference between the target quality and the actual quality, the method can determine guidance data for adapting positioning data and / or exposure data. The guidance data can be displayed on a display to the technician. The guidance data can be continuously updated as a new simulated image is determined. For example, if the lower part of the lung is clipped, the guidance data may include a graphic or text indication that the detector should be lowered. The method can be performed in a preparation phase prior to the actual medical imaging process, in which case the feedback data is provided during the preparation phase and the simulated X-ray image is continuously updated based on the acquired positioning data.

[0045] Figure 3 shows a schematic diagram of a system 20 for a medical imaging process. System 20 comprises the apparatus 21, i.e., apparatus 10, described above with reference to Figure 1, and a medical imaging system 22, in this example an X-ray imaging system. The X-ray imaging system 22 has an X-ray source 23 and an X-ray detector 24. The X-ray imaging system may be fixed (e.g., in an intensive care unit) or movable. The subject 27 is provided with medical care and / or monitoring equipment 28, in this embodiment a tracheal tube. As can be seen from the figure, the medical care and / or monitoring equipment 27 is within the field of view 29 of the medical imaging system 22. Therefore, the medical care and / or monitoring equipment may obstruct organs or interfere with the beam path during image acquisition due to its material and / or its position relative to the subject 27 and / or the medical imaging system 22, thus affecting the quality of the medical image. System 20 further has measuring means, in this example a range camera 26 configured to measure the position and size of the subject 27 and the medical care and / or monitoring equipment 28. The range camera can also detect the positions of the X-ray source 23 and the X-ray detector 24. Furthermore, the system has other measuring means, which in this example is a piezoelectric-based pressure sensor 25 positioned under the support structure 29 (i.e., a medical bed) on which the subject 27 lies. The piezoelectric-based pressure sensor measures the pressure distribution. Based on the pressure distribution, the device 20 determines the positioning data of the subject 27 and / or the positioning data of other medical care and / or monitoring equipment 30. In this example, the other medical care and / or monitoring equipment 30 is a lumbar guide that assists in the positioning of the subject 27. The range camera can only determine the positioning data in the visible area, but the piezoelectric-based pressure sensor can determine that the subject 27 is partially lying on the lumbar guide 30. The measuring means 25 and 26 are wired to the device 21. The system 20 further has a display 29 that displays feedback data in the form of a simulated image of the X-ray image that would be acquired under the current imaging conditions.The system continuously provides feedback and guidance data to the technician (not shown) to assist the technician in adapting positioning data and / or exposure data.

[0046] In another exemplary embodiment, a computer program or computer program element is provided which is configured to perform the method step of the method according to one of the embodiments described above on a suitable apparatus or system.

[0047] Accordingly, the data processing program elements can be stored in a computer unit, which may be part of this embodiment. This data processing unit can be configured to perform or not perform the steps of the method described above. Furthermore, a computing unit can be configured to operate the elements and / or system components described above. The computing unit can be configured to operate automatically and / or to execute user instructions. The computer program can be loaded into the working memory of the data processor. Accordingly, the data processor can be configured to perform the method according to one of the embodiments described above.

[0048] Furthermore, the computer program element can provide all the steps necessary to perform the procedure of the exemplary embodiment of the method described above.

[0049] According to a further exemplary embodiment of the present invention, a computer-readable medium such as a CD-ROM or USB stick is presented, the computer-readable medium having computer program elements stored thereon, the computer program elements being described in the preceding section.

[0050] Computer programs may be stored and / or distributed on suitable media such as optical storage media or solid-state media supplied together with or as part of other hardware, but they may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunications systems.

[0051] However, computer programs can also be presented through networks such as the World Wide Web and downloaded from such networks into the working memory of a data processor. According to a further exemplary embodiment of the present invention, a medium is provided for making a computer program element available for download, and this computer program element is configured to perform a method according to one of the aforementioned embodiments of the present invention.

[0052] Embodiments of the present invention will be described in relation to various subject matter. In particular, some embodiments will be described with reference to method-type claims, and other embodiments will be described with reference to apparatus-type claims. However, those skilled in the art will understand from the above and below descriptions that, unless otherwise noted, any combination of features belonging to one type of subject matter, as well as any combination of features relating to different subject matter, are disclosed in this application. However, all features can be combined to provide a greater synergistic effect than the simple sum of the features.

[0053] Although the present invention has been illustrated and described in detail in the drawings and the foregoing description, such illustrations and descriptions should be considered illustrative or descriptive and not limiting. The present invention is not limited to the disclosed embodiments. Other variations of the disclosed embodiments can be understood and achieved by those skilled in the art in carrying out the claimed invention, from the examination of the drawings, disclosure and dependent claims.

[0054] In the claims, the words “comprising” do not exclude other components or steps, and the indefinite articles “a” or “an” do not exclude plurality. A single processor or other unit may perform the functions of several items mentioned in the claims. The mere fact that certain means are mentioned in different dependent claims does not imply that combinations of these means cannot be used advantageously. No reference numeral in the claims should be construed as limiting its scope. The embodiments of the present invention are described below. (Note 1) A method for providing feedback data in a medical imaging system for a medical imaging process, The calculation unit provides a simulation model trained to predict the appearance of medical images acquired using a medical imaging system, based on the relationship between subject positioning data related to the positioning of the subject, medical device positioning data related to the positioning of at least one medical care and / or monitoring device placed in or at the subject in the medical imaging system, and medical image data related to the subject positioning data and the medical device positioning data. The calculation unit obtains, from at least one measurement means, current subject positioning data of a subject and current medical device positioning data of at least one medical care and / or monitoring device placed in or at the subject in the medical imaging system. A step of determining feedback data by supplying the acquired current subject positioning data and the acquired current device positioning data to a simulation model using the calculation unit, wherein the feedback data includes at least simulated medical image data predicted by the simulation model from the acquired current subject positioning data and the current medical device positioning data; The providing unit provides the feedback data, A method of having. (Note 2) The method described in Appendix 1, wherein the method is performed during a preparation phase prior to the actual medical imaging process, and the feedback data is provided to the medical care and / or monitoring equipment during the preparation phase. (Note 3) The method according to Appendix 1 or 2, wherein the medical care and / or monitoring device comprises one or more of the following: a venous line, a chest tube, a tracheal tube, a nasogastric tube, an intra-aortic balloon pump, and a catheter. (Note 4) The method according to any one of appendices 1 to 3, wherein the at least one measuring means has an optical measuring unit configured to acquire images of one or more subjects and / or medical care and / or monitoring equipment. (Note 5) The method according to any one of appendices 1 to 4, wherein the at least one measuring means has a pressure-based measuring unit, and the pressure-based unit is positioned under the subject to acquire the subject positioning data. (Note 6) The simulation model further takes into account the exposure data from the medical imaging system, according to any one of the methods described in Appendix 1 to 5. (Note 7) The method according to any one of Appendix 1 to 6, wherein the simulated medical image data has one or more simulated X-ray images of the subject and the at least one medical care and / or monitoring device, and the at least one medical care and / or monitoring device is located inside and / or outside the subject. (Note 8) The simulation model is further based on a parametric anatomical model, the parametric anatomical model describing the relationship between one or more characteristics of the subject and the corresponding morphology of the subject's body, the characteristics including geometric and biological characteristics, as described in any one of Appendices 1 to 7. (Note 9) The method according to any one of the appendices, further comprising guidance data configured to guide a person to adapt the feedback data to the position of the subject, the position of the medical care and / or monitoring equipment, and / or the exposure data. (Note 10) The method according to any one of Appendix 1 to 9, wherein the simulated medical image is continuously updated based on the acquired current subject positioning data and the acquired current medical device positioning data. (Note 11) The method according to any one of Appendix 1 to 10, wherein the medical imaging system is an X-ray system, and the simulation model takes into account the positions of the subject, the X-ray detector, the X-ray source, and the medical care and / or monitoring equipment. (Note 12) A device that provides feedback data in a medical imaging system for the medical imaging process, A first providing unit configured to provide a simulation model, wherein the simulation model is trained to predict the appearance of a medical image obtained by using the medical imaging system based on the relationship between subject positioning data related to the positioning of a subject, medical device positioning data related to the positioning of at least one medical care and / or monitoring device placed in or at the subject in the medical imaging system, and medical image data related to the subject positioning data and the medical device positioning data. An acquisition unit configured to acquire, from at least one measuring means, current subject positioning data of the subject and current medical device positioning data of at least one medical care and / or monitoring device placed in or at the subject in the medical imaging system, A decision unit configured to determine feedback data by supplying the acquired current subject positioning data and the acquired current medical device positioning data to the simulation model, wherein the feedback data comprises at least simulated medical image data predicted by the simulation model from the acquired current subject positioning data and the acquired current medical device positioning data. The second providing unit configured to provide the aforementioned feedback data, A device having. (Note 13) The apparatus described in Appendix 12, Medical imaging system, A system that has (Note 14) Use of an optical measurement unit and / or pressure-based measurement unit in the apparatus described in Appendix 12 for acquiring positioning data of a subject and positioning data of at least one medical care and / or monitoring device placed on the subject. (Note 15) A computer program, when executed by a processor, that causes the processor to perform the steps of the method described in any one of the appendices 1 to 11. [Explanation of Symbols]

[0055] 10,21 equipment 11 units provided 12 units acquired 13 Decision Units 14 units provided 20 Systems 22 Medical Imaging Systems 23 X-ray source 24 X-ray detectors 25 Pressure Sensor 26 Range Camera 27 Subjects 28,30 Medical devices such as medical care and / or monitoring equipment 29 viewing angle 31 displays S10 Simulation Model Provision S20 Acquisition of positioning data S30 Determination of Feedback Data S40 Provision of Feedback Data

Claims

1. A method for providing feedback data in a medical imaging system for a medical imaging process, The calculation unit provides a simulation model trained to predict the appearance of medical images acquired by using a medical imaging system, based on the relationship between subject positioning data related to the positioning of a subject, medical device positioning data related to the positioning of at least one medical care and / or monitoring device that contacts or is at least partially inserted into the subject in the medical imaging system, and medical image data related to the subject positioning data and the medical device positioning data. A step of using the calculation unit to acquire from at least one measuring means current subject positioning data of a subject and current medical device positioning data of at least one medical care and / or monitoring device that is in contact with the subject or at least partially inserted into the subject in the medical imaging system, wherein the at least one measuring means has an optical measuring unit configured to acquire one or more images of the subject and / or the medical care and / or monitoring device. A step of determining feedback data by supplying the acquired current subject positioning data and the acquired current equipment positioning data to a simulation model using the calculation unit, wherein the feedback data comprises at least simulated medical image data predicted by the simulation model from the acquired current subject positioning data and the current medical equipment positioning data, wherein the simulated medical image data comprises one or more simulated X-ray images of the subject and the at least one medical care and / or monitoring device, and the feedback data further comprises guidance data configured to guide a person to adapt the position of the subject, the position of the medical care and / or monitoring device, and / or exposure data. The providing unit provides the feedback data, It has, The method described above is performed during a preparation phase prior to the actual medical imaging process, and the feedback data is provided to the medical care and / or monitoring equipment during the preparation phase. A method wherein the medical imaging system is an X-ray system, and the simulation model takes into account the positions of the subject, the X-ray detector, the X-ray source, and the medical care and / or monitoring equipment.

2. The method according to claim 1, wherein the medical care and / or monitoring device comprises one or more of a venous line, a chest tube, a tracheal tube, and a nasogastric tube.

3. The method according to claim 1 or 2, wherein the at least one measuring means comprises a pressure-based measuring unit, the pressure-based unit is positioned beneath the subject to acquire subject positioning data.

4. The method according to claim 1 or 2, wherein the simulation model further takes into account exposure data from the medical imaging system.

5. The method according to claim 1 or 2, wherein the simulation model is further based on a parametric anatomical model, the parametric anatomical model describing a relationship between one or more characteristics of a subject and corresponding forms of the subject's body, the characteristics including geometric and biological characteristics.

6. The method according to claim 1 or 2, wherein the simulated medical image is continuously updated based on the acquired current subject positioning data and the acquired current medical device positioning data.

7. A device that provides feedback data in a medical imaging system for the medical imaging process, A first providing unit configured to provide a simulation model, wherein the simulation model is trained to predict the appearance of a medical image obtained by using the medical imaging system based on the relationship between subject positioning data related to the positioning of a subject, medical device positioning data related to the positioning of at least one medical care and / or monitoring device that contacts or is at least partially inserted into the subject in the medical imaging system, and medical image data related to the subject positioning data and the medical device positioning data. An acquisition unit is configured to acquire current subject positioning data of the subject and current medical device positioning data of at least one medical care and / or monitoring device that is in contact with the subject or at least partially inserted into the subject in the medical imaging system, from at least one measuring means having an optical measuring unit configured to acquire images of one or more of the subject and / or the medical care and / or monitoring device, A decision unit configured to determine feedback data by supplying the acquired current subject positioning data and the acquired current medical device positioning data to the simulation model, wherein the feedback data comprises at least simulated medical image data predicted by the simulation model from the acquired current subject positioning data and the acquired current medical device positioning data, wherein the simulated medical image data comprises one or more simulated X-ray images of the subject and the at least one medical care and / or monitoring device, and the feedback data further comprises guidance data configured to guide a person to adapt the position of the subject, the position of the medical care and / or monitoring device, and / or exposure data, and the feedback data is supplied to the decision unit during a preparation phase prior to the actual medical imaging process. A second providing unit configured to provide the aforementioned feedback data, It has, An apparatus wherein the medical imaging system is an X-ray system, and the simulation model takes into account the positions of the subject, the X-ray detector, the X-ray source, and the medical care and / or monitoring equipment.

8. The apparatus according to claim 7, Medical imaging system, A system that has

9. Use of an optical measuring unit and / or a pressure-based measuring unit in the apparatus according to claim 7 for acquiring positioning data of a subject and positioning data of at least one medical care and / or monitoring device placed on the subject.

10. A computer program, when executed by a processor, that causes the processor to perform the steps of the method according to claim 1 or 2.

Images