Systems and methods for computing and visualizing a position indicator of a target anatomy

Abstract

The invention relates to a system for visualizing a position indicator of a target anatomy. The system comprises a processor configured to receive an image from an image device, the image comprising target anatomy information, process the received target anatomy information using a neural network to predict at least one position indicator of a position of the target anatomy, generate a visual representation of the position indicator of the target anatomy based on the analysis of the neural network, wherein the visual representation is visualized on a display, wherein the visual representation indicates by the position indicator whether the target anatomy is in an optimal position suitable for a medical imaging procedure. The invention also relates to a method for generating a visual representation of a position indicator of a target anatomy.

Description

Technical Field

[0001] This invention relates to the field of medical imaging. Specifically, it relates to the visualization of position indicators of target anatomical structures during X-ray imaging and / or fluorescence fluoroscopy imaging, and to a method for generating a visual representation of the position indicators of target anatomical structures. Background Technology

[0002] During medical imaging, a key element for obtaining clinically valuable medical images is accurate patient localization. Accurate patient localization, based on projection, requires considerable experience. The quality of patient localization is judged based on medical images received from the target anatomy. In routine clinical practice, patient localization relies on the experience of the X-ray equipment / system user. Medical personnel typically interpret medical images to determine the corresponding positions of bones or other anatomical features that indicate the location of the target anatomy. This is particularly important for orthopedic images, as suboptimal target anatomy can lead to re-enhancing images, resulting in additional radiation exposure to the patient. Summary of the Invention

[0003] Therefore, a system may be needed to allow users to locate target anatomy structures, where the location should correspond to the correct patient positioning in order to obtain good quality medical imaging.

[0004] The purpose of this invention is to provide a system that allows users of medical imaging devices / systems to correctly locate target anatomical structures, and in particular, a system that visualizes the actual location of target anatomical structures to users.

[0005] The object of the invention is achieved through the subject matter of the independent claims, wherein further embodiments are incorporated in the dependent claims. It should be understood that the following aspects of the invention are equally applicable to the method, medical systems (e.g., X-ray systems), computer program units, and computer-readable media. Therefore, any features, functions, steps, and / or elements described below with reference to one aspect of this disclosure are equally applicable to any other aspect of this disclosure.

[0006] According to a first aspect of the invention, a system for visualizing location indicators of target anatomical structures is provided. The system includes a processor configured to receive an image from an imaging device, the image including target anatomical structure information, and to process the received target anatomical structure information using a neural network to predict at least one location indicator of the location of the target anatomical structure. The processor is further configured to generate a visual representation of the location indicator of the target anatomical structure based on the analysis of the neural network, wherein the visual representation is visualized on a display, and wherein the visual representation indicates whether the target anatomical structure is in a suitable location for a medical imaging procedure via the location indicator.

[0007] In the context of this invention, the term "visualization" can be understood as an optical illustration or presentation describing a location indicator. Visualization can be displayed on any device capable of visually or optically indicating or showing a location indicator of any target anatomical structure to a user. For example, visualization can be performed within a computer interface or the medical imaging device itself.

[0008] In the context of this invention, the term "location indicator" can be understood as describing a mark, feature, and / or sign configured to visually present the location of a target anatomical structure to a user, in particular. Specifically, the indicator is configured and designed to indicate a location relevant to the acquisition of medical images.

[0009] In the context of this invention, the term "target anatomy" can be understood to describe an anatomical structure that should be examined using medical imaging equipment (e.g., X-ray equipment and / or fluoroscopy equipment). The target anatomy can be any part of the patient's body that will be examined by the medical imaging equipment. In particular, the invention may focus on joint imaging, where evaluating corrective movements regarding how to improve positioning is often very challenging; however, the invention is not limited to joint imaging.

[0010] In the context of this invention, the term "optimal position" can be understood as describing a position suitable for a medical imaging procedure. When the optimal position is obtained, the target anatomy does not need to be repositioned, which reduces the need for re-capture of medical images and improves the quality of the captured medical images. Therefore, by utilizing the correct position, the quality of medical images captured from correctly positioned target anatomy is improved.

[0011] As described herein, this invention allows for the acquisition of clinically valuable medical images, such as valuable X-ray images. A key element is the accurate localization of the patient, particularly the accurate localization of the patient's body parts, i.e., the target anatomy. Accurate localization may depend on projection and requires considerable experience from the radiologist. Retrospective and prospective localization visualizations are proposed. Thus, the invention, as described in various embodiments herein, enables accurate localization of target anatomy before (prospective) or after (retrospective) medical imaging. Therefore, users can even improve patient localization before medical imaging. Furthermore, this visualization is readily understandable because location indicators and their ideal relative positions are well-known features for determining patient localization in clinical practice.

[0012] According to exemplary embodiments of the present invention, a location indicator for a target anatomy can be a set of location indicators for bone contours. Specifically, a location indicator may include two or more bone contours of the target anatomy. Bone contours typically appear in pairs, thus using at least two bone contours to determine the location quality of a target anatomy. Bone contours can be paired corresponding bone contours, a well-known characteristic used in clinical practice to determine the location of target anatomy structures (such as joints or condyles). On the other hand, a location indicator may include more than two bone contours, thus a location indicator is not limited to at least two bone contours or a pair of bone contours. The corresponding number of bone contours used for the location indicator may depend on the target anatomy being examined.

[0013] According to exemplary embodiments of the invention, the bone contour indicating location may be at least one of a condyle contour or a contour of the joint space. For example, for a lateral knee protrusion, good overlap of the lateral and medial condyles is important, while for anterior and posterior ankle protrusions, the medial and lateral joint spaces should be clearly visible. The bone contour may be, for example, the contour of the lateral / medial articular surface of the talus of the tibia and / or the contour of condyles (such as the femoral condyle and humeral condyle), which are often used in clinical practice for patient repositioning. Other examples of such bone contours are contours present on either side of the joint space in lateral and posterior anterior protrusions of the knee, ankle, or elbow. Bone contours may appear in pairs, and the location of target anatomy can be derived from these pairs of bone contours. The list of contours above is not limiting, and other location indicators may also be used.

[0014] According to an exemplary embodiment of the present invention, the visual representation may include the display of a position indicator of the target anatomy overlaid on a background image of the target anatomy, wherein the background image is at least a real-time representation of the target anatomy. Therefore, by utilizing the overlay on the background image, the position indicator can be associated with the corresponding target anatomy, and the user can clearly determine from the overlaid visualization whether the position of the target anatomy is correct. The live representation can be received from an imaging device. The imaging device may be part of a system for visualization or may be an external component. At least the imaging device can communicate with the system for visualization to provide image data from the imaging device to the system, particularly a processor. Therefore, the imaging device is configured to provide image information about the target anatomy and the background image. In other words, based on the information received from the imaging device, the system (particularly the processor) is configured to derive information about the target anatomy and / or the background image to use that information to visualize the position indicator. The real-time representation of the target anatomy can be any illustration suitable for visually indicating the target anatomy to the user.

[0015] According to exemplary embodiments of the present invention, the background image may be at least one of a real-time image of the target anatomy, a real-time depth image of the target anatomy, or a real-time schematic image of the target anatomy. Depending on the technology used by the imaging device, the background image may be displayed / shown as one of the aforementioned images. In particular, the imaging device may be a multi-dimensional imaging device configured to generate at least one of 2D or 3D images. For example, a depth image may be generated using a depth imaging device configured to capture a depth image or depth image map of the target anatomy. This image may be presented to the user as a background image via visualization. Another example may be a direct live image captured by a camera acting as an imaging device, wherein a video of the target anatomy (e.g., a video showing a patient's knee) is used as the background image. A schematic image of the target anatomy may be an image in which the outline of the target anatomy is shown, schematically illustrating the (external) shape of the target anatomy. When using real-time images, the user may be able to move the target anatomy until the correct (ideal) position of the target anatomy is achieved, thereby generating a medical image of good quality.

[0016] According to exemplary embodiments of the present invention, a neural network can be trained using a dataset consisting of X-ray images of a target anatomy, depth images of the target anatomy, and RGB images of the target anatomy. In the images used to train the neural network, relevant contours indicating the location of the target anatomy can be annotated, wherein the annotated location is at least one of a correctly aligned location suitable for medical imaging and / or an misaligned location of the target anatomy. The neural network is trained with the information mentioned herein to be able to predict relevant location indicators, such as relevant bone contour pairs. The neural network can be a trained deep neural network, wherein the present invention is not limited to such a neural network. The annotation of relevant location indicators is performed by a person with the necessary medical expertise. The annotated training data can include, for example, X-ray images and depth images or RGB images, wherein bone contours are annotated in the X-ray images. This information is passed to the depth and / or RGB images, and the network is trained to predict the location of the contours based on the depth or RGB images. If the system is to indicate a quality measurement, the training data for the neural network may also include X-ray images, depth images, and / or RGB images (one or more of each image or a combination thereof) in which quality is annotated. Furthermore, the trained neural network can be used in the system for visualization to predict location indicators on images, such as bone contour pairs. The images can be a live stream of depth and / or RGB images.

[0017] According to exemplary embodiments of the present invention, the visual representation of a location indicator may include different line types for different locations. Different line types may be continuous lines, dashed lines, and / or dotted lines, or any combination thereof. When visualization displays, for example, different location indicators, each location indicator may be indicated using a different line type. On the other hand, when a location indicator may include at least two bone contours, each bone contour may be indicated using a different line type to distinguish these different bone contours in visualization. For example, the line type may indicate the lateral condyle and / or the medial condyle. Illustrations of different line types for location indicators will be described in more detail in the accompanying drawings.

[0018] This visualization also allows for the assessment of how rotational directions can be used to improve patient positioning by indicating, for example, the laterality of bone contours. Based on the relative positions of the bone contours, each indicated by a different line type, the user can derive how rotation can be used to correct the position of the target anatomy. Figure 5 More details were described.

[0019] According to another embodiment of the invention, the quality of the position can be indicated in a visual representation using different colors. For example, to indicate good quality, which means the ideal and correct location of the target's anatomy, the position indicator includes green. On the other hand, when indicating unsatisfactory quality, orange can be selected as the color indicator, or red can be selected for poor quality.

[0020] According to an exemplary embodiment of the invention, the visual representation may further include a guiding element configured to guide the user to the correct location of the target anatomy suitable for the medical imaging procedure. For example, the guiding element may be at least one or more arrows indicating the direction of movement. The indicated direction of movement may be the direction in which the target anatomy can be moved to align / position itself in an ideal location. Therefore, the guiding element can be used to improve the visualization of the user's corrective actions.

[0021] According to an exemplary embodiment of the present invention, when the position indicator can show that the target anatomy is not in the optimal position, the processor can also be configured to use a guiding element to instruct the user on how to align the target anatomy. The processor can be configured to compare the imaging position with the ideal position of the target anatomy and calculate the correction movement to reach the ideal position based on the comparison result.

[0022] According to an exemplary embodiment of the present invention, when the position indicator indicates that the target anatomy is not in the optimal position, the processor is also configured to use the position indicator to indicate that the system geometry of the medical imaging system is not properly adjusted.

[0023] The processor can communicate with the corresponding medical imaging system, and visualization can use position indicators to indicate whether the position of the target anatomy must be adjusted or whether the system geometry (e.g., the tube angle of the X-ray device) is incorrect. The tube angle that should be corrected can be derived from the corresponding position indicator. For example, when the position indicator can be at least two bone contours spaced apart from each other, the user can conclude that the tube angle needs to be corrected.

[0024] According to an exemplary embodiment of the present invention, the guiding element may be at least one of a visual guiding element or an acoustic guiding element displayed on a display. The guiding element may be a visual guiding element presented together with the visualization of a position indicator on a background image. Additionally or alternatively, the guiding element may be an acoustic guiding element. Different guiding elements that allow guidance of the user may be applied.

[0025] According to an exemplary embodiment of the invention, the system may further include an interface configured to allow a user to adjust the display of a visual representation of the target's anatomical structure. The interface may be part of the visualization system or an external component. For example, the visualization system may use a processor that communicates with a computer or computer network, wherein the interface is part of the computer or computer network. Furthermore, the interface may be part of a medical imaging device that communicates with the visualization system.

[0026] According to exemplary embodiments of the present invention, the system can also be configured to adjust the visual representation when the alignment / position of the target anatomy changes, wherein the position indicator adapts to the change in the alignment of the target anatomy. Specifically, when the visualized background image is a live view or live image of the target anatomy, the movement of the target anatomy can be directly displayed / shown. The system for visualization is configured to adjust the position indicator based on a live image / view received from an imaging device during the movement of the target anatomy. For example, the processor can use a trained neural network to adjust the position indicator for a live view / image of the target anatomy.

[0027] According to an exemplary embodiment of the present invention, the background image may be at least one of a medical image of the target anatomy, an RGB image of the target anatomy, a depth image of the target anatomy, or a schematic image of the target anatomy received before generating the visual representation, wherein the visual representation is superimposed on the background image of the target anatomy to indicate by a position indicator whether the imaged target anatomy is in an optimal position.

[0028] By visualizing medical images as background images, the system can retrospectively visualize the location of target anatomy. Users can deduce from the visualization whether the location is correct and can correct it, meaning repositioning the target anatomy to perform a re-enhancing of the medical image. For example, a pair of bone outlines can be shown on an X-ray image, guiding the user to reposition them for a re-enhancing. In retrospective cases, the background image is most likely an X-ray image at the exposure time point or an RGB, depth, or schematic image.

[0029] According to a second aspect of the present invention, a method is provided for generating a visual representation of a location indicator for a target anatomical structure. The method includes the steps of: receiving target anatomical structure information from an imaging device, wherein the imaging device receives an image of the target anatomical structure; processing the received target anatomical structure information using a neural network to predict at least one location indicator for the target anatomical structure; generating a visual representation of the location indicator for the target anatomical structure based on analysis of the neural network; displaying the visual representation on a display, wherein the location indicator indicates whether the location of the target anatomical structure is suitable for a medical imaging process.

[0030] The method can also be configured to perform / carry out steps representing functions as described in embodiments of the system for visualization.

[0031] According to a third aspect of the present invention, a computer program product is provided. A computer program product or computer program unit is provided, characterized in that it is adapted to perform method steps according to one of the foregoing embodiments on a suitable system. The computer program product may include instructions that, when executed by a computer, cause the computer to perform the methods as described above in any of the embodiments. Therefore, the computer program unit may be stored on a computer unit, which may also be part of an embodiment of the present invention. The computing unit may be adapted to perform or cause the execution of the steps of the described methods. The computing unit may be adapted to automatically operate and / or execute user commands. The computer program may be loaded into the working memory of a data processor. Therefore, the data processor may be configured to perform the methods of the present invention. This exemplary embodiment of the present invention covers computer programs that use the present invention from the outset and computer programs that convert existing programs into programs using the present invention through updates. Furthermore, the computer program unit may be able to provide all the necessary steps to implement the exemplary embodiments of the methods described above.

[0032] According to another aspect of the invention, a medical imaging system is provided, wherein the medical imaging system includes a visualization system according to any embodiment described herein. The medical imaging system may be an X-ray system and / or a fluorescence fluoroscopy system. A medical imaging system equipped with a system as described in the various embodiments herein is capable of indicating or visualizing the correct location of a target anatomical structure to the user and can prevent re-images due to incorrect positioning of the target anatomical structure. Furthermore, image quality is improved due to the correct positioning of the target anatomical structure.

[0033] According to another aspect of the invention, a computer-readable medium, such as a CD-ROM, is provided, wherein computer program elements, as described in the preceding section, are stored on the computer-readable medium. The computer program may be stored and / or distributed on a suitable medium, such as an optical storage medium or solid-state medium provided together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunications systems. However, the computer program may also be presented via a network such as the World Wide Web and may be downloaded from such a network to the working memory of a data processor. The computer-readable medium may include instructions that, when executed by a computer, cause the computer to perform the methods of any of the embodiments described herein.

[0034] It should be noted that embodiments of the present invention are described with reference to different subject matter. Specifically, some embodiments are described with reference to method type claims, while others are described with reference to system / device type claims. However, those skilled in the art will understand from the above and below description that, unless otherwise stated, any combination of features related to different subject matter is also considered to be disclosed in this application, in addition to any combination of features belonging to one type of subject matter. However, all features can be combined together to provide synergies, rather than simply being the sum of features. Attached Figure Description

[0035] The above and other aspects of the invention will be apparent from the examples of embodiments described below, and will be explained with reference to the examples of embodiments. The invention will be described in more detail below with reference to examples of embodiments, but is not limited thereto.

[0036] Figure 1 A visualization of a location indicator according to an embodiment of the present invention is shown.

[0037] Figure 2 Another visualization of a location indicator according to an embodiment of the present invention is shown.

[0038] Figure 3Another visualization of a location indicator according to an embodiment of the present invention is shown.

[0039] Figure 4 A further visualization of the location indicator according to an embodiment of the present invention is shown.

[0040] Figure 5 A comparison of visualizations of the same type at different locations according to embodiments of the present invention is shown.

[0041] Figure 6 A flowchart illustrating the different steps performed by a system for visualizing location indicators according to an embodiment of the present invention is shown.

[0042] List of reference numerals in the attached diagram:

[0043] 100 System

[0044] 101 Image Device

[0045] 102 processor

[0046] 103 Image Data

[0047] 104 Neural Network

[0048] 105 Visualization

[0049] 106 monitor

[0050] 107 users

[0051] 108 background images

[0052] 109a, b position indicators

[0053] 210 Guide Element

[0054] 310 and 311 X-ray images

[0055] 412 Fibular outline

[0056] 413 Posterior contour of the articular surface of the talus for the tibia

[0057] 414 Anterior contour of the articular surface of the talus for the tibia Detailed Implementation

[0058] Figure 1 A visualization 105 of a location indicator 109 according to an embodiment of the present invention is shown. The visualization 105 can be displayed on a monitor or interface (not shown). Figure 1 In the visualization, a background image 108 is a depth image of the target's anatomical structure, wherein different depths of the image (where true depth information is continuous information, rather than as shown) are included. Figure 1The discrete information shown is schematically illustrated using different shades. The background image can also be a real-time view / image of the target anatomy, such as a real-time depth image of the target anatomy, a real-time schematic image of the target anatomy, or a real-time RGB image of the target anatomy. At least two position indicators 109a and 109b are shown, indicating bone contour pairs, highlighting the displacement between the lateral and medial contours of the superior talus. Different line types are used to distinguish the different contours belonging to the position indicators. In this case, the line type is used to distinguish the lateral and medial contours of the superior talus. The dashed position indicator 109b shows the lateral articular surface of the talus contour, and the solid position indicator 109a shows the medial articular surface of the talus contour. Because the lines do not overlap, the user can conclude from the visualization that the position of the target anatomy is not correctly set and needs correction. Therefore, the user of the system used for visualization can easily observe that the patient positioning is not ideal before taking medical images. The user can now reposition the patient until the condyles are fully overlapped, which can be achieved if a single condyle contour is almost visible. For example, the location quality can be indicated to the user by switching from red or orange (if the location is incorrect) to green (if the location is correct).

[0059] Figure 2 Another visualization 105 of a location indicator according to an embodiment of the present invention is shown. Figure 2 a and Figure 2 In b, the target anatomical structure is the ankle of the foot. Visualization 105 includes at least two location indicators 109a and 109b, indicating the bony outline of the talus condyle, similar to... Figure 1 The location indicator is shown. Background image 108 is different. Figure 1 The background image. In Figure 2 In the image, background image 108 is a schematic diagram of a foot, showing its outline. Figure 2 In the image, position indicator 109 visualizes an incorrectly positioned foot because position indicators 109a and 109b do not overlap, i.e., they do not overlap to form a single bone contour. In contrast, in... Figure 2 The visualization in b shows the correct, ideal location of the target's anatomy. After the user performs repositioning, it can achieve, for example... Figure 2 The correct position shown in b is acceptable. Furthermore... Figure 2 Guide element 210 is shown; it is an arrow that visually indicates to the user that the target anatomy must be repositioned. For example, arrow 210 could indicate the direction in which the foot must be rotated to the correct position. Figure 2 In the case shown, the arrow must point upwards or downwards.

[0060] Figure 3Another visualization 105 of a position indicator 109 according to an embodiment of the present invention is shown. The visualization includes an X-ray image 311 and at least two position indicators 109a, b. The position indicators 109 include two bone contours of the lateral / medial articular surfaces of the talus of the tibia 109a, b. Furthermore, Figure 3 A retrospective visualization 105 of the bone contour pairs 109a, b is shown, highlighting the displacement between the talar condyles, which highly indicates the quality of patient positioning. As a retrospective visualization 105, X-ray images are received before the processor uses a neural network to calculate the position indicator 109. In this example, color can be used to indicate quality, while the lateral condyle 109b and medial condyle 109a are visualized linearly.

[0061] Figure 4 Another visualization 105 of the position indicator 109 according to an embodiment of the present invention is shown. Figure 4 The target anatomical structures are the anterior and posterior prominences of the ankle joint. As a position indicator 109, the bone contour is indicated by posture around the ankle joint space. Left side ( Figure 4 a) shows a retrospective visualization of the bone contour. This means that background image 108 is an X-ray image of the target anatomy (ankle). Right side ( Figure 4 b) shows a prospective visualization 105, which is a real-time overlay of a schematic image of a background image 108 serving as an ankle contour and predicted posture indicator contours 414, 412, and 413. 412 shows the fibular contour, 413 shows the posterior contour of the talar articular surface of the tibia, and 414 shows the anterior contour of the talar articular surface of the tibia. Thus, as... Figure 4 As shown, more than two bone contours can be used to display the location of the target's anatomical structure, so that the location indicator can include multiple bone contours.

[0062] Figure 5 A comparison of visualizations 105 of location indicators at different locations of a target anatomy structure according to an embodiment of the present invention is shown. The two outlines shown are part of a location indicator. In all Figure 5 In a) through f), the dashed lines indicate the contour of the lateral articular surface of the tibia and the solid lines indicate the contour of the medial articular surface of the tibia. Based on the displayed contours, the user can correct the position through appropriate repositioning. In practice, positioning will be improved by leg rotation (5b and 5c) or by changing the tube angle (5e and 5f). Figure 5 a) and Figure 5 d) shows the perfect position with no positional error. Specifically, the offset of the position indicator (in...) Figure 5 (Indicated by solid and dashed lines), the outline of the condyle shows the rotation and movement of the target's anatomy, as well as the changes in movement caused by the position indicator, thus achieving adjustment. Figure 5 a) through c) show the offset of the profiles due to leg rotation. This means that if the leg rotates, the bone profiles may intersect each other. On the other hand, when the bone profiles are spaced apart from each other and therefore do not intersect, it may be necessary to correct the tube angles. Figure 5 (d) through (f) illustrate the contour shift caused by the tube angle. Therefore, changes in the tube angle can cause bone contours to deviate from each other. It is also possible to correct the position of target anatomy structures by a combination of rotation and correction via the tube angle.

[0063] Figure 6 A flowchart illustrating the various steps performed by a system 100 for visualizing a location indicator 109 according to an embodiment of the present invention is shown. The system 100 for visualizing the location indicator 109 of a target anatomy includes a processor 102 configured to receive an image 103 or image information including target anatomy information from an imaging device 101, and to process the received target anatomy information using a neural network 104 to predict at least one location indicator 109 of the target anatomy's position. The processor is also configured to generate a visual representation 105 of the location indicator 109 of the target anatomy based on analysis of the neural network 104, wherein the visual representation 105 is visualized on a display 106. The visual representation 105 indicates whether the target anatomy is in an optimal position for the medical imaging process via the location indicator 109. A user 107 can interact with the system 100. For example, guidance elements generated from the system 100, particularly from the processor 102, can guide the user 107 to the correct position of the target anatomy suitable for the medical imaging process. Display 106 or any other interface is configured to allow user 107 to adjust the visual representation displayed on the display. Non-limiting examples of user adjustments include adjusting colors for different quality levels, adjusting limits to separate different quality levels, adjusting the line style and thickness of lines, and adjusting the background image type (RGB, depth, or schematic). Figure 6The system described herein is capable of performing a method for generating a visual representation 105 of a location indicator 105 for a target anatomical structure. The method includes the steps of: receiving target anatomical structure information 103 from an imaging device 101, wherein the imaging device 101 generates an image of the target anatomical structure. The step of generating an image of the target anatomical structure can be understood as describing the imaging device receiving images from (RGB, depth) cameras and / or generating images from corresponding cameras. Alternatively, the imaging device itself may be a camera, wherein additional image processing components may be added. The method further includes the steps of: processing the target anatomical structure information received at 102 using a neural network 104 to predict at least one location indicator 109 of the target anatomical structure; generating a visual representation 105 of the location indicator 109 of the target anatomical structure based on the analysis of the neural network 104; displaying the visual representation 105 on a display 106; and indicating by the location indicator 109 whether the location of the target anatomical structure is suitable for a medical imaging process.

[0064] While the invention has been described and illustrated in detail in the accompanying drawings and the foregoing description, such description is intended to be illustrative or exemplary, and not restrictive. The invention is not limited to the disclosed embodiments. Other variations to the disclosed embodiments will be understood and implemented by those skilled in the art in practicing the claimed invention, based on a study of the drawings, the disclosure, and the dependent claims.

[0065] In the claims, the word "comprising" does not exclude other elements or steps, and "a" or "an" does not exclude multiple elements or steps. A single processor or other unit can perform the functions of several items re-referenced in the claims. The fact that certain measures are re-referenced in mutually different dependent claims does not mean that a combination of these measures cannot be advantageous. Any reference numerals in the claims should not be construed as limiting the scope.

Claims

1. A system for visualizing the location indicator of target anatomy, comprising: The processor is configured as follows: Receive images from an imaging device, the images including target anatomical information. The received target anatomical information is processed using a neural network to predict at least one location indicator of the target anatomical structure's location. The analysis based on the neural network generates a visual representation of the location indicator of the target anatomy, wherein the visual representation is visualized on a display. The visual representation indicates, via the position indicator, whether the target anatomical structure is in an optimal position suitable for the medical imaging process. Wherein, the position indicator of the target anatomical structure is a set of position indicators of bone contours, wherein the position indicator includes two or more bone contours of the target anatomical structure.

2. The system according to claim 1, in, The bone contour indicated by the location is at least one of the contour of the condyle or the contour of the joint space.

3. The system according to claim 1 or 2, in, The visual representation includes the display of the location indicator of the target anatomy overlaid on a background image of the target anatomy. The background image is at least a real-time representation of the target's anatomical structure.

4. The system according to claim 3, in, The background image is at least one of the following: a real-time image of the target anatomy, a real-time depth image of the target anatomy, or a real-time schematic image of the target anatomy.

5. The system according to claim 1 or 2, in, The neural network is trained using a dataset consisting of X-ray images of the target anatomy, depth images of the target anatomy, and / or RGB images of the target anatomy. In the images used to train the neural network, annotations indicate the location of the target anatomical structures, representing relevant bone contours. The annotated location is at least one of the correct alignment location suitable for medical imaging and / or the misalignment location of the target anatomy.

6. The system according to claim 1 or 2, in, The visual representation of the location indicator includes different line types for different bone contours. The quality of the location is indicated by different colors in the visual representation.

7. The system according to claim 1 or 2, in, The visual representation also includes a guidance element configured to direct the user to the correct location of the target anatomy suitable for the medical imaging process.

8. The system according to claim 1 or 2, in, When the position indicator shows that the target anatomy is not in the optimal position, the processor is also configured to use the position indicator to indicate that the system geometry of the medical imaging system is not properly adjusted.

9. The system according to claim 7, in, The guiding element is at least one of a visual guiding element or an acoustic guiding element displayed on the display.

10. The system according to claim 1 or 2, further comprising: An interface configured to allow a user to adjust the display of the visual representation of the target's anatomy.

11. The system according to claim 1 or 2, in, The system is also configured to adjust the visual representation when the alignment of the target's anatomy changes. The position indicator is adapted to changes in the alignment of the target's anatomical structure.

12. The system according to claim 1 or 2, in, The background image is at least one of the following: a medical image of the target anatomy, an RGB image of the target anatomy, a depth image of the target anatomy, or a schematic image of the target anatomy received before generating the visual representation. The visual representation is superimposed on the background image of the target anatomy, so that the position indicator indicates whether the imaged target anatomy is in the optimal position.

13. A method for generating a visual representation of the location of a target anatomical structure, the method comprising the steps of: Target anatomical structure information is received from an imaging device, wherein the imaging device generates an image of the target anatomical structure. The received target anatomical information is processed using a neural network to predict at least one location indicator of the target anatomical structure. The analysis based on the neural network is used to generate a visual representation of the location indicator of the target's anatomical structure. Display the visual representation on the monitor. The location indicator indicates whether the position of the target anatomical structure is suitable for the medical imaging process. Wherein, the position indicator of the target anatomical structure is a set of position indicators of bone contours, wherein the position indicator includes two or more bone contours of the target anatomical structure.

14. A computer program product comprising instructions which, when executed by a computer, cause the computer to perform the method according to claim 13.

Images