THA postoperative acetabular prosthesis angle evaluation method based on multi-modal data fusion

Abstract

The invention provides a THA postoperative acetabular prosthesis angle evaluation method and system based on multi-modal data fusion and a computer readable storage medium. The THA postoperative acetabular prosthesis angle evaluation method based on multi-modal data fusion comprises the following steps: acquiring double lower limb CT images of a patient before total hip replacement; wherein the coverage range of the two lower limbs is from the upper part of the hip joint to the lower part of the knee joint; performing three-dimensional reconstruction on the CT images of the two lower limbs to clearly display detailed anatomical information of the pelvis and the two lower limbs of the patient; a biplane X-ray acquisition system is used for acquiring normal position and lateral position X-ray images of two lower limbs of a load-bearing position of a patient, and the position relation of an acetabular prosthesis and a skeleton related anatomical marker relative to the overall force line of the lower limbs in the load-bearing state is determined; the preoperative CT data and the postoperative biplane X-ray data are fused to form a fused image in a three-dimensional space, and the postoperative acetabular prosthesis anatomical front inclination angle, anatomical inclination angle, functional front inclination angle and functional inclination angle are accurately measured on the image.

Description

Technical Field

[0001] This application belongs to the field of acetabular prosthesis angle evaluation after THA, and particularly relates to a method, system and computer-readable storage medium for evaluating the acetabular prosthesis angle after THA based on multi-modal data fusion. Background Art

[0002] At present, the evaluation of the acetabular prosthesis angle after THA is of great significance for judging the prosthesis stability. The existing technologies mainly include the following methods:

[0003] (1) Conventional X-ray examination: By taking the anteroposterior or lateral X-ray films of the hip joint, doctors manually measure the angles between the acetabular prosthesis and the pelvic anatomical landmarks, such as the acetabular abduction angle and the anteversion angle, based on experience.

[0004] Disadvantages: The single-plane X-ray film can only provide two-dimensional image information. Affected by the projection position, it cannot accurately reflect the true angle of the acetabular prosthesis in the three-dimensional space, with large measurement errors, and there may be significant differences in the measurement results of different doctors.

[0005] (2) CT examination: After CT scanning the acetabular region and reconstructing the images, the three-dimensional structure of the prosthesis can be observed to a certain extent.

[0006] Disadvantages: There is a lack of means for monitoring the weight-bearing position. During the standing and lying processes of the human body, the acetabular cup is affected by the change in the pelvic position. At the same time, due to the presence of metal artifacts in CT scanning, the position of the prosthesis cannot be reconstructed in the three-dimensional space, which will affect the accuracy of the measurement results.

[0007] The above existing technologies mainly have the following disadvantages when measuring the three-dimensional angle of the acetabular prosthesis after THA:

[0008] (1) Low measurement accuracy: Whether it is conventional X-ray or CT scanning, it is difficult to accurately measure the angle of the acetabular prosthesis in the three-dimensional space, affecting the accurate judgment of the prosthesis stability and functional recovery.

[0009] (2) Lack of weight-bearing position evaluation: CT scanning cannot obtain the precise relationship between the prosthesis and the overall lower limb force line in the weight-bearing position, and cannot truly simulate the force condition of the acetabular prosthesis under the daily activities of the human body.

[0010] (3) Incomplete evaluation: It cannot comprehensively display the complex spatial relationships between the acetabular prosthesis and the pelvis, femoral head, and surrounding soft tissues, which is not conducive to comprehensively judging the prosthesis status and potential problems. Summary of the Invention

[0011] The embodiments of the present application provide a method, a system and a computer-readable storage medium for evaluating the acetabular prosthesis angle after THA based on multi-modal data fusion, which can accurately measure the angle of the acetabular prosthesis in three-dimensional space; can obtain the accurate relationship between the prosthesis and the overall lower limb force line in the weight-bearing position, and truly simulate the force condition of the acetabular prosthesis under the daily activity state of the human body; can comprehensively display the complex spatial relationship between the acetabular prosthesis and the pelvis, femur, tibia and surrounding soft tissues, which is conducive to comprehensively judging the prosthesis state and potential problems.

[0012] In a first aspect, the embodiments of the present application provide a method for evaluating the acetabular prosthesis angle after THA based on multi-modal data fusion, including:

[0013] Obtain the CT images of both lower limbs of the patient before total hip arthroplasty; wherein, the coverage range of both lower limbs: from above the hip joint to below the knee joint;

[0014] Perform three-dimensional reconstruction on the CT images of both lower limbs to clearly display the detailed anatomical information of the patient's pelvis and both lower limbs;

[0015] Use a biplane X-ray acquisition system to collect the anteroposterior and lateral X-ray images of both lower limbs of the patient in the weight-bearing position, and determine the positional relationship between the acetabular prosthesis and the relevant anatomical landmarks of the bones relative to the overall lower limb force line in the weight-bearing state;

[0016] Perform fusion processing on the preoperative CT data and the postoperative biplane X-ray data to form a fused image in three-dimensional space, and accurately measure the anatomical anteversion angle, anatomical inclination angle, functional anteversion angle, and functional inclination angle of the postoperative acetabular prosthesis on this image.

[0017] Furthermore, accurately calculate the angles of the acetabular prosthesis after THA in three-dimensional space in the weight-bearing state, including at least the anatomical anteversion angle, anatomical inclination angle, functional anteversion angle, and functional inclination angle of the acetabular prosthesis.

[0018] Furthermore, obtaining the CT images of both lower limbs of the patient before total hip arthroplasty and performing three-dimensional reconstruction on the CT images of both lower limbs includes:

[0019] The patient lies supine on the CT scanning bed, and the CT scan of the patient's both lower limbs is performed according to the standard scanning protocol, with the range from above the hip joint to below the knee joint;

[0020] Use professional software to perform three-dimensional reconstruction on the scanned data to clearly display the detailed anatomical information of the patient's pelvis and both lower limbs, so as to accurately obtain the detailed anatomical structure information of the pelvis, femur, tibia, etc.

[0021] Furthermore, using a biplane X-ray acquisition system to collect the anteroposterior and lateral X-ray images of both lower limbs of the patient in the weight-bearing position includes:

[0022] The patient stands on a dual - plane X - ray acquisition device and adjusts the posture to the standard weight - bearing position required by the device;

[0023] Anteroposterior and lateral X - ray images of the patient's lower extremities are acquired to ensure that the images clearly show the acetabular prosthesis and the overall morphology of the lower extremities.

[0024] Furthermore, the CT reconstruction data and the dual - plane X - ray acquisition data are fused and analyzed to form a fused image in three - dimensional space, and the angles of the acetabular prosthesis in three - dimensional space are accurately calculated, including:

[0025] The CT reconstruction data and the dual - plane X - ray acquisition data are input into a trained deep - learning multi - modal data registration and fusion model for image registration, correction, and data format conversion, so that the two data can accurately correspond, forming a fused image in three - dimensional space, and the angles of the acetabular prosthesis in three - dimensional space are accurately calculated.

[0026] Furthermore, the deep - learning multi - modal data registration and fusion model includes:

[0027] The first network branch is used to correct, convert the data format, and extract feature maps from the CT reconstruction data to obtain the first feature map;

[0028] The second network branch is used to correct, convert the data format, and extract feature maps from the dual - plane X - ray acquisition data to obtain the second feature map;

[0029] The acetabular prosthesis angle evaluation network is used to register and fuse the first feature map and the second feature map to form a fused image in three - dimensional space, and evaluate the angles of the acetabular prosthesis in three - dimensional space according to the registration and fusion results.

[0030] Furthermore, after accurately calculating the angles of the acetabular prosthesis in three - dimensional space, it also includes:

[0031] The calculation results of the angles of the acetabular prosthesis in three - dimensional space are graphically displayed on the screen, including the angle information of the acetabular prosthesis in three - dimensional space and its relative positional relationship with anatomical landmarks such as the pelvis and femur;

[0032] A detailed analysis report is generated, which at least includes the patient's basic information, image data, measured angles, and analysis conclusions for clinical doctors' reference.

[0033] In a second aspect, an acetabular prosthesis angle evaluation system based on multi - modal data fusion provided by an embodiment of the present application includes:

[0034] A CT image acquisition module is used to acquire the dual - lower - extremity CT images of the patient before total hip arthroplasty; wherein, the coverage range of the dual lower extremities: from above the hip joint to below the knee joint;

[0035] A three-dimensional reconstruction module, which is used to perform three-dimensional reconstruction on the CT images of the lower extremities to clearly display the detailed anatomical information of the patient's pelvis and lower extremities;

[0036] An X-ray image acquisition module, which is used to use a biplane X-ray acquisition system to acquire the anteroposterior and lateral X-ray images of the patient's lower extremities in the weight-bearing position, and determine the positional relationship between the acetabular prosthesis and the relevant anatomical landmarks of the skeleton relative to the overall force line of the lower extremities in the weight-bearing state;

[0037] An acetabular prosthesis angle evaluation module, which is used to fuse the preoperative CT data and the postoperative biplane X-ray data to form a fused image in three-dimensional space, and accurately measure the relevant angles such as the anatomical anteversion angle, anatomical inclination angle, functional anteversion angle, and functional inclination angle of the postoperative acetabular prosthesis on this image.

[0038] In a third aspect, an embodiment of the present application provides an electronic device, which includes: a processor and a memory storing computer program instructions;

[0039] When the processor executes the computer program instructions, it implements a method for evaluating the angle of the acetabular prosthesis after THA based on multi-modal data fusion.

[0040] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, a method for evaluating the angle of the acetabular prosthesis after THA based on multi-modal data fusion is implemented.

[0041] The method, system and computer-readable storage medium for evaluating the angle of the acetabular prosthesis after THA based on multi-modal data fusion in the embodiments of the present application can accurately measure the angle of the acetabular prosthesis in three-dimensional space; can obtain the accurate relationship between the prosthesis and the overall force line of the lower extremities in the weight-bearing position, and truly simulate the force condition of the acetabular prosthesis under the daily activity state of the human body; can comprehensively display the complex spatial relationship between the acetabular prosthesis and the pelvis, femur, tibia and surrounding soft tissues, which is conducive to comprehensively judging the prosthesis state and potential problems.

[0042] The method for evaluating the angle of the acetabular prosthesis after THA based on multi-modal data fusion includes:

[0043] Obtain the CT images of the lower extremities of the patient before total hip arthroplasty; wherein, the coverage range of the lower extremities: from above the hip joint to below the knee joint;

[0044] Perform three-dimensional reconstruction on the CT images of the lower extremities to clearly display the detailed anatomical information of the patient's pelvis and lower extremities;

[0045] Using a biplane X-ray acquisition system, acquire the anteroposterior and lateral X-ray images of the patient's bilateral lower limbs in the weight-bearing position, and determine the positional relationship between the acetabular prosthesis and the skeletal-related anatomical landmarks relative to the overall force line of the lower limbs in the weight-bearing state;

[0046] Perform fusion processing on the preoperative CT data and the postoperative biplane X-ray data to form a fused image in three-dimensional space, and accurately measure the anatomical anteversion angle, anatomical inclination angle, functional anteversion angle, and functional inclination angle of the acetabular prosthesis on this image. Description of the Drawings

[0047] In order to more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings required for the description of the specific embodiments or the prior art. Obviously, the drawings in the following description are some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0048] Figure 1 It is a schematic flowchart of a method for evaluating the acetabular prosthesis angle after THA based on multi-modal data fusion provided by an embodiment of the present application;

[0049] Figure 2 It is a schematic diagram of a fused image in three-dimensional space provided by an embodiment of the present application;

[0050] Figure 3 It is a schematic diagram of the anatomical anteversion angle provided by an embodiment of the present application;

[0051] Figure 4 It is a schematic diagram of the functional anteversion angle provided by an embodiment of the present application;

[0052] Figure 5 It is a schematic structural diagram of a deep learning multi-modal data registration and fusion model provided by an embodiment of the present application;

[0053] Figure 6 It is a schematic structural diagram of a system for evaluating the acetabular prosthesis angle after THA based on multi-modal data fusion provided by an embodiment of the present application;

[0054] Figure 7 It is a schematic structural diagram of an electronic device provided by an embodiment of the present application. Detailed Embodiments

[0055] The features and exemplary embodiments of various aspects of the present application will be described in detail below. To make the objectives, technical solutions, and advantages of the present application more clear and understandable, the present application will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain the present application, rather than to limit the present application. For those skilled in the art, the present application can be implemented without some of these specific details. The following description of the embodiments is only intended to provide a better understanding of the present application by showing examples of the present application.

[0056] It should be noted that, in this document, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprising", "including", or any other variant thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or device. Without further limitation, an element defined by the statement "comprising..." does not exclude the existence of additional identical elements in the process, method, article, or device comprising the said element.

[0057] To solve the problems of the prior art, the embodiments of the present application provide a method, system, and computer-readable storage medium for evaluating the acetabular prosthesis angle after THA based on multi-modal data fusion. First, the method for evaluating the acetabular prosthesis angle after THA based on multi-modal data fusion provided by the embodiments of the present application will be introduced below.

[0058] Figure 1 The flowchart of the method for evaluating the acetabular prosthesis angle after THA based on multi-modal data fusion provided by an embodiment of the present application is shown. As Figure 1 shown, the method for evaluating the acetabular prosthesis angle after THA based on multi-modal data fusion includes:

[0059] S101. Obtain the CT images of the patient's bilateral lower limbs before total hip arthroplasty; wherein, the coverage range of the bilateral lower limbs: from above the hip joint to below the knee joint;

[0060] S102. Perform three-dimensional reconstruction on the CT images of the bilateral lower limbs to clearly display the detailed anatomical information of the patient's pelvis and bilateral lower limbs;

[0061] In one embodiment, obtaining the CT images of the patient's bilateral lower limbs before total hip arthroplasty and performing three-dimensional reconstruction on the CT images of the bilateral lower limbs includes:

[0062] The patient lies supine on the CT scanning table, and the patient's bilateral lower limbs are scanned by CT according to the standard scanning protocol, with the scanning range from above the hip joint to below the knee joint;

[0063] The scanning data is three-dimensionally reconstructed using professional software to clearly display the detailed anatomical information of the patient's pelvis and bilateral lower limbs, so as to accurately obtain the detailed anatomical structure information of the pelvis, femur, tibia, etc.

[0064] Currently, due to the existence of metal artifacts, CT scanning cannot three-dimensionally reconstruct the prosthesis position, but this application can reconstruct the prosthesis position after THA.

[0065] S103. Use a biplane X-ray acquisition system to acquire the anteroposterior and lateral X-ray images of the patient's bilateral lower limbs in the weight-bearing position, and determine the positional relationship between the acetabular prosthesis and the relevant anatomical landmarks of the bone relative to the overall force line of the lower limb in the weight-bearing state;

[0066] In one embodiment, using a biplane X-ray acquisition system to acquire the anteroposterior and lateral X-ray images of the patient's bilateral lower limbs in the weight-bearing position includes:

[0067] The patient stands on the biplane X-ray acquisition device, and adjusts the posture to the standard weight-bearing position required by the device;

[0068] Acquire the anteroposterior and lateral X-ray images of the patient's bilateral lower limbs to ensure that the images clearly show the acetabular prosthesis and the overall morphology of the lower limbs.

[0069] The biplane X-ray acquisition system acquires the anteroposterior and lateral X-ray images of the bilateral lower limbs in the weight-bearing position, determines the positional relationship between the acetabular prosthesis and the overall force line of the lower limb in the weight-bearing state, and provides a weight-bearing position reference for three-dimensional angle calculation.

[0070] S104. Perform fusion processing on the preoperative CT data and the postoperative biplane X-ray data to form a fused image in three-dimensional space, and accurately measure the anatomical anteversion angle, anatomical inclination angle, functional anteversion angle, and functional inclination angle of the postoperative acetabular prosthesis on this image.

[0071] Figure 2 It is a schematic diagram of the fused image in three-dimensional space provided by one embodiment of this application.

[0072] Through a specific algorithm, the CT reconstruction data and the biplane X-ray acquisition data are fused and analyzed to accurately calculate the angles of the acetabular prosthesis in three-dimensional space, including the angles with the pelvic anatomical axis, femur, tibia, and the lower limb force line in the sagittal, coronal, and axial planes, etc.

[0073] In one embodiment, accurately calculating the angles of the acetabular prosthesis in three-dimensional space includes at least the anatomical anteversion angle, anatomical inclination angle, functional anteversion angle, and functional inclination angle of the acetabular prosthesis.

[0074] Anatomical anteversion angle: It refers to the angle between the opening plane of the acetabular prosthesis and the sagittal plane.

[0075] Anatomical inclination angle: It refers to the angle between the opening plane of the acetabular prosthesis and the coronal plane.

[0076] Functional anteversion angle: It refers to the angle between the acetabular prosthesis in the functional position (such as standing position, sitting position) and the functional pelvic plane.

[0077] Functional inclination angle: It refers to the angle between the acetabular prosthesis in the functional position and the functional pelvic plane.

[0078] Among them, the schematic diagram of the anatomical anteversion angle is as shown in Figure 3 The measurement steps of the anatomical anteversion angle (sagittal plane) are as follows:

[0079] (1) Reconstruct the median sagittal plane of the pelvis (through the pubic symphysis - midline of the sacrum);

[0080] (2) Locate the opening plane of the acetabular prosthesis on the cross-sectional image;

[0081] (3) Measure the angle between the prosthesis plane and the sagittal axis (the midline perpendicular to the coronal plane);

[0082] Normal range: 15 - 25° (Insufficient anteversion is likely to cause posterior dislocation, and excessive anteversion increases the risk of anterior dislocation).

[0083] Among them, the measurement steps of the anatomical inclination angle (coronal plane) are as follows:

[0084] (1) Determine the coronal axis of the pelvis (the line connecting the bilateral anterior superior iliac spines);

[0085] (2) Draw a tangent along the opening edge of the acetabular prosthesis;

[0086] (3) Measure the angle between the tangent and the coronal axis;

[0087] Normal range: 40 - 50° (Abduction angle abnormalities directly affect joint contact stress).

[0088] Among them, Figure 4 is the schematic diagram of the functional anteversion angle provided by an embodiment of the present application. The measurement steps of the functional anteversion angle (considering the pelvis) are as follows:

[0089] (1) Establish the functional pelvic plane (the three-point plane of the bilateral ischial tuberosities and the lower edge of the pubic symphysis);

[0090] (2) Measure the angle between the opening plane of the prosthesis and this plane on the sagittal plane projection;

[0091] Clinical significance: When sitting, the pelvis tilts backward by about 20°, and the anteversion angle needs to be increased correspondingly for compensation.

[0092] Among them, the measurement key points of the functional inclination angle (considering the pelvis) are as follows:

[0093] (1) Obtain images during the single-leg stance phase;

[0094] (2) Measure the angle between the prosthesis opening plane and the gravity line (the line connecting the center of the contralateral femoral head to the center of the acetabulum).

[0095] The algorithm automatically identifies the central axis of the acetabular prosthesis, the pelvic anatomical axis, the center of the femoral head, and the lower limb force line.

[0096] Calculate the angles of the acetabular prosthesis in the sagittal, coronal, axial, and other directions according to the preset formula, such as the acetabular abduction angle, the anteversion angle, etc.

[0097] Data fusion and processing:

[0098] Import the CT reconstruction data and the dual-plane X-ray acquisition data into the data fusion and processing unit;

[0099] Perform image registration, calibration, and data format conversion so that the two sets of data can correspond accurately.

[0100] In one embodiment, the CT reconstruction data and the dual-plane X-ray acquisition data are fused and analyzed to form a fused image in three-dimensional space, and the angles of the acetabular prosthesis in three-dimensional space are accurately calculated, including:

[0101] Input the CT reconstruction data and the dual-plane X-ray acquisition data into the trained deep learning multi-modal data registration and fusion model for image registration, calibration, and data format conversion so that the two sets of data can correspond accurately, form a fused image in three-dimensional space, and accurately calculate the angles of the acetabular prosthesis in three-dimensional space.

[0102] Figure 5 It is a schematic structural diagram of the deep learning multi-modal data registration and fusion model provided by an embodiment of the present application.

[0103] In one embodiment, the deep learning multi-modal data registration and fusion model includes:

[0104] The first network branch is used to correct, convert the data format, and extract feature maps from the CT reconstruction data to obtain the first feature map;

[0105] The second network branch is used to correct, convert the data format, and extract feature maps from the dual-plane X-ray acquisition data to obtain the second feature map;

[0106] The acetabular prosthesis angle evaluation network is used to register and fuse the first feature map and the second feature map to form a fused image in three-dimensional space, and evaluate the angles of the acetabular prosthesis in three-dimensional space according to the registration and fusion results.

[0107] In one embodiment, after accurately calculating the angle of the acetabular prosthesis in three-dimensional space, it further includes:

[0108] Graphically display the calculation result of the angle of the acetabular prosthesis in three-dimensional space on the screen, including the angle information of the acetabular prosthesis in three-dimensional space and its relative positional relationship with anatomical landmarks such as the pelvis and femur;

[0109] Generate a detailed analysis report, including at least patient basic information, image data, measured angles, and analysis conclusions, for clinical doctors' reference.

[0110] Result display and output: The measurement results are graphically displayed on the screen, including the angle information of the acetabular prosthesis in three-dimensional space, its relationship with each axis, and the angle values. Generate a detailed PDF report, including patient basic information, image data, measured angles, analysis conclusions, etc., for clinical doctors' reference.

[0111] The core innovations of the present invention include:

[0112] (1) Multi-modal data fusion: Innovatively combine the biplane X-ray acquisition system with the CT three-dimensional reconstruction of the lower limbs to achieve accurate three-dimensional measurement of the acetabular prosthesis from multiple angles and in all directions, making full use of the advantages of the two imaging techniques and compensating for the deficiencies of single-modal measurement.

[0113] (2) Accurate measurement in the weight-bearing position: Emphasize the angle measurement in the weight-bearing position, which is more in line with the human physiological state and provides a reliable basis for evaluating the performance of the prosthesis in actual use.

[0114] (3) Intelligent algorithm analysis: Adopt advanced image processing and analysis algorithms to automatically identify the acetabular prosthesis and related anatomical landmark points, improving the measurement efficiency and accuracy.

[0115] During the testing and verification process, test multiple patients after acetabular prosthesis implantation, and compare the measurement results of this method with traditional measurement methods and the actual intraoperative implantation angles. The results show that:

[0116] Compared with the traditional X-ray measurement method, the angle error is reduced by more than 80%, and the deviation from the actual intraoperative implantation angle is within ±1°.

[0117] In the repeatability tests with different measurement personnel and at different time points, the consistency (ICC value) of the measurement results is greater than 0.98, showing high stability and reliability.

[0118] Therefore, compared with the prior art, the present invention has the following significant differences:

[0119] (1) Greatly improved accuracy: The fused technology can achieve an angular measurement accuracy within ±1°, far higher than that of existing technologies.

[0120] (2) Comprehensive evaluation: It can simultaneously analyze the angles of the acetabular prosthesis in multiple planes such as the sagittal plane, coronal plane, and axial plane, as well as its relationships with the pelvis, femoral head, and lower limb force line, providing a more comprehensive basis for hip joint function evaluation.

[0121] (3) High clinical application value: More accurate measurement results help doctors formulate personalized treatment plans, such as adjusting rehabilitation training programs, determining whether the dislocation after THA is due to poor angles or other reasons such as laxity, and timely detecting and handling problems such as prosthesis loosening or wear, improving the quality of life of patients after THA and the service life of the prosthesis.

[0122] Figure 6 It is a schematic structural diagram of a THA postoperative acetabular prosthesis angle evaluation system based on multimodal data fusion provided by an embodiment of the present application.

[0123] The THA postoperative acetabular prosthesis angle evaluation system based on multimodal data fusion includes:

[0124] A CT image acquisition module 601 for acquiring bilateral lower limb CT images of a patient before total hip arthroplasty; wherein, the coverage range of the bilateral lower limbs: from above the hip joint to below the knee joint;

[0125] A three-dimensional reconstruction module 602 for performing three-dimensional reconstruction on the bilateral lower limb CT images to clearly display the detailed anatomical information of the patient's pelvis and bilateral lower limbs;

[0126] An X-ray image acquisition module 603 for using a biplane X-ray acquisition system to acquire anteroposterior and lateral X-ray images of the patient's bilateral lower limbs in the weight-bearing position, and determining the positional relationship of the acetabular prosthesis and related anatomical landmarks of the bones relative to the overall force line of the lower limbs in the weight-bearing state;

[0127] An acetabular prosthesis angle evaluation module 604 for fusing the preoperative CT data and the postoperative biplane X-ray data to form a fused image in three-dimensional space, and accurately measuring the anatomical anteversion angle, anatomical inclination angle, functional anteversion angle, and functional inclination angle of the postoperative acetabular prosthesis on this image.

[0128] Figure 7 It is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

[0129] The electronic device may include a processor 701 and a memory 702 storing computer program instructions.

[0130] Specifically, the above-mentioned processor 701 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be an integrated circuit configured to implement one or more embodiments of the present application.

[0131] The memory 702 may include a mass storage for data or instructions. By way of example and not limitation, the memory 702 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive, or a combination of two or more of these. In a suitable case, the memory 702 may include removable or non-removable (or fixed) media. In a suitable case, the memory 702 may be internal or external to the electronic device. In a particular embodiment, the memory 702 may be a non-volatile solid-state memory.

[0132] In one embodiment, the memory 702 may be a read only memory (ROM). In one embodiment, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), an electrically rewritable ROM (EAROM), or a flash memory, or a combination of two or more of these.

[0133] The processor 701 reads and executes the computer program instructions stored in the memory 702 to implement any one of the above-mentioned THA postoperative acetabular prosthesis angle evaluation methods based on multimodal data fusion.

[0134] In one example, the electronic device may further include a communication interface 703 and a bus 710. Among them, as Figure 7 shown, the processor 701, the memory 702, and the communication interface 703 are connected through the bus 710 and complete communication with each other.

[0135] The communication interface 703 is mainly used to implement communication between various modules, systems, units, and / or devices in the embodiments of the present application.

[0136] Bus 710 includes hardware, software, or both, and couples components of an electronic device to each other. By way of example and not limitation, the bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an InfiniBand interconnect, a Low Pin Count (LPC) bus, a memory bus, a MicroChannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local (VLB) bus, or other suitable bus or a combination of two or more of these. Where appropriate, bus 710 may include one or more buses. Although embodiments of the present application describe and illustrate specific buses, the present application contemplates any suitable bus or interconnect.

[0137] In addition, in combination with the above-described method for evaluating the acetabular prosthesis angle after THA based on multimodal data fusion in the embodiments, embodiments of the present application may provide a computer-readable storage medium to implement. Computer program instructions are stored on the computer-readable storage medium; when the computer program instructions are executed by a processor, any one of the above-described methods for evaluating the acetabular prosthesis angle after THA based on multimodal data fusion is implemented.

[0138] It should be clear that the present application is not limited to the specific configurations and processes described above and illustrated in the figures. For the sake of brevity, detailed descriptions of known methods are omitted here. In the above embodiments, several specific steps are described and illustrated as examples. However, the method process of the present application is not limited to the specific steps described and illustrated, and those skilled in the art can make various changes, modifications, and additions, or change the order between steps after understanding the spirit of the present application.

[0139] The functional modules shown in the above-described block diagrams can be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an Application Specific Integrated Circuit (ASIC), appropriate firmware, a plug-in, a functional card, and so on. When implemented in software, the elements of the present application are programs or code segments for performing the required tasks. The program or code segment can be stored in a machine-readable medium or transmitted via a data signal carried in a carrier wave on a transmission medium or a communication link. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROMs, flash memories, Erasable ROMs (EROMs), floppy disks, CD-ROMs, optical discs, hard disks, fiber optic media, Radio Frequency (RF) links, and so on. The code segment can be downloaded via a computer network such as the Internet, an intranet, and so on.

[0140] It should also be noted that, in the exemplary embodiments mentioned in this application, some methods or systems are described based on a series of steps or systems. However, this application is not limited to the order of the above steps. That is to say, the steps can be executed in the order mentioned in the embodiments, or different from the order in the embodiments, or several steps can be executed simultaneously.

[0141] As described above with reference to the flowcharts and / or block diagrams of the methods, systems, and computer program products according to the embodiments of the present application. It should be understood that each block in the flowchart and / or block diagram, and the combination of blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, or other programmable data processing system to generate a machine, such that the instructions executed by the processor of the computer or other programmable data processing system enable the implementation of the functions / actions specified in one or more blocks of the flowchart and / or block diagram. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor, or a field-programmable logic circuit. It should also be understood that each block in the block diagram and / or flowchart, and the combination of blocks in the block diagram and / or flowchart, can also be implemented by dedicated hardware that performs the specified functions or actions, or can be implemented by a combination of dedicated hardware and computer instructions.

[0142] As mentioned above, the above is only the specific implementation manner of this application. Those skilled in the art can clearly understand that for the convenience and conciseness of description, the specific working processes of the systems, modules, and units described above can refer to the corresponding processes in the foregoing method embodiments and will not be repeated here. It should be understood that the protection scope of this application is not limited thereto. Any person skilled in the art within the technical scope disclosed in this application can easily think of various equivalent modifications or substitutions, and these modifications or substitutions should all be covered within the protection scope of this application.

Claims

1. A method for evaluating the acetabular prosthesis angle after THA based on multimodal data fusion, characterized in that, Including: Obtain the CT images of both lower limbs of the patient before total hip arthroplasty; wherein, the coverage range of both lower limbs: from above the hip joint to below the knee joint; Perform three-dimensional reconstruction on the CT images of both lower limbs to clearly display the detailed anatomical information of the patient's pelvis and both lower limbs; Use a biplane X-ray acquisition system to acquire the anteroposterior and lateral X-ray images of both lower limbs of the patient in the weight-bearing position, and determine the positional relationship of the acetabular prosthesis and related anatomical landmarks relative to the overall force line of the lower limbs in the weight-bearing state; Perform fusion processing on the preoperative CT data and the postoperative biplane X-ray data to form a fused image in three-dimensional space, and accurately measure the anatomical anteversion angle, anatomical inclination angle, functional anteversion angle, and functional inclination angle of the postoperative acetabular prosthesis on this image.

2. The method for evaluating the acetabular prosthesis angle after THA based on multimodal data fusion according to claim 1, wherein Accurately calculate the angles of the acetabular prosthesis in three-dimensional space in the weight-bearing state after THA, including at least the anatomical anteversion angle, anatomical inclination angle, functional anteversion angle, and functional inclination angle of the acetabular prosthesis.

3. The method for evaluating the acetabular prosthesis angle after THA based on multimodal data fusion according to claim 1, wherein Obtain the CT images of both lower limbs of the patient before total hip arthroplasty, and perform three-dimensional reconstruction on the CT images of both lower limbs, including: The patient lies supine on the CT scanning bed, and the CT scan of both lower limbs of the patient is performed according to the standard scanning protocol, with the range from above the hip joint to below the knee joint; Use professional software to perform three-dimensional reconstruction on the scanned data to clearly display the detailed anatomical information of the patient's pelvis and both lower limbs, so as to accurately obtain the detailed anatomical structure information of the pelvis, femur, tibia, etc.

4. The method for evaluating the acetabular prosthesis angle after THA based on multimodal data fusion according to claim 1, wherein Use a biplane X-ray acquisition system to acquire the anteroposterior and lateral X-ray images of both lower limbs of the patient in the weight-bearing position, including: The patient stands on the biplane X-ray acquisition device and adjusts the posture to the standard weight-bearing position required by the device; Acquire the anteroposterior and lateral X-ray images of both lower limbs of the patient to ensure that the images clearly display the acetabular prosthesis and the overall morphology of the lower limbs.

5. The method for evaluating the acetabular prosthesis angle after THA based on multimodal data fusion according to claim 1, wherein, Perform fusion analysis on the CT reconstruction data and the biplane X-ray acquisition data to form a fused image in three-dimensional space, and accurately calculate the angles of the acetabular prosthesis in three-dimensional space, including: Input the CT reconstruction data and the biplane X-ray acquisition data into the trained deep learning multi-modal data registration and fusion model for image registration, correction, and data format conversion, so that the two data can accurately correspond, form a fused image in three-dimensional space, and accurately calculate the angles of the acetabular prosthesis in three-dimensional space.

6. The method for evaluating the acetabular prosthesis angle after THA based on multimodal data fusion according to claim 5, wherein, The deep learning multi-modal data registration and fusion model includes: The first network branch is used to correct, convert the data format, and extract feature maps from the CT reconstruction data to obtain the first feature map; The second network branch is used to correct, convert the data format, and extract feature maps from the biplane X-ray acquisition data to obtain the second feature map; The acetabular prosthesis angle evaluation network is used to register and fuse the first feature map and the second feature map to form a fused image in three-dimensional space, and evaluate the angles of the acetabular prosthesis in three-dimensional space according to the registration and fusion results.

7. The method for evaluating the acetabular prosthesis angle after THA based on multi-modal data fusion according to claim 2, characterized in that, After accurately calculating the angles of the acetabular prosthesis in three-dimensional space, it further includes: Display the calculation results of the angles of the acetabular prosthesis in three-dimensional space graphically on the screen, including the angle information of the acetabular prosthesis in three-dimensional space and its relative positional relationship with anatomical landmarks such as the pelvis and femur; Generate a detailed analysis report, including at least the patient's basic information, image data, measured angles, and analysis conclusions for clinical doctors' reference.

8. A THA postoperative acetabular prosthesis angle evaluation system based on multimodal data fusion, characterized in that, The system includes: A CT image acquisition module for acquiring bilateral lower limb CT images before total hip arthroplasty of the patient; wherein, the coverage range of the bilateral lower limbs: from above the hip joint to below the knee joint; A three-dimensional reconstruction module for performing three-dimensional reconstruction on the bilateral lower limb CT images to clearly display the detailed anatomical information of the patient's pelvis and bilateral lower limbs; An X-ray image acquisition module for using a biplane X-ray acquisition system to acquire the anteroposterior and lateral X-ray images of the patient's bilateral lower limbs in the weight-bearing position, and determining the positional relationship between the acetabular prosthesis and the relevant anatomical landmarks of the bone relative to the overall force line of the lower limb in the weight-bearing state; An acetabular prosthesis angle evaluation module for fusing the preoperative CT data and the postoperative biplane X-ray data to form a fused image in three-dimensional space, and accurately measuring the anatomical anteversion angle, anatomical inclination angle, functional anteversion angle, and functional inclination angle of the postoperative acetabular prosthesis on this image.

9. An electronic device, characterized in that, The electronic device includes: a processor and a memory storing computer program instructions; When the processor executes the computer program instructions, it implements the method for evaluating the acetabular prosthesis angle after THA based on multi-modal data fusion as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, Computer program instructions are stored on the computer-readable storage medium, and when the computer program instructions are executed by the processor, they implement the method for evaluating the acetabular prosthesis angle after THA based on multi-modal data fusion as described in any one of claims 1-7.

Images