A method for assessing acetabular prosthesis angle after THA surgery based on multimodal data fusion

Abstract

The application provides a THA postoperative acetabular prosthesis angle evaluation method and system based on multi-modal data fusion and a computer readable storage medium. The THA postoperative acetabular prosthesis angle evaluation method based on multi-modal data fusion comprises the following steps: acquiring a double lower limb CT image of a patient before total hip arthroplasty; wherein the coverage range of the double lower limbs is from above the hip joint to below the knee joint; performing three-dimensional reconstruction on the double lower limb CT image to clearly display detailed anatomical information of the pelvis and the double lower limbs of the patient; using a biplane X-ray acquisition system to acquire an anteroposterior and lateral X-ray image of the double lower limbs of the patient in a weight-bearing position, and determining the positional relationship of the acetabular prosthesis and the related anatomical landmarks of the skeleton relative to the overall force line of the lower limbs in the weight-bearing state; fusing the preoperative CT data and the postoperative biplane X-ray data to form a fusion image in a three-dimensional space, and performing accurate measurement of the postoperative acetabular prosthesis anatomical anteversion angle, anatomical inclination angle, functional anteversion angle and functional inclination angle on the image.

Description

Technical Field

[0001] This application belongs to the field of acetabular prosthesis angle assessment after THA, and particularly relates to a method, system and computer-readable storage medium for acetabular prosthesis angle assessment after THA based on multimodal data fusion. Background Technology

[0002] Currently, assessing the acetabular prosthesis angle after THA is crucial for determining prosthesis stability. Existing techniques primarily include the following methods:

[0003] (1) Routine X-ray examination: By taking anteroposterior or lateral X-ray films of the hip joint, the doctor manually measures the angle between the acetabular prosthesis and the anatomical landmarks of the pelvis, such as the acetabular abduction angle and anteversion angle, based on experience.

[0004] Disadvantages: Single-plane X-rays can only provide two-dimensional image information and are affected by the projection position, so they cannot accurately reflect the true angle of the acetabular prosthesis in three-dimensional space. The measurement error is relatively large, and the measurement results of different doctors may vary greatly.

[0005] (2) CT scan: After CT scanning of the acetabular region, the three-dimensional structure of the prosthesis can be observed to a certain extent.

[0006] Disadvantages: It lacks methods for monitoring weight-bearing positions; the acetabular cup is affected by pelvic position changes during standing and lying down. Additionally, CT scans, due to metal artifacts, cannot reconstruct the prosthesis position in three-dimensional space, affecting the accuracy of measurement results.

[0007] The aforementioned existing technology has the following main drawbacks when measuring the three-dimensional angles of the acetabular prosthesis after THA:

[0008] (1) Low measurement accuracy: Whether it is a regular X-ray or a CT scan, it is difficult to accurately measure the angle of the acetabular prosthesis in three-dimensional space, which affects the accurate judgment of the stability of the prosthesis and functional recovery.

[0009] (2) Lack of weight-bearing assessment: CT scans cannot obtain the precise relationship between the prosthesis and the overall force line of the lower limb when the prosthesis is in a weight-bearing position, and cannot truly simulate the stress situation of the acetabular prosthesis under the daily human activity state.

[0010] (3) Incomplete assessment: It cannot fully demonstrate the complex spatial relationship between the acetabular prosthesis, pelvis, femoral head and surrounding soft tissues, which is not conducive to a comprehensive judgment of the prosthesis status and potential problems. Summary of the Invention

[0011] This application provides a method, system, and computer-readable storage medium for evaluating the angle of the acetabular prosthesis after THA based on multimodal data fusion. It can accurately measure the angle of the acetabular prosthesis in three-dimensional space; obtain the precise relationship between the prosthesis and the overall force line of the lower limb when the prosthesis is in a weight-bearing position, and realistically simulate the stress situation of the acetabular prosthesis under the daily activity state of the human body; and comprehensively display the complex spatial relationship between the acetabular prosthesis and the pelvis, femur, tibia and surrounding soft tissues, which is conducive to the comprehensive judgment of the prosthesis status and potential problems.

[0012] In a first aspect, embodiments of this application provide a method for evaluating the acetabular prosthesis angle after THA surgery based on multimodal data fusion, including:

[0013] Obtain bilateral lower extremity CT images of the patient before total hip arthroplasty; the coverage area of ​​both lower extremities is from above the hip joint to below the knee joint.

[0014] Three-dimensional reconstruction was performed on CT images of both lower limbs to clearly display detailed anatomical information of the patient's pelvis and both lower limbs;

[0015] Using a dual-plane X-ray acquisition system, anteroposterior and lateral X-ray images of the patient's weight-bearing lower limbs were acquired to determine the positional relationship of the acetabular prosthesis and related skeletal anatomical landmarks relative to the overall force line of the lower limbs under weight-bearing conditions.

[0016] Preoperative CT data and postoperative biplane X-ray data are fused to form a three-dimensional fused image. On this image, the postoperative anatomical anteversion angle, anatomical tilt angle, functional anteversion angle, and functional tilt angle of the acetabular prosthesis are accurately measured.

[0017] Furthermore, the angles of the acetabular prosthesis in three-dimensional space after THA under load-bearing conditions are precisely calculated, including at least the anatomical anteversion angle, anatomical tilt angle, functional anteversion angle, and functional tilt angle of the acetabular prosthesis.

[0018] Furthermore, preoperative CT images of both lower extremities were acquired, and three-dimensional reconstruction was performed on the CT images, including:

[0019] The patient lies supine on the CT scanning table, and a CT scan of the patient's lower limbs is performed according to the standard scanning protocol, from above the hip joint to below the knee joint;

[0020] By using specialized software to perform three-dimensional reconstruction of the scanned data, the detailed anatomical information of the patient's pelvis and lower limbs can be clearly displayed, enabling precise acquisition of detailed anatomical information of the pelvis, femur, tibia, etc.

[0021] Furthermore, using a biplane X-ray acquisition system, anteroposterior and lateral X-ray images of the patient's weight-bearing lower limbs were acquired, including:

[0022] The patient stands on the biplane X-ray acquisition device and adjusts their posture to the standard weight-bearing position required by the device.

[0023] Acquire anteroposterior and lateral X-ray images of the patient's lower limbs to ensure that the images clearly show the acetabular prosthesis and the overall morphology of the lower limbs.

[0024] Furthermore, CT reconstruction data and biplane X-ray acquisition data are fused and analyzed to form a fused image in three-dimensional space, accurately calculating the angle of the acetabular prosthesis in three-dimensional space, including:

[0025] CT reconstruction data and biplane X-ray acquisition data are input into a trained deep learning multimodal data registration and fusion model for image registration, correction, and data format conversion, so that the two data can be accurately matched to form a fused image in three-dimensional space, and the angle of the acetabular prosthesis in three-dimensional space can be accurately calculated.

[0026] Furthermore, deep learning-based multimodal data registration and fusion models include:

[0027] The first network branch is used to correct CT reconstruction data, convert data format, and extract feature maps to obtain the first feature map;

[0028] The second network branch is used to correct, convert, and extract feature maps from the dual-plane X-ray acquisition data to obtain the second feature map.

[0029] The acetabular prosthesis angle assessment network is used to register and fuse the first feature map and the second feature map to form a fused image in three-dimensional space, and to assess the angle of the acetabular prosthesis in three-dimensional space based on the registration and fusion results.

[0030] Furthermore, after accurately calculating the angles of the acetabular prosthesis in three-dimensional space, the process also includes:

[0031] The angle calculation results of the acetabular prosthesis in three-dimensional space are displayed on the screen in a graphical manner, including the angle information of the acetabular prosthesis in three-dimensional space and its relative positional relationship with anatomical landmarks such as the pelvis and femur;

[0032] Generate a detailed analysis report, which includes at least basic patient information, image data, measurement angles, and analysis conclusions, for clinicians' reference.

[0033] Secondly, embodiments of this application provide a system for assessing the acetabular prosthesis angle after THA surgery based on multimodal data fusion, comprising:

[0034] The CT image acquisition module is used to acquire CT images of both lower limbs before total hip arthroplasty; the coverage area of ​​both lower limbs is from above the hip joint to below the knee joint.

[0035] The 3D reconstruction module is used to perform 3D reconstruction of CT images of both lower limbs to clearly display detailed anatomical information of the patient's pelvis and both lower limbs;

[0036] The X-ray image acquisition module is used to acquire anteroposterior and lateral X-ray images of the patient's weight-bearing lower limbs using a dual-plane X-ray acquisition system, and to determine the positional relationship of the acetabular prosthesis and related anatomical landmarks relative to the overall force line of the lower limbs under weight-bearing conditions.

[0037] The acetabular prosthesis angle assessment module is used to fuse preoperative CT data and postoperative biplane X-ray data to form a three-dimensional fused image. On this image, the anatomical anteversion angle, anatomical tilt angle, functional anteversion angle, functional tilt angle and other related angles of the acetabular prosthesis are accurately measured.

[0038] Thirdly, embodiments of this application provide an electronic device, which includes: a processor and a memory storing computer program instructions;

[0039] When the processor executes the computer program instructions, it implements a method for evaluating the acetabular prosthesis angle after THA surgery based on multimodal data fusion.

[0040] Fourthly, embodiments of this application provide a computer-readable storage medium storing computer program instructions, which, when executed by a processor, implement a method for evaluating the acetabular prosthesis angle after THA surgery based on multimodal data fusion.

[0041] The present application provides a method, system, and computer-readable storage medium for evaluating the angle of the acetabular prosthesis after THA based on multimodal data fusion. These methods can accurately measure the angle of the acetabular prosthesis in three-dimensional space; obtain the precise relationship between the prosthesis and the overall force line of the lower limb when the prosthesis is in a weight-bearing position, and realistically simulate the stress on the acetabular prosthesis during daily human activities; and comprehensively demonstrate the complex spatial relationship between the acetabular prosthesis and the pelvis, femur, tibia, and surrounding soft tissues, which is beneficial for comprehensively judging the prosthesis status and potential problems.

[0042] This method for assessing the acetabular prosthesis angle after THA surgery based on multimodal data fusion includes:

[0043] Obtain bilateral lower extremity CT images of the patient before total hip arthroplasty; the coverage area of ​​both lower extremities is from above the hip joint to below the knee joint.

[0044] Three-dimensional reconstruction was performed on CT images of both lower limbs to clearly display detailed anatomical information of the patient's pelvis and both lower limbs;

[0045] Using a dual-plane X-ray acquisition system, anteroposterior and lateral X-ray images of the patient's weight-bearing lower limbs were acquired to determine the positional relationship of the acetabular prosthesis and related skeletal anatomical landmarks relative to the overall force line of the lower limbs under weight-bearing conditions.

[0046] Preoperative CT data and postoperative biplane X-ray data are fused to form a three-dimensional fused image. On this image, the anatomical anteversion angle, anatomical tilt angle, functional anteversion angle, and functional tilt angle of the acetabular prosthesis are accurately measured. Attached Figure Description

[0047] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0048] Figure 1 This is a flowchart illustrating a method for evaluating the acetabular prosthesis angle after THA based on multimodal data fusion, provided in one embodiment of this application.

[0049] Figure 2 This is a schematic diagram of a fused image in three-dimensional space provided in one embodiment of this application;

[0050] Figure 3 This is a schematic diagram of the anatomical anterior tilt angle provided in one embodiment of this application;

[0051] Figure 4 This is a schematic diagram of a functional lean angle provided in one embodiment of this application;

[0052] Figure 5 This is a schematic diagram of the structure of a deep learning multimodal data registration and fusion model provided in one embodiment of this application;

[0053] Figure 6 This is a schematic diagram of the structure of a THA postoperative acetabular prosthesis angle assessment system based on multimodal data fusion provided in one embodiment of this application;

[0054] Figure 7 This is a schematic diagram of the structure of an electronic device provided in one embodiment of this application. Detailed Implementation

[0055] The features and exemplary embodiments of various aspects of this application will be described in detail below. To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain this application and not to limit it. For those skilled in the art, this application can be implemented without some of these specific details. The following description of the embodiments is merely to provide a better understanding of this application by illustrating examples.

[0056] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus that includes said element.

[0057] To address the problems of the prior art, this application provides a method, system, and computer-readable storage medium for evaluating the acetabular prosthesis angle after THA based on multimodal data fusion. The method for evaluating the acetabular prosthesis angle after THA based on multimodal data fusion provided in this application is described below.

[0058] Figure 1 This illustration shows a flowchart of a method for assessing the acetabular prosthesis angle after THA based on multimodal data fusion, according to an embodiment of this application. Figure 1 As shown, this method for assessing the acetabular prosthesis angle after THA based on multimodal data fusion includes:

[0059] S101. Obtain CT images of both lower extremities before the patient's total hip arthroplasty; the coverage area of ​​both lower extremities is from above the hip joint to below the knee joint.

[0060] S102. Perform three-dimensional reconstruction on CT images of both lower limbs to clearly display detailed anatomical information of the patient's pelvis and both lower limbs;

[0061] In one embodiment, acquiring bilateral lower extremity CT images of a patient before total hip arthroplasty and performing three-dimensional reconstruction of the bilateral lower extremity CT images includes:

[0062] The patient lies supine on the CT scanning table, and a CT scan of the patient's lower limbs is performed according to the standard scanning protocol, from above the hip joint to below the knee joint;

[0063] By using specialized software to perform three-dimensional reconstruction of the scanned data, the detailed anatomical information of the patient's pelvis and lower limbs can be clearly displayed, enabling precise acquisition of detailed anatomical information of the pelvis, femur, tibia, etc.

[0064] Currently, CT scans cannot reconstruct the position of the prosthesis in three dimensions due to the presence of metal artifacts, but this application can reconstruct the position of the prosthesis after THA surgery.

[0065] S103. Using a dual-plane X-ray acquisition system, acquire anteroposterior and lateral X-ray images of the patient's weight-bearing lower limbs to determine the positional relationship of the acetabular prosthesis and related skeletal anatomical landmarks relative to the overall force line of the lower limbs under weight-bearing conditions.

[0066] In one embodiment, a dual-plane X-ray acquisition system is used to acquire anteroposterior and lateral X-ray images of the patient's weight-bearing lower limbs, including:

[0067] The patient stands on the biplane X-ray acquisition device and adjusts their posture to the standard weight-bearing position required by the device.

[0068] Acquire anteroposterior and lateral X-ray images of the patient's lower limbs to ensure that the images clearly show the acetabular prosthesis and the overall morphology of the lower limbs.

[0069] The dual-plane X-ray acquisition system acquires anteroposterior and lateral X-ray images of both lower limbs in a weight-bearing position, determines the positional relationship of the acetabular prosthesis relative to the overall force line of the lower limbs under weight-bearing conditions, and provides a weight-bearing reference for three-dimensional angle calculation.

[0070] S104. The preoperative CT data and postoperative biplane X-ray data are fused to form a three-dimensional fused image. The anatomical anteversion angle, anatomical tilt angle, functional anteversion angle, and functional tilt angle of the acetabular prosthesis are accurately measured on this image.

[0071] Figure 2 This is a schematic diagram of a fused image in three-dimensional space provided in one embodiment of this application.

[0072] By fusing and analyzing CT reconstruction data and biplane X-ray acquisition data using a specific algorithm, the angles of the acetabular prosthesis in three-dimensional space can be accurately calculated, including the angles with the pelvic anatomical axis, femur, tibia, and lower limb force lines in the sagittal, coronal, and axial planes.

[0073] In one embodiment, the angles of the acetabular prosthesis in three-dimensional space are accurately calculated, including at least the anatomical anteversion angle, the anatomical tilt angle, the functional anteversion angle, and the functional tilt angle.

[0074] Anatomical anteversion angle: refers to the angle between the plane of the acetabular prosthesis opening and the sagittal plane.

[0075] Anatomical tilt angle: refers to the angle between the plane of the acetabular prosthesis opening and the coronal plane.

[0076] Functional anteversion angle: refers to the angle between the acetabular prosthesis and the functional pelvic plane in a functional position (such as standing or sitting).

[0077] Functional tilt angle: refers to the angle between the acetabular prosthesis and the functional pelvic plane in the functional position.

[0078] The schematic diagram of the anatomical anterior tilt angle is shown below. Figure 3 As shown, the measurement steps for the anatomical anterior tilt angle (sagittal plane) are as follows:

[0079] (1) Reconstruct the midsagittal plane of the pelvis (through the pubic symphysis-sacral midline);

[0080] (2) Locate the acetabular prosthesis opening plane on the cross-sectional image;

[0081] (3) Measure the angle between the prosthesis plane and the sagittal axis (the midline perpendicular to the coronal plane);

[0082] Normal range: 15-25° (insufficient forward tilting can easily lead to posterior dislocation, while excessive forward tilting increases the risk of anterior dislocation).

[0083] The steps for measuring the anatomical tilt angle (coronal plane) are as follows:

[0084] (1) Determine the coronal axis of the pelvis (the line connecting the anterior superior iliac spines on both sides);

[0085] (2) Draw a tangent line along the opening edge of the acetabular prosthesis;

[0086] (3) Measure the angle between the tangent and the coronal axis;

[0087] Normal range: 40-50° (abduction angle directly affects joint contact stress).

[0088] in, Figure 4 This is a schematic diagram of a functional anteversion angle provided in one embodiment of this application. The measurement steps for the functional anteversion angle (considering the pelvis) are as follows:

[0089] (1) Establish the functional pelvic plane (the plane of three points: bilateral ischial tuberosities and the lower edge of the pubic symphysis);

[0090] (2) Measure the angle between the prosthesis opening plane and the plane on the sagittal projection;

[0091] Clinical significance: When sitting, the pelvis tilts posteriorly by about 20°, requiring corresponding increases in the anterior tilt angle for compensation.

[0092] The key points for measuring the functional tilt angle (considering the pelvis) are as follows:

[0093] (1) Acquire images while standing on one leg;

[0094] (2) Measure the angle between the prosthesis opening plane and the gravity line (the line connecting the center of the contralateral femoral head to the center of the acetabulum).

[0095] The algorithm automatically identifies the midline of the acetabular prosthesis, the anatomical axis of the pelvis, the center of the femoral head, and the force line of the lower limb.

[0096] The angles of the acetabular prosthesis in the sagittal, coronal, and axial directions, such as the acetabular abduction angle and anteversion angle, are calculated according to the preset formula.

[0097] Data fusion and processing:

[0098] Import CT reconstruction data and dual-plane X-ray acquisition data into the data fusion and processing unit;

[0099] Perform image registration, correction, and data format conversion to ensure accurate correspondence between the two datasets.

[0100] In one embodiment, CT reconstruction data and biplane X-ray acquisition data are fused and analyzed to form a fused image in three-dimensional space, and the angle of the acetabular prosthesis in three-dimensional space is accurately calculated, including:

[0101] CT reconstruction data and biplane X-ray acquisition data are input into a trained deep learning multimodal data registration and fusion model for image registration, correction, and data format conversion, so that the two data can be accurately matched to form a fused image in three-dimensional space, and the angle of the acetabular prosthesis in three-dimensional space can be accurately calculated.

[0102] Figure 5 This is a schematic diagram of the structure of a deep learning multimodal data registration and fusion model provided in one embodiment of this application.

[0103] In one embodiment, a deep learning multimodal data registration and fusion model includes:

[0104] The first network branch is used to correct CT reconstruction data, convert data format, and extract feature maps to obtain the first feature map;

[0105] The second network branch is used to correct, convert, and extract feature maps from the dual-plane X-ray acquisition data to obtain the second feature map.

[0106] The acetabular prosthesis angle assessment network is used to register and fuse the first feature map and the second feature map to form a fused image in three-dimensional space, and to assess the angle of the acetabular prosthesis in three-dimensional space based on the registration and fusion results.

[0107] In one embodiment, after accurately calculating the angle of the acetabular prosthesis in three-dimensional space, the method further includes:

[0108] The angle calculation results of the acetabular prosthesis in three-dimensional space are displayed on the screen in a graphical manner, including the angle information of the acetabular prosthesis in three-dimensional space and its relative positional relationship with anatomical landmarks such as the pelvis and femur;

[0109] Generate a detailed analysis report, which includes at least basic patient information, image data, measurement angles, and analysis conclusions, for clinicians' reference.

[0110] Results Display and Output: Measurement results are displayed graphically on the screen, including the angular information of the acetabular prosthesis in three-dimensional space and its relationship with each axis, as well as the angular values. A detailed PDF report is generated, containing basic patient information, image data, measurement angles, and analysis conclusions, for clinicians' reference.

[0111] The core innovations of this invention include:

[0112] (1) Multimodal data fusion: The innovative combination of dual-plane X-ray acquisition system and CT three-dimensional reconstruction of the lower limbs enables accurate three-dimensional measurement of the acetabular prosthesis from multiple angles and in all directions, making full use of the advantages of the two imaging technologies to make up for the shortcomings of single-modal measurement.

[0113] (2) Accurate measurement under load: Emphasis is placed on angle measurement under load, which is more in line with the physiological state of the human body and provides a reliable basis for evaluating the performance of the prosthesis in actual use.

[0114] (3) Intelligent algorithm analysis: Advanced image processing and analysis algorithms are used to automatically identify the acetabular prosthesis and related anatomical landmarks, thereby improving measurement efficiency and accuracy.

[0115] During the testing and validation process, multiple patients who had undergone acetabular prosthesis implantation were tested. The measurement results of this method were compared with those of traditional measurement methods and the actual implantation angle during surgery. The results showed:

[0116] Compared with traditional X-ray measurement methods, the angle error is reduced by more than 80%, and the deviation from the actual implantation angle during surgery is within ±1°.

[0117] In repeatable tests conducted by different personnel and at different time points, the consistency (ICC value) of the measurement results was greater than 0.98, demonstrating high stability and reliability.

[0118] Therefore, compared with the prior art, the present invention has the following significant differences:

[0119] (1) Significantly improved accuracy: The fused technology can measure angles with an accuracy of ±1°, which is far higher than the accuracy of existing technologies.

[0120] (2) Comprehensive assessment: It can simultaneously analyze the angles of the acetabular prosthesis in multiple planes such as sagittal, coronal and axial planes and its relationship with the pelvis, femoral head and lower limb force lines, providing a more comprehensive basis for hip joint function assessment.

[0121] (3) High clinical application value: More accurate measurement results help doctors develop personalized treatment plans, such as adjusting rehabilitation training plans, judging whether the dislocation after THA is due to poor angle or other reasons such as loosening, timely detection and treatment of problems such as prosthesis loosening or wear, and improving the quality of life and lifespan of prostheses for patients after THA.

[0122] Figure 6 This is a schematic diagram of the structure of a THA postoperative acetabular prosthesis angle assessment system based on multimodal data fusion provided in one embodiment of this application.

[0123] This multimodal data fusion-based system for assessing the acetabular prosthesis angle after THA includes:

[0124] The CT image acquisition module 601 is used to acquire CT images of both lower limbs before a patient undergoes total hip arthroplasty; wherein the coverage area of ​​both lower limbs is from above the hip joint to below the knee joint.

[0125] The 3D reconstruction module 602 is used to perform 3D reconstruction of CT images of both lower limbs to clearly display detailed anatomical information of the patient's pelvis and both lower limbs;

[0126] The X-ray image acquisition module 603 is used to acquire anteroposterior and lateral X-ray images of the patient's two lower limbs in a weight-bearing position using a dual-plane X-ray acquisition system, and to determine the positional relationship of the acetabular prosthesis and related anatomical landmarks of the skeleton relative to the overall force line of the lower limbs under weight-bearing conditions.

[0127] The acetabular prosthesis angle assessment module 604 is used to fuse preoperative CT data and postoperative biplane X-ray data to form a fused image in three-dimensional space. On this image, the anatomical anteversion angle, anatomical tilt angle, functional anteversion angle, and functional tilt angle of the acetabular prosthesis are accurately measured.

[0128] Figure 7 This is a schematic diagram of the structure of an electronic device provided in one embodiment of this application.

[0129] The electronic device may include a processor 701 and a memory 702 storing computer program instructions.

[0130] Specifically, the processor 701 may include a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits that can be configured to implement the embodiments of this application.

[0131] Memory 702 may include mass storage for data or instructions. For example, and not limitingly, memory 702 may include a hard disk drive (HDD), floppy disk drive, flash memory, optical disk, magneto-optical disk, magnetic tape, or Universal Serial Bus (USB) drive, or a combination of two or more of these. Where suitable, memory 702 may include removable or non-removable (or fixed) media. Where suitable, memory 702 may be internal or external to an electronic device. In a particular embodiment, memory 702 may be a non-volatile solid-state memory.

[0132] In one embodiment, memory 702 may be read-only memory (ROM). In one embodiment, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), an electrically rewritable ROM (EAROM), or flash memory, or a combination of two or more of these.

[0133] The processor 701 reads and executes computer program instructions stored in the memory 702 to implement any of the above embodiments of the THA postoperative acetabular prosthesis angle assessment method based on multimodal data fusion.

[0134] In one example, the electronic device may also include a communication interface 703 and a bus 710. For example, Figure 7 As shown, the processor 701, memory 702, and communication interface 703 are connected through bus 710 and complete communication with each other.

[0135] The communication interface 703 is mainly used to realize communication between various modules, systems, units and / or devices in the embodiments of this application.

[0136] Bus 710 includes hardware, software, or both, that couples components of an electronic device together. For example, and not limitingly, the bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an Infinite Bandwidth Interconnect, a Low Pin Count (LPC) bus, a memory bus, a Microchannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local (VLB) bus, or other suitable buses, or combinations of two or more of these. Where appropriate, bus 710 may include one or more buses. Although specific buses are described and illustrated in embodiments of this application, any suitable bus or interconnect is contemplated herein.

[0137] Furthermore, in conjunction with the multimodal data fusion-based method for assessing the acetabular prosthesis angle after THA surgery described in the above embodiments, this application embodiment can be implemented using a computer-readable storage medium. This computer-readable storage medium stores computer program instructions; when executed by a processor, these computer program instructions implement any of the multimodal data fusion-based methods for assessing the acetabular prosthesis angle after THA surgery described in the above embodiments.

[0138] It should be clarified that this application is not limited to the specific configurations and processes described above and shown in the figures. For the sake of brevity, detailed descriptions of known methods are omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of this application is not limited to the specific steps described and shown. Those skilled in the art can make various changes, modifications, and additions, or change the order of steps, after understanding the spirit of this application.

[0139] The functional modules shown in the above-described block diagram can be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, they can be, for example, electronic circuits, application-specific integrated circuits (ASICs), appropriate firmware, plug-ins, function cards, etc. When implemented in software, the elements of this application are programs or code segments used to perform the required tasks. Programs or code segments can be stored on a machine-readable medium or transmitted over a transmission medium or communication link via data signals carried on a carrier wave. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, radio frequency (RF) links, etc. Code segments can be downloaded via computer networks such as the Internet, intranets, etc.

[0140] It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or systems. However, this application is not limited to the order of the above steps; that is, the steps can be performed in the order mentioned in the embodiments, or in a different order, or several steps can be performed simultaneously.

[0141] The foregoing flowcharts and / or block diagrams of methods, systems, and computer program products according to embodiments of this application have described various aspects of the present application. It should be understood that each block in the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing system to produce a machine such that these instructions, executable via the processor of the computer or other programmable data processing system, enable the implementation of the functions / actions specified in one or more blocks of the flowcharts and / or block diagrams. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor, or a field-programmable logic circuit. It is also understood that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can also be implemented by special-purpose hardware performing the specified functions or actions, or can be implemented by a combination of special-purpose hardware and computer instructions.

[0142] The above description is merely a specific implementation of this application. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, modules, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here. It should be understood that the protection scope of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the protection scope of this application.

Claims

1. A method for evaluating the angle of the acetabular prosthesis after THA based on multi-modal data fusion, characterized in that, The application relates to a method for measuring the angles of a hip joint prosthesis in a three-dimensional space under a weight-bearing state after total hip arthroplasty. The method comprises the following steps: CT images of both lower limbs of a patient before total hip arthroplasty are acquired; the coverage range of the lower limbs is from above the hip joint to below the knee joint; three-dimensional reconstruction is performed on the CT images of the lower limbs to clearly show detailed anatomical information of the pelvis and the lower limbs of the patient; a biplane X-ray acquisition system is used to acquire anteroposterior and lateral X-ray images of the lower limbs of the patient in a weight-bearing position, and the position relationship of the acetabular prosthesis and the related anatomical markers of the skeleton relative to the overall force line of the lower limbs under the weight-bearing state is determined; the preoperative CT data and the postoperative biplane X-ray data are fused to form a fused image in a three-dimensional space, and accurate measurement of the anatomical anteversion angle, the anatomical inclination angle, the functional anteversion angle and the functional inclination angle of the acetabular prosthesis is performed on the image; the measurement steps of the functional anteversion angle are as follows: a functional pelvic plane is established, the functional pelvic plane is a three-point plane of the bilateral ischial tuberosities and the lower edge of the pubic symphysis; the included angle between the prosthesis opening plane and the plane is measured on the sagittal plane projection; the measurement points of the functional inclination angle are as follows:

2. The method for post-THA acetabular prosthesis angle evaluation based on multi-modal data fusion according to claim 1, characterized in that, the image is acquired in a single-leg standing phase; the included angle between the prosthesis opening plane and the gravity line, which is the connecting line from the center of the contralateral femoral head to the center of the acetabulum, is measured.

3. The method for post-THA acetabular prosthesis angle evaluation based on multi-modal data fusion according to claim 1, characterized in that, The angles of the acetabular prosthesis in a three-dimensional space under a weight-bearing state after total hip arthroplasty are accurately calculated, and the angles at least include the anatomical anteversion angle, the anatomical inclination angle, the functional anteversion angle and the functional inclination angle of the acetabular prosthesis. CT images of both lower limbs of a patient before total hip arthroplasty are acquired, and three-dimensional reconstruction is performed on the CT images of the lower limbs, including: The patient lies on the CT scanning bed, and CT scanning is performed on the lower limbs of the patient according to a standard scanning protocol, the scanning range being from above the hip joint to below the knee joint; 4. The method for post-THA acetabular prosthesis angle evaluation based on multi-modal data fusion according to claim 1, characterized in that, three-dimensional reconstruction is performed on the scanning data by using professional software, and detailed anatomical information of the pelvis and the lower limbs of the patient is clearly shown, so that detailed anatomical structure information of the pelvis, the femur and the tibia can be accurately acquired. A biplane X-ray acquisition system is used to acquire anteroposterior and lateral X-ray images of the lower limbs of the patient in a weight-bearing position, including: The patient stands on the biplane X-ray acquisition device, and the posture is adjusted to the standard weight-bearing position required by the device; 5. The method for post-THA acetabular prosthesis angle evaluation based on multi-modal data fusion as claimed in claim 1, wherein, anteroposterior and lateral X-ray images of the lower limbs of the patient are acquired, and the images clearly show the overall morphology of the acetabular prosthesis and the lower limbs. CT reconstruction data and biplane X-ray acquisition data are fused and analyzed to form a fused image in a three-dimensional space, and the angles of the acetabular prosthesis in the three-dimensional space are accurately calculated, including:

6. The method for post-THA acetabular prosthesis angle evaluation based on multi-modal data fusion according to claim 5, characterized in that, The CT reconstruction data and the biplane X-ray acquisition data are input into a trained deep learning multi-modal data registration and fusion model for image registration, correction and data format conversion, so that the two data can be accurately corresponded, a fused image in a three-dimensional space is formed, and the angles of the acetabular prosthesis in the three-dimensional space are accurately calculated. The deep learning multi-modal data registration and fusion model comprises: a first network branch for correcting, data format converting and feature map extracting the CT reconstruction data to obtain a first feature map; a second network branch for correcting, data format converting and feature map extracting the biplane X-ray acquisition data to obtain a second feature map; The acetabular prosthesis angle evaluation network is used for registration and fusion of the first feature map and the second feature map, forms a fused image in three-dimensional space, and performs angle evaluation of the acetabular prosthesis in the three-dimensional space according to the registration and fusion result.

7. The method for post-THA acetabular prosthesis angle evaluation based on multi-modal data fusion as claimed in claim 2, wherein, After the angle of the acetabular prosthesis in the three-dimensional space is accurately calculated, the following steps are further included: The angle calculation result of the acetabular prosthesis in the three-dimensional space is displayed in a graphical manner on the screen, including the angle information of the acetabular prosthesis in the three-dimensional space and the relative position relationship with the anatomical landmarks such as the pelvis and the femur; A detailed analysis report is generated, at least containing patient basic information, image data, measured angle and analysis conclusion, for reference by clinicians.

8. A THA postoperative acetabular prosthesis angle evaluation system based on multi-modal data fusion, characterized in that, The system comprises: A CT image acquisition module is configured to acquire CT images of both lower limbs of a patient before total hip arthroplasty; wherein the coverage range of both lower limbs is from above the hip joint to below the knee joint; A three-dimensional reconstruction module is configured to perform three-dimensional reconstruction on the CT images of both lower limbs to clearly display detailed anatomical information of the pelvis and both lower limbs of the patient; An X-ray image acquisition module is configured to use a biplane X-ray acquisition system to acquire anteroposterior and lateral X-ray images of both lower limbs of the patient in a weight-bearing position, and determine the position relationship of the acetabular prosthesis and the related anatomical landmarks of the skeleton relative to the overall force line of the lower limbs in the weight-bearing state; An acetabular prosthesis angle evaluation module is configured to fuse the preoperative CT data and the postoperative biplane X-ray data to form a fused image in three-dimensional space, and accurately measure the anatomical anteversion angle, the anatomical inclination angle, the functional anteversion angle and the functional inclination angle of the postoperative acetabular prosthesis on the image; wherein the measurement steps of the functional anteversion angle are as follows: a functional pelvic plane is established, which is a three-point plane of the bilateral ischial tuberosities and the lower edge of the pubic symphysis; the included angle between the prosthesis opening plane and the plane is measured on the sagittal plane projection; The measurement points of the functional inclination angle are as follows: The image is acquired in a single-leg standing phase; the included angle between the prosthesis opening plane and the gravity line is measured, and the gravity line is a connecting line from the center of the contralateral femoral head to the center of the acetabulum.

9. An electronic device, comprising: The electronic device comprises a processor and a memory storing computer program instructions; The processor executes the computer program instructions to implement the THA postoperative acetabular prosthesis angle evaluation method based on multi-modal data fusion according to any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, The computer program instructions are stored on the computer readable storage medium, and the computer program instructions are executed by the processor to implement the THA postoperative acetabular prosthesis angle evaluation method based on multi-modal data fusion according to any one of claims 1-7.

Images