Preoperative planning information correction method, device and preoperative planning system

By marking boundary points in the preoperative planning system to form a correction axis and automatically adjusting the three-dimensional view, the problem that conventional four views are difficult to meet the personalized needs of doctors is solved, and the accuracy and efficiency of preoperative planning are improved.

CN118675700BActive Publication Date: 2024-11-29YUANHUA ORTHOPAEDIC ROBOTICS (SHENZHEN) LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411154489.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-08-22
Publication Date
2024-11-29
Estimated Expiration
2044-08-22

AI Technical Summary

Technical Problem

In the prior art In preoperative planning, conventional four-views are difficult to meet the personalized needs of doctors, resulting in limited accuracy and efficiency of preoperative planning.

Method used

A preoperative planning information correction method and system is provided. By marking multiple boundary points in the view area to form a correction axis, the three-dimensional view is automatically rotated and adjusted to make it more in line with the doctor's observation angle.

Benefits of technology

It improves the accuracy and efficiency of preoperative planning, helps doctors better observe the surgical site and formulate appropriate surgical plans.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118675700B_ABST
    Figure CN118675700B_ABST
Patent Text Reader

Abstract

The embodiments of the present application are applicable to the field of computer-assisted medical technology, and provide a method, device and system for correcting preoperative planning information, the method comprising: displaying a preoperative planning operation page including a view area and an operation area, wherein the view area displays a three-dimensional view and multiple two-dimensional views of the surgical site, and the operation area includes a landmark point list area displaying multiple landmark points; at least one correction axis can be formed by determining multiple landmark points marked in the view area; after receiving the correction instruction, the information to be corrected can be determined based on the correction axis, and the three-dimensional view can be corrected according to the information to be corrected. Using the above method, landmark points can be selected to form a correction axis and the three-dimensional view can be corrected using the correction axis, so that the display effect of the corrected three-dimensional view is more in line with the doctor's observation angle, which is convenient for the doctor to complete preoperative planning more efficiently.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application belong to the field of computer-assisted medical technology, and in particular, relate to a method and device for correcting preoperative planning information and a preoperative planning system. Background Art

[0002] Computer-assisted medical technology is a technology that uses computer technology to analyze and process medical images or clinical data, and gives corresponding diagnostic opinions or assists doctors in making diagnoses. The application of computer-assisted medical technology can improve the efficiency of diagnosis and treatment and reduce the workload of doctors. For example, intelligent orthopedic surgical robots can be used to assist doctors in orthopedic surgery.

[0003] Before using the intelligent orthopedic surgical robot to assist in surgery, the doctor needs to make preoperative planning based on the patient's actual situation and formulate a reasonable surgical plan. In this process, it is particularly important to show the doctor the relevant information of the patient's surgical site completely and accurately. At present, conventional four views are usually used for preoperative planning, that is, 3D (three dimensions) view, cross-sectional CT (computed tomography) view, sagittal CT view, coronal CT view, etc. are used to display the information of the patient's surgical site. However, the conventional four views are all obtained through modeling based on preoperative scanning, and the information displayed is the posture of the surgical site at the time of scanning. However, due to the diversity of surgical procedures and the complexity of patients, it is difficult to use conventional four views to specifically display the information that the doctor actually wants to observe, and the personalized needs of the doctor in the preoperative planning stage are difficult to be guaranteed, which has an adverse effect on the rapid and accurate preoperative planning. Summary of the invention

[0004] In view of this, the embodiments of the present application provide a method, device and preoperative planning system for correcting preoperative planning information, which can correct various views obtained by modeling according to the actual needs of orthopedic surgery or the actual needs of the doctor, so that the final displayed view effect is more in line with the doctor's observation perspective, which helps the doctor to complete preoperative planning more efficiently and accurately.

[0005] A first aspect of an embodiment of the present application provides a method for correcting preoperative planning information, comprising:

[0006] Displaying a preoperative planning operation page, the preoperative planning operation page includes a view area and an operation area, the view area displays a three-dimensional view and multiple two-dimensional views of the surgical site, the multiple two-dimensional views include a cross-sectional view, a sagittal view and a coronal view, and the operation area includes a landmark point list area displaying multiple landmark points;

[0007] Determining a plurality of landmark points marked in the viewing area, the plurality of landmark points marked in the viewing area corresponding one-to-one to a plurality of landmark points selected in the landmark point list area, the plurality of landmark points marked in the viewing area forming at least one correction axis;

[0008] In response to the received correction instruction, determining information to be corrected based on the correction axis, the information to be corrected including rotation angles in multiple directions of the bone model coordinate system;

[0009] The three-dimensional view is corrected according to the information to be corrected.

[0010] A second aspect of an embodiment of the present application provides a preoperative planning information correction device, comprising:

[0011] A display module, used for displaying a preoperative planning operation page, wherein the preoperative planning operation page includes a view area and an operation area, wherein the view area displays a three-dimensional view and multiple two-dimensional views of the surgical site, wherein the multiple two-dimensional views include a cross-sectional view, a sagittal view, and a coronal view, and the operation area includes a landmark point list area displaying multiple landmark points;

[0012] a marking module, configured to determine a plurality of marked landmark points in the viewing area, wherein the plurality of marked landmark points in the viewing area correspond one-to-one to the plurality of landmark points selected in the landmark point list area, and the plurality of marked landmark points in the viewing area form at least one correction axis;

[0013] A determination module, configured to determine information to be corrected based on the correction axis in response to the received correction instruction, wherein the information to be corrected includes rotation angles in multiple directions of the bone model coordinate system;

[0014] A correction module is used to correct the three-dimensional view according to the information to be corrected.

[0015] A third aspect of an embodiment of the present application provides a preoperative planning system, comprising the preoperative planning information correction device as described in the second aspect above.

[0016] A fourth aspect of an embodiment of the present application provides a preoperative planning system, including a display unit and a processing unit, wherein:

[0017] A display unit, used for displaying a preoperative planning operation page, wherein the preoperative planning operation page includes a view area and an operation area, wherein the view area displays a three-dimensional view and multiple two-dimensional views of the surgical site, wherein the multiple two-dimensional views include a cross-sectional view, a sagittal view, and a coronal view, and the operation area includes a landmark point list area displaying multiple landmark points;

[0018] The processing unit is used to determine the multiple landmark points marked in the viewing area, and in response to the received correction instruction, determine the information to be corrected based on the correction axis, wherein the information to be corrected includes the rotation angles in multiple directions of the bone model coordinate system; and correct the three-dimensional view according to the information to be corrected. The multiple landmark points marked in the viewing area correspond to the multiple landmark points selected in the landmark point list area one by one, and the correction axis is formed by connecting the multiple landmark points marked in the viewing area.

[0019] The fifth aspect of an embodiment of the present application provides a computer-assisted medical device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the preoperative planning information correction method as described in the first aspect above is implemented.

[0020] A sixth aspect of an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the preoperative planning information correction method as described in the first aspect above is implemented.

[0021] A seventh aspect of the embodiments of the present application provides a computer program product. When the computer program product is run on a computer, the computer is enabled to execute the preoperative planning information correction method described in the first aspect.

[0022] Compared with the prior art, the embodiments of the present application have the following beneficial effects:

[0023] In an embodiment of the present application, a three-dimensional view and multiple two-dimensional views of the surgical site can be displayed to the doctor through the preoperative planning operation page, so that the doctor can observe the surgical site in order to formulate a suitable surgical plan. When the three-dimensional view modeled based on the original data obtained by scanning does not meet the doctor's actual observation needs, the doctor can mark multiple landmark points in the view area of ​​the page to form at least one correction axis. In this way, the preoperative planning system can automatically correct the three-dimensional view according to the correction axis. Since the correction axis is determined by connecting the various position points selected by the doctor in the view, the doctor can select the appropriate position point according to his own observation needs to form a correction correction, so that after the preoperative planning system corrects the view according to the correction axis, the three-dimensional view presented is more in line with the doctor's observation perspective, which helps the doctor to better observe the actual situation of the surgical site and complete the planning of the surgical plan more efficiently and accurately. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments or prior art descriptions. Obviously, the drawings described below are only some embodiments of the present application, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0025] Figure 1 is a schematic diagram of a preoperative planning information correction method provided in an embodiment of the present application;

[0026] Figure 2 is a schematic diagram of a preoperative planning operation page provided in an embodiment of the present application;

[0027] Figure 3 is a schematic diagram of a process for correcting an original view provided in an embodiment of the present application;

[0028] Figure 4 is a schematic diagram of another preoperative planning operation page provided in an embodiment of the present application;

[0029] Figure 5 It is a schematic diagram of a process for correcting a three-dimensional view of a femur provided in an embodiment of the present application;

[0030] Figure 6 It is a schematic diagram of a process for correcting a three-dimensional view of a tibia provided in an embodiment of the present application;

[0031] Figure 7 It is a schematic diagram of the effect of correcting a three-dimensional view of a femur provided in an embodiment of the present application;

[0032] Figure 8 It is a schematic diagram of the effect of correcting a three-dimensional view of a tibia provided by an embodiment of the present application;

[0033] Fig. 9 is a schematic diagram of a preoperative planning information correction device provided in an embodiment of the present application;

[0034] Fig.10 is a schematic diagram of a computer-assisted medical device provided in an embodiment of the present application;

[0035] Fig.11 It is a schematic diagram of a preoperative planning system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0036] In the following description, specific details such as specific system structures, technologies, etc. are proposed for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application can also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from hindering the description of the present application.

[0037] The technical solution of the present application is described below through specific embodiments.

[0038] Reference Figure 1 , shows a schematic diagram of a preoperative planning information correction method provided in an embodiment of the present application, which may specifically include the following steps:

[0039] S101. Display a preoperative planning operation page, wherein the preoperative planning operation page includes a view area and an operation area, wherein the view area displays a three-dimensional view and multiple two-dimensional views of the surgical site, wherein the multiple two-dimensional views include a cross-sectional view, a sagittal view, and a coronal view, and the operation area includes a landmark point list area displaying multiple landmark points.

[0040] It should be noted that the method can be applied to a preoperative planning system, that is, the execution subject of the method can be a preoperative planning system. The preoperative planning system in the embodiment of the present application can be a computer-assisted medical system, which can include a processing unit and a display unit. Among them, the processing unit can process relevant data or information, such as segmenting and modeling the data obtained from the patient's preoperative scan, and constructing a bone model of the surgical site; the display unit can be a device with a display function, such as a display, etc. Exemplarily, in the preoperative planning stage, the display unit can be used to display the bone model obtained by modeling, and allow users such as doctors to perform preoperative planning on the bone model. In this process, the preoperative planning system can correct the displayed view based on the user's operation, so that the corrected view is more in line with the doctor's observation angle. The preoperative planning information correction method provided in the embodiment of the present application is used to correct the relevant preoperative planning information. For example, a preoperative planning system can use this method to correct the three-dimensional view of the patient's surgical site obtained by modeling, so as to facilitate doctors to carry out preoperative planning; or, this method can also be used to correct the three-dimensional view of the surgical site after completing preoperative planning, that is, after simulating the installation of the prosthesis according to the relevant plan, so as to facilitate doctors to observe whether the planning plan is appropriate.

[0041] In an embodiment of the present application, the preoperative planning system can display a preoperative planning operation page through a display unit. The operation page can be a page provided to the doctor for operation. The doctor can interact with the preoperative planning system and complete preoperative planning by operating on this page.

[0042] like Figure 2 FIG. 1 is a schematic diagram of a preoperative planning operation page provided in an embodiment of the present application. Figure 2 The operation page shown may include a view area 201 and an operation area 202, wherein the view area 201 may include multiple display windows, each of which may be used to display a type of view. Figure 2 As shown, the view area 201 includes four display windows 2011-2014, wherein the display window 2011 can be used to display a three-dimensional view of the surgical site, and the display windows 2012-2014 are used to display a two-dimensional view respectively. These two-dimensional views may include a cross-sectional view of the surgical site displayed by the display window 2012, a sagittal view displayed by the display window 2013, and a coronal view displayed by the display window 2014.

[0043] Among them, the three-dimensional view may refer to a 3D model view displayed after modeling the real bone; each two-dimensional view may refer to a view displayed by cutting the real bone based on a certain axial direction, for example, the cross section may refer to an observation plane obtained by cross-cutting the bone, the sagittal plane may refer to an observation plane obtained by cutting the bone vertically from front to back, and the coronal plane may refer to an observation plane obtained by cutting the bone vertically from left to right. In the embodiment of the present application, the three-dimensional view may be called a 3D view, and each two-dimensional view may be a CT view, i.e., a cross-sectional CT view, a sagittal CT view, and a coronal CT view.

[0044] like Figure 2 As shown, the operation area 202 on the right side of the operation page may include a landmark point list area 2021, in which a plurality of landmark points may be displayed. On the simulated bone model, the landmark point is a marked point with medical significance and name, and different landmark points need to be marked for different surgical procedures. Exemplarily, in knee surgery, the femoral landmark points may generally include the center of the femoral head, the lateral epicondyle, the medial epicondyle, the lateral side of the distal femur, the medial side of the distal femur, the lateral side of the posterior femoral condyle, the medial side of the posterior femoral condyle, and the center of the distal femur; the tibial landmark points may generally include the lateral malleolus, the medial malleolus, the center of the tibial plateau, the tibial tuberosity, the PCL (posterior cruciate ligament, posterior cruciate ligament) stop point center, the lateral side of the platform, and the medial side of the platform. In knee surgery involving the femur or tibia, the above-mentioned femoral landmark points and tibial landmark points are both position points with specific reference meanings, and those skilled in the art can distinguish between them.

[0045] Figure 2 The multiple landmark points displayed in the landmark point list area 2021 can be selected by the doctor during preoperative planning for subsequent processing.

[0046] Figure 2 The middle operation area 202 may also include a correction operation area 2022. After completing the relevant processing, the user can click on the correction operation area 2022 to issue a correction instruction to the preoperative planning system to correct the relevant views and realize the "axis correction" function.

[0047] As an example of an embodiment of the present application, the above-mentioned preoperative planning system can be used for preoperative planning of knee joint surgery, that is, the surgery mentioned in the embodiment of the present application can refer to knee joint surgery. Therefore, the two-dimensional view and the three-dimensional view displayed in each display window of the view area 201 can be a 3D view of the knee joint obtained by CT scanning and modeling, and a CT view of each observation surface of the knee joint.

[0048] S102: Determine a plurality of landmark points marked in the viewing area, wherein the plurality of landmark points marked in the viewing area correspond one-to-one to a plurality of landmark points selected in the landmark point list area, and the plurality of landmark points marked in the viewing area form at least one correction axis.

[0049] In the embodiment of the present application, the multiple landmark points marked in the viewing area can be the various position points selected by the user in the viewing area. Specifically, the doctor can select in each view of the viewing area with a mouse, and the selected position points can be marked as landmark points.

[0050] In a possible implementation of the embodiment of the present application, the preoperative planning system can determine multiple position points marked in the three-dimensional view, and use the multiple position points marked in the three-dimensional view as landmark points. For example, the doctor can select multiple position points in the three-dimensional view to mark the landmark points that will be used later.

[0051] In another possible implementation of the embodiment of the present application, the doctor may also select multiple position points in the two-dimensional view, and by determining the multiple position points selected in the multiple two-dimensional views, the multiple position points selected in the two-dimensional view may be mapped to the three-dimensional view, thereby obtaining multiple landmark points marked in the three-dimensional view. Since only two-dimensional information can be determined in a two-dimensional view, when the doctor selects a position point in the two-dimensional view, it is necessary to combine the two-dimensional information in the three two-dimensional views, map the selected position point to the three-dimensional view, and mark it in the three-dimensional view.

[0052] In the embodiment of the present application, the multiple landmark points marked in the viewing area and the multiple landmark points selected in the landmark point list area may correspond one to one. After the user selects a landmark point in the landmark point list area and marks the landmark point in the viewing area, the preoperative planning system may establish a correspondence between the multiple landmark points marked in the viewing area and the multiple landmark points selected in the landmark point list area, thereby ensuring that the selected landmark points correspond one to one with the marked landmark points.

[0053] In the embodiment of the present application, the selection and marking of landmark points can be completed by the user, that is, the doctor, through interaction with the preoperative planning system.

[0054] In one possible implementation, the doctor can select multiple landmark points in the landmark point list area in sequence, and then click multiple position points in the view area in a corresponding order, thereby using the multiple selected position points as landmark points and associating them with the multiple landmark points selected in the landmark point list area.

[0055] Exemplarily, the doctor can first select the lateral landmark point of the posterior femoral condyle and the medial landmark point of the posterior femoral condyle in the landmark point list area in sequence, that is, among the multiple landmark points displayed in the landmark point list area, the doctor can first select the lateral landmark point of the posterior femoral condyle, and then select the medial landmark point of the posterior femoral condyle. At this time, the preoperative planning system can record the above two landmark points and the order in which the two landmark points are selected. Then, the doctor can click on the corresponding number of landmark points in the view area. For example, the doctor can click on a position point in the three-dimensional view of the view area, and the position point can be a lateral landmark point of the posterior femoral condyle determined based on the doctor's experience; then, the doctor can click on another position point again, which is a medial landmark point of the posterior femoral condyle in the three-dimensional view. According to the order in which the doctor selects the two landmark points in the three-dimensional view, the preoperative planning system can use the landmark point selected first as the marked lateral landmark point of the posterior femoral condyle, and the landmark point selected later as the marked medial landmark point of the posterior femoral condyle. In this way, the preoperative planning system can sequentially associate the multiple landmark points marked in the view area with the multiple landmark points selected in the landmark point list area. The preoperative planning system can determine which type of landmark point each marked landmark point is by selecting the landmark points.

[0056] In another possible implementation, each landmark point and its corresponding relationship can also be determined by selecting them one by one. Specifically, the doctor can select a landmark point in the landmark point list area, and then click a position point in the view area. The preoperative planning system can use the selected position point as a landmark point and correspond it one by one with the landmark point selected in the landmark point list area. After completing the selection of the above landmark point, the doctor can select another landmark point in the landmark point list area, and click another position point again in the view area, and use the position point as the landmark point corresponding to the landmark point selected in the landmark point list area.

[0057] Exemplarily, the doctor can select a landmark point in the landmark point list area, such as the lateral landmark point of the posterior femoral condyle, and then the doctor can click a position point in the view area, which will be considered by the preoperative planning system as the currently selected landmark point, that is, the lateral landmark point of the posterior femoral condyle. The preoperative planning system can establish a correspondence between the two. Then, the doctor can select another landmark point in the landmark point list area, such as the medial landmark point of the posterior femoral condyle, and then the doctor can click a position point in the view area, which will be considered by the preoperative planning system as the currently selected medial landmark point of the posterior femoral condyle. In this way, through a loop operation, a correspondence between the marked landmark points in the view area and the selected landmark points in the list area can be suggested.

[0058] It should be noted that since only two-dimensional information can be determined in the two-dimensional view, the selected location point needs to be mapped to the three-dimensional view. Therefore, after the doctor selects the location point in the two-dimensional view, the preoperative planning system needs to map the location point in the two-dimensional view to the three-dimensional view. After the corresponding location point is displayed in the three-dimensional view, the preoperative planning system can use the corresponding location point as a landmark point to establish a one-to-one correspondence with the landmark point selected in the list area.

[0059] In an embodiment of the present application, after the preoperative planning system establishes the correspondence between the landmark points, the coordinate data of the multiple marked landmark points can be stored. The coordinate data can be the coordinates of each landmark point determined based on the bone model coordinate system, that is, the coordinates of each landmark point in the three-dimensional view.

[0060] In an embodiment of the present application, the multiple landmark points marked in the view area can form at least one correction axis. For example, in the aforementioned example, after marking the two landmark points of the lateral side of the posterior femoral condyle and the medial side of the posterior femoral condyle, the preoperative planning system can connect the lateral side of the posterior femoral condyle landmark point and the medial side of the posterior femoral condyle landmark point to form a correction axis, and subsequent view correction can be performed based on the axis.

[0061] In a possible implementation of an embodiment of the present application, when the doctor selects a position point in the view area, he can select multiple position points, thereby marking multiple landmark points in the view area. For example, the doctor can mark the eight landmark points of the center of the femoral head, the lateral epicondyle, the medial epicondyle, the lateral side of the distal femur, the medial side of the distal femur, the lateral side of the posterior femoral condyle, the medial side of the posterior femoral condyle, and the center of the distal femur in the view area. However, not all lines between any two landmark points can be used as the correction axis, so the preoperative planning system can preset a composition relationship between the landmark points and the correction axis formed, and the composition relationship can be used to indicate which landmark points can be connected in pairs and used as the axis of view correction. When the number of marked landmark points is large, the preoperative planning system can connect multiple landmark points with the above composition relationship in pairs to form a correction axis according to the coordinate data of each landmark point and the composition relationship between the pre-set landmark points and the correction axis formed.

[0062] In another possible implementation of the embodiment of the present application, when there are a large number of correction axes formed by connecting each landmark point two by two, the preoperative planning system can also prompt the doctor to select the required correction axis through human-computer interaction. For example, the preoperative planning system can display multiple correction axes in the view area and add operation instruction information to each correction axis, instructing the doctor to delete or retain a certain correction axis. The doctor can determine the correction axis that needs to be retained, that is, the correction axis that needs to be used later, based on actual observation needs.

[0063] S103. In response to the received correction instruction, determine information to be corrected based on the correction axis, wherein the information to be corrected includes rotation angles in multiple directions of the bone model coordinate system.

[0064] After completing the aforementioned operations, the preoperative planning system can automatically correct the three-dimensional view based on the correction axis.

[0065] In a possible implementation of the embodiment of the present application, the preoperative planning system automatically corrects the three-dimensional view under the instruction of the doctor. For example, a button can be provided in the operation area of ​​the preoperative planning operation page for the doctor to operate. When the doctor clicks the button, it can be considered that an instruction to correct the three-dimensional view is issued to the preoperative planning system. In one example, the button can be configured at Figure 2 in the correction operation area 2022.

[0066] In the embodiment of the present application, in response to the received correction instruction, the preoperative planning system can determine the information to be corrected based on the determined correction axis, and correct the three-dimensional view displayed in the view area according to the information to be corrected, so that the corrected three-dimensional view better meets the actual observation needs of the doctor. The above-mentioned information to be corrected may include the rotation angles of the bone model coordinate system in multiple directions, such as the rotation angle of the bone model coordinate system x axis, y Axis and z The rotation angle about the axis.

[0067] In a possible implementation of the embodiment of the present application, after the correction axis is determined based on the doctor's operation, the preoperative planning system can process it according to the built-in algorithm to automatically calculate the information to be corrected. For example, the preoperative planning system can determine a corresponding vector based on the correction axis, and calculate the information to be corrected by determining the projection of the vector on certain planes. The information to be corrected can be information such as the angles required to rotate different observation planes in the three-dimensional view during correction.

[0068] S104: Correct the three-dimensional view according to the information to be corrected.

[0069] In a possible implementation of the embodiment of the present application, the information to be corrected may include a bone model coordinate system x axis, y Axis and z The preoperative planning system can correct the three-dimensional view according to the above information, that is, rotate different observation planes according to the rotation angles on each axis, thereby achieving the correction of the three-dimensional view.

[0070] In another possible implementation of the embodiment of the present application, the information to be corrected can also exist in the form of an axis correction transformation matrix, and the axis correction transformation matrix can include the direction correction vectors on each axis of the bone model coordinate system. The direction correction vectors on each axis can be used for coordinate transformation of the bone model coordinate system currently modeled using the axis correction transformation matrix when performing view correction, and the coordinates of each position point after the transformation are also the new coordinates after completing the view correction. Through the coordinate transformation, each position point in the three-dimensional view can be transformed to a new position point, so as to realize the correction of the three-dimensional view. After completing the correction of the three-dimensional view, the views of each observation plane of the three-dimensional view, i.e., the cross-section, sagittal and coronal planes, can also be obtained by sectioning along a certain axis direction and displayed in the window corresponding to the view area for displaying the two-dimensional CT view, so as to realize the correction of each two-dimensional view. In this way, the views displayed in each window in the entire view area are all corrected views.

[0071] In an embodiment of the present application, a three-dimensional view and multiple two-dimensional views of the surgical site can be displayed to the doctor through the preoperative planning operation page, so that the doctor can observe the surgical site in order to formulate a suitable surgical plan. When the three-dimensional view modeled based on the original data obtained by scanning does not meet the doctor's actual observation needs, the doctor can mark multiple landmark points in the view area of ​​the page to form at least one correction axis. In this way, the preoperative planning system can automatically correct the three-dimensional view according to the correction axis. Since the correction axis is determined by connecting the various position points selected by the doctor in the view, the doctor can select the appropriate position point according to his own observation needs to form a correction correction, so that after the preoperative planning system corrects the view according to the correction axis, the three-dimensional view presented is more in line with the doctor's observation perspective, which helps the doctor to better observe the actual situation of the surgical site and complete the planning of the surgical plan more efficiently and accurately.

[0072] In a possible implementation of an embodiment of the present application, the correction instruction may be an original view correction instruction for correcting the original scan information. The original scan information may refer to a view formed after a CT scan of the patient's surgical site is performed through data segmentation and modeling, including a three-dimensional view, i.e., a 3D view, and multiple two-dimensional views, i.e., two-dimensional CT views. These views can be presented to the doctor for the doctor to plan the surgical plan, for example, to determine how to install a prosthesis at the knee joint, etc. The above-mentioned original view correction instruction may be an instruction to correct the presented original view.

[0073] In a possible implementation of the embodiment of the present application, the correction of the original view can be performed based on the axis formed by the line connecting the lateral landmark point of the posterior femoral condyle and the medial landmark point of the posterior femoral condyle. In the embodiment of the present application, the axis formed by connecting the lateral landmark point of the posterior femoral condyle and the medial landmark point of the posterior femoral condyle is referred to as the first correction axis.

[0074] When correcting the original view, the posterior condylar axis vector formed by connecting the lateral landmark point of the posterior femoral condyle and the medial landmark point of the posterior femoral condyle can be used. v 1 (that is, the vector corresponding to the correction axis formed by the lateral landmark point of the posterior femoral condyle and the medial landmark point of the posterior femoral condyle) on the transverse plane passing through the lateral landmark point of the posterior femoral condyle v 2 and bone model coordinate system x Axis direction vector v x Angle θ As the rotation angle of the axis correction, z The axis is the rotation axis of the cross-sectional CT view. y The sagittal and coronal CT views were rotated with the axis as the rotation axis. x Axis is the rotation axis rotationally corrected coronal CT view.

[0075] The following describes in detail the process of determining the information to be corrected based on the first correction axis after receiving the instruction to correct the original view.

[0076] like Figure 3 FIG. 1 is a flow chart of a correction process for an original view provided by an embodiment of the present application. Figure 3 In the process shown, the preoperative planning system can first determine whether the two landmark points forming the first correction axis are selected, that is, whether the lateral landmark point of the posterior femoral condyle and the medial landmark point of the posterior femoral condyle are selected. If the above two landmark points are not selected, the doctor needs to select the landmark point through operation. It should be noted that since the selection of the landmark point is determined by the doctor by clicking in the view area, the doctor can determine the reasonable position of the landmark point according to his actual observation needs, so as to ensure that the subsequent corrected view can meet the doctor's observation needs and achieve a more personalized view display effect.

[0077] In a possible implementation of an embodiment of the present application, the doctor can first operate a tool such as a mouse to select the two landmark points in the landmark point list area. For the view area, if it is necessary to select a landmark point in the three-dimensional view, it can be implemented by clicking the right button of the mouse, and the landmark point selected will be marked as the landmark point selected in the current landmark point list area. If it is necessary to select a landmark point in the two-dimensional CT view, the landmark point in the two-dimensional CT view can be mapped to the three-dimensional view by coordinate mapping by double-clicking the left button of the mouse. Similarly, the landmark point selected at this time will be marked as the landmark point selected in the current landmark point list area. For example, by clicking the lateral landmark point of the posterior condyle of the femur and the medial landmark point of the posterior condyle of the femur, the line connecting the two landmark points can constitute the first correction axis.

[0078] like Figure 3 As shown, the preoperative planning system can calculate the vector corresponding to the correction axis formed by the two landmark points after determining that the lateral landmark point of the posterior femoral condyle and the medial landmark point of the posterior femoral condyle have been selected. v 1.

[0079] In the embodiment of the present application, after the doctor completes the selection of landmark points in the landmark point list area and the view area, he can click the "axis correction" button to issue a correction instruction to the preoperative planning system for the original view. In response to the received original view correction instruction, the preoperative planning system can determine the vector corresponding to the first correction axis. v 1 Projection vector on the cross section formed by the lateral landmark of the posterior femoral condyle as the reference point v 2. The projection vector v 2 can be called the first projection vector.

[0080] Then, the preoperative planning system can calculate the first projection vector v 2 and bone model coordinate system x Axis direction vector v x , y Axis direction vector v y The angle between them. Among them, the projection vector can be set v 2 and bone model coordinate system x Axis direction vector v x The angle between θ , let the projection vector v 2 and bone model coordinate system y Axis direction vector v y The angle between β .

[0081] like Figure 3 As shown, in calculating the above angle θ and β Before surgery, the preoperative planning system needs to determine whether the patient's surgical side is on the left or right side. By determining the left or right side of the surgical side, the directions of the axes of the bone model coordinate system can be unified. Specifically, Figure 3 As shown in the figure, when the surgical side is the left side, the bone model coordinate system x Axis direction vector v x It can take negative values; when the surgical side is the right side, the bone model coordinate system y Axis direction vector v y Can take negative values.

[0082] In determining x Axis direction vector v x and y Axis direction vector v y After taking the value sign, the preoperative planning system can calculate the first projection vector v 2 and x Axis direction vector v x The angle between θ , calculate the first projection vector v 2 and y Axis direction vector v y The angle between β , and determine the angle information of the corrected three-dimensional view according to the above angle.

[0083] In a possible implementation of the embodiment of the present application, the preoperative planning system calculates the angle obtained by the above calculation. θ and β When determining the angle information of the corrected 3D view, the first projection vector v 2 and bone model coordinate system y Axis direction vector v y The angle between them determines the first projection vector v 2 and bone model coordinate system x Axis direction vector v x The angle symbol between .

[0084] Specifically, Figure 3 As shown, the preoperative planning system can determine the calculated angle β Angle, when the angle β When the angle is greater than 90 degrees and less than 270 degrees, you can set the first projection vector v 2 and bone model coordinate system x Axis direction vector v x The angle between θ The sign of is negative. If the angle β If the angle is not within the above range of greater than 90 degrees and less than 270 degrees, then the angle θ The sign can remain unchanged.

[0085] The preoperative planning system can then determine the angle behind the symbol θ As the angles of each observation plane of the three-dimensional view. Figure 3 As shown, the rotation axis of the cross-sectional view of the corrected three-dimensional view can be the coordinate system of the bone model. z The rotation axis of the sagittal view of the corrected 3D view can be the y The rotation axis of the coronal view of the corrected 3D view can be the x axis. That is, in determining the angle θ After that, the bone model coordinate system can be z The axis is the rotation axis for the cross-section view of the 3D view. θ Angle rotation correction; bone model coordinate system y The axis is the rotation axis, and the sagittal view of the three-dimensional view is θ Angle rotation correction; bone model coordinate system x The axis is the rotation axis, and the coronal view of the three-dimensional view is θ The angle is rotated and corrected to complete the correction of the original view.

[0086] In the embodiment of the present application, the original view is a 3D simulation model view. By correcting the original view, a more comprehensive and accurate targeted view expression can be provided to the doctor, thereby assisting the doctor to complete preoperative plan planning more efficiently.

[0087] It should be noted that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0088] As an example of an embodiment of the present application, in the preoperative planning of knee surgery, the obtained planning scheme can be information such as the model, size, and position of the prosthesis that needs to be installed at the knee surgery site. For the planning information obtained after the prosthesis planning is completed, the correction method provided by the embodiment of the present application can also be used to correct the relevant views. Exemplarily, after the prosthesis planning is completed, the displayed femoral view and / or tibial view can be corrected.

[0089] Figure 4 is a schematic diagram of another preoperative planning operation page provided in an embodiment of the present application. Figure 4 The preoperative planning operation page shown is the same as Figure 2 The difference between the preoperative planning operation page shown is that Figure 2 The list of landmark points in Area 2021 is replaced by Figure 4 The prosthesis information display area 2023 in the image is used to display the information of the related prosthesis after the prosthesis planning is completed. Therefore, when the above-mentioned prosthesis information display area 2023 is displayed in the operation area, it can be indicated that the doctor has preliminarily completed the preoperative planning for the patient. At this time, the doctor can further confirm or check the preoperative planning plan. In this process, in order to better present the three-dimensional view after the planning is completed, the doctor can use the preoperative planning system to correct the currently presented three-dimensional view. The above-mentioned correction can be done by clicking Figure 4 The “axis correction” in the correction operation area 2022 is used to issue instructions to the preoperative planning system.

[0090] Therefore, in another possible implementation of the embodiment of the present application, the correction instruction may also be a correction instruction for the femoral view that corrects the planning information obtained after the prosthesis planning is completed, and the above-mentioned femoral view may be a three-dimensional view of the femur after the prosthesis is installed at the surgical site after the surgical planning is completed. When correcting the three-dimensional view of the femur, the correction axis may be formed by connecting the central landmark point of the femoral head and the central landmark point of the distal end of the femur, and the correction axis may be referred to as the second correction axis in the embodiment of the present application.

[0091] When the second correction axis is used to correct the femoral three-dimensional view, the preoperative planning system can use the vector of the line connecting the femoral head center landmark point to the femoral head distal center landmark point as the bone model coordinate system. y The correction vector in the direction of the axis is the first y The axis direction correction vector is the line vector connecting the projection points of the medial landmark point of the posterior femoral condyle and the lateral landmark point of the posterior femoral condyle on the plane passing through the center of the distal femur and the center of the femur, with the line vector connecting the landmark points of the center of the femoral head and the center of the distal femur as the normal vector. x The correction vector in the direction of the axis is the first x Axis direction correction vector, then x The correction vector in the axis direction is y The cross product of the correction vector in the axis direction is z The correction vector in the direction of the axis is the first z Axis direction correction vector. x axis, y Axis and z The correction vectors in the axial direction can form an axis correction transformation matrix, which is used to transform the bone model coordinate system, thereby achieving correction of the femur three-dimensional view.

[0092] The following describes in detail the process of determining the information to be corrected based on the second correction axis after receiving an instruction to correct the three-dimensional view of the femur.

[0093] like Figure 5 FIG. 1 is a schematic diagram of a process for correcting a three-dimensional view of a femur provided in an embodiment of the present application. Figure 5 What is shown in FIG. 1 is a detailed process of calculating the axis correction transformation matrix based on the second correction axis.

[0094] according to Figure 5 In the process shown, when correcting the three-dimensional view of the femur, the preoperative planning system can first determine whether the two landmark points forming the second correction axis are selected, that is, whether the landmark point of the center of the femoral head and the landmark point of the distal center of the femoral head are selected. If the above two landmark points are not selected, the doctor needs to select the landmark point through operation. By selecting the above two landmark points, the two landmark points can form the correction axis, that is, the second correction axis.

[0095] In response to the received femoral view correction instruction, such as Figure 5 As shown, the preoperative planning system can calculate the vector corresponding to the second correction axis v 3, and calculate the vector v 3 is the normal vector, and the distal femoral center landmark point is the reference point of the plane P .

[0096] Then, the preoperative planning system can determine the lateral landmark point of the posterior femoral condyle and the medial landmark point of the posterior femoral condyle in the above plane. P Two projection points on P m , P l It should be noted that since the above two projection points P m , P l The lateral landmark of the posterior femoral condyle and the medial landmark of the posterior femoral condyle are in the same plane. P Therefore, when calculating the above projection point P m , P l Previously, the preoperative planning system needed to determine whether the lateral landmark point of the posterior femoral condyle and the medial landmark point of the posterior femoral condyle were selected. If the lateral landmark point of the posterior femoral condyle and the medial landmark point of the posterior femoral condyle were not selected, the preoperative planning system could prompt the doctor to select these two landmark points.

[0097] like Figure 5 As shown, the projection point is calculated P m , P l After that, the preoperative planning system can calculate the projection points P m , P l The axis vector v 4. Specifically, the preoperative planning system can connect two projection points P m , P l Form the second projection vector as the above axis vector v 4.

[0098] Similarly, the preoperative planning system needs to determine whether the patient's surgical side is the left or right side. Figure 5 As shown, when the surgical side is the right side, the second projection vector v 4 is negative; when the side is on the left, the second projection vector v The sign of the value of 4 remains unchanged.

[0099] The preoperative planning system can be based on the second projection vector v 4. Determine the information to be corrected for the three-dimensional view of the femur, that is, the axis correction transformation matrix. The axis correction transformation matrix for correcting the three-dimensional view of the femur can be referred to as the first axis correction transformation matrix in the embodiment of the present application.

[0100] In the embodiments of the present application, Figure 5As shown, the preoperative planning system is based on the second projection vector v 4. Determine the first axis correction transformation matrix for correcting the femoral three-dimensional view as follows:

[0101] To determine the second projection vector after the sign v 4 is the first coordinate system of the bone model x Axis correction vector, the vector corresponding to the second correction axis v 3 is the first coordinate system of the bone model y Axis direction correction vector. That is, x Correction vector in the axis direction v x = v 4. y Correction vector in the axis direction v y = v 3.

[0102] By calculation x Correction vector in the axis direction v x and y Correction vector in the axis direction v y The cross product between them can be used as the first coordinate system of the bone model z Axis direction correction vector, i.e. z Correction vector in the axis direction v z = v 4× v 3. The first x Axis correction vector v x The first y Axis correction vector v y and the first z Axis correction vector v z The first axis correction transformation matrix that together constitutes the corrected femoral three-dimensional view T m =( v x , v y , v z ).

[0103] The preoperative planning system can use the first axis correction transformation matrix T m The bone model coordinate system is transformed to complete the correction of the femur three-dimensional view.

[0104] In another possible implementation of the embodiment of the present application, the correction instruction may also be a tibial view correction instruction for correcting the planning information obtained after the prosthesis planning is completed, that is, the three-dimensional tibial view may be corrected using the method provided in the embodiment of the present application.

[0105] When correcting the three-dimensional view of the tibia, the correction axis used may be an axis formed by connecting the medial malleolus landmark point and the lateral malleolus landmark point, and the axis may be referred to as the third correction axis in the embodiment of the present application. The information to be corrected required for correction based on the third correction axis may be a second axis correction transformation matrix for correcting the three-dimensional view of the tibia, and the axis correction transformation matrix may be referred to as the second axis correction transformation matrix in the embodiment of the present application.

[0106] In the embodiment of the present application, when the third correction axis is used to correct the tibial three-dimensional view, the line vector of the axis center of the tibial plateau center landmark point and the medial malleolus landmark point and the lateral malleolus landmark point, and the line vector of the line center landmark point of the PCL insertion point and the tibial tuberosity landmark point can be cross-producted to obtain: x The correction vector in the direction of the axis is the second x The axis direction correction vector is taken as the line vector connecting the PCL insertion center landmark point and the tibial tuberosity landmark point. y The correction vector in the direction of the axis is the second y Axis direction correction vector; then x The correction vector in the axis direction is y The cross product of the correction vector in the axis direction is z The correction vector in the direction of the axis is the second z Axis direction correction vector.

[0107] The following describes in detail the process of determining the information to be corrected based on the third correction axis after receiving the instruction to correct the three-dimensional view of the tibia.

[0108] like Figure 6 FIG. 1 is a schematic diagram of a process for correcting a three-dimensional view of a tibia provided in an embodiment of the present application. Figure 6 What is shown in FIG. 1 is the detailed process of calculating the axis correction transformation matrix based on the third correction axis.

[0109] according to Figure 6 In the process shown, when correcting the tibia three-dimensional view, the preoperative planning system can first determine whether the two landmark points forming the third correction axis are selected, that is, whether the medial malleolus landmark point and the lateral malleolus landmark point are selected. If the above two landmark points are not selected, the doctor needs to select the landmark point through operation. By selecting the above two landmark points, the two landmark points can form the correction axis, that is, the third correction axis.

[0110] In response to the received tibial view correction instruction, such as Figure 6 As shown, the preoperative planning system can calculate the center point of the third correction axis. p 1. Determine the center point of the third correction axis p 1 The first direction vector formed by the tibial plateau center landmark point v 5, and the second direction vector formed by connecting the PCL insertion center landmark point and the tibial tubercle landmark point v 6.

[0111] In this process, if Figure 6 As shown, the preoperative planning system can determine whether the tibial plateau center landmark point, the PCL insertion center landmark point, and the tibial tuberosity landmark point are selected. If the above landmark points are not selected, the preoperative planning system can prompt the doctor to select these landmark points.

[0112] like Figure 6 As shown in the figure, after selecting the tibial plateau center landmark point, the preoperative planning system can calculate the direction vector between the center point of the axis formed by the tibial plateau center landmark point and the medial malleolus landmark point and the lateral malleolus landmark point, that is, calculate the direction vector between the tibial plateau center landmark point and the aforementioned points p 1 direction vector v 5.

[0113] After selecting the PCL insertion center landmark point and the tibial tubercle landmark point, the preoperative planning system can calculate the direction vector of the axis formed by connecting the PCL insertion center landmark point and the tibial tubercle landmark point, that is, the second direction vector v 6.

[0114] The preoperative planning system can be based on the first direction vector v 5 and the second direction vector v 6. Determine the axis correction transformation matrix for correcting the tibia three-dimensional view, that is, the second axis correction transformation matrix.

[0115] In the embodiments of the present application, Figure 6 As shown, the preoperative planning system is based on the vector v 5 and vector v 6. When determining the axis correction transformation matrix for correcting the tibia 3D view, the second direction vector can be calculated v 6 and the first direction vector v 5, as the bone model coordinate system x The direction correction vector of the axis is the second x The axis direction correction vector is v x = v 6× v 5; Take the first direction vector v5 as the bone model coordinate system y The direction correction vector of the axis is the second y Axis correction vector v y = v 5; On this basis, calculate x Axis correction vector v x With the y Axis correction vector v y The cross product between them can be used as the bone model coordinate system z The direction correction vector of the axis is the second z Axis correction vector v z = v x× v y , the above x Axis direction correction vector, y Axis correction vector and z The axis direction correction vectors together constitute the second axis correction transformation matrix for correcting the tibia three-dimensional view T m =( v x , v y , v z ).

[0116] The preoperative planning system can use the second axis correction transformation matrix T m The coordinate system of the bone model is transformed to complete the correction of the three-dimensional view of the tibia.

[0117] like Figure 7 and Figure 8 The figures are schematic diagrams showing the effects of correcting the femur 3D view and the tibia 3D view using the correction method provided in the embodiment of the present application. Figure 7 This is a schematic diagram of the effect of using this method to correct the femur three-dimensional view. Figure 8 This is a schematic diagram of the effect of using this method to correct the tibia three-dimensional view. Figure 7 As can be seen from the figure, after axis correction, the corrected viewing angle has changed. The changed viewing angle may be more in line with the doctor's actual observation needs, which is conducive to the doctor to better observe the actual situation of the patient's knee joint and other surgical sites.

[0118] Reference Fig. 9, shows a schematic diagram of a preoperative planning information correction device provided in an embodiment of the present application, which may specifically include a display module 901, a marking module 902, a determination module 903 and a correction module 904, wherein:

[0119] Display module 901, used to display a preoperative planning operation page, the preoperative planning operation page includes a view area and an operation area, the view area displays a three-dimensional view and multiple two-dimensional views of the surgical site, the multiple two-dimensional views include a cross-sectional view, a sagittal view and a coronal view, the operation area includes a landmark point list area displaying multiple landmark points;

[0120] a marking module 902, configured to determine a plurality of marked landmark points in the viewing area, wherein the plurality of marked landmark points in the viewing area correspond one-to-one to the plurality of landmark points selected in the landmark point list area, and the plurality of marked landmark points in the viewing area form at least one correction axis;

[0121] A determination module 903 is used to determine information to be corrected based on the correction axis in response to the received correction instruction, wherein the information to be corrected includes rotation angles in multiple directions of the bone model coordinate system;

[0122] The correction module 904 is used to correct the three-dimensional view according to the information to be corrected.

[0123] In a possible implementation of the embodiment of the present application, the marking module 902 may be specifically used for:

[0124] determining a plurality of position points marked in the three-dimensional view;

[0125] The marked multiple position points in the three-dimensional view are used as landmark points, and a corresponding relationship between the marked multiple landmark points and the selected multiple landmark points in the landmark point list area is established; and the coordinate data of the marked multiple landmark points are stored.

[0126] In a possible implementation of an embodiment of the present application, the marking module 902 can also be used to: determine multiple position points selected in the multiple two-dimensional views; map the multiple position points selected in the two-dimensional views to the three-dimensional view to obtain multiple landmark points marked in the three-dimensional view.

[0127] In another possible implementation of the embodiment of the present application, the marking module 902 can also be used to: according to the coordinate data and the composition relationship between the pre-set landmark points and the constructed correction axis, connect multiple landmark points having the composition relationship in pairs to form the correction axis.

[0128] In a possible implementation of the embodiment of the present application, the correction instruction includes an original view correction instruction for correcting the original scan information, the correction axis includes a first correction axis formed by connecting the lateral landmark point of the posterior femoral condyle and the medial landmark point of the posterior femoral condyle, and the determination module 903 can be specifically used to:

[0129] In response to the received original view correction instruction, determining a first projection vector of a vector corresponding to the first correction axis on a cross section with the lateral landmark point of the posterior femoral condyle as a reference point;

[0130] Calculate the first projection vector and the bone model coordinate system respectively x Axis direction vector, y The angle between the axis direction vectors; wherein, when the surgical side is the left side, the bone model coordinate system x The axis direction vector takes a negative value; when the surgical side is the right side, the bone model coordinate system y The axis direction vector takes a negative value;

[0131] Angle information for correcting the three-dimensional view is determined according to the included angle.

[0132] In the embodiment of the present application, the determining module 903 may also be used to: y The angle between the first projection vector and the bone model coordinate system is determined. x The sign of the angle between the axis direction vectors; wherein, when the angle is greater than 90 degrees and less than 270 degrees, the first projection vector and the bone model coordinate system x The sign of the angle between the axis direction vectors is negative; the angle between the first projection vector after determining the sign and the bone model coordinate system x The angles between the axis direction vectors are used as the angles of each observation plane of the three-dimensional view for correction; wherein the rotation axis of the cross-sectional view for correction of the three-dimensional view is the z Axis, the rotation axis of the sagittal view of the three-dimensional view is the bone model coordinate system y Axis, the rotation axis of the coronal view of the three-dimensional view is the bone model coordinate system x axis.

[0133] In another possible implementation of the embodiment of the present application, the correction instruction also includes a femoral view correction instruction for correcting the planning information obtained after the prosthesis planning is completed, the correction axis includes a second correction axis formed by connecting the femoral head center landmark point and the femoral distal center landmark point, the information to be corrected also includes a first axis correction transformation matrix for correcting the femoral three-dimensional view, and the determination module 903 can also be used to:

[0134] In response to the received femoral view correction instruction, determining a plane with a vector corresponding to the second correction axis as a normal vector and the distal femoral center landmark point as a reference point;

[0135] respectively determining two projection points of the lateral landmark point of the posterior femoral condyle and the medial landmark point of the posterior femoral condyle on the plane;

[0136] Connect the two projection points to form a second projection vector; wherein, when the surgical side is the right side, the value sign of the second projection vector is negative; when the surgical side is the left side, the value sign of the second projection vector remains unchanged;

[0137] Based on the second projection vector, a first axis correction transformation matrix for correcting the three-dimensional view of the femur is determined.

[0138] In the embodiment of the present application, the determining module 903 can also be used to: determine the second projection vector after the sign as the first projection vector of the bone model coordinate system x The vector corresponding to the second correction axis is used as the first axis of the bone model coordinate system. y Axis direction correction vector; calculate the first x The axis direction correction vector is related to the first y The cross product between the axis direction correction vectors is used as the first z Axis direction correction vector, the first x Axis direction correction vector, the first y The axis direction correction vector and the first z The axial direction correction vectors together constitute a first axis correction transformation matrix for correcting the three-dimensional view of the femur.

[0139] In another possible implementation of the embodiment of the present application, the correction instruction also includes a tibial view correction instruction for correcting the planning information obtained after the prosthesis planning is completed, the correction axis includes a third correction axis formed by connecting the medial malleolus landmark point and the lateral malleolus landmark point, the information to be corrected also includes a second axis correction transformation matrix for correcting the tibial three-dimensional view, and the determination module 903 can also be used to:

[0140] In response to the received tibial view correction instruction, determine a first direction vector formed by a center point of the third correction axis and a tibial plateau center landmark point, and a second direction vector formed by connecting a posterior cruciate ligament PCL insertion center landmark point and a tibial tuberosity landmark point;

[0141] A second axis correction transformation matrix for correcting the three-dimensional view of the tibia is determined according to the first direction vector and the second direction vector.

[0142] In the embodiment of the present application, the determination module 903 can also be used to: calculate the cross product between the second direction vector and the first direction vector as the second direction vector of the bone model coordinate system. x axis direction correction vector; taking the first direction vector as the second y Axis direction correction vector; calculate the second x The axis direction correction vector is related to the second y The cross product between the axis direction correction vectors is used as the second z Axis direction correction vector, the second x Axis direction correction vector, the second y The axis direction correction vector and the second z The axial direction correction vectors together constitute a second axis correction transformation matrix for correcting the three-dimensional view of the tibia.

[0143] The embodiment of the present application provides a preoperative planning information correction device, which can be the preoperative planning system in the aforementioned method embodiment, or the processing unit in the preoperative planning system, or the device can also be other devices or modules or units that can implement related functions. The device provided in the embodiment of the present application can be used to implement each step in the aforementioned method embodiments.

[0144] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment part.

[0145] Reference Fig.10 , shows a schematic diagram of a computer-assisted medical device provided in an embodiment of the present application. Fig.10 As shown, the computer-assisted medical device 1000 in the embodiment of the present application includes: a processor 1010, a memory 1020, and a computer program 1021 stored in the memory 1020 and executable on the processor 1010. When the processor 1010 executes the computer program 1021, the steps in each embodiment of the above-mentioned preoperative planning information correction method are implemented, such as Figure 1 Alternatively, when the processor 1010 executes the computer program 1021, the functions of each module / unit in the above-mentioned device embodiments are realized, for example Fig. 9 The functions of modules 901 to 904 are shown.

[0146] Exemplarily, the computer program 1021 may be divided into one or more modules / units, which are stored in the memory 1020 and executed by the processor 1010 to complete the present application. The one or more modules / units may be a series of computer program instruction segments capable of completing specific functions, which may be used to describe the execution process of the computer program 1021 in the computer-assisted medical device 1000. For example, the computer program 1021 may be divided into a display module, a marking module, a determination module, and a correction module, and the specific functions of each module are as follows:

[0147] A display module, used for displaying a preoperative planning operation page, wherein the preoperative planning operation page includes a view area and an operation area, wherein the view area displays a three-dimensional view and multiple two-dimensional views of the surgical site, wherein the multiple two-dimensional views include a cross-sectional view, a sagittal view, and a coronal view, and the operation area includes a landmark point list area displaying multiple landmark points;

[0148] a marking module, configured to determine a plurality of marked landmark points in the viewing area, wherein the plurality of marked landmark points in the viewing area correspond one-to-one to the plurality of landmark points selected in the landmark point list area, and the plurality of marked landmark points in the viewing area form at least one correction axis;

[0149] A determination module, configured to determine information to be corrected based on the correction axis in response to the received correction instruction, wherein the information to be corrected includes rotation angles in multiple directions of the bone model coordinate system;

[0150] A correction module is used to correct the three-dimensional view according to the information to be corrected.

[0151] The computer-assisted medical device 1000 may be a device or system capable of implementing the relevant steps in the aforementioned method embodiments. For example, the computer-assisted medical device 1000 may be the aforementioned preoperative planning system, or the computer-assisted medical device 1000 may also be a desktop computer, a cloud server, or other device or system. The computer-assisted medical device 1000 may include, but is not limited to, a processor 1010 and a memory 1020. Those skilled in the art will appreciate that Fig.10 It is only an example of the computer-assisted medical device 1000 and does not constitute a limitation of the computer-assisted medical device 1000. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the computer-assisted medical device 1000 may also include input and output devices, network access devices, buses, etc.

[0152] The processor 1010 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0153] The memory 1020 may be an internal storage unit of the computer-assisted medical device 1000, such as a hard disk or memory of the computer-assisted medical device 1000. The memory 1020 may also be an external storage device of the computer-assisted medical device 1000, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the computer-assisted medical device 1000. Further, the memory 1020 may also include both an internal storage unit and an external storage device of the computer-assisted medical device 1000. The memory 1020 is used to store the computer program 1021 and other programs and data required by the computer-assisted medical device 1000. The memory 1020 may also be used to temporarily store data that has been output or is to be output.

[0154] In combination with the aforementioned embodiments, the embodiments of the present application further disclose a preoperative planning system, which may include the aforementioned preoperative planning information correction device, for implementing the preoperative planning information correction method or related functions described in the aforementioned embodiments.

[0155] In a possible implementation of the embodiment of the present application, as Fig.11 As shown, the preoperative planning system may include a display unit 1101 and a processing unit 1102, wherein:

[0156] A display unit 1101 is used to display a preoperative planning operation page, wherein the preoperative planning operation page includes a view area and an operation area, wherein the view area displays a three-dimensional view and multiple two-dimensional views of the surgical site, wherein the multiple two-dimensional views include a cross-sectional view, a sagittal view, and a coronal view, and the operation area includes a landmark point list area displaying multiple landmark points;

[0157] The processing unit 1102 is configured to determine a plurality of landmark points marked in the viewing area, determine information to be corrected based on a correction axis in response to a received correction instruction, the information to be corrected including rotation angles in multiple directions of a bone model coordinate system, and correct the three-dimensional view according to the information to be corrected. The plurality of landmark points marked in the viewing area correspond one-to-one to the plurality of landmark points selected in the landmark point list area, and the correction axis is formed by connecting the plurality of landmark points marked in the viewing area.

[0158] An embodiment of the present application also discloses a computer-assisted medical device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the preoperative planning information correction method as described in the aforementioned embodiments is implemented.

[0159] The embodiment of the present application further discloses a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the preoperative planning information correction method as described in the above-mentioned embodiments is implemented.

[0160] The embodiment of the present application further discloses a computer program product. When the computer program product is run on a computer, the computer is enabled to execute the preoperative planning information correction method described in the above-mentioned embodiments.

[0161] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application is described in detail with reference to the above-mentioned embodiments, a person skilled in the art should understand that the technical solutions described in the above-mentioned embodiments can still be modified, or some of the technical features can be replaced by equivalents; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application.

Claims

1. A method for correcting preoperative planning information, It is characterized in that include: Displaying a preoperative planning operation page, the preoperative planning operation page includes a view area and an operation area, the view area displays a three-dimensional view and multiple two-dimensional views of the surgical site, the multiple two-dimensional views include a cross-sectional view, a sagittal view and a coronal view, and the operation area includes a landmark point list area displaying multiple landmark points; Determining a plurality of landmark points marked in the viewing area, the plurality of landmark points marked in the viewing area corresponding one-to-one to a plurality of landmark points selected in the landmark point list area, the plurality of landmark points marked in the viewing area forming at least one correction axis; In response to the received correction instruction, determining information to be corrected based on the correction axis, the information to be corrected including rotation angles in multiple directions of the bone model coordinate system; Correcting the three-dimensional view according to the information to be corrected; The correction instruction includes an original view correction instruction for correcting the original scan information, the correction axis includes a first correction axis formed by connecting a lateral landmark point of the posterior femoral condyle and a medial landmark point of the posterior femoral condyle, and the information to be corrected is determined based on the correction axis in response to the received correction instruction, including: In response to the received original view correction instruction, determining a first projection vector of a vector corresponding to the first correction axis on a cross section with the lateral landmark point of the posterior femoral condyle as a reference point; Calculate the first projection vector and the bone model coordinate system respectively x Axis direction vector, y The angle between the axis direction vectors; wherein, when the surgical side is the left side, the bone model coordinate system x The axis direction vector takes a negative value; when the surgical side is the right side, the bone model coordinate system y The axis direction vector takes a negative value; According to the first projection vector and the bone model coordinate system y The angle between the first projection vector and the bone model coordinate system is determined. x The sign of the angle between the axis direction vectors; wherein, when the angle is greater than 90 degrees and less than 270 degrees, the first projection vector and the bone model coordinate system x The sign of the angle between the axis direction vectors is negative; To determine the signed first projection vector and the bone model coordinate system x The angles between the axis direction vectors are used as the angles of each observation plane of the three-dimensional view for correction; wherein the rotation axis of the cross-sectional view for correction of the three-dimensional view is the z Axis, the rotation axis of the sagittal view of the three-dimensional view is the bone model coordinate system y Axis, the rotation axis of the coronal view of the three-dimensional view is the bone model coordinate system x axis.

2. The method according to claim 1, It is characterized in that The determining a plurality of landmark points marked in the view area comprises: determining a plurality of position points marked in the three-dimensional view; The marked multiple position points in the three-dimensional view are used as landmark points, and a corresponding relationship between the marked multiple landmark points and the selected multiple landmark points in the landmark point list area is established; and the coordinate data of the marked multiple landmark points are stored.

3. The method according to claim 2, It is characterized in that The determining of a plurality of position points marked in the three-dimensional view comprises: Determine a plurality of position points selected in the plurality of two-dimensional views; A plurality of position points selected in the two-dimensional view are mapped to the three-dimensional view to obtain a plurality of landmark points marked in the three-dimensional view.

4. The method according to claim 2, It is characterized in that After storing the coordinate data of the marked multiple landmark points, the method further includes: According to the coordinate data and the composition relationship between the pre-set landmark points and the constructed correction axis, multiple landmark points having the composition relationship are connected in pairs to form the correction axis.

5. The method according to any one of claims 1 to 4, It is characterized in that The correction instruction also includes a femoral view correction instruction for correcting the planning information obtained after the prosthesis planning is completed, the correction axis includes a second correction axis formed by connecting the femoral head center landmark point and the femoral distal center landmark point, the information to be corrected also includes a first axis correction transformation matrix for correcting the femoral three-dimensional view, and the information to be corrected is determined based on the correction axis in response to the received correction instruction, and also includes: In response to the received femoral view correction instruction, determining a plane with a vector corresponding to the second correction axis as a normal vector and the distal femoral center landmark point as a reference point; respectively determining two projection points of the lateral landmark point of the posterior femoral condyle and the medial landmark point of the posterior femoral condyle on the plane; Connect the two projection points to form a second projection vector; wherein, when the surgical side is the right side, the value sign of the second projection vector is negative; when the surgical side is the left side, the value sign of the second projection vector remains unchanged; Based on the second projection vector, a first axis correction transformation matrix for correcting the three-dimensional view of the femur is determined.

6. The method according to claim 5, It is characterized in that Determining a first axis correction transformation matrix for correcting the three-dimensional view of the femur based on the second projection vector includes: The second projection vector after determining the sign is the first projection vector of the bone model coordinate system. x The vector corresponding to the second correction axis is used as the first axis of the bone model coordinate system. y Axis direction correction vector; Calculate the first x The axis direction correction vector is related to the first y The cross product between the axis direction correction vectors is used as the first z Axis direction correction vector, the first x Axis direction correction vector, the first y The axis direction correction vector and the first z The axial direction correction vectors together constitute a first axis correction transformation matrix for correcting the three-dimensional view of the femur.

7. The method according to any one of claims 1 to 4 or 6, It is characterized in that The correction instruction also includes a tibial view correction instruction for correcting the planning information obtained after the prosthesis planning is completed, the correction axis includes a third correction axis formed by connecting the medial malleolus landmark point and the lateral malleolus landmark point, the information to be corrected also includes a second axis correction transformation matrix for correcting the tibia three-dimensional view, and the information to be corrected is determined based on the correction axis in response to the received correction instruction, and further includes: In response to the received tibial view correction instruction, determining a first direction vector formed by a center point of the third correction axis and a tibial plateau center landmark point, and a second direction vector formed by connecting a posterior cruciate ligament insertion center landmark point and a tibial tuberosity landmark point; A second axis correction transformation matrix for correcting the three-dimensional view of the tibia is determined according to the first direction vector and the second direction vector.

8. The method according to claim 7, It is characterized in that Determining a second axis correction transformation matrix for correcting the three-dimensional view of the tibia according to the first direction vector and the second direction vector includes: Calculate the cross product between the second direction vector and the first direction vector as the second direction vector of the bone model coordinate system. x Axis direction correction vector; The first direction vector is used as the second coordinate system of the bone model. y Axis direction correction vector; Calculate the second x The axis direction correction vector is related to the second y The cross product between the axis direction correction vectors is used as the second z Axis direction correction vector, the second x Axis direction correction vector, the second y The axis direction correction vector and the second z The axial direction correction vectors together constitute a second axis correction transformation matrix for correcting the three-dimensional view of the tibia.

9. A preoperative planning information correction device, It is characterized in that include: A display module, used for displaying a preoperative planning operation page, wherein the preoperative planning operation page includes a view area and an operation area, wherein the view area displays a three-dimensional view and multiple two-dimensional views of the surgical site, wherein the multiple two-dimensional views include a cross-sectional view, a sagittal view, and a coronal view, and the operation area includes a landmark point list area displaying multiple landmark points; a marking module, configured to determine a plurality of marked landmark points in the viewing area, wherein the plurality of marked landmark points in the viewing area correspond one-to-one to the plurality of landmark points selected in the landmark point list area, and the plurality of marked landmark points in the viewing area form at least one correction axis; A determination module, configured to determine information to be corrected based on the correction axis in response to the received correction instruction, wherein the information to be corrected includes rotation angles in multiple directions of the bone model coordinate system; A correction module, used for correcting the three-dimensional view according to the information to be corrected; The correction instruction includes an original view correction instruction for correcting the original scan information, the correction axis includes a first correction axis formed by connecting the lateral landmark point of the posterior femoral condyle and the medial landmark point of the posterior femoral condyle, and the determination module is specifically used for: In response to the received original view correction instruction, determining a first projection vector of a vector corresponding to the first correction axis on a cross section with the lateral landmark point of the posterior femoral condyle as a reference point; Calculate the first projection vector and the bone model coordinate system respectively x Axis direction vector, y The angle between the axis direction vectors; wherein, when the surgical side is the left side, the bone model coordinate system x The axis direction vector takes a negative value; when the surgical side is the right side, the bone model coordinate system y The axis direction vector takes a negative value; According to the first projection vector and the bone model coordinate system y The angle between the first projection vector and the bone model coordinate system is determined. x The sign of the angle between the axis direction vectors; wherein, when the angle is greater than 90 degrees and less than 270 degrees, the first projection vector and the bone model coordinate system x The sign of the angle between the axis direction vectors is negative; To determine the signed first projection vector and the bone model coordinate system x The angles between the axis direction vectors are used as the angles of each observation plane of the three-dimensional view for correction; wherein the rotation axis of the cross-sectional view for correction of the three-dimensional view is the z Axis, the rotation axis of the sagittal view of the three-dimensional view is the bone model coordinate system y Axis, the rotation axis of the coronal view of the three-dimensional view is the bone model coordinate system x axis.

10. A computer-assisted medical device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, It is characterized in that When the processor executes the computer program, the preoperative planning information correction method as described in any one of claims 1-8 is implemented.

11. A computer-readable storage medium storing a computer program. It is characterized in that When the computer program is executed by a processor, the preoperative planning information correction method as described in any one of claims 1-8 is implemented.

Citation Information

Patent Citations

  • Knee joint simulation operation automatic planning method and system based on deep learning

    CN116327357A

  • Surgical planning system and method for preoperative evaluation of rotation center data

    CN118076312A