Dual-plane down-flow procedure adaptive bone structure space reconstruction method and device

Abstract

The application discloses a kind of dual-plane under procedure adaptive skeletal structure space reconstruction method, applied to dual-plane X-ray imaging system, comprising the following steps: obtaining in first imaging plane in pre-set interest point;Form reference line in second imaging plane based on the interest point and first X-ray light source;The corresponding interest point of the interest point in the first imaging plane in the second imaging plane is obtained in the second imaging plane based on the reference line;The three-dimensional coordinates of the corresponding key point are determined in three-dimensional coordinate system based on the interest point in the first imaging plane and the interest point in the second imaging plane;The three-dimensional coordinates of multiple key points are determined by repeating the above steps to realize skeletal structure reconstruction.The method can accurately reflect the position, morphology and stress condition of human skeleton under load, and reconstruct the skeletal structure.

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of bone structure analysis, and particularly relates to a dual-plane process adaptive bone structure spatial reconstruction method, device, equipment and storage medium. BACKGROUND

[0002] Currently, in the medical field, three-dimensional data of a human body is usually obtained by using CT or MR to scan and reconstruct three-dimensional structures of human tissues. Reconstructing three-dimensional structures of human tissues of a patient based on CT data requires a large dose of scanning, which will cause a large dose of radiation to the human body. Therefore, it is usually recommended that an individual only have an enhanced CT once every six months. Although MR has an advantage in the aspect of radiation dose, it requires a patient to adopt a lying position for scanning, cannot reflect the stress condition of a bone under a load-bearing state, and also requires the human body to bear a certain radiation dose, and is usually used for human tissue structure analysis rather than human bone structure. In today's medical field, obtaining a real three-dimensional bone structure can provide theoretical support for quantitative analysis in aspects of bone, joint damage, correction, and recovery training. Therefore, higher requirements are proposed for reconstructing a three-dimensional bone structure. SUMMARY

[0003] To solve the above problems, the purpose of the present application is to provide a dual-plane process adaptive bone structure spatial reconstruction method, device, equipment and storage medium, which can accurately reflect the position, shape and stress condition of a human bone under a load-bearing state, and reconstruct a bone structure.

[0004] To achieve the above purpose, the technical scheme of the present application is as follows: a dual-plane process adaptive bone structure spatial reconstruction method applied to a dual-plane X-ray imaging system, comprising the following steps: obtaining a preset point of interest in a first imaging plane; forming a reference line in a second imaging plane based on the point of interest and a first X-ray light source; obtaining a corresponding point of interest of the point of interest in the first imaging plane in the second imaging plane based on the reference line in the second imaging plane; determining three-dimensional coordinates of a corresponding key point in a three-dimensional coordinate system based on the point of interest in the first imaging plane and the point of interest in the second imaging plane; repeating the above steps to determine three-dimensional coordinates of a plurality of key points to realize bone structure reconstruction.

[0005] In an embodiment of the present application, the step of forming a reference line in a second imaging plane based on a point of interest and a first X-ray light source comprises the following steps: obtaining three-dimensional position coordinates of the first X-ray light source and coordinates of the point of interest in the first imaging plane; and taking a line segment of the first X-ray light source and the point of interest formed in the first imaging plane passing through a to-be-measured human body part as a reference line.

[0006] In an embodiment of the present application, the acquiring the corresponding point of interest in the second imaging plane based on the reference line in the second imaging plane includes: acquiring a preset position coordinate matching table; and determining the corresponding point of interest in the second imaging plane based on the position coordinate matching table within a preset amplitude range of the reference line.

[0007] In an embodiment of the present application, the determining the three-dimensional coordinates of the corresponding key points in a three-dimensional coordinate system based on the point of interest in the first imaging plane and the point of interest in the second imaging plane includes: performing sum average based on the coordinate positions of the point of interest in the first imaging plane and the point of interest in the second imaging plane to generate the three-dimensional coordinates of the key points.

[0008] In an embodiment of the present application, the determining the three-dimensional coordinates of a plurality of key points to realize the reconstruction of the bone structure includes: connecting the plurality of key points based on the determined three-dimensional coordinates to acquire a set of spatial lines.

[0009] In an embodiment of the present application, the method further includes: setting a guide interactive control in a UI interface during the determination of the three-dimensional coordinates of the key points.

[0010] In an embodiment of the present application, the method further includes: realizing the process indication of the operation process by a state machine during the determination of the three-dimensional coordinates of the key points.

[0011] Based on the same concept, the present application further provides a device for the adaptive reconstruction of the bone structure in a two-plane process, which includes: an acquisition module, configured to acquire a preset point of interest in a first imaging plane; a reference indication module, configured to form a reference line in a second imaging plane based on the point of interest and a first X-ray source, and to acquire a corresponding point of interest in the second imaging plane based on the reference line in the second imaging plane; a positioning module, configured to determine the three-dimensional coordinates of the corresponding key points in a three-dimensional coordinate system based on the point of interest in the first imaging plane and the point of interest in the second imaging plane; and a reconstruction module, configured to determine the three-dimensional coordinates of a plurality of key points according to a preset program to realize the reconstruction of the bone structure.

[0012] Based on the same concept, the present application further provides a computer device, which includes: a memory, configured to store a processing program; and a processor, configured to realize the adaptive reconstruction of the bone structure in a two-plane process when the processing program is executed.

[0013] Based on the same concept, the application also provides a readable storage medium, which stores a processing program, and the processing program is executed by a processor to realize the method for double-plane adaptive bone structure space reconstruction.

[0014] Compared with the prior art, the application has the advantages that:

[0015] 1. Compared with CT, the application can accurately reflect the position, shape and stress of human bones under load, reconstruct the human bone structure, and objectively reflect the bone condition, thereby providing a human bone reconstruction model that meets the needs of bone, joint correction, injury recovery, surgery planning and other applications.

[0016] 2. Compared with CT, the application uses X-rays, which produces less radiation dose to the patient and has less negative effect on the human body.

[0017] 3. The application can analyze the coordinates of the key points in the first imaging plane and the second imaging plane based on a large amount of case data, and obtain a data table of the amplitude range that meets the statistical rules of each part of the human body, which can help the operating medical staff more accurately determine the points of interest. BRIEF DESCRIPTION OF DRAWINGS

[0018] The specific embodiments of the application will be further described in detail below with reference to the accompanying drawings, in which:

[0019] Figure 1 The flowchart of the method for double-plane adaptive bone structure space reconstruction of the application;

[0020] Figure 2 The example diagram for determining the points of interest and the reference lines of the application;

[0021] Figure 3 The example diagram for determining the points of interest of the application;

[0022] Figure 4 The example diagram for determining the key points of the application;

[0023] Figure 5 The interactive flowchart of the method for double-plane adaptive bone structure space reconstruction of the application;

[0024] Figure 6 The schematic diagram of the device for double-plane adaptive bone structure space reconstruction of the application;

[0025] Figure 7 The schematic diagram of the embodiment of the computer device of the application. DETAILED DESCRIPTION

[0026] The present application will be further described below in conjunction with the accompanying drawings and specific embodiments. The advantages and features of the present application will become more apparent from the following description and claims. It is to be understood that the drawings are simplified and are not drawn to scale, and are merely intended to facilitate the understanding of the embodiments of the present application.

[0027] It should be noted that all directional indications, such as upper, lower, left, right, front, back, etc., are only used to explain the relative position relationship, movement condition, etc. between components in a certain posture (as shown in the drawings), and if the certain posture changes, the directional indications will also change accordingly.

[0028] Embodiment one

[0029] Please refer to Figure 1 It is a two-plane down-flow adaptive bone structure space reconstruction method applied to a two-plane X-ray imaging system, including the following steps:

[0030] S100: Obtain a preset point of interest in a first imaging plane;

[0031] S200: Form a reference line in a second imaging plane based on the point of interest and a first X-ray light source;

[0032] S300: Obtain a corresponding point of interest in the second imaging plane of the point of interest in the first imaging plane in the second imaging plane based on the reference line;

[0033] S400: Determine the three-dimensional coordinates of the corresponding key points in a three-dimensional coordinate system based on the point of interest in the first imaging plane and the point of interest in the second imaging plane;

[0034] S500: Repeat the above steps to determine the three-dimensional coordinates of multiple key points to realize bone structure reconstruction.

[0035] By determining the point of interest in the first imaging plane of the two-plane X-ray imaging system, the reference line in the second imaging plane is determined, and the corresponding point of interest in the second imaging plane of the point of interest in the first imaging plane is determined, which can more accurately determine the coordinates of the key points in the three-dimensional space, and provide guarantee for the accuracy of subsequent bone structure reconstruction.

[0036] Preferably, the reference line in the second imaging plane based on the point of interest and the first X-ray light source includes:

[0037] S201: Obtain the three-dimensional position coordinates of the first X-ray light source and the coordinates of the point of interest in the first imaging plane;

[0038] S202: connecting the first X-ray source and the point of interest formed in the first imaging plane as a reference line through the line segment of the part of the human body to be measured.

[0039] Since the X-ray source is a point source, it penetrates the human body and projects onto its corresponding imaging plane to form points corresponding to each part of the human body. The human body is a three-dimensional structure, and each point forms a line segment from the incident human body to the corresponding exit human body from the perspective of another imaging plane. This line segment is the reference line. Specifically, as shown in Figure 2 Figure 2 The left side is the first imaging plane. When a point of interest is confirmed, a reference line is formed in the right second imaging plane as shown in the figure.

[0040] Preferably, the reference line based on the reference line in the second imaging plane to obtain the point of interest includes:

[0041] S301: Obtain a pre-set position coordinate matching table;

[0042] S302: Determine the point of interest within the reference line pre-set amplitude range based on the position coordinate matching table.

[0043] The position coordinate matching table can be based on a large number of case data, analyze the coordinates of the key points in the first imaging plane and the second imaging plane, and obtain a data table of the amplitude range conforming to the statistical law of each part of the human body. It can help the operating medical staff to more accurately determine the point of interest.

[0044] Preferably, the three-dimensional coordinates of the corresponding key points determined based on the pair of points of interest in the first imaging plane and the second imaging plane in the three-dimensional coordinate system include: summing and averaging based on the coordinate position of the point of interest to generate the three-dimensional coordinates of the key point.

[0045] As shown in Figure 3 based on the above method, the point of interest is determined. And the algorithm summing and averaging processing is performed on the point of interest to obtain the first key point as shown in Figure 4 .

[0046] Preferably, the three-dimensional coordinates of the plurality of key points are determined to realize the reconstruction of the skeletal structure, including: connecting the plurality of key points based on the determined plurality of key points to obtain a set of space lines. Similarly, the above method is repeated to obtain the second key point, the third key point, to prepare for subsequent skeletal reconstruction.

[0047] ​In the present application, the concept of key points and matchstick man composed of key points is proposed. The matchstick man is an abstract expression of human skeleton lineation. That is, the matchstick man is a spatial line set obtained by defining several key points of the skeleton structure of a certain part of the human body and connecting them in sequence. It is a modeling method for studying human skeleton movement or joint injury, and provides a quantitative analysis means for clinical treatment and postoperative recovery of bones and joints. By designing a plurality of groups of interest points on the double plane, the corresponding key points in space are reconstructed according to the interest points, and the matchstick man structure can be outlined by connecting the key points. Obviously, the position relationship between bones and joints can be abstracted into the position relationship between points, lines and planes in space by using the matchstick man to express a specific skeleton structure, which provides theoretical support for quantitative analysis of bone and joint injury, correction, recovery training and the like.

[0048] Preferably, the double-plane flow adaptive bone structure spatial reconstruction method further comprises: setting a guide interactive control in the UI interface during the process of determining the three-dimensional coordinates of the key points.

[0049] In any imaging plane, the desired interest points are selected at will, at which time the corresponding interactive control dialog box is popped up, and the next operation is performed. Figure 5 As shown in the figure, the interactive flow of the present application is shown. Taking one of the possible operation procedures as an example, first click the frontal (coronal) image, then the state transfers along the left branch in the figure, and if the lateral (sagittal) image is clicked, the state transfers along the right branch in the figure. First, select an interest point on one plane, at which time the state becomes CORPOINT_STATE, which indicates that the point is added on the frontal image, and then the state transfers to the next state SAGREFLINE_STATE, which indicates that the system has determined the reference line of the just-added interest point on the other plane, and then another interest point is selected on the reference line, at which time the state becomes SAGPOINT_STATE, which indicates that the interest point on the lateral image is also selected, and finally the state becomes FINISHED, which indicates that the pair of interest points is defined, and the corresponding key points in space can be reconstructed according to the pair of interest points.

[0050] In another scheme, the double-plane flow adaptive bone structure spatial reconstruction method further comprises: in the process of determining the three-dimensional coordinates of the key points, the progress of the operation process is realized by a state machine.

[0051] Specifically, the desired interest point is arbitrarily selected on any imaging plane, and at this time, the state of the state machine is triggered to the next state, which can be a reference line or an interest point. The setting of the key points required to create the matchstick structure is guided through different state transitions, and the key points in the three-dimensional space are reconstructed according to the key points, so as to outline the spatial matchstick structure.

[0052] Embodiment Two

[0053] As Figure 6 shown, based on the same concept, the application also provides a dual-plane downlink process adaptive bone structure space reconstruction device, comprising: an acquisition module 1 for acquiring a pre-set interest point in a first imaging plane; a reference indication module 2 for forming a reference line in a second imaging plane based on the interest point and a first X-ray source, and acquiring a corresponding interest point of the interest point in the first imaging plane in the second imaging plane based on the reference line in the second imaging plane; a positioning module 3 for determining the three-dimensional coordinates of the corresponding key points in a three-dimensional coordinate system based on the interest points in the first imaging plane and the interest points in the second imaging plane; and a reconstruction module 4 for determining the three-dimensional coordinates of a plurality of key points according to a preset program to realize bone structure reconstruction.

[0054] After adopting the above technical solution, compared with the prior art, the application has the advantages that:

[0055] 1. Compared with CT, the application can accurately reflect the position, shape and stress condition of human bone under load, reconstruct the human bone structure, and objectively reflect the bone condition, thereby providing a human bone reconstruction model that meets the needs of applications such as bone and joint correction, injury recovery, and surgical planning.

[0056] 2. Compared with CT, the application uses X-rays, which produces less radiation dose to the patient and has less negative effect on the human body.

[0057] 3. The application can analyze the coordinates of the key points in the first imaging plane and the second imaging plane based on a large amount of case data by pre-setting the position coordinate matching table, and obtain a data table with an amplitude range that meets the statistical rules of each part of the human body, which can help medical personnel more accurately determine the interest point.

[0058] Embodiment Three

[0059] As Figure 7As shown, based on the same concept, the application also provides a computer device 700 which can have a big difference due to different configurations or performances, and can include one or more processors (central processing units, CPU) 710 (for example, one or more processors) and a memory 720, one or more storage media 730 (for example, one or more mass storage devices) storing application programs 733 or data 732. Among them, the memory 720 and the storage medium 730 can be temporary storage or persistent storage. The programs stored in the storage medium 730 can include one or more modules (not shown in the figure), each of which can include a series of instruction operations in the computer device 700. Further, the processor 710 can be configured to communicate with the storage medium 730 to execute a series of instruction operations in the storage medium 730 on the computer device 700.

[0060] The computer device 700 can also include one or more power supplies 740, one or more wired or wireless network interfaces 750, one or more input / output interfaces 760, and / or one or more operating systems 731, such as Windows Server, Mac OS X, Unix, Linux, FreeBSD, etc.

[0061] Those skilled in the art can understand that, Figure 7 The computer device structure shown does not constitute a limitation on the computer device, and can include more or fewer components than shown or combine certain components, or different component arrangements.

[0062] The computer readable instructions are executed by the processor, so that the processor implements the above-mentioned double-plane flow adaptive bone structure space reconstruction method when executing the computer readable instructions.

[0063] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiments, which will not be described here.

[0064] The integrated unit, if implemented in the form of a software function unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application or the entire or part of the technical solutions that essentially contribute to the prior art can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in the various embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0065] The above-described embodiments are merely used to illustrate the technical solutions of the present application, rather than limit the same; even though the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that modifications can still be made to the technical solutions recorded in the foregoing embodiments, or equivalent replacements can be made to some of the technical features; and these modifications or replacements do not cause the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A dual-plane under-procedure adaptive bone structure spatial reconstruction method, characterized in that, For use in dual-plane X-ray imaging systems, the following steps are included: Acquire a preset point of interest within the first imaging plane; Based on the point of interest and the first X-ray source, a reference line is formed in the second imaging plane; further comprising: obtaining the three-dimensional position coordinates of the first X-ray source and the coordinates of the point of interest in the first imaging plane; and using the line segment connecting the first X-ray source and the point of interest in the first imaging plane that passes through the part of the human body to be tested as the reference line; Based on the reference line, obtain the corresponding point of interest in the second imaging plane of the point of interest in the first imaging plane; Based on the points of interest in the first imaging plane and the points of interest in the second imaging plane, determine the three-dimensional coordinates of the corresponding key points in the three-dimensional coordinate system; Repeat the above steps to determine the three-dimensional coordinates of multiple key points in order to reconstruct the skeletal structure.

2. The method for adaptive skeletal structure spatial reconstruction under dual-plane conditions as described in claim 1, characterized in that, The step of obtaining the corresponding point of interest in the second imaging plane of the point of interest in the first imaging plane based on the reference line includes: Retrieve the preset position coordinate matching table; Within the preset amplitude range of the reference line, the corresponding point of interest in the second imaging plane is determined based on the position coordinate matching table.

3. The method for adaptive skeletal structure spatial reconstruction under dual-plane conditions as described in claim 1, characterized in that, The step of determining the three-dimensional coordinates of the corresponding key points in a three-dimensional coordinate system based on the points of interest in the first imaging plane and the points of interest in the second imaging plane includes: The three-dimensional coordinates of the key point are generated by summing and averaging the coordinate positions of the point of interest in the first imaging plane and the point of interest in the second imaging plane.

4. The method for adaptive skeletal structure spatial reconstruction under dual-plane conditions as described in claim 1, characterized in that, The process of determining the three-dimensional coordinates of multiple key points to achieve skeletal structure reconstruction includes: A set of spatial lines is obtained by connecting multiple identified key points with lines.

5. The method for adaptive skeletal structure spatial reconstruction under dual-plane conditions as described in claim 1, characterized in that, Also includes: During the process of determining the 3D coordinates of key points, guide interactive controls are set in the UI interface.

6. The method for adaptive skeletal structure spatial reconstruction under dual-plane conditions as described in claim 1, characterized in that, Also includes: In determining the three-dimensional coordinates of key points, a state machine is used to indicate the progress of the operation.

7. A dual-plane adaptive skeletal structure spatial reconstruction device, characterized in that, include: The acquisition module is used to acquire preset points of interest within the first imaging plane; The reference indication module is used to form a reference line in a second imaging plane based on the point of interest and the first X-ray source, and further includes: acquiring the three-dimensional position coordinates of the first X-ray source and the coordinates of the point of interest in the first imaging plane; using the line segment connecting the first X-ray source and the point of interest in the first imaging plane that passes through the human body part to be tested as the reference line; and acquiring the corresponding point of interest in the second imaging plane based on the reference line. The positioning module is used to determine the three-dimensional coordinates of the corresponding key points in a three-dimensional coordinate system based on the points of interest in the first imaging plane and the points of interest in the second imaging plane. The reconstruction module is used to determine the three-dimensional coordinates of multiple key points according to a preset program in order to achieve skeletal structure reconstruction.

8. A computer device, characterized in that, include: The memory is used to store the processing program; A processor that, when executing the processing program, implements the biplane process-adaptive skeletal structure spatial reconstruction method as described in any one of claims 1 to 6.

9. A readable storage medium, characterized in that, The readable storage medium stores a processing program, which, when executed by a processor, implements the biplane process-adaptive skeletal structure spatial reconstruction method as described in any one of claims 1 to 6.

Images