Spinal compression fracture healing planning method based on multi-modal three-dimensional medical image

Abstract

The invention provides a spine compression fracture healing planning method, system and device based on a multi-modal three-dimensional medical image and a computer readable storage medium. The spine compression fracture healing planning method based on the multi-modal three-dimensional medical image comprises the following steps: acquiring a spine CT image and a spine MR image of a patient; based on the spine CT image and the spine MR image, respectively carrying out identification and segmentation to respectively obtain a fracture centrum CT image and a fracture centrum MR image of the spine centrum compression fracture part; inputting the fracture centrum CT image and the fracture centrum MR image into a preset bone cement anti-leakage planning model, and outputting a bone cement injection anti-leakage planning scheme; wherein the bone cement injection anti-leakage planning scheme at least comprises the viscosity, the injection amount, the injection position, the injection opportunity and the injection rate of the bone cement. According to the embodiment of the invention, the anti-seepage planning of bone cement injection can be carried out quickly and accurately.

Description

Technical Field

[0001] The present application belongs to the field of bone cement injection leakage prevention, and in particular, relates to a spinal compression fracture healing planning method, system, device and computer-readable storage medium based on multimodal three-dimensional medical images. Background Art

[0002] The common method for spinal compression fractures is to inject bone cement into the diseased vertebra through percutaneous puncture using a specific instrument to increase the strength and stability of the vertebra. If the bone cement is injected well, the patient's compression fracture will occur in a short time, and the height of the vertebra can even be restored. If the injection technique is not good, it will lead to extravasation of bone cement, which may cause pulmonary embolism or other complications.

[0003] At present, in the related technology, the injection amount and injection timing of the bone cement injection module are determined by monitoring through a sensor module, so as to achieve the effect of reducing bone cement leakage.

[0004] However, monitoring through sensor modules is complicated and has low accuracy.

[0005] Therefore, how to quickly and accurately plan the anti-leakage of bone cement injection is a technical problem that needs to be solved urgently by those skilled in the art. Summary of the invention

[0006] The embodiments of the present application provide a method, system, device and computer-readable storage medium for spinal compression fracture healing planning based on multimodal three-dimensional medical images, which can quickly and accurately perform bone cement injection anti-leakage planning.

[0007] In a first aspect, an embodiment of the present application provides a spinal compression fracture healing planning method based on multimodal three-dimensional medical images, comprising:

[0008] Obtaining a spine CT image and a spine MR image of the patient;

[0009] Based on the spinal CT image and the spinal MR image, identification and segmentation are performed respectively, and the fractured vertebral CT image and the fractured vertebral MR image of the spinal vertebral compression fracture site are obtained respectively;

[0010] Inputting the fractured vertebral CT image and the fractured vertebral MR image into a preset bone cement anti-leakage planning model, and outputting a bone cement injection anti-leakage planning scheme;

[0011] The bone cement injection anti-leakage planning scheme includes at least: bone cement viscosity, injection volume, injection position, injection timing and injection rate.

[0012] Optionally, identification and segmentation are performed based on the spinal CT image and the spinal MR image to obtain the fractured vertebral CT image and the fractured vertebral MR image of the spinal vertebral compression fracture site, respectively, including:

[0013] The spinal CT image and the spinal MR image are respectively input into the preset segmentation network model, and pass through the initial convolution layer, which has 16 filters, each of which has a size of 3x3, and output the first feature map;

[0014] Using multiple convolutional layers and maximum pooling layers, the spatial dimension of the first feature map is reduced to obtain a second feature map;

[0015] Based on the second feature map and skip connection, the output of the previous layer is directly connected to the subsequent layer to reduce information loss and obtain the third feature map.

[0016] Optionally, after obtaining the third feature map, the method further includes:

[0017] Upsampling the third feature map to increase the spatial dimension of the feature map to obtain a fourth feature map;

[0018] The feature maps of different layers are fused to enhance the feature representation and obtain the fifth feature map;

[0019] Multiple feature maps are merged to output the corresponding fractured vertebral CT images and fractured vertebral MR images of the spinal vertebral compression fracture site.

[0020] Optionally, also include:

[0021] Perform volume rendering or surface rendering on the fractured vertebral CT image to obtain an initial fractured vertebral three-dimensional model;

[0022] The initial fractured vertebral 3D model is smoothed and filled with holes to obtain the final fractured vertebral 3D model.

[0023] Optional, bone cement leakage prevention planning model, including:

[0024] Reorganize some channels and divide the channel dimensions into multiple sub-feature groups to achieve uniform distribution of spatial semantic features;

[0025] Using two parallel branches at the front end to extract the attention weights of the feature map has the advantage of better capturing the relationship between cross-channels;

[0026] At the back end of the module, the features output by the two branches are processed in a cross-dimensional interactive manner.

[0027] Optionally, the viscosity, injection volume, and injection position of the bone cement are determined, including:

[0028] Select the appropriate bone cement viscosity based on the type of fracture and the condition of the bone;

[0029] Calculate the amount of bone cement to be injected based on the volume and bone quality of the fracture area in the three-dimensional model;

[0030] By analyzing the three-dimensional model, the precise location of the fracture and the direction of the fracture crack are determined, and the center of the fracture or the largest crack is selected as the injection location for bone cement.

[0031] Optionally, the timing and rate of bone cement injection may include:

[0032] Determine the timing of bone cement injection based on the diffusion of bone cement;

[0033] The injection rate of bone cement is determined based on the diffusion of bone cement, the size of the fracture crack and the hardness of the bone.

[0034] In a second aspect, the present application provides a spinal compression fracture healing planning system based on multimodal three-dimensional medical images, including:

[0035] An image acquisition module, used for acquiring a patient's spine CT image and a spine MR image;

[0036] An image segmentation module is used to identify and segment the spinal CT image and the spinal MR image, respectively, to obtain a fractured vertebral CT image and a fractured vertebral MR image of the spinal vertebral compression fracture site;

[0037] A bone cement anti-leakage planning module is used to input the fractured vertebral CT image and the fractured vertebral MR image into a preset bone cement anti-leakage planning model, and output a bone cement injection anti-leakage planning scheme;

[0038] The bone cement injection anti-leakage planning scheme includes at least: bone cement viscosity, injection volume, injection position, injection timing and injection rate.

[0039] In a third aspect, an embodiment of the present application provides an electronic device, the electronic device comprising: a processor and a memory storing computer program instructions;

[0040] When the processor executes the computer program instructions, a spinal compression fracture healing planning method based on multimodal three-dimensional medical images is implemented.

[0041] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having computer program instructions stored thereon, which, when executed by a processor, implement a spinal compression fracture healing planning method based on multimodal three-dimensional medical images.

[0042] The spinal compression fracture healing planning method, system, device and computer-readable storage medium based on multimodal three-dimensional medical images of the embodiments of the present application can quickly and accurately perform bone cement injection anti-leakage planning.

[0043] The spinal compression fracture healing planning method based on multimodal three-dimensional medical images includes:

[0044] Obtaining a spine CT image and a spine MR image of the patient;

[0045] Based on the spinal CT image and the spinal MR image, identification and segmentation are performed respectively, and the fractured vertebral CT image and the fractured vertebral MR image of the spinal vertebral compression fracture site are obtained respectively;

[0046] Inputting the fractured vertebral CT image and the fractured vertebral MR image into a preset bone cement anti-leakage planning model, and outputting a bone cement injection anti-leakage planning scheme;

[0047] The bone cement injection anti-leakage planning scheme includes at least: bone cement viscosity, injection volume, injection position, injection timing and injection rate. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0049] Figure 1 It is a flowchart of a spinal compression fracture healing planning method based on multimodal three-dimensional medical images provided by an embodiment of the present application;

[0050] Figure 2 It is a structural diagram of a segmentation network model provided by an embodiment of the present application;

[0051] Figure 3 It is a structural schematic diagram of a bone cement anti-leakage planning model provided by an embodiment of the present application;

[0052] Figure 4 It is a structural schematic diagram of a spinal compression fracture healing planning system based on multimodal three-dimensional medical images provided by an embodiment of the present application;

[0053] Figure 5 It is a schematic diagram of the structure of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0054] The features and exemplary embodiments of various aspects of the present application will be described in detail below. In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain the present application, rather than to limit the present application. For those skilled in the art, the present application can be implemented without the need for some of these specific details. The following description of the embodiments is only to provide a better understanding of the present application by illustrating the examples of the present application.

[0055] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "include..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0056] In order to solve the problems of the prior art, the embodiments of the present application provide a method, system, device and computer-readable storage medium for planning the healing of spinal compression fractures based on multimodal three-dimensional medical images. The following first introduces the method for planning the healing of spinal compression fractures based on multimodal three-dimensional medical images provided by the embodiments of the present application.

[0057] Figure 1 FIG. 1 is a flow chart of a spinal compression fracture healing planning method based on multimodal three-dimensional medical images provided by an embodiment of the present application. Figure 1 As shown, the spinal compression fracture healing planning method based on multimodal three-dimensional medical images includes:

[0058] S101, obtaining a spine CT image and a spine MR image of a patient;

[0059] S102, identifying and segmenting the spinal CT image and the spinal MR image, respectively, to obtain a fractured vertebral CT image and a fractured vertebral MR image of the spinal vertebral compression fracture site;

[0060] S103, inputting the fractured vertebral CT image and the fractured vertebral MR image into a preset bone cement anti-leakage planning model, and outputting a bone cement injection anti-leakage planning scheme;

[0061] The bone cement injection anti-leakage planning scheme includes at least: bone cement viscosity, injection volume, injection position, injection timing and injection rate.

[0062] Figure 2 It is a structural diagram of a segmentation network model provided by an embodiment of the present application;

[0063] In one embodiment, identification and segmentation are performed based on the spinal CT image and the spinal MR image to obtain the fractured vertebral CT image and the fractured vertebral MR image of the spinal vertebral compression fracture site, respectively, including:

[0064] The spinal CT image and the spinal MR image are respectively input into the preset segmentation network model, and pass through the initial convolution layer, which has 16 filters, each of which has a size of 3x3, and output the first feature map;

[0065] Using multiple convolutional layers and maximum pooling layers, the spatial dimension of the first feature map is reduced to obtain a second feature map;

[0066] Based on the second feature map and skip connection, the output of the previous layer is directly connected to the subsequent layer to reduce information loss and obtain the third feature map.

[0067] In one embodiment, after obtaining the third feature map, the method further includes:

[0068] Upsampling the third feature map to increase the spatial dimension of the feature map to obtain a fourth feature map;

[0069] The feature maps of different layers are fused to enhance the feature representation and obtain the fifth feature map;

[0070] Multiple feature maps are merged to output the corresponding fractured vertebral CT images and fractured vertebral MR images of the spinal vertebral compression fracture site.

[0071] In one embodiment, it further includes:

[0072] Perform volume rendering or surface rendering on the fractured vertebral CT image to obtain an initial fractured vertebral three-dimensional model;

[0073] The initial fractured vertebral 3D model is smoothed and filled with holes to obtain the final fractured vertebral 3D model.

[0074] Figure 3 It is a structural schematic diagram of a bone cement anti-leakage planning model provided by an embodiment of the present application;

[0075] In one embodiment, the bone cement anti-leakage planning model includes:

[0076] Reorganize some channels and divide the channel dimensions into multiple sub-feature groups to achieve uniform distribution of spatial semantic features;

[0077] Using two parallel branches at the front end to extract the attention weights of the feature map has the advantage of better capturing the relationship between cross-channels;

[0078] At the back end of the module, the features output by the two branches are processed in a cross-dimensional interactive manner.

[0079] In one embodiment, the determination of the viscosity, injection volume, and injection position of the bone cement includes:

[0080] Select the appropriate bone cement viscosity based on the type of fracture and the condition of the bone;

[0081] Calculate the amount of bone cement to be injected based on the volume and bone quality of the fracture area in the three-dimensional model;

[0082] By analyzing the three-dimensional model, the precise location of the fracture and the direction of the fracture crack are determined, and the center of the fracture or the largest crack is selected as the injection location for bone cement.

[0083] In one embodiment, the determination of the injection timing and injection rate of bone cement includes:

[0084] Determine the timing of bone cement injection based on the diffusion of bone cement;

[0085] The injection rate of bone cement is determined based on the diffusion of bone cement, the size of the fracture crack and the hardness of the bone.

[0086] Figure 4 1 is a schematic diagram of a spinal compression fracture healing planning system based on multimodal three-dimensional medical images provided by an embodiment of the present application; the spinal compression fracture healing planning system based on multimodal three-dimensional medical images includes:

[0087] An image acquisition module 401 is used to acquire a spine CT image and a spine MR image of a patient;

[0088] An image segmentation module 402 is used to identify and segment the spinal CT image and the spinal MR image, respectively, to obtain a fractured vertebral CT image and a fractured vertebral MR image of the spinal vertebral compression fracture site;

[0089] A bone cement anti-leakage planning module 403 is used to input the fractured vertebral CT image and the fractured vertebral MR image into a preset bone cement anti-leakage planning model, and output a bone cement injection anti-leakage planning scheme;

[0090] The bone cement injection anti-leakage planning scheme includes at least: bone cement viscosity, injection volume, injection position, injection timing and injection rate.

[0091] Figure 5A schematic diagram of the structure of an electronic device provided in an embodiment of the present application is shown.

[0092] The electronic device may include a processor 501 and a memory 502 storing computer program instructions.

[0093] Specifically, the processor 501 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.

[0094] The memory 502 may include a large capacity memory for data or instructions. By way of example and not limitation, the memory 502 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive or a combination of two or more of these. Where appropriate, the memory 502 may include a removable or non-removable (or fixed) medium. Where appropriate, the memory 502 may be inside or outside the electronic device. In a particular embodiment, the memory 502 may be a non-volatile solid-state memory.

[0095] In one embodiment, the memory 502 may be a read-only memory (ROM). In one embodiment, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), an electrically rewritable ROM (EAROM), or a flash memory, or a combination of two or more of these.

[0096] The processor 501 reads and executes the computer program instructions stored in the memory 502 to implement any one of the spinal compression fracture healing planning methods based on multimodal three-dimensional medical images in the above embodiments.

[0097] In one example, the electronic device may further include a communication interface 503 and a bus 510. Figure 5 As shown, the processor 501, the memory 502, and the communication interface 503 are connected via a bus 510 and communicate with each other.

[0098] The communication interface 503 is mainly used to implement communication between various modules, systems, units and / or devices in the embodiments of the present application.

[0099] Bus 510 includes hardware, software or both, and the parts of electronic equipment are coupled to each other. For example, but not limitation, bus may include accelerated graphics port (AGP) or other graphics bus, enhanced industrial standard architecture (EISA) bus, front side bus (FSB), hypertransport (HT) interconnection, industrial standard architecture (ISA) bus, infinite bandwidth interconnection, low pin count (LPC) bus, memory bus, micro channel architecture (MCA) bus, peripheral component interconnection (PCI) bus, PCI-Express (PCI-X) bus, serial advanced technology attachment (SATA) bus, video electronics standard association local (VLB) bus or other suitable bus or two or more of these combinations. In appropriate cases, bus 510 may include one or more buses. Although the present application embodiment describes and shows a specific bus, the application considers any suitable bus or interconnection.

[0100] In addition, in combination with the spinal compression fracture healing planning method based on multimodal three-dimensional medical images in the above embodiments, the present application embodiment can provide a computer-readable storage medium for implementation. The computer-readable storage medium stores computer program instructions; when the computer program instructions are executed by the processor, any one of the spinal compression fracture healing planning methods based on multimodal three-dimensional medical images in the above embodiments is implemented.

[0101] It should be clear that the present application is not limited to the specific configuration and processing described above and shown in the figures. For the sake of simplicity, a detailed description of the known method is omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the present application is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order between the steps after understanding the spirit of the present application.

[0102] The functional modules shown in the above-described block diagram can be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an application specific integrated circuit (ASIC), appropriate firmware, a plug-in, a function card, etc. When implemented in software, the elements of the present application are programs or code segments that are used to perform the required tasks. Programs or code segments can be stored in machine-readable media, or transmitted on a transmission medium or a communication link by a data signal carried in a carrier wave. "Machine-readable media" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, optical fiber media, radio frequency (RF) links, etc. Code segments can be downloaded via computer networks such as the Internet, intranets, etc.

[0103] It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or systems. However, this application is not limited to the order of the above steps, that is, the steps can be performed in the order mentioned in the embodiment, or in a different order from the embodiment, or several steps can be performed simultaneously.

[0104] The above reference is according to the method of the embodiment of the present application, the flow chart of system (system) and computer program product and / or block diagram and describe various aspects of the present application.It should be understood that each square frame in the flow chart and / or block diagram and the combination of each square frame in the flow chart and / or block diagram can be realized by computer program instructions.These computer program instructions can be provided to the processor of general-purpose computer, special-purpose computer or other programmable data processing system, to produce a kind of machine, so that these instructions executed by the processor of computer or other programmable data processing system enable the realization of the function / action specified in one or more square frames of flow chart and / or block diagram.Such processor can be but not limited to general-purpose processor, special-purpose processor, special application processor or field programmable logic circuit.It can also be understood that each square frame in the block chart and / or flow chart and the combination of square frames in the block chart and / or flow chart can also be realized by the special-purpose hardware that performs the specified function or action, or can be realized by the combination of special-purpose hardware and computer instructions.

[0105] The above is only a specific implementation of the present application. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, modules and units described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. It should be understood that the protection scope of the present application is not limited to this. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in this application, and these modifications or replacements should be included in the protection scope of this application.

Claims

1. A method for planning the healing of spinal compression fractures based on multimodal three-dimensional medical images, characterized in that: include: Obtaining a spine CT image and a spine MR image of the patient; Based on the spinal CT image and the spinal MR image, identification and segmentation are performed respectively, and the fractured vertebral CT image and the fractured vertebral MR image of the spinal vertebral compression fracture site are obtained respectively; Inputting the fractured vertebral CT image and the fractured vertebral MR image into a preset bone cement anti-leakage planning model, and outputting a bone cement injection anti-leakage planning scheme; The bone cement injection anti-leakage planning scheme includes at least: bone cement viscosity, injection volume, injection position, injection timing and injection rate.

2. The method for planning healing of spinal compression fractures based on multimodal three-dimensional medical images according to claim 1, characterized in that: Based on the spinal CT image and the spinal MR image, the fractured vertebrae CT image and the fractured vertebrae MR image of the spinal vertebrae compression fracture site are obtained respectively, including: The spinal CT image and the spinal MR image are respectively input into the preset segmentation network model, and pass through the initial convolution layer, which has 16 filters, each of which has a size of 3x3, and output the first feature map; Using multiple convolutional layers and maximum pooling layers, the spatial dimension of the first feature map is reduced to obtain a second feature map; Based on the second feature map and skip connection, the output of the previous layer is directly connected to the subsequent layer to reduce information loss and obtain the third feature map.

3. The method for planning healing of spinal compression fractures based on multimodal three-dimensional medical images according to claim 2, characterized in that: After obtaining the third feature map, it also includes: Upsampling the third feature map to increase the spatial dimension of the feature map to obtain a fourth feature map; The feature maps of different layers are fused to enhance the feature representation and obtain the fifth feature map; Multiple feature maps are merged to output the corresponding fractured vertebral CT images and fractured vertebral MR images of the spinal vertebral compression fracture site.

4. The method for planning healing of spinal compression fractures based on multimodal three-dimensional medical images according to claim 1, characterized in that: Also includes: Perform volume rendering or surface rendering on the fractured vertebral CT image to obtain an initial fractured vertebral three-dimensional model; The initial fractured vertebral 3D model is smoothed and filled with holes to obtain the final fractured vertebral 3D model.

5. The method for spinal compression fracture healing planning based on multimodal three-dimensional medical images according to claim 1, characterized in that: Bone cement anti-leakage planning model, including: Reorganize some channels and divide the channel dimensions into multiple sub-feature groups to achieve uniform distribution of spatial semantic features; Using two parallel branches at the front end to extract the attention weights of the feature map has the advantage of better capturing the relationship between cross-channels; At the back end of the module, the features output by the two branches are processed in a cross-dimensional interactive manner.

6. The method for planning healing of spinal compression fractures based on multimodal three-dimensional medical images according to claim 1, characterized in that: The viscosity, injection volume, and injection location of bone cement are determined, including: Select the appropriate bone cement viscosity based on the type of fracture and the condition of the bone; Calculate the amount of bone cement to be injected based on the volume and bone quality of the fracture area in the three-dimensional model; By analyzing the three-dimensional model, the precise location of the fracture and the direction of the fracture crack are determined, and the center of the fracture or the largest crack is selected as the injection location for bone cement.

7. The method for planning healing of spinal compression fractures based on multimodal three-dimensional medical images according to claim 6, characterized in that: The timing and rate of bone cement injection include: Determine the timing of bone cement injection based on the diffusion of bone cement; The injection rate of bone cement is determined based on the diffusion of bone cement, the size of the fracture crack and the hardness of the bone.

8. A spinal compression fracture healing planning system based on multimodal three-dimensional medical images, characterized in that: The system comprises: An image acquisition module, used for acquiring a patient's spine CT image and a spine MR image; An image segmentation module is used to identify and segment the spinal CT image and the spinal MR image, respectively, to obtain a fractured vertebral CT image and a fractured vertebral MR image of the spinal vertebral compression fracture site; A bone cement anti-leakage planning module is used to input the fractured vertebral CT image and the fractured vertebral MR image into a preset bone cement anti-leakage planning model, and output a bone cement injection anti-leakage planning scheme; The bone cement injection anti-leakage planning scheme includes at least: bone cement viscosity, injection volume, injection position, injection timing and injection rate.

9. An electronic device, characterized in that: The electronic device comprises: a processor and a memory storing computer program instructions; When the processor executes the computer program instructions, the spinal compression fracture healing planning method based on multimodal three-dimensional medical images as described in any one of claims 1-7 is implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer program instructions, and when the computer program instructions are executed by the processor, the method for planning healing of spinal compression fractures based on multimodal three-dimensional medical images as described in any one of claims 1 to 7 is implemented.

Images