Long bone fracture reduction method and system based on image processing

Abstract

The invention relates to the technical field of fracture reduction assistance, in particular to a long bone fracture reduction method and system based on image processing. The method comprises the following steps: acquiring an upper fracture edge of an upper broken bone area and a lower fracture edge of a lower fracture area in a long bone fracture image, and selecting an upper target base point from the upper fracture edge according to the position and sharpness of an upper edge pixel point of the upper fracture edge; selecting a lower target base point on the edge of the lower fracture according to the position of the upper target base point on the edge of the upper fracture and the relative size of the width of the upper fracture area and the width of the lower fracture area; according to the relative positions of the upper target base point and the lower target base point and the direction trend of the edge of the upper fracture, a reduction path of the long bone fracture is determined; and moving the upper broken bone area along the reduction path to assist the reduction of the long bone fracture. Collision in the fracture reduction process can be avoided, the movement path of the broken bone is shortest, and the reduction effect on the long bone fracture is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of fracture reduction assistance, and in particular to a long bone fracture reduction method and system based on image processing. Background Art

[0002] Long bones are a type of bone that is long and columnar, such as the femur and tibia. Fracture reduction methods include manual reduction, traction reduction, and surgical incision reduction. Traditional fracture reduction surgeries, such as tibia fracture reduction, usually use intraoperative X-ray images to understand the state of the broken bone during the reduction process, and then multiple doctors pull the patient's muscles to achieve fracture reduction. Existing methods usually preset the path of fracture reduction based on laboratory theoretical conditions, which results in an excessive range of movement, causing iatrogenic soft tissue trauma to the patient, resulting in poor reduction of long bone fractures. Summary of the invention

[0003] In order to solve the technical problem that the preset fracture reduction path based on the theoretical situation in the laboratory has too large a moving range, resulting in poor reduction effect of long bone fractures, the purpose of the present invention is to provide a long bone fracture reduction method and system based on image processing, and the technical scheme adopted is as follows: In a first aspect, an embodiment of the present invention provides a method for reducing a long bone fracture based on image processing, the method comprising: Obtain long bone fracture images of the patient's fracture site; Performing regional segmentation on the long bone fracture image to obtain the upper fracture region and the lower fracture region; obtaining the upper fracture edge and the lower fracture edge; According to the position and sharpness of the pixel point on the upper edge of the upper fracture edge, an upper target base point on the upper fracture edge is selected; according to the position of the upper target base point on the upper fracture edge and the relative size of the width of the upper fracture area and the lower fracture area, a lower target base point is selected from the lower fracture edge; According to the relative positions of the upper target base point and the lower target base point, and the direction of the upper fracture edge, the reduction path of the long bone fracture is determined; the upper fracture bone area is moved along the reduction path to assist in the reduction of the long bone fracture.

[0004] Further, the obtaining of the upper fracture edge and the lower fracture edge includes: Obtaining corner points in the long bone fracture image; recording the upper fractured bone region and the lower fractured bone region as fractured bone regions, and dividing each fractured bone region into different regional blocks; For each area block, any two corner points in the area block form a corner point pair, and the average of the distances between the two corner points in all the corner point pairs of the area block is used as the overall value of the corner point distance of the area block; according to the total number of corner points in the area block and the overall value of the corner point distance, the fracture index of the area block is obtained; the total number of corner points in the area block is positively correlated with the fracture index, and the overall value of the corner point distance is negatively correlated with the fracture index; For each area block of the broken bone region, the area block corresponding to the fracture index greater than the preset fracture threshold is recorded as the fracture area block; the edge formed by all the fracture area blocks in the broken bone region is detected and the edge obtained is taken as the fracture edge; The fracture edge of the upper fractured bone region was recorded as the upper fracture edge, and the fracture edge of the lower fractured bone region was recorded as the lower fracture edge.

[0005] Further, the selecting of the upper target base point on the upper fracture edge includes: An edge pixel point is randomly selected from the upper fracture edge and recorded as an example point. On the upper fracture edge, the previous edge pixel point and the next edge pixel point adjacent to the example point are recorded as adjacent analysis points of the example point. The line segment obtained by connecting the example point and each of its adjacent analysis points is recorded as the analysis edge of the example point; the angle between the two analysis edges of the example point is taken as the sharpness index of the example point; According to the ordinate of the pixel coordinates of each edge pixel point on the upper fracture edge and the sharpness index, a base point judgment index corresponding to the edge pixel point is obtained; the ordinate and the base point judgment index are positively correlated, and the sharpness index and the base point judgment index are negatively correlated; The edge pixel point corresponding to the largest base point judgment index on the upper fracture edge is recorded as the upper target base point.

[0006] Further, the selecting a lower target base point from the lower fracture edge includes: For each broken bone region, a morphological operation is performed on the broken bone region to obtain a skeleton line of the broken bone region; a perpendicular line is drawn to each pixel point on the skeleton line, and a line segment is obtained by connecting the perpendicular line of each pixel point on the skeleton line with two intersection points of the edge of the broken bone region, and the line segment is recorded as the width line segment of each pixel point on the skeleton line; Calculate the average of the absolute values ​​of the differences between the lengths of the width segments of each pixel point on the skeleton line and its adjacent analysis point as the width difference value of each pixel point on the skeleton line; record the pixel points on the skeleton line whose width difference values ​​are less than a preset difference threshold as width judgment points of the broken bone area; The width line segment of the width judgment point corresponding to the maximum value in the ordinate of the pixel coordinates of the width judgment point in the upper broken bone region is recorded as the upper long bone width line segment; the width line segment of the width judgment point corresponding to the minimum value in the ordinate of the pixel coordinates of the width judgment point in the lower broken bone region is recorded as the lower long bone width line segment; Obtain a vertical point of the upper target base point on the upper long bone width line segment, recorded as the upper target point; select a lower target point from the lower long bone width line segment, the distance between the lower target point and the left end point of the lower long bone width line segment is equal to the distance between the upper target point and the left end point of the upper long bone width line segment; Draw perpendicular lines to the upper and lower target points of the lower long bone width segment, and record the intersection of the perpendicular line to the lower target point and the edge of the lower fracture as the suspected lower target base point; for edge pixel points within a preset local range of the upper and lower target base points of the lower fracture edge, take the edge pixel point corresponding to the largest base point judgment index as the lower target base point.

[0007] Furthermore, determining the reduction path of the long bone fracture according to the relative position of the upper target base point and the lower target base point, and the direction of the upper fracture edge, includes: Obtaining a reset midpoint according to the relative position of the upper target base point and the lower target base point, and the direction of the upper fracture edge; The straight line from the upper target base point to the reset midpoint is taken as the first path; The straight line from the reset midpoint to the lower target base point is used as the second path; The first path and the second path constitute a reset path.

[0008] Further, obtaining the reset midpoint includes: If the abscissa of the pixel coordinates of the upper target base point is greater than the abscissa of the pixel coordinates of the lower target base point, the edge between the left end point of the upper fracture edge and the upper target base point is recorded as the direction analysis edge, and the edge between the right end point of the lower fracture edge and the lower target base point is recorded as the collision analysis edge; if the abscissa of the pixel coordinates of the upper target base point is less than the abscissa of the pixel coordinates of the target base point, the edge between the right end point of the upper fracture edge and the upper target base point is recorded as the direction analysis edge, and the edge between the left end point of the lower fracture edge and the lower target base point is recorded as the collision analysis edge; Perform straight line fitting on the edge pixel points on the direction analysis edge to obtain the direction line; obtain the length analysis line segment of the lower target base point, where there is an intersection between the length analysis line segment and the collision analysis edge; and record the intersection of the direction line and the length analysis line segment as the reset midpoint.

[0009] Furthermore, the performing of regional segmentation on the long bone fracture image to obtain an upper fractured bone region and a lower fractured bone region includes: The maximum inter-class variance method is used to obtain the segmentation threshold of the long bone fracture image; in the long bone fracture image, the connected domain formed by the pixel points whose gray value is greater than the segmentation threshold is recorded as the broken bone area; there are two broken bone areas; Obtain the geometric center of the broken bone area; for the vertical coordinates of the pixel coordinates of the geometric centers of the two broken bone areas, the broken bone area corresponding to the smallest vertical coordinate is recorded as the upper broken bone area, and the broken bone area corresponding to the largest vertical coordinate is recorded as the lower broken bone area.

[0010] Further, moving the upper broken bone region along the reduction path includes: moving an upper target base point on the upper broken bone region along the reduction path.

[0011] Furthermore, the algorithm for acquiring corner points in the long bone fracture image is a Harris corner point detection algorithm.

[0012] In a second aspect, another embodiment of the present invention provides a long bone fracture reduction system based on image processing, the system comprising: a data acquisition module for acquiring a long bone fracture image of a patient's fracture site; A fracture edge acquisition module is used to segment the long bone fracture image into an upper fracture area and a lower fracture area; and to acquire an upper fracture edge and a lower fracture edge; The target base point screening module is used to select the upper target base point on the upper fracture edge according to the position and sharpness of the upper edge pixel point of the upper fracture edge; select the lower target base point from the lower fracture edge according to the position of the upper target base point on the upper fracture edge and the relative size of the width of the upper fracture area and the lower fracture area; The auxiliary reduction module is used to determine the reduction path of the long bone fracture according to the relative position of the upper target base point and the lower target base point, and the direction of the upper fracture edge; move the upper fracture area along the reduction path to assist in the reduction of the long bone fracture.

[0013] The present invention has the following beneficial effects: In an embodiment of the present invention, the broken bones of a long bone fracture, namely the upper broken bone area and the lower broken bone area, are obtained; in order to avoid collision of the broken bones during fracture reduction, it is necessary to ensure that the lowest point of the narrower part of the upper broken bone does not collide with the lower broken bone, and the upper target base point on the upper fracture edge is selected according to the position and sharpness of the upper edge pixel point of the upper fracture edge; in order to solve the problem that the cross-section of the upper broken bone does not match the cross-section of the lower broken bone due to the falling of a small amount of broken bones, based on the position of the upper target base point at the upper fracture edge and combined with the feature that the width of the middle part of the long bone is relatively close, the lower target base point is screened; the relative position of the upper target base point and the lower target base point determines the direction of the reduction path, and the direction of the upper fracture edge determines the length of the direction of the reduction path. Combining the two factors for analysis, the length of the moving path is minimized while ensuring that there is no collision during fracture reduction, so as to reduce damage to other human tissues during fracture reduction and improve the reduction effect of long bone fracture. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] In order to more clearly illustrate the technical solutions and advantages in the embodiments of the present invention or the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0015] Figure 1 A flowchart of a method for reducing a long bone fracture based on image processing provided by one embodiment of the present invention; Figure 2 A partial schematic diagram of a long bone fracture image provided by an embodiment of the present invention; Figure 3 A system structure diagram of a long bone fracture reduction system based on image processing provided by one embodiment of the present invention; Figure 4 A schematic diagram of a computer device of a long bone fracture reduction device based on image processing provided by one embodiment of the present invention. DETAILED DESCRIPTION

[0016] In order to further explain the technical means and effects adopted by the present invention to achieve the predetermined invention purpose, the following is a detailed description of the specific implementation, structure, features and effects of a method and system for reducing a long bone fracture based on image processing proposed by the present invention in combination with the accompanying drawings and preferred embodiments. In the following description, different "one embodiment" or "another embodiment" does not necessarily refer to the same embodiment. In addition, specific features, structures or characteristics in one or more embodiments may be combined in any suitable form.

[0017] Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

[0018] The specific scheme of a long bone fracture reduction method and system based on image processing provided by the present invention is described in detail below with reference to the accompanying drawings.

[0019] Embodiment 1: The present invention proposes a long bone fracture reduction method based on image processing, please refer to Figure 1 , which shows a flowchart of the steps of a long bone fracture reduction method based on image processing provided by an embodiment of the present invention, the method comprising: Step S1: Acquire a long bone fracture image of the patient's fracture site.

[0020] The doctor uses an X-ray scanner to scan the patient's long bone fracture site from the front to obtain an image of the long bone fracture; Figure 2 A partial schematic diagram of a long bone fracture image provided by an embodiment of the present invention is shown in FIG. Figure 2 As shown, Figure 2 There are two long bones in the left long bone, the left long bone is fractured, and the right long bone is not fractured. The object of this plan is the left long bone. The long bone is in a white strip shape extending downward. The extension of the long bone is interrupted at the fracture site, the fracture site is in a dislocated state, and the edge contour of the fracture is relatively complex.

[0021] It should be noted that since the X-ray image is a grayscale image, the long bone fracture image is a grayscale image.

[0022] Step S2: performing regional segmentation on the long bone fracture image to obtain an upper fracture region and a lower fracture region; and obtaining an upper fracture edge and a lower fracture edge.

[0023] Usually, a long bone after fracture will be divided into two or more parts. Since this scheme only analyzes a single fracture position, there are only two fractures in the long bone fracture image. Since the long bones in the long bone fracture image are nearly vertically distributed, the long bone after fracture is divided into an upper fracture and a lower fracture, which are recorded as the upper fracture area and the lower fracture area respectively. The method for obtaining the two fracture areas is as follows: Use the maximum inter-class variance method to obtain the segmentation threshold of the long bone fracture image; in the long bone fracture image, record the connected domain composed of pixels with grayscale values ​​greater than the segmentation threshold as the broken bone area; there are two broken bone areas; obtain the geometric center of the broken bone area; for the vertical coordinates of the pixel coordinates of the geometric centers of the two broken bone areas, record the broken bone area corresponding to the smallest vertical coordinate as the upper broken bone area, and the broken bone area corresponding to the largest vertical coordinate as the lower broken bone area. Among them, the maximum inter-class variance method and pixel coordinates are both well-known technologies for those skilled in the art and will not be repeated here.

[0024] Since the density of bone is higher than that of surrounding soft tissue, the gray value of bone part is larger, and the connected domain formed by the pixel points whose gray value is greater than the segmentation threshold in the long bone fracture image is recorded as the broken bone area. The geometric centroid of the broken bone area represents the approximate position of the broken bone area; because the dislocation state of the fracture site of the long bone will not change the position of the long bone, and the positive direction of the longitudinal axis of the image coordinate system is vertically downward, the longitudinal coordinate of the geometric center of the upper broken bone area is smaller than that of the lower broken bone area.

[0025] The fracture edge of the fracture site can help doctors accurately identify the specific location, direction and shape of the fracture, thereby determining the fracture reduction path. Therefore, it is necessary to obtain the upper fracture edge of the upper fracture area and the lower fracture edge of the lower fracture area. The specific acquisition method is as follows: Acquire corner points in the long bone fracture image; record the upper fractured bone area and the lower fractured bone area as fractured bone areas, and divide each fractured bone area into different area blocks; for each area block, any two corner points in the area block constitute a corner point pair, and the average of the distances between the two corner points in all the corner point pairs of the area block is used as the overall value of the corner point distance of the area block; obtain the fracture index of the area block according to the total number of corner points in the area block and the overall value of the corner point distance; the total number of corner points in the area block is positively correlated with the fracture index, and the overall value of the corner point distance is negatively correlated with the fracture index; for each area block of the fractured bone area, record the area block corresponding to the fracture index greater than the preset fracture threshold as the fracture area block; perform edge detection on the area formed by all the fracture area blocks of the fractured bone area, and obtain the edge as the fracture edge; record the fracture edge of the upper fractured bone area as the upper fracture edge, and the fracture edge of the lower fractured bone area as the lower fracture edge.

[0026] It should be noted that the embodiment of the present invention uses the Harris corner detection algorithm to perform corner detection on the long bone fracture image to obtain the corner points in the long bone fracture image; the broken bone area is divided into uniformly sized regional blocks, and the size of the regional block is , the implementer can set the size of the area block according to the specific situation. If the total number of corner points in the area block is 0 or 1, this embodiment directly sets the overall value of the corner point distance of the area block to a constant of 1. Among them, the Harris corner point detection algorithm is a well-known technology for those skilled in the art and will not be described here.

[0027] The fracture of long bones is usually uneven, and the edge contour of the fracture is relatively complex, that is, the edge contour trend direction changes greatly and the direction changes more frequently, and there are many corner points; while the surface of long bones is smooth, and there are fewer corner points on the edges of the fracture area. There are more corner points in the regional block at the fracture position of long bones, which makes the distance between different corner points in the regional block smaller. Therefore, the total number of corner points in the regional block is positively correlated with the fracture index, and the overall value of the corner point distance is negatively correlated with the fracture index. Among them, the distance between different corner points in the process of obtaining the overall value of the corner point distance refers to the Euclidean distance.

[0028] In the embodiment of the present invention, the ratio of the total number of corner points in each area block to the overall value of the corner point distance is normalized to obtain the fracture index of the corresponding area block. In the embodiment of the present invention, the correlation between the total number of corner points in the area block, the overall value of the corner point distance and the fracture index can also be constructed by other basic mathematical operations, which will not be limited or elaborated here.

[0029] The larger the fracture index, the more likely the regional block is to be at the fracture position of the long bone. The regional block corresponding to the fracture index greater than the preset fracture threshold is recorded as the fracture regional block. The Canny operator is used to perform edge detection on the area formed by the fracture regional block of the fractured bone area to obtain the fracture edge of the fractured bone area.

[0030] It should be noted that in the embodiment of the present invention, the Norm function is used for normalization processing. In the embodiment of the present invention, other normalization methods may also be selected, such as function transformation, maximum and minimum normalization, etc., which are not limited here; the preset fracture threshold is an empirical value of 0.8, and the implementer can set it according to the specific situation.

[0031] Step S3: Select the upper target base point on the upper fracture edge according to the position and sharpness of the pixel point on the upper edge of the upper fracture edge; select the lower target base point from the lower fracture edge according to the position of the upper target base point on the upper fracture edge and the relative size of the width of the upper fracture area and the lower fracture area.

[0032] The key to reducing broken bones is to set the reduction path of the fracture. A correct and short reduction path is helpful to minimize the damage to other human tissues during fracture reduction.

[0033] This plan is used to reduce fractures with complex cross-sections. Complex cross-sections refer to the situation where the upper fracture surface is displaced downward to a certain extent after the fracture, resulting in a state of upper and lower bone dislocation. Usually, the lower fracture is fixed and the upper fracture is moved to achieve fracture reduction. When setting the reduction path, it is necessary to avoid collision of the fractured bones due to the complex fracture cross-section.

[0034] In order to avoid collision of broken bones during fracture reduction, it is necessary to analyze the edge contour of the fracture. The upper broken bone is convex downward, and the lower broken bone is convex upward. If a pair of base points are arbitrarily located on the upper fracture edge of the upper broken bone area and the lower fracture edge of the lower fracture area to set the reduction path, the lower convex part of the upper broken bone will collide with the upper convex part of the lower broken bone. This scheme selects the upper target base point and the lower target base point based on the contour trend of the upper fracture edge and the lower fracture edge to set the fracture reduction path.

[0035] The method for obtaining the upper target base point is as follows: Considering that only the upper fracture is displaced during fracture reduction, the upper target base point should be selected to avoid collision with the lower fracture when the upper fracture moves. The fracture of the upper fracture is wide at the top and narrow at the bottom. To avoid collision, it is only necessary to ensure that the lowest point of the narrow part of the upper fracture does not collide with the lower fracture. Therefore, the edge pixel point closest to the bottom of the image and the sharpest on the edge of the upper fracture is selected as the upper target base point.

[0036] In an embodiment of the present invention, a method for obtaining an upper target base point includes: randomly selecting an edge pixel point on the upper fracture edge as an example point, and on the upper fracture edge, recording an adjacent previous edge pixel point and an adjacent next edge pixel point of the example point as adjacent analysis points of the example point; recording a line segment connecting the example point and each of its adjacent analysis points as an analysis edge of the example point; taking the angle between the two analysis edges of the example point as a sharpness index of the example point; obtaining a base point judgment index of the corresponding edge pixel point according to the ordinate and the sharpness index of the pixel coordinates of each edge pixel point on the upper fracture edge; the ordinate is positively correlated with the base point judgment index, and the sharpness index is negatively correlated with the base point judgment index; and recording the edge pixel point corresponding to the largest base point judgment index on the upper fracture edge as the upper target base point.

[0037] Because the positive direction of the longitudinal axis of the image coordinate system is the vertical downward direction, the larger the longitudinal coordinate of the pixel coordinate of the upper edge pixel point on the upper fracture edge, the greater the possibility that the edge pixel point is at the lowest point of the upper fracture area, and the greater the possibility that the edge pixel point is selected as the upper target base point. In this embodiment, the sharpness of the example point is measured by the angle between the two analysis edges of the example point; if the angle between the two analysis edges of the example point is smaller, it means that the sharpness of the position of the example point is more obvious, and the possibility that the example point is selected as the upper target base point is greater. Therefore, the longitudinal coordinate of the pixel coordinate of the example point is positively correlated with the base point judgment index, and the sharpness index is negatively correlated with the base point judgment index.

[0038] In the embodiment of the present invention, the ratio of the ordinate of the pixel coordinate of the example point to the sharpness index is used as the base point judgment index of the example point. The example point with a larger base point judgment index is more likely to be selected as the upper target base point, and the edge pixel point corresponding to the largest base point judgment index on the upper fracture edge is recorded as the upper target base point.

[0039] It should be noted that the edge pixels at the endpoints on both sides of the upper fracture edge do not participate in the selection of the upper target base point; the remaining edge pixels on the upper fracture edge except the endpoints are the intersection points of its two analysis edges, and the value range of the angle between the two analysis edges of the edge pixel points is .

[0040] The method for obtaining the lower target base point is as follows: The cross section of the upper broken bone is basically consistent with the cross section of the lower broken bone, but a small amount of broken bones may fall off, resulting in poor accuracy of the lower target base point determined based on the contour consistency of the fracture edges of the upper and lower broken bones. Long bone fractures usually occur in the middle of the long bone, and the width of the middle position of the long bone is relatively close. The width of the two long bone fractures at a certain distance is approximately equal.

[0041] In an embodiment of the present invention, a method for acquiring a lower target base point includes: for each broken bone region, performing a morphological operation on the broken bone region to acquire a skeleton line of the broken bone region; drawing perpendicular lines to each pixel point on the skeleton line, and connecting the perpendicular lines to the two intersection points of the edge of the broken bone region to obtain line segments, which are recorded as width line segments of each pixel point on the skeleton line; calculating the average of the absolute values ​​of the differences between the lengths of the width line segments of each pixel point on the skeleton line and its adjacent analysis points, as the width difference value of each pixel point on the skeleton line; recording the pixel points on the skeleton line whose width difference values ​​are less than a preset difference threshold as width judgment points of the broken bone region; recording the width judgment points corresponding to the maximum value in the ordinate of the pixel coordinates of the width judgment points of the upper broken bone region. The width segment of the point is recorded as the upper long bone width segment; the width segment of the width judgment point corresponding to the minimum value in the ordinate of the pixel coordinates of the width judgment point in the lower fracture area is recorded as the lower long bone width segment; the vertical point of the upper target base point on the upper long bone width segment is obtained, and it is recorded as the upper target point; the lower target point is selected from the lower long bone width segment, and the distance between the lower target point and the left end point of the lower long bone width segment is equal to the distance between the upper target point and the left end point of the upper long bone width segment; the vertical lines of the upper and lower target points of the lower long bone width segment are drawn, and the intersection of the vertical line of the lower target point and the edge of the lower fracture is recorded as the suspected lower target base point; for the edge pixel points within the preset local range of the upper and lower target base points of the lower fracture edge, the edge pixel point corresponding to the largest base point judgment index is taken as the lower target base point.

[0042] If the width difference value of each pixel point on the skeleton line is smaller, it means that the bone width of the broken bone at the pixel point position is closer, and the possibility of using the pixel point to measure the bone width of the broken bone area is greater. Since the positive direction of the vertical axis of the image coordinate system is the vertical downward direction, among the width judgment points in the upper broken bone area, the width judgment point with a larger vertical coordinate is closer to the fracture position, and the accuracy of determining the lower target base point is higher.

[0043] Therefore, the width segment of the width judgment point corresponding to the maximum value in the vertical coordinate of the pixel coordinate of the width judgment point in the upper broken bone area is recorded as the upper long bone width segment; the width segment of the width judgment point corresponding to the minimum value in the vertical coordinate of the pixel coordinate of the width judgment point in the lower broken bone area is recorded as the lower long bone width segment.

[0044] Since the contours of the fracture edges of the upper and lower broken bones are consistent, the distances between the upper target point and the lower target point and the same side edge of the broken bone area are relatively close. Therefore, the distance between the lower target point and the left end point of the lower long bone width line segment is equal to the distance between the upper target point and the left end point of the upper long bone width line segment. The left end point can be replaced by the right end point.

[0045] Through the lower target point, a vertical line perpendicular to the width line segment of the lower long bone is drawn. The intersection of the vertical line of the lower target point and the lower fracture edge is recorded as the suspected lower target base point. The lower target base point is within the local range of the suspected lower target base point. The contours of the fracture edges of the upper and lower fractured bones are consistent, and the edge pixel point with the largest base point judgment index within the local range of the suspected lower target base point is taken as the lower target base point. In this way, the lower target base point is determined based on the width feature of the long bone.

[0046] It should be noted that the embodiment of the present invention uses a thinning algorithm to obtain the skeleton line of the broken bone area; the preset difference threshold is an empirical value of 5, and the implementer can set it according to the specific situation. Each edge pixel point on the edge of the lower fracture and its 2 left and 2 right edge pixel points constitute the preset local range of each pixel point on the edge of the lower fracture. For the two endpoints of the width line segment, the endpoint corresponding to the minimum value in the horizontal coordinate of the pixel coordinate is recorded as the left endpoint, and the endpoint corresponding to the maximum value in the horizontal coordinate of the pixel coordinate is recorded as the right endpoint. Among them, the thinning algorithm is a well-known technology for those skilled in the art and will not be repeated here.

[0047] It should be noted that the acquisition method of the base point judgment index of the upper edge pixel point of the lower fracture edge is the same as that of the upper edge pixel point of the upper fracture edge; the acquisition method of the adjacent analysis points of each pixel point on the skeleton line is the same as that of the adjacent analysis points of the upper edge pixel point of the fracture edge, that is, the adjacent previous pixel point and the adjacent next pixel point of each pixel point on the skeleton line of the broken bone area are recorded as the adjacent analysis points of each pixel point on the skeleton line.

[0048] Step S4: Determine the reduction path of the long bone fracture according to the relative positions of the upper target base point and the lower target base point, and the direction of the upper fracture edge; move the upper fracture area along the reduction path to assist in the reduction of the long bone fracture.

[0049] When setting the fracture reduction path, the cross section of the long bone needs to be considered. For more complex cross sections, in order to avoid collision during fracture reduction, multiple paths need to be set to connect and generate a composite reduction path. Since the fracture reduction adopts the method of fixing the lower broken bone and moving the upper broken bone, the path formed by moving the upper target base point to the position of the lower target base point is used as the fracture reduction path.

[0050] Fracture reduction needs to consider the fracture edge contour at the fracture position where the upper target base point is located to avoid collision during fracture reduction. Figure 2 As shown, Figure 2 The upper-middle fracture is slightly offset to the lower right of the lower fracture, and the horizontal coordinate of the pixel coordinate of the upper target base point is greater than the horizontal coordinate of the pixel coordinate of the lower target base point; the collision during fracture reduction occurs at the lower left side of the upper fracture and the upper right side of the lower fracture, and the setting of the first path of the reduction path needs to be based on the distribution of the section edge at the lower left side of the upper fracture. If the upper fracture is offset to the lower left, the collision during reduction occurs at the lower right side of the upper fracture and the upper left side of the lower fracture. Therefore, according to the relative position of the upper target base point and the lower target base point, and the direction of the upper fracture edge, the reduction path is determined to obtain the reduction midpoint.

[0051] In an embodiment of the present invention, a method for obtaining a reset midpoint is as follows: if the horizontal coordinate of the pixel coordinate of the upper target base point is greater than the horizontal coordinate of the pixel coordinate of the lower target base point, the edge between the left end point of the upper break edge and the upper target base point is recorded as a direction analysis edge, and the edge between the right end point of the lower break edge and the lower target base point is recorded as a collision analysis edge; if the horizontal coordinate of the pixel coordinate of the upper target base point is less than the horizontal coordinate of the pixel coordinate of the target base point, the edge between the right end point of the upper break edge and the upper target base point is recorded as a direction analysis edge, and the edge between the left end point of the lower break edge and the lower target base point is recorded as a collision analysis edge; a straight line is fitted to the edge pixel points on the direction analysis edge to obtain a direction line; the length analysis line segment of the lower target base point is obtained, and there is an intersection between the length analysis line segment and the collision analysis edge; the intersection of the direction line and the length analysis line segment is recorded as the reset midpoint.

[0052] The direction analysis edge is the edge of the upper fracture that needs to be referenced during fracture reduction, and is used to determine the direction of the first path of the reduction path; the collision analysis edge is the edge that may collide during fracture reduction, and is used to determine the length of the first path of the reduction path. When there is only one edge pixel point between the length analysis line segment and the collision analysis edge, the upper fracture area moves straight from the reduction midpoint to the lower target base point without colliding with the lower fracture edge. Therefore, the straight line from the upper target base point to the reduction midpoint is taken as the first path.

[0053] It should be noted that, since long bone fractures may cause the upper broken bone to shift relative to the lower broken bone, the horizontal coordinates of the pixel coordinates of the upper target base point and the lower target base point will not be equal; this embodiment uses the least squares method to perform straight line fitting on the edge pixel points on the direction analysis edge. Among them, the least squares method is a well-known technology for those skilled in the art and will not be described in detail here.

[0054] When setting the second path, there is no need to consider the collision between the upper and lower broken bones. In order to reduce the damage to other human tissues during the fracture reduction process, it is only necessary to translate the upper broken bone based on the midpoint of the path and the lower target base point. Since the straight line between the two points is the shortest, the straight line from the midpoint of the reduction to the lower target base point is used as the second path.

[0055] The first path and the second path form a reset path, the midpoint of the path is the end point of the first path, and also the starting point of the second path. The upper target base point is the starting point of the reset path, and the lower target base point is the end point of the reset path.

[0056] The specific process of reducing long bone fractures is as follows: the lower broken bone area remains stationary, and the upper target base point of the upper broken bone area is moved toward the lower target base point along the reduction path. When the upper target base point moves, the upper broken bone area moves along with the upper target base point, that is, the moving path of all pixel points in the upper broken bone area is the same length as the reduction path, and the moving path is parallel to the direction of each segment of the reduction path.

[0057] This scheme considers the position distribution of the two broken bone areas and the distribution of the fracture edge contour to set the reduction path of long bone fractures. Under the premise of ensuring that no collision occurs during the fracture reduction process, the length of the reduction path is minimized to reduce damage to other human tissues during the fracture reduction process and improve the reduction effect of long bone fractures.

[0058] So far, the present invention is completed.

[0059] Embodiment 2: The present invention proposes a long bone fracture reduction system based on image processing, please refer to Figure 3 , which shows a system structure diagram of a long bone fracture reduction system based on image processing provided by an embodiment of the present invention, the system comprising: The data acquisition module 510 is used to obtain a long bone fracture image of the fracture site of the patient; The fracture edge acquisition module 520 is used to perform regional segmentation on the long bone fracture image to obtain an upper fracture region and a lower fracture region; and to obtain an upper fracture edge and a lower fracture edge; The target base point screening module 530 is used to select an upper target base point on the upper fracture edge according to the position and sharpness of the upper edge pixel point of the upper fracture edge; select a lower target base point from the lower fracture edge according to the position of the upper target base point on the upper fracture edge and the relative size of the width of the upper fracture area and the lower fracture area; The auxiliary reduction module 540 is used to determine the reduction path of the long bone fracture according to the relative positions of the upper target base point and the lower target base point, and the direction of the upper fracture edge; move the upper fracture area along the reduction path to assist in the reduction of the long bone fracture.

[0060] It should be noted that the device provided in the above embodiment is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the computer device is divided into different functional modules to complete all or part of the functions described above. In addition, the long bone fracture reduction system based on image processing and the long bone fracture reduction method based on image processing provided in the above embodiment belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0061] Embodiment 3: Figure 4 A computer device schematic diagram of a long bone fracture reduction device based on image processing provided by one embodiment of the present invention. Figure 4 As shown, the computer device includes: a memory 601, a processor 602, and a computer program 603 stored in the memory 601 and running on the processor 602, wherein when the processor 602 executes the computer program 603, the computer device can execute any one of the long bone fracture reduction methods based on image processing introduced above.

[0062] In addition, an embodiment of the present application also protects a device, which may include a memory and a processor, wherein the memory stores an executable program code, and the processor is used to call and execute the executable program code to execute a long bone fracture reduction method based on image processing provided in an embodiment of the present application.

[0063] In this embodiment, the functional modules of the device can be divided according to the above method example. For example, each functional module can be corresponded, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0064] It should be understood that the device provided in this embodiment is used to execute the above-mentioned long bone fracture reduction method based on image processing, and thus can achieve the same effect as the above-mentioned implementation method.

[0065] In the case of an integrated unit, the device may include a processing module and a storage module. When the device is applied to a device, the processing module may be used to control and manage the actions of the device. The storage module may be used to support the device to execute mutual program codes, etc.

[0066] The processing module may be a processor or a controller, which may implement or execute various exemplary logic blocks, modules and circuits included in the disclosure of this application. The processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, etc. The storage module may be a memory.

[0067] It should be noted that the sequence of the above embodiments of the present invention is only for description and does not represent the advantages and disadvantages of the embodiments. The processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0068] The various embodiments in this specification are described in a progressive manner, and the same or similar parts between the various embodiments can be referenced to each other, and each embodiment focuses on the differences from other embodiments.

[0069] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A long bone fracture reduction method based on image processing, characterized in that: The method includes: Obtain long bone fracture images of the patient's fracture site; Performing regional segmentation on the long bone fracture image to obtain the upper fracture region and the lower fracture region; obtaining the upper fracture edge and the lower fracture edge; According to the position and sharpness of the pixel point on the upper edge of the upper fracture edge, an upper target base point on the upper fracture edge is selected; according to the position of the upper target base point on the upper fracture edge and the relative size of the width of the upper fracture area and the lower fracture area, a lower target base point is selected from the lower fracture edge; According to the relative positions of the upper target base point and the lower target base point, and the direction of the upper fracture edge, the reduction path of the long bone fracture is determined; the upper fracture bone area is moved along the reduction path to assist in the reduction of the long bone fracture.

2. The long bone fracture reduction method based on image processing according to claim 1, characterized in that: The obtaining of the upper fracture edge and the lower fracture edge comprises: Obtain corner points in the long bone fracture image; record the upper fractured bone region and the lower fractured bone region as fractured bone regions, and divide each fractured bone region into different regional blocks; For each area block, any two corner points in the area block form a corner point pair, and the average of the distances between the two corner points in all the corner point pairs of the area block is used as the overall value of the corner point distance of the area block; according to the total number of corner points in the area block and the overall value of the corner point distance, the fracture index of the area block is obtained; the total number of corner points in the area block is positively correlated with the fracture index, and the overall value of the corner point distance is negatively correlated with the fracture index; For each area block of the broken bone region, the area block corresponding to the fracture index greater than the preset fracture threshold is recorded as the fracture area block; the edge formed by all the fracture area blocks in the broken bone region is detected and the edge obtained is taken as the fracture edge; The fracture edge of the upper fractured bone region was recorded as the upper fracture edge, and the fracture edge of the lower fractured bone region was recorded as the lower fracture edge.

3. The long bone fracture reduction method based on image processing according to claim 1, characterized in that: The step of selecting an upper target base point on the upper fracture edge includes: An edge pixel point is randomly selected from the upper fracture edge and recorded as an example point. On the upper fracture edge, the previous edge pixel point and the next edge pixel point adjacent to the example point are recorded as adjacent analysis points of the example point. The line segment obtained by connecting the example point and each of its adjacent analysis points is recorded as the analysis edge of the example point; the angle between the two analysis edges of the example point is taken as the sharpness index of the example point; According to the ordinate of the pixel coordinates of each edge pixel point on the upper fracture edge and the sharpness index, a base point judgment index corresponding to the edge pixel point is obtained; the ordinate and the base point judgment index are positively correlated, and the sharpness index and the base point judgment index are negatively correlated; The edge pixel point corresponding to the largest base point judgment index on the upper fracture edge is recorded as the upper target base point.

4. The long bone fracture reduction method based on image processing according to claim 3, characterized in that: The step of selecting a lower target base point from the lower fracture edge includes: For each broken bone region, a morphological operation is performed on the broken bone region to obtain a skeleton line of the broken bone region; a perpendicular line is drawn to each pixel point on the skeleton line, and a line segment is obtained by connecting the perpendicular line of each pixel point on the skeleton line with two intersection points of the edge of the broken bone region, and the line segment is recorded as the width line segment of each pixel point on the skeleton line; Calculate the average of the absolute values ​​of the differences between the lengths of the width segments of each pixel point on the skeleton line and its adjacent analysis point as the width difference value of each pixel point on the skeleton line; record the pixel points on the skeleton line whose width difference values ​​are less than a preset difference threshold as width judgment points of the broken bone area; The width line segment of the width judgment point corresponding to the maximum value in the ordinate of the pixel coordinates of the width judgment point in the upper broken bone region is recorded as the upper long bone width line segment; the width line segment of the width judgment point corresponding to the minimum value in the ordinate of the pixel coordinates of the width judgment point in the lower broken bone region is recorded as the lower long bone width line segment; Obtain a vertical point of the upper target base point on the upper long bone width line segment, recorded as the upper target point; select a lower target point from the lower long bone width line segment, the distance between the lower target point and the left end point of the lower long bone width line segment is equal to the distance between the upper target point and the left end point of the upper long bone width line segment; Draw perpendicular lines to the upper and lower target points of the lower long bone width segment, and record the intersection of the perpendicular line to the lower target point and the edge of the lower fracture as the suspected lower target base point; for edge pixel points within a preset local range of the upper and lower target base points of the lower fracture edge, take the edge pixel point corresponding to the largest base point judgment index as the lower target base point.

5. The long bone fracture reduction method based on image processing according to claim 1, characterized in that: Determining the reduction path of the long bone fracture according to the relative position of the upper target base point and the lower target base point, and the direction of the upper fracture edge, comprises: Obtaining a reset midpoint according to the relative position of the upper target base point and the lower target base point, and the direction of the upper fracture edge; The straight line from the upper target base point to the reset midpoint is taken as the first path; The straight line from the reset midpoint to the lower target base point is used as the second path; The first path and the second path constitute a reset path.

6. The long bone fracture reduction method based on image processing according to claim 5, characterized in that: The obtaining of the reset midpoint comprises: If the abscissa of the pixel coordinates of the upper target base point is greater than the abscissa of the pixel coordinates of the lower target base point, the edge between the left end point of the upper fracture edge and the upper target base point is recorded as the direction analysis edge, and the edge between the right end point of the lower fracture edge and the lower target base point is recorded as the collision analysis edge; if the abscissa of the pixel coordinates of the upper target base point is less than the abscissa of the pixel coordinates of the target base point, the edge between the right end point of the upper fracture edge and the upper target base point is recorded as the direction analysis edge, and the edge between the left end point of the lower fracture edge and the lower target base point is recorded as the collision analysis edge; Perform straight line fitting on the edge pixel points on the direction analysis edge to obtain the direction line; obtain the length analysis line segment of the lower target base point, where there is an intersection between the length analysis line segment and the collision analysis edge; and record the intersection of the direction line and the length analysis line segment as the reset midpoint.

7. The long bone fracture reduction method based on image processing according to claim 1, characterized in that: The method of performing regional segmentation on the long bone fracture image to obtain an upper fractured bone region and a lower fractured bone region includes: The maximum inter-class variance method is used to obtain the segmentation threshold of the long bone fracture image; in the long bone fracture image, the connected domain formed by the pixel points whose gray value is greater than the segmentation threshold is recorded as the broken bone area; there are two broken bone areas; Obtain the geometric center of the broken bone area; for the vertical coordinates of the pixel coordinates of the geometric centers of the two broken bone areas, the broken bone area corresponding to the smallest vertical coordinate is recorded as the upper broken bone area, and the broken bone area corresponding to the largest vertical coordinate is recorded as the lower broken bone area.

8. The long bone fracture reduction method based on image processing according to claim 1, characterized in that: The moving the upper broken bone region along the reduction path comprises: moving an upper target base point on the upper broken bone region along the reduction path.

9. The long bone fracture reduction method based on image processing according to claim 2, characterized in that: The algorithm for obtaining corner points in long bone fracture images is the Harris corner point detection algorithm.

10. A long bone fracture reduction system based on image processing, characterized in that: The system includes: a data acquisition module for acquiring a long bone fracture image of a patient's fracture site; A fracture edge acquisition module is used to segment the long bone fracture image into an upper fracture area and a lower fracture area; and to acquire an upper fracture edge and a lower fracture edge; The target base point screening module is used to select the upper target base point on the upper fracture edge according to the position and sharpness of the upper edge pixel point of the upper fracture edge; select the lower target base point from the lower fracture edge according to the position of the upper target base point on the upper fracture edge and the relative size of the width of the upper fracture area and the lower fracture area; The auxiliary reduction module is used to determine the reduction path of the long bone fracture according to the relative position of the upper target base point and the lower target base point, and the direction of the upper fracture edge; move the upper fracture area along the reduction path to assist in the reduction of the long bone fracture.

Images