An orthopedic trauma image recognition method, device, equipment, medium and computer program product

Abstract

This application relates to the field of image processing technology, and specifically relates to an orthopedic trauma image recognition method, device, equipment, medium, and computer program product. The initial bone image is denoised using a first filtering function to obtain a first reference image. Based on image processing, a second filtering parameter is determined to perform denoising again to generate a target bone image. The image recognition result of the target object is obtained by comprehensively considering N successive bone trauma features. It can be seen that by matching the first filtering function with specific parameters according to different part labels, the noise distribution characteristics of bone images in different parts can be more accurately removed while retaining details; the filtering parameter can be obtained according to the characteristics of each image, the filtering effect can be flexibly adjusted, the balance between noise suppression and feature retention can be better achieved, the bone features can be effectively enhanced, and the trauma details can be highlighted, making the extraction of bone trauma features more accurate, which helps to comprehensively identify the recovery situation of the target object and improve the accuracy of orthopedic trauma image recognition.

Description

Technical Field

[0001] The present invention generally relates to the technical field of image processing, and particularly relates to an orthopedic trauma image recognition method, device, equipment, medium and computer program product. Background Art

[0002] Due to factors such as limited equipment accuracy and signal interference in existing image acquisition devices, various noises exist in the collected bone images, making key information such as fracture lines and bone injuries become blurred, and it is impossible to accurately extract the fine structures and texture information of bones. This not only affects the data accuracy of researchers' studies on bone trauma, resulting in possible deviations in research conclusions; in the teaching scenario, it will also interfere with medical students' learning and cognition of normal and trauma bone images, hindering the progress of their professional skills training; in the field of medical device R & D, it will also mislead R & D personnel's judgment on the improvement direction of image processing technology, making R & D resources unable to be accurately invested. Therefore, accurate trauma image recognition plays an important role in multiple related fields.

[0003] In the task of orthopedic trauma image recognition, there are many limitations in the current image recognition technology. For example, while traditional mean filtering removes noise, it will blur the image indiscriminately, smoothing both the fine structures of bones and the noise together, resulting in a lack of accurate data basis for subsequent tasks such as bone mechanical property analysis and structural modeling based on images; median filtering, although having a certain effect in protecting edges, is difficult to effectively remove noise for complex mixed noises, especially when the noise density is high, and in areas with rich textures, it is prone to problems of over-smoothing or texture distortion, causing the loss of the true information of bone textures and affecting the analysis of the integrity of bone structures; and various denoising techniques rely on the selection of parameters. However, the orthopedic image features are complex and variable, and it is difficult to find uniformly applicable parameters for images under different parts and different imaging conditions, resulting in unstable denoising effects. When extracting key features of bones, it is easy to have feature omissions or misjudgments, and it is impossible to provide reliable feature data for in-depth research on bones.

[0004] Therefore, in the task of orthopedic trauma image recognition, how to improve the recognition accuracy has become an urgent problem to be solved. Summary of the Invention

[0005] In view of the above-mentioned defects or deficiencies in the prior art, it is desirable to provide an orthopedic trauma image recognition method, device, equipment, medium and computer program product.

[0006] In a first aspect, an embodiment of the present application provides an orthopedic trauma image recognition method, and the orthopedic trauma image recognition method includes the following steps:

[0007] S1. Obtain N initial bone images of a target object, part labels corresponding to the N initial bone images, a first filtering function including first filtering parameters corresponding to the part labels, and the acquisition time corresponding to each initial bone image, where N is an integer greater than 1.

[0008] S2. Perform image processing on any one of the initial bone images to obtain a target bone image corresponding to the current initial bone image.

[0009] S3. Extract bone trauma features corresponding to the target bone image.

[0010] S4. Obtain an image recognition result corresponding to the target object according to the bone trauma features corresponding to the N target bone images and the acquisition time corresponding to each initial bone image, where the image recognition result includes the degree of recovery and the recovery trend.

[0011] In a second aspect, an orthopedic trauma image recognition device provided by an embodiment of the present application includes:

[0012] A data acquisition module, configured to obtain N initial bone images of a target object, part labels corresponding to the N initial bone images, a first filtering function including first filtering parameters corresponding to the part labels, and the acquisition time corresponding to each initial bone image, where N is an integer greater than 1.

[0013] An image processing module, configured to perform image processing on any one of the initial bone images to obtain a target bone image corresponding to the current initial bone image.

[0014] A feature extraction module, configured to extract bone trauma features corresponding to the target bone image.

[0015] An image recognition module, configured to obtain an image recognition result corresponding to the target object according to the bone trauma features corresponding to the N target bone images and the acquisition time corresponding to each initial bone image, where the image recognition result includes the degree of recovery and the recovery trend.

[0016] In a third aspect, an electronic device provided by an embodiment of the present application includes a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the method described in the embodiment of the present application is implemented.

[0017] In a fourth aspect, a computer-readable storage medium provided by an embodiment of the present application has a computer program stored thereon. When the program is executed by a processor, the method described in the embodiment of the present application is implemented.

[0018] In a fifth aspect, a computer program product provided by an embodiment of the present application includes a computer program. When the computer program is executed by a processor, the method described in the embodiment of the present application is implemented.

[0019] Additional aspects and advantages of the present invention will be given in part in the following description, become apparent in part from the following description, or be learned through the practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Other features, objects, and advantages of the present application will become more apparent from the following detailed description of non-limiting embodiments read with reference to the accompanying drawings:

[0021] Figure 1 The implementation environment architecture diagram of the orthopedic trauma image recognition method provided by an embodiment of the present application is shown;

[0022] Figure 2 The flowchart of the orthopedic trauma image recognition method provided by an embodiment of the present application is shown;

[0023] Figure 3 The flowchart of step S1 in the orthopedic trauma image recognition method provided by an embodiment of the present application is shown;

[0024] Figure 4 The flowchart of step S2 in the orthopedic trauma image recognition method provided by an embodiment of the present application is shown;

[0025] Figure 5 The flowchart of step S23 in the orthopedic trauma image recognition method provided by an embodiment of the present application is shown;

[0026] Figure 6 The flowchart of step S233 in the orthopedic trauma image recognition method provided by an embodiment of the present application is shown;

[0027] Figure 7 The flowchart of step S4 in the orthopedic trauma image recognition method provided by an embodiment of the present application is shown;

[0028] Figure 8 The exemplary structural block diagram of the orthopedic trauma image recognition device provided by an embodiment of the present application is shown;

[0029] Figure 9 The structural diagram of the computer system of an electronic device or server suitable for implementing the embodiments of the present application is shown. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0030] The present application will be further described in detail below with reference to the drawings and embodiments. It can be understood that the specific embodiments described herein are only for explaining the related invention and not for limiting the invention. Additionally, it should be noted that only the parts related to the invention are shown in the drawings for the convenience of description.

[0031] It should be noted that, without conflict, the embodiments in the present application and the features in the embodiments may be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and embodiments.

[0032] For the specific implementation environment of the orthopedic trauma image recognition method proposed in the present application, please refer to Figure 1 . Figure 1 FIG. shows the implementation environment architecture diagram of the orthopedic trauma image recognition method provided by the embodiments of the present application.

[0033] As Figure 1 shown, the implementation environment architecture includes: a terminal device 101 and a server 102.

[0034] The terminal device 101 may be a desktop computer, a laptop computer, a smart phone, a tablet computer, an e-book reader, smart glasses, a smart watch, etc., but is not limited thereto.

[0035] The server 102 may be an independent physical server, or a server cluster or a distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. Among them, the server 102 is used to provide replacement entries to the terminal device 101 and execute the recognition strategy for the abnormality of the target entry.

[0036] The terminal device 101 and the server 102 are directly or indirectly connected through a wired or wireless communication method. Optionally, the above-mentioned wireless network or wired network uses standard communication technologies and / or protocols. The network is usually the Internet, or can be any network, including but not limited to any combination of a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), a mobile, wired or wireless network, a private network or a virtual private network.

[0037] The orthopedic trauma image recognition method proposed in the present application can be implemented by an orthopedic trauma image recognition device, and the orthopedic trauma image recognition device can be installed on the terminal device or the server.

[0038] To further illustrate the technical solution provided by the embodiments of the present application, the following will provide a detailed description in conjunction with the accompanying drawings and specific implementation manners. Although the embodiments of the present application provide method operation instruction steps as shown in the following embodiments or drawings, based on routine or non-creative labor, more or fewer operation instruction steps may be included in the method. In steps where there is no necessary causal relationship logically, the execution order of these steps is not limited to the execution order provided by the embodiments of the present application. When the method is actually processed or the device executes, it can be executed in the method order shown in the embodiments or drawings or executed in parallel.

[0039] It should be noted that the acquisition or use of the data in the embodiments of the present application requires the consent of the user. Relevant data can be obtained only after the user authorizes and permits it, and the acquisition or use of the data complies with relevant laws and regulations.

[0040] Please refer to Figure 2 , Figure 2 which shows a schematic flowchart of an orthopedic trauma image recognition method provided by an embodiment of the present application. As Figure 2 shown, the orthopedic trauma image recognition method includes:

[0041] S1, obtaining N initial bone images of a target object, part labels corresponding to the N initial bone images, a first filtering function including a first filtering parameter corresponding to the part label, and the acquisition time corresponding to each initial bone image, where N is an integer greater than 1.

[0042] S2, performing image processing on any one of the initial bone images to obtain a target bone image corresponding to the current initial bone image.

[0043] S3, extracting bone trauma features corresponding to the target bone image.

[0044] S4, obtaining an image recognition result corresponding to the target object according to the bone trauma features corresponding to the N target bone images and the acquisition time corresponding to each initial bone image, where the image recognition result includes the degree of recovery and the recovery trend.

[0045] Among them, the target object refers to the user object that needs to perform orthopedic trauma image recognition. The initial bone images of the target object are collected at different time points through devices such as X-rays and CTs, which may contain various noise interferences that affect the accuracy of the recognition result.

[0046] The part label is the body part corresponding to each initial bone image, such as body parts like the head, arm, leg, trunk, etc. Due to factors such as the physiological structure and tissue composition of different parts of the human body, when acquiring trauma images for different parts, the noise distribution characteristics on the images are different. For example, the diaphysis is mainly composed of dense cortical bone, with a relatively simple and uniform structure. In imaging examinations, the noise distribution is often relatively uniform, and the overall noise level is relatively low. The metaphysis has more cancellous bone, with a complex trabecular structure. Noise is more likely to appear in the trabecular spaces, and the noise distribution shows characteristics related to the trabecular structure, presenting as scattered dots or patches, and the density will change with the density of the trabeculae. In the skull, air-containing cavities such as the sinuses, in imaging examinations, due to the large density difference between gas and surrounding bone and soft tissue, it is easy to generate artifacts and a relatively high level of noise, and the noise distribution is usually irregularly distributed around the edge of the air cavity. In parts rich in soft tissues such as muscle and fat, the noise distribution is related to the uniformity of soft tissues, blood vessel distribution, etc. Generally, the noise is relatively uniform, but there may be slightly higher noise around blood vessels.

[0047] Therefore, in this embodiment, the part label corresponding to the initial bone image and the first filtering function including the first filtering parameter corresponding to the part label are obtained, which is convenient for subsequent different filtering processes according to the bone characteristics of different parts, thereby improving the noise filtering effect and further enhancing the accuracy of subsequent image recognition.

[0048] The first filtering function can perform specific mathematical operations on each pixel and its neighboring pixels in the initial bone image. According to the setting of the first filtering parameter, it can specifically remove noise and retain the important features of the image.

[0049] Perform image processing on any initial bone image, remove the noise in the current initial bone image, obtain the target bone image corresponding to the current initial bone image, improve the image quality, and further enhance the accuracy of subsequent recognition of the recovery situation of bone trauma.

[0050] Extract the features related to bone trauma in the target bone image, such as the position, length, and shape of the fracture line, the number, size, and position of bone fragments, and the information of the bone density change area, etc., as the feature basis for subsequent recognition of the recovery situation of bone trauma.

[0051] Comprehensively consider the bone trauma features extracted from N target bone images and the acquisition time corresponding to each initial bone image. Combining the acquisition time with the bone trauma features can analyze the change of bone trauma over time. For example, if over time, the fracture line gradually narrows and the bone fragments gradually decrease, it indicates that the bone is in a recovery state. From this, a quantitative assessment of the recovery degree and a qualitative description of the overall recovery situation, such as good recovery, slow recovery, etc., can be obtained and output as the image recognition result.

[0052] As described above, image processing is performed on the initial bone image to generate a target bone image. Bone trauma features are extracted from the target bone image. By synthesizing the trauma features of N target bone images and the corresponding acquisition times, the image recognition result of the target object is obtained. It can be seen that by matching a specific first filtering function and parameters according to different part labels, the noise distribution characteristics of bone images in different parts can be more accurately removed, details can be retained, so that the extraction of bone trauma features is more accurate, which helps to more accurately identify the recovery status of the target object, thereby improving the recognition accuracy of orthopedic trauma images.

[0053] Please refer to Figure 3 , Figure 3 FIG. shows a schematic flowchart of step S1 provided by an embodiment of the present application. S1 includes the following steps:

[0054] S11, obtain a plurality of bone image samples corresponding to the part label, a noise image sample corresponding to each bone image sample, and a first preset filtering model including preset filtering parameters.

[0055] S12, filter the noise image sample according to the first preset filtering model to obtain a reference image sample corresponding to the noise image sample.

[0056] S13, obtain an image error according to the reference image sample corresponding to the noise image sample and the bone image sample, and construct an objective function according to the image error.

[0057] S14, update the preset filtering parameters by the gradient descent method until the objective function converges, and determine the updated preset filtering parameters corresponding to the convergence of the objective function as the first filtering parameters corresponding to the part label.

[0058] S15, construct a first filtering function according to the first filtering parameters.

[0059] Among them, the bone image sample represents the image in the normal or ideal state of the corresponding part, while the noise image sample is the image situation with noise in the actual acquisition process. By methods such as computer reconstruction of the noise image sample, the original data obtained from different angles or levels is reconstructed into an intuitive two-dimensional or three-dimensional image, the noise interference is removed, the resolution and clarity of the image are enhanced, the detail information is highlighted, and a bone image sample close to the ideal state is obtained as the basis for obtaining the first filtering parameters.

[0060] Since computer reconstruction of images requires a large amount of computing resources and time, it is limited to a certain extent in scenarios with high real-time requirements and a large number of images. Therefore, in this embodiment, the computer-reconstructed image is used as the sample basis, and the first filtering parameters corresponding to the labels of each part are corrected through the samples to improve the denoising effect corresponding to the first filtering parameters. In subsequent analysis, the initial bone image is preliminarily denoised based on the first filtering parameters, improving the denoising efficiency while ensuring the denoising effect and reducing the denoising cost.

[0061] The first preset filtering model containing preset filtering parameters is used to filter the noise image sample to obtain the corresponding reference image sample, so as to generate a reference image close to the ideal bone image. Then, the filtered reference image sample is compared with the original bone image sample, and the image error between the two is calculated, which reflects the difference degree between the reference image and the ideal bone image.

[0062] Based on the image error, an objective function is constructed. By calculating the gradient of the objective function with respect to the parameters and gradually adjusting the parameters along the opposite direction of the gradient, the value of the objective function is continuously reduced until the objective function converges, that is, the value of the objective function no longer changes significantly. At this time, the updated preset filtering parameters are determined as the first filtering parameters corresponding to the part label, thus ensuring that the filtering parameters can be optimized according to the actual sample data to achieve the best denoising effect.

[0063] As described above, by analyzing the bone image samples and noise image samples of specific parts and optimizing the filtering parameters based on the objective function, the finally obtained first filtering function can be highly adaptive to the noise characteristics of this part, can more effectively remove the unique noise of different parts, while retaining the detailed information of the bones to the greatest extent, improving the accuracy and pertinence of filtering, and making the entire orthopedic trauma image recognition method more versatile and stable when facing diverse actual situations.

[0064] Please refer to Figure 4 , Figure 4 which shows the schematic flowchart of step S2 provided by an embodiment of the present application. S2 includes the following steps:

[0065] S21, for any initial bone image, filter the current initial bone image according to the first filtering function containing the first filtering parameters to obtain the first reference image corresponding to the current initial bone image.

[0066] S22, perform preset processing on the first reference image to obtain a second reference image, where the preset processing includes binarization processing, erosion processing, and dilation processing.

[0067] S23. Obtain a second filtering parameter according to the first reference image and the second reference image, where the second filtering parameter corresponds to a second filtering model.

[0068] S24. Filter the first reference image according to the second filtering model to obtain a target bone image corresponding to the current initial bone image.

[0069] Among them, the first filtering function can perform specific mathematical operations on each pixel in the initial bone image and its neighboring pixels. According to the setting of the first filtering parameter, noise is removed targeted and important features of the image are retained to obtain the first reference image corresponding to the current initial bone image. Compared with the initial image, the noise of the first reference image is initially suppressed, and the image quality is improved, laying a foundation for subsequent processing.

[0070] The binarization process can convert the first reference image into a binary image, that is, there are only two pixel values in the image, usually 0 (black) and 255 (white). By setting a gray value threshold, pixels with gray values greater than the gray value threshold in the image are set to one value, and those less than the threshold are set to another value, which helps to highlight the main structure in the first reference image and initially separate the bone from the background such as surrounding tissues, facilitating subsequent processing. For example, in a bone image, the bone part with a higher gray value can be set to white, and other backgrounds can be set to black.

[0071] The erosion process can perform an erosion operation on the binarized image, causing the boundaries of the objects in the image to shrink inward, removing some isolated noise points or small burrs, and making the outline of the bone clearer and more regular.

[0072] The dilation process is the opposite of the erosion process. The dilation process will expand the boundaries of the objects in the image, fill the noise gaps, and obtain the second reference image.

[0073] According to the comparative analysis between the reference images before and after the preset processing, it can provide guidance on the denoising degree for the secondary filtering, obtain appropriate second filtering parameters, and thus further filter and denoise the first reference image based on the second filtering model to obtain a target bone image with higher quality.

[0074] In a specific embodiment, the first filtering parameter is (a0, a1, a2, a3, a4, a5). Correspondingly, the first filtering model including the first filtering parameter is f(x, y) = a0 + a1×x + a2×y + a3×x 2 + a4×x×y + a5×y 2, the pixel value at the position (x, y) in the initial bone image is h(x, y). After filtering the current initial bone image according to the first filtering function containing the first filtering parameter, the pixel value at the position (x, y) in the first reference image corresponding to the current initial bone image is r(x, y) = h(x, y) × f(x, y).

[0075] The second filtering parameter is (Z, Q). A convolution kernel of size (L, L) is obtained according to Q, where L = (Q - 1) / 2. Correspondingly, the second filtering model containing the second filtering parameter is g(x, y) = (1 / (2×π×Z 2 )) × e^(-((x 2 +y 2 ) / (2×Z 2 ))), which represents the coefficient of the convolution kernel at the position (x, y). Then, filtering the first reference image according to the second filtering model, the pixel value at the position (x, y) in the target bone image corresponding to the current initial bone image is:

[0076] c(x, y) = Σ L u=-L (Σ L v=-L (r(x + u, y + v) × g(u, v))). Among them, r(x + u, y + v) is the pixel value at the position (x + u, y + v) in the first reference image.

[0077] As described above, each initial bone image is denoised using the first filtering function containing the first filtering parameter to obtain the first reference image. The first reference image is sequentially subjected to preset image processing such as binarization, erosion, and dilation to obtain the second reference image to highlight the bone structure, remove noise, and fill gaps. The second filtering parameter is determined based on the first reference image and the second reference image, and the first reference image is denoised again to generate the target bone image, further balancing noise removal and detail retention. The bone trauma features are extracted from the target bone image, and the trauma features of N target bone images and the corresponding acquisition times are comprehensively considered to obtain the image recognition result of the target object. It can be seen that by matching specific first filtering functions and parameters according to different part labels, the noise distribution characteristics of bone images in different parts can be more accurately removed, details can be retained, and a high-quality image basis for subsequent processing can be provided; by combining the preset processing steps with the second filtering parameter to obtain the second filtering model, the filtering effect can be flexibly adjusted according to the characteristics of each image, better balancing noise suppression and feature retention, effectively enhancing the bone features, highlighting the trauma details, making the extraction of bone trauma features more accurate, and contributing to a comprehensive and dynamic recognition of the recovery situation of the target object, thereby improving the accuracy of orthopedic trauma image recognition.

[0078] Please refer toFigure 5 , Figure 5 shows the schematic flowchart of step S23 provided by an embodiment of the present application. S23 includes the following steps:

[0079] S231, perform edge detection on the first reference image to obtain a first edge image.

[0080] S232, perform edge detection on the second reference image to obtain a second edge image.

[0081] S233, based on the first edge image and the second edge image, obtain the degree of edge difference between the first reference image and the second reference image.

[0082] S234, based on the degree of edge difference and a preset difference degree threshold, obtain a second filtering parameter.

[0083] Among them, those skilled in the art know that any edge detection method in the prior art falls within the protection scope of the present invention, which will not be elaborated here. For example, edge detection methods such as Sobel operator, Laplacian operator, and Canny operator.

[0084] The preset difference degree threshold is a preset standard for determining whether the edge difference between the first reference image and the second reference image is within an acceptable range. The second filtering parameter is determined according to the comparison result between the degree of edge difference and the threshold.

[0085] As described above, adaptively determine the parameters of the second filtering model according to the edge difference between the first reference image and the second reference image. While removing noise, retain the important features of the image as much as possible, improve the accuracy of subsequent bone trauma feature extraction, and ultimately improve the accuracy of the entire orthopedic trauma image recognition.

[0086] Please refer to Figure 6 , Figure 6 shows the schematic flowchart of step S233 provided by an embodiment of the present application. S233 includes the following steps:

[0087] S2331, match all the first edge pixel points and all the second edge pixel points to obtain a number of edge pixel point pairs. Among them, each edge pixel point pair includes a first edge pixel point and a matching second edge pixel point.

[0088] S2332, for any edge pixel point pair, determine the distance between the first edge pixel point and the second edge pixel point in the current edge pixel point pair as the edge difference value of the current edge pixel point pair.

[0089] S2333. Determine the variance of the edge difference values of all edge pixel pairs as the edge difference degree between the first reference image and the second reference image.

[0090] Among them, all the first-edge pixel points and all the second-edge pixel points can be matched based on the characteristics of the pixel points. For example, local feature descriptors of each first-edge pixel point and second-edge pixel point are extracted by the Scale-Invariant Feature Transform (SIFT) algorithm or the Speeded Up Robust Feature (SURF) algorithm. For the feature descriptor of each first-edge pixel point, find the most matching feature descriptor in the set of feature descriptors of the second-edge pixel points to obtain the corresponding edge pixel pairs. Common matching methods include nearest neighbor matching, k-nearest neighbor matching, etc.

[0091] Taking the Euclidean distance as an example, the distance calculation method intuitively reflects the difference in the spatial positions of two pixel points in the image. The greater the distance, the greater the position difference between these two corresponding edge pixel points. And the variance of the edge difference values of all edge pixel pairs is used to reflect the edge difference degree between the first reference image and the second reference image.

[0092] As described above, by matching edge pixel points, calculating difference values, and statistically analyzing the variance to determine the edge difference degree, starting from the microscopic pixel level, comprehensively considering the information of the entire edge image, it can more comprehensively and accurately reflect the edge difference between the two reference images, providing a quantitative and reliable basis for determining a suitable second filtering model in the follow-up.

[0093] In a specific embodiment, the second filtering parameter includes a first filtering coefficient and a second filtering coefficient, and S234 includes the following steps:

[0094] S2341. Compare the edge difference degree with a preset difference degree threshold, and determine the minimum value between the edge difference degree and the preset difference degree threshold as the first filtering coefficient.

[0095] S2342. According to the first filtering coefficient and a preset parameter mapping model, obtain the second filtering coefficient corresponding to the first filtering coefficient, where the parameter mapping model is used to represent the mapping relationship between the first filtering coefficient and the second filtering coefficient.

[0096] Among them, if the edge difference degree is less than the preset threshold, it indicates that the edge difference between the two reference images is relatively small. At this time, taking the edge difference degree as the first filtering coefficient, a relatively small filtering intensity can be adopted to avoid the loss of useful information in the image due to over-filtering. If the edge difference degree is greater than the preset threshold, it indicates that the edge difference is large, and there may be many interference factors such as noise. At this time, selecting the preset difference degree threshold as the first filtering coefficient can limit the filtering intensity from being too large, ensuring that while removing noise, key information such as the edges of the image is retained as much as possible. The specific value of the preset difference degree threshold can be set by the implementer according to the actual situation. For example, the preset difference degree threshold can be set to 2.

[0097] The preset parameter mapping model is a pre-established model that describes the correspondence between the first filtering coefficient and the second filtering coefficient, which can be set by the implementer according to the actual situation. For example, the preset parameter mapping model can be Q = r×Z + 1, where Z refers to the first filtering coefficient, r refers to the preset weight, and Q refers to the second filtering coefficient. The specific value of r can be set by the implementer according to the actual situation. For example, r = 6 can be set.

[0098] In a specific embodiment, the first filtering coefficient can be used to represent the standard deviation size, and the second filtering coefficient can be used to represent the Gaussian kernel size.

[0099] As described above, adaptively determining the first filtering coefficient and the second filtering coefficient of the second filtering model according to the edge difference situation between the first reference image and the second reference image can adjust the filtering intensity according to the actual situation of the image, and while removing noise, retain the edges and detail information of the image as much as possible, laying a foundation for obtaining a high-quality target bone image and accurately extracting bone trauma features subsequently.

[0100] In another embodiment, S2 includes the following steps:

[0101] S201, for any initial bone image, perform preset processing on the current initial bone image to obtain a third reference image corresponding to the current initial bone image, where the preset processing includes binarization processing, erosion processing, and dilation processing;

[0102] S202, according to the current initial bone image and the corresponding third reference image, obtain a third filtering parameter, where the third filtering parameter corresponds to the second filtering model.

[0103] S203, filter the current initial bone image according to the first filtering model, the first preset weight value corresponding to the first filtering model, the second filtering model, and the second preset weight value corresponding to the second filtering model to obtain a target bone image corresponding to the current initial bone image.

[0104] Among them, the method for obtaining the third filtering parameter can refer to S231 - S234, that is, refer to the method for obtaining the second filtering parameter.

[0105] Then, the current initial bone image can be filtered simultaneously according to the first filtering model and the second filtering model, and the corresponding weights can be configured respectively, so as to configure the importance and influence degree of the two filtering models during filtering respectively, improve the filtering effect, and further improve the recognition accuracy of subsequent orthopedic images. Moreover, compared with the method of steps S21 - S24, the parallel filtering method reduces the resource occupancy rate and improves the processing efficiency of the initial bone image.

[0106] In a specific embodiment, the obtained first filtering parameter is (a0, a1, a2, a3, a4, a5), the first preset weight is q1, correspondingly, the first filtering model is f(x, y) = a0 + a1×x + a2×y + a3×x 2 + a4×x×y + a5×y 2 . The third filtering parameter is (T, P), and a convolution kernel of size (B, B) is obtained according to P, where B = (P - 1) / 2, correspondingly, the second filtering model is g(x, y) = (1 / (2×π×T 2 ))×e^(-((x 2 +y 2 ) / (2×T 2 ))), which represents the coefficient of the convolution kernel at the position (x, y), and the second preset weight is q2.

[0107] The pixel value at the position (x, y) in the initial bone image is h(x, y). Then, the initial bone image is filtered according to the first filtering model, the first preset weight corresponding to the first filtering model, the second filtering model, and the second preset weight corresponding to the second filtering model, and the pixel value at the position (x, y) in the obtained target bone image is:

[0108] c(x, y) = q1×(h(x, y)×f(x, y)) + q2×(Σ B u=-B (Σ B v=-B (h(x + u, y + v)×g(u, v)))). Among them, h(x + u, y + v) is the pixel value at the position (x + u, y + v) in the initial bone image.

[0109] In a specific embodiment, several target bone images obtained through the above steps S21 - S24 in the historical operation can be used as key image samples. Referring to steps S11 - S14, the method for obtaining the first weight and the second weight includes the following steps:

[0110] S204, obtain the first initial weights corresponding to the first filtering model and the second initial weights corresponding to the second filtering model;

[0111] S205, for any key image sample, filter the initial bone image corresponding to the current key image sample according to the first filtering model, the first initial weights corresponding to the first filtering model, the second filtering model, and the second initial weights corresponding to the second filtering model, to obtain the target image sample corresponding to the current key image sample;

[0112] S206, according to the current key image sample and the corresponding target image sample, obtain the image error sample, and construct a key function according to the image error sample;

[0113] S207, update the first initial weights and the second initial weights through the gradient descent method until the key function converges, and determine the updated first initial weights and the second initial weights corresponding to when the key function converges as the first initial weights and the second initial weights.

[0114] Among them, the key image sample represents an image with good denoising effect. By comparing the target image sample filtered according to the first filtering model, the first initial weights, the second filtering model, and the second initial weights with the corresponding key image sample, and calculating the image error between the two, it can reflect the quality of the filtering effect according to the first filtering model, the first initial weights, the second filtering model, and the second initial weights.

[0115] Therefore, construct a key function based on the image error sample, calculate the gradient of the key function with respect to the weights, and gradually adjust the weights along the opposite direction of the gradient, so that the value of the key function continuously decreases until the key function converges, that is, the value of the key function no longer changes significantly. At this time, the updated first initial weights and the second initial weights corresponding to are determined as the first initial weights and the second initial weights.

[0116] Therefore, the optimized first initial weights and the second initial weights can be directly used to directly filter and denoise the initial bone image in combination with the first filtering model and the second filtering model, thereby ensuring a good denoising effect while reducing the resource occupancy rate and improving the processing efficiency of the initial bone image.

[0117] Please refer to Figure 7 , Figure 7 shows a schematic flow chart of step S4 provided by an embodiment of the present application. S4 includes the following steps:

[0118] S41, obtain a preset large language model and a preset task description text.

[0119] S42. Sort the bone trauma features corresponding to the N target bone images in the order of the acquisition time from the earliest to the latest, and obtain a bone trauma feature sequence.

[0120] S43. Sort the N acquisition times in the order of the acquisition time from the earliest to the latest, and obtain an acquisition time sequence.

[0121] S44. Input the bone trauma feature sequence, the acquisition time sequence, and a preset task description text into a preset large language model to obtain an image recognition result corresponding to the target object.

[0122] Among them, the large language model (LLM) is an artificial intelligence model based on deep learning. After being trained with a large amount of text data, it has strong language understanding and generation capabilities. In this embodiment, the preset large language model is a model that has been specifically screened or trained and is suitable for processing tasks related to orthopedic image analysis.

[0123] The task description text is a preset text used to clearly inform the large language model of the tasks to be completed. For example, "According to the provided bone trauma feature sequence and the corresponding acquisition time sequence, analyze and give the recovery degree and recovery trend of the target object."

[0124] Input the sorted bone trauma feature sequence, the acquisition time sequence, and the preset task description text into the preset large language model together. Based on its language understanding and analysis capabilities, the large language model deeply processes the input information, mines the change rules of the bone trauma features in the time sequence, and thus infers the recovery degree and recovery trend of the target object. For example, the recovery degree may be presented in the form of a percentage, such as "The recovery degree is 60%." The recovery trend may be described as "The recovery speed is accelerating" or "The recovery speed tends to be stable", etc.

[0125] In another specific implementation, the preset large language model can be a large prediction model fine-tuned based on Chat GPT-4. Input the sorted bone trauma feature sequence, the acquisition time sequence, and the preset task description text into the large prediction model together. The large prediction model can encode the acquisition time sequence as a natural language description as a time series feature, for example, encoded as "The area of the arm fracture region: 120 mm² on the 1st day to 80 mm² on the 30th day", and then based on its language understanding and analysis capabilities, deeply process the input information to generate an interpretable report that meets the requirements of the implementer, including the prediction of the recovery degree and recovery trend of the target object.

[0126] It should be noted that although the operations of the method of the present invention are described in a specific order in the accompanying drawings, this does not require or imply that these operations must be performed in that specific order, or that all the operations shown must be performed to achieve the desired result.

[0127] Please refer to Figure 8 , Figure 8 which shows an exemplary structural block diagram of an orthopedic trauma image recognition device 800 provided by an embodiment of the present application. As Figure 8 shown, the orthopedic trauma image recognition device 800 includes:

[0128] A data acquisition module 81, configured to acquire N initial bone images of a target object, part labels corresponding to the N initial bone images, a first filtering function including first filtering parameters corresponding to the part labels, and acquisition times corresponding to each initial bone image, where N is an integer greater than 1.

[0129] An image processing module 82, configured to perform image processing on any initial bone image to obtain a target bone image corresponding to the current initial bone image.

[0130] A feature extraction module 83, configured to extract bone trauma features corresponding to the target bone image.

[0131] An image recognition module 84, configured to obtain an image recognition result corresponding to the target object according to the bone trauma features corresponding to the N target bone images and the acquisition times corresponding to each initial bone image, where the image recognition result includes a recovery degree and a recovery trend.

[0132] In a specific embodiment, the data acquisition module 81 includes:

[0133] A data acquisition sub-module, configured to acquire a plurality of bone image samples corresponding to the part labels, noise image samples corresponding to each bone image sample, and a first preset filtering model including preset filtering parameters.

[0134] A sample filtering sub-module, configured to filter the noise image samples according to the first preset filtering model to obtain reference image samples corresponding to the noise image samples.

[0135] A target function construction sub-module, configured to obtain an image error according to the reference image samples corresponding to the noise image samples and the bone image samples, and construct a target function according to the image error.

[0136] A parameter update sub-module, configured to update the preset filtering parameters by the gradient descent method until the target function converges, and determine the updated preset filtering parameters corresponding to the convergence of the target function as the first filtering parameters corresponding to the part labels.

[0137] The first filtering function construction sub-module is used to construct a first filtering function according to the first filtering parameter.

[0138] In a specific embodiment, the image processing module 82 includes:

[0139] The first filtering sub-module is used to perform filtering on any initial bone image according to the first filtering function including the first filtering parameter, and obtain a first reference image corresponding to the current initial bone image;

[0140] The image processing sub-module is used to perform preset processing on the first reference image to obtain a second reference image, where the preset processing includes binarization processing, erosion processing, and dilation processing;

[0141] The second filtering parameter acquisition sub-module is used to obtain a second filtering parameter according to the first reference image and the second reference image, where the second filtering parameter corresponds to a second filtering model;

[0142] The second filtering sub-module is used to perform filtering on the first reference image according to the second filtering model, and obtain a target bone image corresponding to the current initial bone image.

[0143] In a specific embodiment, the second filtering parameter acquisition sub-module includes:

[0144] The first edge detection unit is used to perform edge detection on the first reference image to obtain a first edge image.

[0145] The second edge detection unit is used to perform edge detection on the second reference image to obtain a second edge image.

[0146] The difference degree acquisition unit is used to obtain the edge difference degree between the first reference image and the second reference image according to the first edge image and the second edge image.

[0147] The second filtering parameter acquisition unit is used to obtain a second filtering parameter according to the edge difference degree and a preset difference degree threshold.

[0148] In a specific embodiment, the first edge image includes a plurality of first edge pixel points, the second edge image includes a plurality of second edge pixel points, and the difference degree acquisition unit includes:

[0149] The pixel point matching sub-unit is used to match all the first edge pixel points and all the second edge pixel points to obtain a plurality of edge pixel point pairs, where each edge pixel point pair includes a first edge pixel point and a matching second edge pixel point.

[0150] A difference value acquisition subunit, configured to determine, for any pair of edge pixels, the distance between the first edge pixel and the second edge pixel in the current pair of edge pixels as the edge difference value of the current pair of edge pixels.

[0151] A difference degree acquisition subunit, configured to determine the variance of the edge difference values of all pairs of edge pixels as the edge difference degree between the first reference image and the second reference image.

[0152] In a specific embodiment, the second filtering parameter includes a first filtering coefficient and a second filtering coefficient, and the second filtering parameter acquisition unit includes:

[0153] A first filtering coefficient acquisition subunit, configured to compare the edge difference degree with a preset difference degree threshold, and determine the minimum value between the edge difference degree and the preset difference degree threshold as the first filtering coefficient.

[0154] A second filtering coefficient acquisition subunit, configured to obtain, according to the first filtering coefficient and a preset parameter mapping model, the second filtering coefficient corresponding to the first filtering coefficient, where the parameter mapping model is used to represent the mapping relationship between the first filtering coefficient and the second filtering coefficient.

[0155] In a specific embodiment, the image recognition module 84 includes:

[0156] A model acquisition sub-module, configured to obtain a preset large language model and a preset task description text.

[0157] A first sequence acquisition sub-module, configured to sort the bone trauma features corresponding to N target bone images in the order of acquisition time from earliest to latest, and obtain a bone trauma feature sequence.

[0158] A second sequence acquisition sub-module, configured to sort the N acquisition times in the order of acquisition time from earliest to latest, and obtain an acquisition time sequence.

[0159] An image recognition sub-module, configured to input the bone trauma feature sequence, the acquisition time sequence, and the preset task description text into the preset large language model, and obtain an image recognition result corresponding to the target object, where the image recognition result includes a recovery degree and a recovery trend.

[0160] It should be understood that the various modules or modules described in the apparatus 800 and the reference Figure 2Each step in the described method corresponds to each other. Thus, the operations and features described above for the method also apply to the apparatus 800 and the modules included therein, which will not be elaborated here. The apparatus 800 can be pre-implemented in the browser or other security applications of the electronic device, or can be loaded into the browser or its security applications of the electronic device by means such as downloading. The corresponding modules in the apparatus 800 can cooperate with the modules in the electronic device to implement the solutions of the embodiments of the present application.

[0161] Among the several modules or units mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of the two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0162] The following refers to Figure 9 , Figure 9 shows a schematic structural diagram of a computer system of an electronic device or a server suitable for implementing the embodiments of the present application.

[0163] As Figure 9 shown, the computer system includes a central processing unit (CPU) 901, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 902 or the program loaded from the storage section 908 into the random access memory (RAM) 903. In the RAM 903, various programs and data required for the operation instructions of the system are also stored. The CPU 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. The input / output (I / O) interface 905 is also connected to the bus 904.

[0164] The following components are connected to the I / O interface 905; an input section 906 including a keyboard, a mouse, etc.; an output section 907 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc. and a speaker, etc.; a storage section 908 including a hard disk, etc.; and a communication section 909 including a network interface card such as a LAN card, a modem, etc. The communication section 909 performs communication processing via a network such as the Internet. The drive 910 is also connected to the I / O interface 905 as needed. A removable medium 911, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 910 as needed, so that the computer program read from it can be installed into the storage section 908 as needed.

[0165] Specifically, according to the embodiments of the present application, the above refers to the flowchart Figure 2The described process can be implemented as a computer software program. For example, embodiments of the present application include a computer program product that includes a computer program carried on a computer-readable medium, and the computer program includes program code for performing the method shown in the flowchart. In such an embodiment, the computer program includes program code for performing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 909 and / or installed from a removable medium 911. When the computer program is executed by a central processing unit (CPU) 901, the above-described functions defined in the system of the present application are performed.

[0166] It should be noted that the computer-readable medium shown in the present application can be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. A computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of a computer-readable storage medium can include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. And in the present application, a computer-readable signal medium can include a data signal propagated in a baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on a computer-readable medium can be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0167] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operation instructions of systems, methods, and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code, and the foregoing module, program segment, or part of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order from that marked in the accompanying drawings. For example, two connected blocks may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, as well as the combination of blocks in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system that executes the specified functions or operation instructions, or can be implemented by a combination of dedicated hardware and computer instructions.

[0168] The units or modules involved in the embodiments described in the present application can be implemented in software or in hardware. The described units or modules can also be provided in a processor. Among them, the names of these units or modules do not, in some cases, constitute a limitation on the units or modules themselves.

[0169] On the other hand, the present application also provides a computer-readable storage medium, which may be included in the electronic device described in the above embodiments, or may exist separately and not be assembled into the electronic device. The above computer-readable storage medium stores one or more programs, and when the above programs are used by one or more processors to execute the orthopedic trauma image recognition method described in the present application.

[0170] The above description is only a preferred embodiment of the present application and an explanation of the technical principles applied. Those skilled in the art should understand that the scope of disclosure involved in the present application is not limited to the technical solutions formed by the specific combination of the above technical features, and should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the foregoing disclosure concept. For example, the technical solutions formed by mutually replacing the above features with the technical features (but not limited to) having similar functions disclosed in the present application.

Claims

1. An orthopedic trauma image recognition method, characterized in that, The orthopedic trauma image recognition method includes: S1. Obtain N initial bone images of a target object, the part labels corresponding to the N initial bone images, the first filtering function including the first filtering parameter corresponding to the part label, and the acquisition time corresponding to each initial bone image, where N is an integer greater than 1. S1 includes the following steps: S11. Obtain a plurality of bone image samples corresponding to the part label, the noise image samples corresponding to each bone image sample, and the first preset filtering model including the preset filtering parameter; S12. Filter the noise image samples according to the first preset filtering model to obtain the reference image samples corresponding to the noise image samples; S13. Obtain the image error according to the reference image samples corresponding to the noise image samples and the bone image samples, and construct an objective function according to the image error; S14. Update the preset filtering parameter by the gradient descent method until the objective function converges, and determine the updated preset filtering parameter when the objective function converges as the first filtering parameter corresponding to the part label; S15. Construct the first filtering function according to the first filtering parameter; S2. Perform image processing on any one of the initial bone images to obtain the target bone image corresponding to the current initial bone image. S2 includes the following steps: S21. For any one of the initial bone images, filter the current initial bone image according to the first filtering function including the first filtering parameter to obtain the first reference image corresponding to the current initial bone image; S22. Perform preset processing on the first reference image to obtain the second reference image, where the preset processing includes binarization processing, erosion processing, and dilation processing; S23. Obtain the second filtering parameter according to the first reference image and the second reference image, where the second filtering parameter corresponds to the second filtering model; S24. Filter the first reference image according to the second filtering model to obtain the target bone image corresponding to the current initial bone image; S3. Extract the bone trauma features corresponding to the target bone image; S4. Obtain the image recognition result corresponding to the target object according to the bone trauma features corresponding to the N target bone images and the acquisition time corresponding to each initial bone image, where the image recognition result includes the recovery degree and the recovery trend.

2. The orthopedic trauma image recognition method according to claim 1, wherein S23 includes the following steps: S231. Perform edge detection on the first reference image to obtain the first edge image; S232. Perform edge detection on the second reference image to obtain the second edge image; S233. Obtain the edge difference degree between the first reference image and the second reference image according to the first edge image and the second edge image; S234. Obtain the second filtering parameter according to the edge difference degree and the preset difference degree threshold.

3. The orthopedic trauma image recognition method according to claim 2, characterized in that The first edge image includes a plurality of first edge pixel points, and the second edge image includes a plurality of second edge pixel points. S233 includes the following steps: S2331. Match all the first edge pixels and all the second edge pixels to obtain a number of edge pixel pairs, where each edge pixel pair includes a first edge pixel and a matching second edge pixel. S2332. For any edge pixel pair, determine the distance between the first edge pixel and the second edge pixel in the current edge pixel pair as the edge difference value of the current edge pixel pair. S2333. Determine the variance of the edge difference values of all edge pixel pairs as the edge difference degree between the first reference image and the second reference image.

4. The orthopedic trauma image recognition method according to claim 1, characterized in that S4 includes the following steps: S41. Obtain a preset large language model and a preset task description text. S42. Sort the bone trauma features corresponding to N target bone images in the order of acquisition time from earliest to latest to obtain a bone trauma feature sequence. S43. Sort the N acquisition times in the order of acquisition time from earliest to latest to obtain an acquisition time sequence. S44. Input the bone trauma feature sequence, the acquisition time sequence, and the preset task description text into the preset large language model to obtain the image recognition result corresponding to the target object.

5. An orthopedic trauma imaging recognition device, characterized in that, The orthopedic trauma image recognition device includes: A data acquisition module for acquiring N initial bone images of a target object, the part labels corresponding to the N initial bone images, a first filtering function including first filtering parameters corresponding to the part labels, and the acquisition time corresponding to each initial bone image, where N is an integer greater than 1. The data acquisition module includes: A data acquisition sub-module for acquiring a number of bone image samples corresponding to the part labels, noise image samples corresponding to each bone image sample, and a first preset filtering model including preset filtering parameters. A sample filtering sub-module for filtering the noise image samples according to the first preset filtering model to obtain reference image samples corresponding to the noise image samples. A target function construction sub-module for obtaining an image error according to the reference image samples corresponding to the noise image samples and the bone image samples, and constructing a target function according to the image error. A parameter update sub-module for updating the preset filtering parameters by the gradient descent method until the target function converges, and determining the updated preset filtering parameters corresponding to the convergence of the target function as the first filtering parameters corresponding to the part labels. A first filtering function construction sub-module for constructing the first filtering function according to the first filtering parameters. An image processing module for performing image processing on any initial bone image to obtain a target bone image corresponding to the current initial bone image. The image processing module includes: A first filtering sub-module for filtering any initial bone image according to the first filtering function including the first filtering parameters to obtain a first reference image corresponding to the current initial bone image. An image processing sub-module, configured to perform preset processing on the first reference image to obtain a second reference image, where the preset processing includes binarization processing, erosion processing, and dilation processing; A second filtering parameter acquisition sub-module, configured to obtain a second filtering parameter according to the first reference image and the second reference image, where the second filtering parameter corresponds to a second filtering model; A second filtering sub-module, configured to filter the first reference image according to the second filtering model to obtain a target bone image corresponding to the current initial bone image; A feature extraction module, configured to extract bone trauma features corresponding to the target bone image; An image recognition module, configured to obtain an image recognition result corresponding to the target object according to the bone trauma features corresponding to N target bone images and the acquisition time corresponding to each initial bone image, where the image recognition result includes a recovery degree and a recovery trend.

6. An electronic device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the orthopedic trauma image recognition method according to any one of claims 1-4.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the orthopedic trauma image recognition method according to any one of claims 1-4.

8. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the steps of the orthopedic trauma image recognition method according to any one of claims 1-4.

Images