Rib fracture detection method, rib fracture detection information display method and system

Abstract

The embodiment of the present application provides a rib fracture detection method, a rib fracture detection information display method and a system. The rib fracture detection method comprises: obtaining three-dimensional scanning data corresponding to the rib; performing a fracture detection operation based on the three-dimensional scanning data to obtain a detection result; when the detection result is a bone fracture lesion, generating three-dimensional position information corresponding to the bone fracture lesion; and performing three-dimensional display on the bone fracture lesion based on the three-dimensional position information. The technical scheme provided by the embodiment effectively realizes full-automatic rib fracture detection operation in a short time and obtains a detection result. When the detection result is a bone fracture lesion, the bone fracture lesion and the three-dimensional position information corresponding to the bone fracture lesion can be presented in a structured form. This not only reduces the film reading load of medical staff, but also helps doctors make diagnosis and decision, and saves diagnosis time.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of rib detection, and in particular to a rib fracture detection method, a rib fracture detection information display method and system. BACKGROUND

[0002] In modern society, traffic accidents, accidental falls and even intentional injury events occur from time to time, and are often accompanied by rib fractures and other injuries. The diagnosis of rib fractures is a relatively complex task in clinical practice, not only to tell patients whether there is a fracture, but also to clearly describe the location of the fracture, such as: left rib or right rib, left rib or right rib, front segment, axillary segment or posterior segment of a certain rib, and the type of fracture and other information. The whole diagnosis process is very time-consuming and laborious, especially for minor fractures that need to be carefully compared and viewed. In real life, since the detection results will affect a series of subsequent links such as disability recognition and insurance claims, therefore, missed diagnosis or misdiagnosis of rib fractures is usually unacceptable. SUMMARY

[0003] The embodiments of the present application provide a rib fracture detection method, a rib fracture detection information display method and system, which can automatically and accurately detect rib fractures and accurately locate and display the lesion position of specific rib fractures, thereby not only reducing the workload of medical staff, but also assisting doctors in making diagnosis decisions and saving diagnosis time.

[0004] In a first aspect, the embodiments of the present application provide a rib fracture detection method, comprising:

[0005] obtaining three-dimensional scanning data corresponding to the ribs;

[0006] performing a fracture detection operation based on the three-dimensional scanning data to obtain a detection result;

[0007] when the detection result is that there is a fracture lesion, generating three-dimensional position information corresponding to the fracture lesion;

[0008] performing three-dimensional display of the fracture lesion based on the three-dimensional position information.

[0009] In a second aspect, the embodiments of the present application provide a rib fracture detection device, comprising:

[0010] a first obtaining module configured to obtain three-dimensional scanning data corresponding to the ribs;

[0011] a first detection module configured to perform a fracture detection operation based on the three-dimensional scanning data to obtain a detection result;

[0012] The first generating module is configured to generate three-dimensional position information corresponding to the bone fracture lesion when the detection result is that the bone fracture lesion exists.

[0013] The first processing module is configured to perform three-dimensional display on the bone fracture lesion based on the three-dimensional position information.

[0014] In a third aspect, an electronic device is provided, including a memory and a processor, wherein the memory is configured to store one or more computer instructions, and the one or more computer instructions are executed by the processor to implement the rib fracture detection method in the first aspect.

[0015] In a fourth aspect, a computer storage medium is provided for storing a computer program, and the computer program causes a computer to execute the rib fracture detection method in the first aspect when the computer program is executed.

[0016] In a fifth aspect, a rib fracture detection information display method is provided, including:

[0017] An interactive interface for displaying rib fracture detection information is acquired, and the rib fracture detection information includes a rib fracture lesion and three-dimensional position information corresponding to the rib fracture lesion.

[0018] The rib fracture detection information is displayed in three dimensions based on the three-dimensional position information and different regions in the interactive interface.

[0019] In response to an execution operation input by a user in the interactive interface, the displayed rib fracture detection information is adjusted accordingly.

[0020] In a sixth aspect, a rib fracture detection information display device is provided, including:

[0021] A second acquiring module is configured to acquire an interactive interface for displaying rib fracture detection information, and the rib fracture detection information includes a rib fracture lesion and three-dimensional position information corresponding to the rib fracture lesion.

[0022] A second display module is configured to display the rib fracture detection information in three dimensions based on the three-dimensional position information and different regions in the interactive interface.

[0023] A second processing module is configured to adjust the displayed rib fracture detection information in response to an execution operation input by a user in the interactive interface.

[0024] In a seventh aspect, an embodiment of the present application provides an electronic device, comprising: a memory, a processor; wherein the memory is configured to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the method for displaying rib fracture detection information in the fifth aspect.

[0025] In an eighth aspect, an embodiment of the present application provides a computer storage medium for storing a computer program, wherein the computer program causes a computer to implement the method for displaying rib fracture detection information in the fifth aspect when executed.

[0026] In a ninth aspect, an embodiment of the present application provides a rib fracture detection method, comprising:

[0027] In response to a call of a rib fracture detection request, determining a processing resource corresponding to a rib fracture detection service;

[0028] Using the processing resource to perform the following steps: obtaining three-dimensional scanning data corresponding to a rib; using a three-dimensional fracture detection model to perform a fracture detection operation on the three-dimensional scanning data to obtain a detection result, wherein the three-dimensional fracture detection model is trained to be used for performing a fracture detection operation on three-dimensional scanning data; when the detection result is that there is a fracture lesion in the rib, generating three-dimensional position information corresponding to the fracture lesion; and displaying the fracture lesion based on the three-dimensional position information.

[0029] In a tenth aspect, an embodiment of the present application provides a rib fracture detection apparatus, comprising:

[0030] A third determination module configured to, in response to a call of a rib fracture detection request, determine a processing resource corresponding to a rib fracture detection service;

[0031] A third processing module configured to use the processing resource to perform the following steps: obtaining three-dimensional scanning data corresponding to a rib; using a three-dimensional fracture detection model to perform a fracture detection operation on the three-dimensional scanning data to obtain a detection result, wherein the three-dimensional fracture detection model is trained to be used for performing a fracture detection operation on three-dimensional scanning data; when the detection result is that there is a fracture lesion in the rib, generating three-dimensional position information corresponding to the fracture lesion; and displaying the fracture lesion based on the three-dimensional position information.

[0032] In an eleventh aspect, an embodiment of the present application provides an electronic device, comprising: a memory, a processor; wherein the memory is configured to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the rib fracture detection method in the ninth aspect.

[0033] In a twelfth aspect, an embodiment of the present application provides a computer storage medium for storing a computer program, the computer program enabling a computer to implement the rib fracture detection method in the ninth aspect when executed.

[0034] In a thirteenth aspect, an embodiment of the present application provides a rib fracture detection information display method, comprising:

[0035] In response to a display request for rib fracture detection information, determining a processing resource corresponding to a display service of the rib fracture detection information;

[0036] Using the processing resource to perform the following steps: obtaining an interactive interface for displaying the rib fracture detection information, the rib fracture detection information including a rib fracture lesion and three-dimensional position information corresponding to the rib fracture lesion; performing three-dimensional display on the rib fracture detection information based on the three-dimensional position information and different regions in the interactive interface; and in response to an execution operation input by a user in the interactive interface, adjusting the displayed rib fracture detection information accordingly.

[0037] In a fourteenth aspect, an embodiment of the present application provides a rib fracture detection information display device, comprising:

[0038] A fourth determination module configured to, in response to a display request for rib fracture detection information, determine a processing resource corresponding to a display service of the rib fracture detection information;

[0039] A fourth processing module configured to use the processing resource to perform the following steps: obtaining an interactive interface for displaying the rib fracture detection information, the rib fracture detection information including a rib fracture lesion and three-dimensional position information corresponding to the rib fracture lesion; performing three-dimensional display on the rib fracture detection information based on the three-dimensional position information and different regions in the interactive interface; and in response to an execution operation input by a user in the interactive interface, adjusting the displayed rib fracture detection information accordingly.

[0040] In a fifteenth aspect, an embodiment of the present application provides an electronic device, comprising a memory and a processor, wherein the memory is configured to store one or more computer instructions, and the one or more computer instructions are configured to enable the processor to implement the rib fracture detection information display method in the thirteenth aspect when executed.

[0041] In a sixteenth aspect, an embodiment of the present application provides a computer storage medium for storing a computer program, the computer program enabling a computer to implement the rib fracture detection information display method in the thirteenth aspect when executed.

[0042] In a seventeenth aspect, an embodiment of the present application provides a rib fracture detection system, comprising:

[0043] a data scanning end configured to scan a rib region of a human body to obtain three-dimensional scanning data and transmit the three-dimensional scanning data to the rib fracture detection device;

[0044] a rib fracture detection device communicatively connected to the data scanning end, configured to perform a fracture detection operation based on the three-dimensional scanning data to obtain a detection result, generate three-dimensional position information corresponding to a fracture lesion when the detection result indicates that the fracture lesion exists in the ribs, and display the fracture lesion based on the three-dimensional position information.

[0045] In an eighteenth aspect, the embodiment provides a fracture detection method, including:

[0046] obtaining three-dimensional image data corresponding to a set part;

[0047] performing a fracture detection operation based on the three-dimensional image data to obtain a detection result;

[0048] generating three-dimensional position information corresponding to a fracture lesion when the detection result indicates that the fracture lesion exists;

[0049] displaying the fracture lesion in three dimensions based on the three-dimensional position information.

[0050] In a nineteenth aspect, the embodiment provides a fracture detection device, including:

[0051] a fifth obtaining module configured to obtain three-dimensional image data corresponding to a set part;

[0052] a fifth detection module configured to perform a fracture detection operation based on the three-dimensional image data to obtain a detection result;

[0053] a fifth generation module configured to generate three-dimensional position information corresponding to a fracture lesion when the detection result indicates that the fracture lesion exists;

[0054] a fifth display module configured to display the fracture lesion in three dimensions based on the three-dimensional position information.

[0055] In a twentieth aspect, the embodiment provides an electronic device, including a memory and a processor, wherein the memory is configured to store one or more computer instructions, and the one or more computer instructions are configured to implement the fracture detection method in the eighteenth aspect when executed by the processor.

[0056] In a twenty-first aspect, the embodiment provides a computer storage medium configured to store a computer program, and the computer program is configured to implement the fracture detection method in the eighteenth aspect when executed by a computer.

[0057] The technical scheme provided by the embodiment comprises the following steps: acquiring three-dimensional scanning data corresponding to the rib, performing a fracture detection operation based on the three-dimensional scanning data, and obtaining a detection result, which is a result of whether a fracture lesion exists in the rib; when the detection result is that a fracture lesion exists, generating three-dimensional position information corresponding to the fracture lesion, and performing three-dimensional display of the fracture lesion based on the three-dimensional position information. The technical scheme effectively realizes automatic detection of rib fracture in a short time, and obtains a detection result. When the detection result is that a fracture lesion exists, the fracture lesion and the three-dimensional position information corresponding to the fracture lesion can be presented in a structured form. This not only solves the labor-intensive task in the prior art and reduces the workload of doctors, but also helps doctors make diagnosis and decision, saves diagnosis time, and further improves the practicability of the detection method, which is beneficial to market promotion and application. BRIEF DESCRIPTION OF DRAWINGS

[0058] In order to more clearly illustrate the technical scheme in the embodiments of the present application or the prior art, the drawings needed to be used in the embodiments or the prior art description will be briefly introduced. Obviously, the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0059] Figure 1 A scene schematic diagram of a rib fracture detection method provided by the embodiment of the present application;

[0060] Figure 2 A flowchart of a rib fracture detection method provided by the embodiment of the present application;

[0061] Figure 3 A flowchart of analyzing and processing the three-dimensional scanning data by using the three-dimensional detection model to obtain a detection result provided by the embodiment of the present application;

[0062] Figure 4 A schematic diagram of performing rib segmentation operation on the three-dimensional scanning data to obtain rib segmentation data provided by the embodiment of the present application;

[0063] Figure 5 A flowchart of another rib fracture detection method provided by the embodiment of the present application;

[0064] Figure 6 A schematic diagram of a front segment area, a middle segment area and a rear segment area of a rib provided by the embodiment of the present application;

[0065] Figure 7A flowchart of a process of three-dimensionally displaying the fracture focus based on the three-dimensional position information is provided for the embodiment of the present application.

[0066] Figure 8 A flowchart of another rib fracture detection method is provided for the embodiment of the present application.

[0067] Figure 9 A schematic diagram of a detection result is provided for the embodiment of the present application Figure 1 .

[0068] Figure 10 A schematic diagram of a detection result is provided for the embodiment of the present application Figure 2 .

[0069] Figure 11 A flowchart of a display method of rib fracture detection information is provided for the embodiment of the present application.

[0070] Figure 12 A schematic diagram of the principle of a rib fracture detection method is provided for the application embodiment of the present application.

[0071] Figure 13 A flowchart of a rib fracture detection method is provided for the embodiment of the present application.

[0072] Figure 14 A flowchart of a display method of rib fracture detection information is provided for the embodiment of the present application.

[0073] Figure 15 A structural schematic diagram of a rib fracture detection device is provided for the embodiment of the present application.

[0074] Figure 16 A structural schematic diagram of an electronic device corresponding to the rib fracture detection device is provided for the embodiment shown in Figure 15 .

[0075] Figure 17 A structural schematic diagram of a display device of rib fracture detection information is provided for the embodiment of the present application.

[0076] Figure 18 A structural schematic diagram of an electronic device corresponding to the display device of rib fracture detection information is provided for the embodiment shown in Figure 17 .

[0077] Figure 19 A structural schematic diagram of another rib fracture detection device is provided for the embodiment of the present application.

[0078] Figure 20 A structural schematic diagram of an electronic device corresponding to the rib fracture detection device is provided for the embodiment shown in Figure 19 .

[0079] Figure 21 A schematic diagram of another rib fracture detection information display device provided in an embodiment of the present invention;

[0080] Figure 22 To and Figure 21 A schematic diagram of the electronic device corresponding to the rib fracture detection information display device provided in the embodiment shown;

[0081] Figure 23 This is a schematic diagram of a rib fracture detection system provided in an embodiment of the present invention;

[0082] Figure 24 This is a schematic flowchart of a fracture detection method provided in an embodiment of the present invention;

[0083] Figure 25 This is a schematic diagram of the structure of a fracture detection device provided in an embodiment of the present invention;

[0084] Figure 26 To and Figure 25 The illustrated embodiment provides a schematic diagram of the electronic device corresponding to the fracture detection device. Detailed Implementation

[0085] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0086] The terminology used in the embodiments of this invention is for the purpose of describing particular embodiments only and is not intended to limit the invention. The singular forms “a,” “the,” and “the” used in the embodiments of this invention and the appended claims are also intended to include the plural forms, unless the context clearly indicates otherwise. “Multiple” generally includes at least two, but does not exclude the inclusion of at least one.

[0087] It should be understood that the term "and / or" used in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Additionally, the character " / " in this article generally indicates that the preceding and following related objects have an "or" relationship.

[0088] Depending on the context, the word "if" as used herein can be interpreted to mean "when" or "while" or "in response to determining" or "in response to detecting." Similarly, the phrase "if it is determined" or "if [a stated condition or event] is detected" can be interpreted to mean "when it is determined" or "in response to determining" or "when [a stated condition or event] is detected" or "in response to detecting [a stated condition or event]."

[0089] It is also to be noted that the terms "comprising", "including", and any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by "comprises... a" does not, without more constraints, exclude the existence of additional identical elements in the process, method, article, or apparatus that comprises the element.

[0090] In addition, the sequence of steps in the following method embodiments is only an example, not a strict limitation.

[0091] In order to understand the specific implementation process of the technical solutions in the embodiments, the related technologies are described as follows:

[0092] In modern society, with the improvement of people's material living standards, the large-scale popularization of traffic travel tools, and the vigorous development of entertainment and sports undertakings, traffic accidents, accidental falls, and even intentional injury events occur from time to time, and are often accompanied by rib fractures and other injuries. The diagnosis of rib fractures is a relatively complex task in clinical practice, which not only needs to tell whether the patient has a fracture, but also needs to clearly describe the location of the fracture, such as: left rib or right rib, the first or the second rib on the left or right side, the anterior segment, axillary segment or posterior segment of a certain rib, and the type of fracture and other information. The whole diagnosis process is very time-consuming and laborious, especially for minor fractures, which also needs to be carefully compared and viewed. In actual life, since the detection result will affect a series of subsequent links such as injury identification and insurance claims, therefore, the missed diagnosis or misdiagnosis of rib fractures is usually unacceptable.

[0093] Generally, computed tomography (CT) is the main method for diagnosing fractures, and doctors usually need to view each image layer by layer to observe whether the continuity of the rib structure is destroyed, and it is quite difficult to judge various information of the fracture in a short time, such as: the location information of the fracture, the type information of the fracture, and so on.

[0094] To solve the above technical problems, the embodiment provides a rib fracture detection method, a rib fracture detection information display method and a system. Figure 1

[0095] The data scanning end can be any computing device with certain data transmission capability and three-dimensional scanning data acquisition capability. In actual implementation, the data scanning end can be a computed tomography (CT) device, a nuclear magnetic resonance scanning device, or the like. In addition, the basic structure of the data scanning end can include at least one processor. The number of processors depends on the configuration and type of the data scanning end. The data scanning end can also include a memory, which can be volatile, such as RAM, or non-volatile, such as read-only memory (ROM), flash memory, or the like, or can include both types. The memory usually stores an operating system (OS), one or more application programs, and program data, etc. In addition to the processing unit and the memory, the data scanning end also includes some basic configurations, such as a network card chip, an IO bus, a display component, and some peripheral devices, etc. Optionally, some peripheral devices can include, for example, a keyboard, a mouse, a stylus, a printer, etc. Other peripheral devices are well known in the art and will not be described here.

[0096] The rib fracture detection device refers to a device that can provide rib fracture detection services in a network virtual environment, and usually refers to a device that plans information and performs rib fracture detection operations using a network. In physical implementation, the rib fracture detection device can be any device that can provide computing services, respond to service requests, and perform processing, such as a cluster server, a regular server, a cloud server, a cloud host, a virtual center, etc. The rib fracture detection device is mainly composed of a processor, a hard disk, a memory, a system bus, etc., and is similar to a general computer architecture.

[0097] In the above embodiment, the data scanning end can be connected to the rib fracture detection device in a network, which can be a wireless or wired network connection. If the data scanning end is connected to the rib fracture detection device in a network, the network standard of the mobile network can be any one of 2G (GSM), 2.5G (GPRS), 3G (WCDMA, TD-SCDMA, CDMA2000, UTMS), 4G (LTE), 4G+ (LTE+), WiMax, 5G, etc.

[0098] ​In this embodiment of the application, the data scanning end can obtain three-dimensional scan data to be processed by scanning a set object (person, animal, etc.). After obtaining the three-dimensional scan data to be processed, the three-dimensional scan data can be uploaded to the rib fracture detection device so that the rib fracture detection device can analyze and process the uploaded three-dimensional scan data to be processed.

[0099] The rib fracture detection device is used to acquire three-dimensional scan data corresponding to the ribs, and then perform fracture detection operations based on the three-dimensional scan data to obtain the detection result, which is the result of whether there is a fracture lesion in the ribs. When the detection result indicates the presence of a fracture lesion, three-dimensional location information corresponding to the fracture lesion is generated, and the fracture lesion is displayed in three dimensions based on the three-dimensional location information.

[0100] The technical solution provided in this embodiment acquires three-dimensional scan data corresponding to the ribs, and then performs fracture detection based on the three-dimensional scan data to obtain the detection result, which is the result of whether there is a fracture lesion in the ribs. When the detection result indicates the presence of a fracture lesion, three-dimensional location information corresponding to the fracture lesion is generated, and the fracture lesion is displayed in three dimensions based on the three-dimensional location information. This effectively realizes the fully automatic detection of rib fractures in a short time and obtains the detection result. When the detection result indicates the presence of a fracture lesion, the fracture lesion and the corresponding three-dimensional location information can be presented in a structured form. This not only solves the labor-intensive task in the prior art and reduces the doctor's workload in reading images, but also helps doctors make diagnostic decisions, saves diagnostic time, and further improves the practicality of the detection method, which is conducive to market promotion and application.

[0101] The following detailed description of some embodiments of the present invention is provided in conjunction with the accompanying drawings. Where there is no conflict between the embodiments, the following embodiments and features thereof can be combined with each other.

[0102] Figure 2 This is a flowchart illustrating a rib fracture detection method provided in an embodiment of the present invention; see attached diagram. Figure 2 As shown, this embodiment provides a method for detecting rib fractures. The main body executing this method can be a rib fracture detection device. It is understood that the rib fracture detection device can be implemented as software or a combination of software and hardware. Specifically, the rib fracture detection method may include the following steps:

[0103] Step S201: Obtain the three-dimensional scan data corresponding to the ribs.

[0104] Step S202: Perform fracture detection based on 3D scan data to obtain detection results.

[0105] Step S203: when the detection result is that there is a fracture lesion, generating three-dimensional position information corresponding to the fracture lesion.

[0106] Step S204: three-dimensionally displaying the fracture lesion based on the three-dimensional position information.

[0107] The above steps will be described in detail as follows:

[0108] Step S201: obtaining three-dimensional scanning data corresponding to the rib.

[0109] The three-dimensional scanning data refers to three-dimensional data corresponding to the rib and required for rib fracture detection operation. The three-dimensional scanning data can correspond to different data types. In some examples, the three-dimensional scanning data includes at least one of the following: computed tomography (CT) data and nuclear magnetic resonance data. It can be understood that the three-dimensional scanning data is not limited to the types described above, and other types of three-dimensional scanning data can be selected by those skilled in the art according to specific application requirements, as long as the rib fracture detection operation can be realized.

[0110] In addition, the three-dimensional scanning data corresponding to the rib means that the three-dimensional scanning data includes scanning data corresponding to the rib region. It can be understood that the three-dimensional scanning data can include not only scanning data of the rib region, but also scanning data of other parts, such as scanning data of the spine region, scanning data of the sternum region, scanning data of the heart region, and scanning data of the artery region. In specific implementation, the present embodiment does not limit the specific acquisition method of the three-dimensional scanning data corresponding to the rib, and those skilled in the art can set it according to specific application scenarios or application requirements. In some examples, the three-dimensional scanning data corresponding to the rib can be stored in a preset area, and the three-dimensional scanning data corresponding to the rib can be obtained by accessing the preset area. In some other examples, a data scanning end can be arranged on the rib fracture detection device, or the rib fracture detection device is communicatively connected with a data scanning end. The chest region of the human body is scanned by using the data scanning end to obtain three-dimensional scanning data of the chest. Since the three-dimensional scanning data includes the rib region, the three-dimensional scanning data of the chest can be directly determined as the three-dimensional scanning data required for fracture detection operation and corresponding to the rib. After the three-dimensional scanning data is obtained by the data scanning end, the three-dimensional scanning data can be sent to the rib fracture detection device, so that the rib fracture detection device can stably obtain the three-dimensional scanning data.

[0111] In some examples, in order to ensure the accuracy of the rib fracture detection operation, the acquiring the three-dimensional scan data corresponding to the rib can include: acquiring three-dimensional raw data corresponding to the rib; and performing normalization processing on the three-dimensional raw data to obtain the three-dimensional scan data.

[0112] Specifically, the three-dimensional raw data corresponding to the rib can be acquired first. It can be understood that the position area and size information of the rib region of the human chest will be different for different human bodies, and thus the three-dimensional scan data obtained will also be different. At this time, in order to ensure stable rib fracture detection operation on different three-dimensional scan data, after the three-dimensional raw data is acquired, normalization processing can be performed on the three-dimensional raw data, so as to obtain the three-dimensional scan data. In this way, when different sizes of three-dimensional raw data corresponding to the rib are obtained, the same size or similar size of three-dimensional scan data can be obtained after data normalization processing, and the application range of the rib fracture detection method is further improved.

[0113] Of course, those skilled in the art can also use other ways to acquire three-dimensional scan data, as long as the accuracy and reliability of acquiring the three-dimensional scan data can be ensured, which will not be described here.

[0114] Step S202: performing a fracture detection operation based on the three-dimensional scan data to obtain a detection result.

[0115] After the three-dimensional scan data is acquired, a fracture detection operation can be performed based on the three-dimensional scan data, so as to obtain a detection result of the fracture detection operation. In some examples, the performing a fracture detection operation based on the three-dimensional scan data to obtain a detection result in the embodiment can include: acquiring a three-dimensional detection model, wherein the three-dimensional detection model is trained to perform a fracture detection operation based on three-dimensional scan data; and performing analysis and processing on the three-dimensional scan data by using the three-dimensional detection model to obtain a detection result.

[0116] Specifically, the three-dimensional detection model is pre-trained for fracture detection operation based on three-dimensional scanning data. In order to improve the quality and efficiency of the fracture detection operation, the three-dimensional detection model can be obtained first, and then the three-dimensional scanning data is input into the three-dimensional detection model, so that the three-dimensional detection model can analyze and process the three-dimensional scanning data, thereby obtaining a detection result. The detection result can include whether there is a fracture lesion. If there is a fracture lesion, the detection result can also include the lesion type corresponding to the fracture lesion and the confidence corresponding to the lesion type. The lesion type can include at least one of the following: displaced fracture, non-displaced fracture, cortical bending, old fracture, and the like. The displaced fracture refers to a fracture lesion where the cortical rupture and misalignment can be observed. The non-displaced fracture refers to a fracture lesion where the bone cortex is broken on one side or both sides, but is still basically aligned. The cortical bending refers to a fracture lesion where the inner or outer cortex is twisted or concave, which is common in children and has great importance in forensic medicine. Such fractures are often missed in imaging examinations. The old fracture refers to a fracture lesion where the deformity healing, delayed healing and non-healing of the fracture starts from the appearance of callus, and the like.

[0117] In some examples, when the detection result includes the lesion type corresponding to the fracture lesion and the confidence corresponding to the lesion type, the fracture detection operation based on the three-dimensional scanning data includes: performing a classification and identification operation on the three-dimensional scanning data using a classification model, thereby obtaining the lesion category corresponding to the fracture lesion and the confidence corresponding to the lesion category.

[0118] Specifically, the classification model for analyzing and identifying the lesion category of the three-dimensional scanning data is pre-configured. The three-dimensional scanning data is sent to the classification model, thereby obtaining the probability information of the three-dimensional scanning data with respect to each lesion type, for example: the probability of a three-dimensional scanning data being a displaced fracture is 30%, the probability of being a non-displaced fracture is 55%, the probability of being a cortical bending is 25%, and the probability of being an old fracture is 80%. Based on the above probability information of the three-dimensional scanning data with respect to each lesion type, it can be determined that the lesion category corresponding to the three-dimensional scanning data is an old fracture, and the confidence corresponding to the old fracture is 80%. Of course, those skilled in the art can also use other ways to obtain the lesion category corresponding to the fracture lesion and the confidence corresponding to the lesion category, as long as the accuracy and reliability of determining the lesion category corresponding to the fracture lesion and the confidence corresponding to the lesion category can be ensured. Herein, no further description is given.

[0119] Step S203: When the detection result is that there is a fracture lesion, three-dimensional position information corresponding to the fracture lesion is generated.

[0120] In the case of a detected fracture lesion, three-dimensional position information corresponding to the fracture lesion can be generated for the convenience of the user in viewing or applying the fracture lesion. The specific implementation of generating three-dimensional position information corresponding to the fracture lesion is not limited in the embodiment, and can be set by the person skilled in the art according to the specific application scenario or application requirement. For example, a setting coordinate system corresponding to the rib can be established based on the three-dimensional scanning data. In some examples, the three-dimensional scanning data corresponding to the rib can correspond to a world coordinate system when the three-dimensional scanning data is scanned. The setting coordinate system corresponding to the rib can be determined by the positional relationship between the world coordinate system and the three-dimensional scanning data. Then, the three-dimensional position information (i.e., three-dimensional coordinates) corresponding to the fracture lesion of the rib can be generated based on the setting coordinate system and the region where the fracture lesion of the rib is located. It can be understood that the three-dimensional position information can include length information, width information, and depth information of the region where the fracture lesion is located, and the like.

[0121] Of course, the person skilled in the art can also generate three-dimensional position information corresponding to the fracture lesion in other ways, as long as the accuracy and reliability of generating three-dimensional position information corresponding to the fracture lesion can be ensured. Details are not repeated here.

[0122] Step S204: three-dimensional display of the fracture lesion based on the three-dimensional position information.

[0123] After obtaining the three-dimensional position information, the fracture lesion can be three-dimensionally displayed based on the three-dimensional position information, so that the user can clearly and intuitively understand the relevant information of the fracture lesion through the display interface. In some examples, three-dimensional display of the fracture lesion based on the three-dimensional position information can include determining three display regions for displaying the fracture lesion, and three-dimensionally displaying the fracture lesion based on the three display regions and the three-dimensional position information, thereby ensuring the quality and effect of displaying the fracture lesion.

[0124] The rib fracture detection method provided in this embodiment acquires three-dimensional scan data corresponding to the ribs, and then performs fracture detection operations based on the three-dimensional scan data to obtain detection results. The detection results indicate whether a fracture lesion exists in the ribs. When the detection result indicates the presence of a fracture lesion, three-dimensional location information corresponding to the fracture lesion is generated, and the fracture lesion is displayed in three dimensions based on the three-dimensional location information. This effectively realizes the fully automated detection operation of rib fractures in a short time and obtains the detection results. When the detection result indicates the presence of a fracture lesion, the fracture lesion and its corresponding three-dimensional location information can be presented in a structured form. This not only solves the labor-intensive task in the prior art and reduces the doctor's workload in reading images, but also helps doctors make diagnostic decisions, saves diagnostic time, and further improves the practicality of the detection method, which is conducive to market promotion and application.

[0125] Figure 3 This is a flowchart illustrating the process of analyzing and processing 3D scanning data using a 3D detection model to obtain detection results, provided in an embodiment of the present invention. Based on the above embodiments, refer to the appendix... Figure 3 As shown, this embodiment provides a method for analyzing and processing 3D scanning data using a 3D detection model. Specifically, the analysis and processing of 3D scanning data using a 3D detection model to obtain detection results can include:

[0126] Step S301: Perform rib segmentation on the 3D scan data to obtain rib segmentation data.

[0127] Generally, the obtained 3D scan data includes not only data from the fracture area but also data from other areas, such as the spine, sternum, heart, and arteries. To reduce the data processing workload of fracture detection, rib segmentation can be performed on the 3D scan data after acquisition. This rib segmentation data includes: rib identification labels, rib regions, and point-by-point coordinates of the centerline of each rib. Specifically, the identification labels of each rib serve as unique identifiers to distinguish it from other ribs. Since the human body normally consists of 24 ribs (12 on the left and 12 on the right), different ribs can be assigned different numbers. For example, the left ribs can be numbered L1 to L12 from top to bottom, and the right ribs can be numbered R1 to R12 from top to bottom. To facilitate viewing and marking of ribs in different locations, ribs with different numbers can be marked with different colors, such as... Figure 4The rib region described above refers to the region covered by 24 ribs; the point-by-point coordinates of the center points of each rib are used to determine the specific location information of each rib. It can be understood that the rib segmentation data can not only include the data information described above, but also include other data information, which can be set by a person skilled in the art according to a specific application scenario or application requirement, and will not be described here.

[0128] In addition, the specific implementation of obtaining the rib segmentation data is not limited in the embodiment, and a person skilled in the art can configure it according to a specific application scenario or design requirement. For example, the rib segmentation operation on the three-dimensional scanning data to obtain the rib segmentation data can include: analyzing and identifying the three-dimensional scanning data by using a rib recognition model to obtain the position characteristics of the rib region, the first pair of ribs and other pairs of ribs in the three-dimensional scanning data, wherein the rib recognition model is trained to identify the position characteristics of the rib region, the first pair of ribs and other pairs of ribs in the three-dimensional scanning data; determining the point-by-point coordinates of the center lines of the ribs based on the position characteristics of the first pair of ribs and other pairs of ribs; and determining the identity tags and rib regions of the ribs based on the point-by-point coordinates of the center lines of the ribs.

[0129] The rib recognition model is trained to identify the position characteristics of the rib region, the first pair of ribs and other pairs of ribs in the three-dimensional scanning data. Therefore, after obtaining the three-dimensional scanning data, the three-dimensional scanning data can be input into the rib recognition model, so that the rib recognition model can analyze and process the three-dimensional scanning data, thereby obtaining the position characteristics of the rib region, the first pair of ribs and other pairs of ribs in the three-dimensional scanning data. After obtaining the position characteristics of the first pair of ribs and other pairs of ribs, the position characteristics of the first pair of ribs and other pairs of ribs can be analyzed and processed, thereby the point-by-point coordinates of the center lines of the ribs can be determined. After determining the point-by-point coordinates of the center lines of the ribs, the point-by-point coordinates of the center lines of the ribs can be analyzed and processed, thereby the identity tags and rib regions of the ribs can be determined.

[0130] Specifically, after determining the position feature of the first pair of ribs and the position feature corresponding to each of the other pairs of ribs, the identity label of each rib can be determined based on the position feature of the first pair of ribs and the positional relationship between the first pair of ribs and the other pairs of ribs, which can identify whether the rib is located in the left chest or the right chest, the number of the rib in the left chest or the number of the rib in the right chest, thereby achieving accurate identification and determination of the identity of each rib. Similarly, the rib area covered by the rib can be determined based on the position feature of the first pair of ribs and the position feature corresponding to each of the other pairs of ribs, thereby accurately and effectively determining the rib area.

[0131] In this embodiment, the rib recognition model is used to analyze and identify the three-dimensional scanning data to obtain the position feature of the rib area, the first pair of ribs and the other pairs of ribs in the three-dimensional scanning data, and then based on the position feature of the first pair of ribs and the position feature corresponding to each of the other pairs of ribs, the point-by-point coordinates of the center line of each rib are determined; and based on the point-by-point coordinates of the center line of each rib, the identity label of each rib and the rib area are determined, which effectively ensures the accuracy and reliability of obtaining the rib segmentation data. It can be understood that those skilled in the art can also use other ways to obtain the rib segmentation data as long as the accuracy and reliability of obtaining the rib segmentation data can be ensured, which will not be described here.

[0132] Step S302: using a three-dimensional detection model to perform a fracture detection operation on the rib segmentation data to obtain a detection result.

[0133] After obtaining the rib segmentation data, a three-dimensional detection model can be used to perform a fracture detection operation on the rib segmentation data to obtain a detection result. In some examples, using a three-dimensional detection model to perform a fracture detection operation on the rib segmentation data to obtain a detection result can include: determining a target area corresponding to the rib based on the rib segmentation data; using a sliding window method to sample the target area to obtain a plurality of sample data corresponding to the target area; using a three-dimensional detection model to perform a fracture detection operation on the plurality of sample data to obtain a detection result.

[0134] Since the rib segmentation data includes more data, when directly performing rib detection based on the rib segmentation data, more data processing resources are occupied and longer data processing time is required. Therefore, in order to improve the speed and quality of analyzing and processing the rib segmentation data, the rib segmentation data can be analyzed and processed to determine the target region (i.e., the region of interest) corresponding to the ribs. Specifically, the coordinate information corresponding to each rib can be determined based on the rib segmentation data, the maximum value and the minimum value of the region where the rib is located can be determined based on the coordinate information, and the target region corresponding to the rib can be determined based on the maximum value and the minimum value. Then, the target region can be sampled in a sliding window manner to obtain a plurality of sample data corresponding to the target region. The size of the sliding window can be preconfigured, and the number of sample data is related to the size of the sliding window. Generally, when the size of the sliding window is large, the number of sample data is small, and when the size of the sliding window is small, the number of sample data is large. In addition, adjacent sample data can have overlapping data, which can improve the accuracy of analyzing and processing the rib segmentation data.

[0135] After obtaining the plurality of sample data corresponding to the target region, the plurality of sample data can be input into the three-dimensional detection model, so that the three-dimensional detection model can analyze and process the plurality of sample data, and thus the detection result corresponding to the rib segmentation data can be obtained.

[0136] In this embodiment, the rib segmentation data is obtained by performing rib segmentation on the three-dimensional scanning data, and then the three-dimensional detection model is used to perform fracture detection on the rib segmentation data to obtain the detection result. This not only reduces the data processing amount of the fracture detection operation, but also ensures the accuracy and reliability of obtaining the detection result.

[0137] Figure 5 Another flowchart of a rib fracture detection method provided by the embodiment is shown in FIG. 8. Based on the above embodiment, the rib fracture detection method provided by the embodiment can further include the following steps: Figure 5 As shown in FIG. 8, in order to improve the accuracy of the fracture detection operation, the method in this embodiment can further include the following steps:

[0138] Step S501: segmenting each rib based on the centerline point coordinates of each rib to obtain the front segment region, the middle segment region and the rear segment region of each rib.

[0139] Step S502: obtaining the positioning information of the fracture lesion based on the three-dimensional position information of the fracture lesion corresponding to the front segment region, the middle segment region and the rear segment region of each rib.

[0140] Wherein, after obtaining the point-by-point coordinates of the center points of the ribs, the ribs can be segmented based on the point-by-point coordinates of the center lines of the ribs, so that the front segment region, the interruption region and the rear segment region of each rib can be obtained, as shown in Figure 6 In some examples, the ribs can be trisected based on the point-by-point coordinates of the center points of the ribs, and the first trisected region connected with the spine is determined as the front segment region of the rib, the middle trisected region corresponding to the rib is determined as the middle segment region of the rib, which can also be referred to as the axillary segment region, and the other trisected region corresponding to the rib is determined as the rear segment region of the rib, so that the front segment region, the middle segment region and the rear segment region of the rib can be accurately determined.

[0141] After obtaining the front segment region, the middle segment region and the rear segment region of each rib, the three-dimensional position information (i.e. three-dimensional coordinates) corresponding to the bone fracture lesion is analyzed and matched based on the front segment region, the middle segment region and the rear segment region of each rib, so that the positioning information of the bone fracture lesion can be obtained, which can identify the region where the rib is located, which is any one of the front segment region, the middle segment region and the rear segment region, so that the accurate positioning operation of the bone fracture lesion is effectively realized.

[0142] In this embodiment, the ribs are segmented based on the point-by-point coordinates of the center lines of the ribs to obtain the front segment region, the middle segment region and the rear segment region of each rib, and then the positioning information of the bone fracture lesion is obtained based on the front segment region, the middle segment region and the rear segment region of each rib and the three-dimensional position information corresponding to the bone fracture lesion, i.e. the specific region position of the rib where the bone fracture lesion is located, so that the accurate positioning operation of the bone fracture lesion is effectively realized, and the accuracy and reliability of the rib fracture detection operation are further ensured.

[0143] Figure 7 A flowchart of the three-dimensional display of the bone fracture lesion based on the three-dimensional position information provided by the embodiment of the present application is shown in the accompanying drawings. Figure 7 As shown in the accompanying drawings, the embodiment does not limit the specific implementation manner of the three-dimensional display of the bone fracture lesion, and the person skilled in the art can set it according to the specific application scene or application requirement. In some examples, the three-dimensional display of the bone fracture lesion based on the three-dimensional position information in the embodiment can include:

[0144] Step S701: detecting whether the three-dimensional position information is located on the rib in the rib region.

[0145] Step S702: when the three-dimensional position information is located on the rib, the three-dimensional display of the bone fracture lesion based on the three-dimensional position information is allowed.

[0146] Step S703: If the three-dimensional position information is not on the rib, then the three-dimensional display of the fracture lesion based on the three-dimensional position information is prohibited.

[0147] Wherein, since the fracture lesion obtained by detection may exist some false detection cases, in order to reduce or avoid the display of the fracture lesion obtained by false detection, when the detection result of the existence of the fracture lesion is obtained, the detection result corresponding to the fracture lesion can be de-identified. Specifically, the three-dimensional position information of the fracture lesion can be obtained, and after the three-dimensional position information is obtained, it can be detected whether the three-dimensional position information is located on the rib in the rib region, that is, whether the fracture lesion obtained by detection is located on the rib, and when the three-dimensional position information is located on the rib, it indicates that the fracture lesion obtained by detection is a rib fracture lesion, at this time it indicates that the detection operation of the rib fracture is correct, and then the three-dimensional display operation of the fracture lesion based on the three-dimensional position information is allowed. On the contrary, when the three-dimensional position information is not on the rib, it indicates that the fracture lesion obtained by detection is not a rib fracture lesion, at this time it indicates that the detection operation of the rib fracture is wrong, and then the three-dimensional position information is prohibited to perform three-dimensional display on the fracture lesion.

[0148] In still some examples, when the three-dimensional position information is not on the rib, the method in the embodiment can further include: deleting the detection result corresponding to the three-dimensional position information.

[0149] Specifically, when the three-dimensional position information is not on the rib, it indicates that the fracture lesion obtained by detection is not a rib fracture lesion, at this time it indicates that the detection operation of the rib fracture is wrong, in order to avoid the above-mentioned detection result to cause the user to be wrongly guided, the detection result corresponding to the three-dimensional position information can be deleted.

[0150] In the embodiment, by detecting whether the three-dimensional position information is located on the rib in the rib region, when the three-dimensional position information is located on the rib, the three-dimensional display of the fracture lesion based on the three-dimensional position information is allowed; when the three-dimensional position information is not on the rib, the three-dimensional display of the fracture lesion based on the three-dimensional position information is prohibited, thereby effectively realizing that the three-dimensional display of the fracture lesion with correct rib fracture detection operation is allowed, and the three-dimensional display of the fracture lesion with wrong rib fracture detection operation is prohibited, and further avoiding the detection result with problems in the rib fracture detection operation to cause the user to be wrongly guided, so as to further ensure the accuracy and reliability of the rib fracture detection operation.

[0151] Figure 8 A flowchart of another rib fracture detection method provided by the embodiment of the present application is provided; on the basis of any one of the above-mentioned embodiments, referring to FIG. 8, after the detection result is obtained, the method in the embodiment can further include: Figure 8 ​

[0152] Step S801: Obtain an editing operation input for the detection result.

[0153] Step S802: Edit the detection result based on the editing operation, and obtain an edited result.

[0154] After obtaining the detection result, the detection result can be displayed in three dimensions through a display interface for the convenience of the user to view and adjust the detection result. After displaying the detection result, the user can input an editing operation for the detection result on the display interface. The editing operation can include any one of the following: a viewing operation, a modification operation, a deletion operation, a storage operation, and the like. After obtaining the editing operation input for the detection result, the editing operation can be performed on the detection result based on the editing operation, so that an edited result can be obtained.

[0155] Specifically, different editing operations can correspond to different edited results. For example, when the editing operation is a viewing operation, the user can view the detection result, such as zoom-in viewing or zoom-out viewing, and the like. At this time, the edited result is the same as the detection result. For example, as shown in FIG. 6, a display interface diagram of a detection result is provided. When the user inputs a first execution operation, the detection result can be displayed, as shown in FIG. 6. When the user inputs a second execution operation, the angle of displaying the detection result can be changed, so as to realize zoom-in display of the detection result, as shown in FIG. 7. In the detection result, the identifier "A" represents the front, the identifier "P" represents the back, the identifier "H" represents the top, and the identifier "F" represents the bottom. It can be understood that when the detection result is displayed, the detection result can be displayed through three-dimensional dimensions and by using three different display regions, so as to ensure the quality and effect of displaying the detection result. Figures 9-10 Figure 9 Figure 10 Figures 9-10

[0156] It should be noted that when the detection result is displayed in three dimensions, the user can input a second execution operation in any region of the display interface. After obtaining the second execution operation, the display data in all regions can be adjusted based on the second execution operation. For example, as shown in FIG. 8, when the user performs a zoom-in operation on the data in the upper left region, after obtaining the zoom-in operation, the data in the upper left region, the upper right region, and the lower region can be simultaneously displayed in a zoom-in manner based on the zoom-in operation. That is, the display operation of the data in all regions is a linkage operation. When the display angle of the data in one region changes, the data in other regions also changes in the same linkage manner. Figure 9

[0157] ​​​​​When the editing operation is a modification operation, that is, the user can perform a modification operation on at least part of the information in the detection result, the edited result is different from the detection result. When the editing operation is a deletion operation, that is, the user can delete at least part of the information in the detection result, the edited result is different from the detection result. When the editing operation is a storage operation, that is, the user can store the detection result, the edited result is the same as the detection result.

[0158] In this embodiment, the editing operation input for the detection result is acquired, and then the detection result is edited based on the editing operation to obtain the edited result, so that after the detection result is acquired, the user can perform an editing operation on the detection result according to actual needs, and the flexibility and reliability of the method are improved.

[0159] Figure 11 A flowchart of a rib fracture detection information display method provided in this embodiment is shown in FIG. 11. Figure 11 As shown in the figure, the embodiment provides a rib fracture detection information display method. The execution subject of the rib fracture detection information display method can be a rib fracture detection information display device. It can be understood that the rib fracture detection information display device can be implemented as software or a combination of software and hardware. Specifically, the rib fracture detection information display method can include the following steps.

[0160] In step S1101, rib fracture detection information and an interactive interface for displaying the rib fracture detection information are acquired. The rib fracture detection information includes rib fracture lesions and three-dimensional position information corresponding to the rib fracture lesions.

[0161] In step S1102, the rib fracture detection information is displayed in three dimensions based on the three-dimensional position information and different regions in the interactive interface.

[0162] In step S1103, the displayed rib fracture detection information is adjusted in response to an execution operation input by the user in the interactive interface.

[0163] The above steps are described in detail as follows.

[0164] In step S1101, rib fracture detection information and an interactive interface for displaying the rib fracture detection information are acquired. The rib fracture detection information includes rib fracture lesions and three-dimensional position information corresponding to the rib fracture lesions.

[0165] The rib fracture detection information can be obtained by the implementation manners in the above embodiments, that is, three-dimensional scanning data corresponding to the ribs can be acquired, and then a fracture detection operation is performed on the three-dimensional scanning data to obtain the rib fracture detection information. The rib fracture detection information described above can include a rib fracture lesion and three-dimensional position information corresponding to the rib fracture lesion. Of course, the information included in the rib fracture detection information is not limited to the information described above, and can also include other types of data, for example: the rib fracture detection information can also include a lesion type corresponding to the rib fracture lesion and a confidence corresponding to the lesion type. In order to facilitate the user to view and adjust the three-dimensional scanning data in time, an interactive interface for displaying the rib fracture detection information can be acquired, that is, the rib fracture detection information can be displayed through the interactive interface.

[0166] Step S1102: three-dimensionally display the rib fracture detection information based on the three-dimensional position information and different regions in the interactive interface.

[0167] After the three-dimensional position information and the interactive interface are acquired, a plurality of different regions in the interactive interface can be determined, and then the rib fracture detection information can be three-dimensionally displayed based on the three-dimensional position information and the plurality of different regions determined, so that the user can conveniently and quickly acquire the rib fracture detection information.

[0168] Step S1103: in response to an execution operation input by the user in the interactive interface, adjust the displayed rib fracture detection information accordingly.

[0169] After the rib fracture detection information is displayed by using the interactive interface, in order to facilitate the user to view and adjust the rib fracture detection information, the rib fracture detection information can be three-dimensionally displayed through the interactive interface. After the rib fracture detection information is displayed, the user can input an execution operation for the rib fracture detection information on the interactive interface. The execution operation can be a point operation, a sliding operation, an editing operation, etc. The editing operation can include any one of the following: a viewing operation, a modification operation, a deletion operation, a storage operation, etc. After the execution operation input by the user in the interactive interface is acquired, the displayed rib fracture detection information can be adjusted accordingly based on the execution operation, so that adjusted information can be obtained.

[0170] The rib fracture detection information display method provided by the embodiment can obtain rib fracture detection information and an interactive interface used for displaying the rib fracture detection information, and then display the rib fracture detection information in three dimensions based on three-dimensional position information and different regions in the interactive interface. In response to an execution operation input by a user in the interactive interface, the displayed rib fracture detection information is adjusted accordingly, so that after the rib fracture detection information is obtained, the user can perform corresponding operations on the detection result according to actual needs, and the flexibility and reliability of the method are improved.

[0171] In a specific application, referring to the accompanying drawings, the application provides a rib fracture detection method. Figure 12 The rib fracture detection method provided by the application can be executed by a rib fracture detection device, which can include a preprocessing module, a rib segmentation module, a fracture detection module, a post-processing module, and a fracture positioning module. When the rib fracture detection device performs a rib fracture detection operation, the rib segmentation module, the fracture detection module, the fracture positioning module, and the fracture classification module can automatically perform rib segmentation, fracture detection, fracture positioning, and fracture classification in a short time and present the results in a structured form, thereby assisting doctors in making diagnosis and decision. Specifically, the rib fracture detection method can include the following steps:

[0172] Step 1: Obtain chest CT scan data.

[0173] Specifically, a chest scanning device can be used to scan the chest of a human body, thereby obtaining chest CT scan data.

[0174] Step 2: Send the CT scan data to the preprocessing module to obtain processed scan data.

[0175] Specifically, after the preprocessing module obtains the CT scan data, the CT scan data in a pre-specified window width and window level can be normalized, thereby obtaining processed scan data. The processed scan data is the three-dimensional scan data corresponding to the ribs in the above embodiment. This can effectively filter out irrelevant information in invalid regions or regions unrelated to the rib region, improve the quality and efficiency of data processing, and reduce the data processing resources required for data processing.

[0176] Step 3: Send the processed scan data to the rib segmentation module to obtain multi-label rib segmentation results, rib region of interest (ROI) coordinate frames, and rib centerline point coordinates.

[0177] The multi-label rib segmentation result is used to identify different ribs in the human body. In general, the labels of the 24 normal ribs of the human body can be identified in the following manner, for example: the labels of the left ribs are L1-L12, and the labels of the right ribs are R1-R12. When displaying the identified ribs, different colors can be used to distinguish the ribs. In addition, the rib segmentation module can be obtained by training a segmentation network, which includes but is not limited to UNet convolutional neural network, VNet convolutional neural network, and other commonly used segmentation networks. It should be noted that the rib segmentation module in this embodiment is obtained by using a 3D network to extract and learn features in a three-dimensional space.

[0178] Step 4: input the obtained multi-label rib segmentation result, rib region of interest (ROI) coordinate frame, and rib centerline point-by-point coordinates into the fracture detection module, so as to obtain a fracture lesion detection result.

[0179] Specifically, in the rib region of interest (ROI) coordinate frame region, a three-dimensional sample of a specific size can be extracted, and the extracted multiple three-dimensional samples can be assembled into a sample set. Then, the sample set is input into the fracture detection module. The fracture detection module can then analyze and process the three-dimensional samples in the sample set using a sliding window method, thereby obtaining a sub-detection result corresponding to each three-dimensional sample. By splicing all the sub-detection results, a fracture lesion detection result can be obtained, which can be output by the fracture detection module. The fracture lesion detection result can be a detection result of whether there is a fracture lesion in the rib ROI region. If the fracture lesion detection result indicates that there is a fracture lesion in the rib ROI region, each fracture lesion can correspond to its lesion coordinates (3D image coordinates + 3D world coordinates), lesion category (any one of displacement fracture, non-displacement fracture, cortical bending, and old fracture), confidence, and relative position information of the fracture in the rib ROI region.

[0180] The fracture detection module can be obtained by learning and training a detection network. The detection network can include but is not limited to a Retina-Net neural network, a Faster-RCNN neural network, or an anchor-free target detection algorithm network (Fully Convolutional One-Stage Object Detection, abbreviated as FCOS). The detection network is a 3D detection network that has been modified and adapted for 3D medical image detection. The head network of the neural network additionally includes a segmentation branch to output the segmentation result of the lesion.

[0181] Step 5: identify the fracture lesion detection result and remove the incorrect fracture lesion detection result.

[0182] After obtaining the fracture lesion detection result, the multi-label rib segmentation result can be used to identify the fracture lesion detection result. Specifically, under a given rule, if the obtained fracture lesion detection result is not on the rib in the rib region, the fracture lesion detection result is deleted; if the obtained fracture lesion detection result is on the rib in the rib region, the fracture lesion detection result can be displayed in three dimensions. Specifically, the fracture lesion detection result can be displayed in three dimensions by using a three-dimensional labeling tool and three-dimensional coordinates of the fracture lesion.

[0183] Step 6: fracture positioning operation is performed on the fracture lesion detection result to obtain positioning information of the fracture lesion detection result.

[0184] Specifically, the fracture lesion detection result is input into the fracture positioning module, and then the fracture positioning module can determine, according to the post-processed fracture lesion detection result list, in combination with the multi-label rib segmentation result and the rib center line, on which rib each fracture lesion is located and assign a corresponding number to it, and then determine the segmented (front segment, axillary segment, posterior segment) region where the fracture lesion is located according to the center point coordinates of the lesion 3D coordinate frame and the distance of each point of the corresponding rib center line, so as to obtain the positioning information of the fracture lesion detection result.

[0185] Step 7: output the fracture lesion detection result in combination with the positioning information of the fracture lesion detection result.

[0186] The rib fracture detection method provided by the application embodiment uses a 3D network instead of a 2D network to realize a complete automatic detection method for rib fracture lesions, and can realize operations such as multi-label rib segmentation, rib fracture detection, and rib fracture positioning, and has rich functions. Specifically, the positioning information of the output fracture lesion can be a 3D coordinate frame (i.e., three-dimensional position information), the shape of the 3D coordinate frame matches the shape of the area occupied by the fracture lesion, compared with the 2D coordinate frame used in the prior art, the 3D coordinate frame can more accurately reflect the spatial position of the fracture lesion, and the fracture lesion detection result provided by the method includes a pixel-level segmentation result of the fracture lesion, which can be used to more finely depict the range of the fracture lesion, so as to facilitate accurate and prominent display of the fracture lesion. In addition, the method can classify the fracture type more finely, can provide more accurate information for doctors, and the process of the multi-label rib segmentation result obtained by the method is not simply dependent on the sorting of connected domain centroids, can provide more robust rib numbering results, and can also provide more accurate fracture positioning results, further improving the practicability of the method.

[0187] Figure 13A flowchart of a rib fracture detection method provided by an embodiment of the present application is shown in FIG. 13. Referring to FIG. 13, the embodiment provides a rib fracture detection method. The execution subject of the rib fracture detection method can be a rib fracture detection device. It can be understood that the rib fracture detection device can be implemented as software or a combination of software and hardware. Specifically, the rib fracture detection method can include the following steps: Figure 13 As shown in FIG. 13, the embodiment provides a rib fracture detection method. The execution subject of the rib fracture detection method can be a rib fracture detection device. It can be understood that the rib fracture detection device can be implemented as software or a combination of software and hardware. Specifically, the rib fracture detection method can include the following steps:

[0188] Step S1301: In response to a call of a rib fracture detection request, determine a processing resource corresponding to a rib fracture detection service.

[0189] Step S1302: Use the processing resource to perform the following steps: acquire three-dimensional scanning data corresponding to a rib; use a three-dimensional fracture detection model to perform a fracture detection operation on the three-dimensional scanning data to obtain a detection result, wherein the three-dimensional fracture detection model is trained to be used for performing a fracture detection operation on three-dimensional scanning data; when the detection result is that there is a fracture lesion in the rib, generate three-dimensional position information corresponding to the fracture lesion; and display the fracture lesion based on the three-dimensional position information.

[0190] Specifically, the rib fracture detection method provided by the present application can be executed in the cloud. A plurality of computing nodes can be deployed in the cloud, and each computing node has computing, storage, and other processing resources. In the cloud, a service can be provided by a plurality of computing nodes. Of course, one computing node can also provide one or more services.

[0191] For the scheme provided by the present application, the cloud can provide a service for completing the rib fracture detection method, referred to as a rib fracture detection service. When a user needs to use the rib fracture detection service, the rib fracture detection service is called to trigger a request to call the rib fracture detection service to the cloud. The request can carry three-dimensional scanning data to be processed. The cloud determines a computing node responding to the request, and uses the processing resource in the computing node to perform the following steps: acquire three-dimensional scanning data corresponding to a rib; use a three-dimensional fracture detection model to perform a fracture detection operation on the three-dimensional scanning data to obtain a detection result, wherein the three-dimensional fracture detection model is trained to be used for performing a fracture detection operation on three-dimensional scanning data; when the detection result is that there is a fracture lesion in the rib, generate three-dimensional position information corresponding to the fracture lesion; and display the fracture lesion based on the three-dimensional position information.

[0192] Specifically, the implementation process, implementation principle, and implementation effect of the above method steps in the embodiment are similar to those of the method steps of the above Figures 1-10 、 Figure 12 embodiment, and the parts not described in detail in the present embodiment can be referred to the description of the above Figures 1-10 ,Figure 12 Brief description of the illustrated embodiments.

[0193] Figure 14 A flowchart of a rib fracture detection information display method provided by an embodiment of the application is shown in FIG. 1. The rib fracture detection information display method provided by the embodiment can be executed by a rib fracture detection information display device. It should be understood that the rib fracture detection information display device can be implemented as software or a combination of software and hardware. Specifically, the rib fracture detection information display method can include the following steps. Figure 14

[0194] Step S1401: In response to a call of a rib fracture detection information display request, determine a processing resource corresponding to a rib fracture detection information display service.

[0195] Step S1402: Use the processing resource to perform the following steps: acquire an interactive interface for displaying rib fracture detection information, the rib fracture detection information including rib fracture lesions and three-dimensional position information corresponding to the rib fracture lesions; perform three-dimensional display of the rib fracture detection information based on the three-dimensional position information and different regions in the interactive interface; and in response to an execution operation input by a user in the interactive interface, make corresponding adjustments to the displayed rib fracture detection information.

[0196] Specifically, the rib fracture detection information display method provided by the application can be executed in the cloud. A plurality of computing nodes can be deployed in the cloud, each of which has computing, storage, and other processing resources. In the cloud, a plurality of computing nodes can be organized to provide a certain service. Of course, one computing node can also provide one or more services.

[0197] According to the scheme provided by the application, the cloud can provide a service for completing the rib fracture detection information display method, referred to as a rib fracture detection information display service. When a user needs to use the rib fracture detection information display service, the rib fracture detection information display service is called to trigger a request to call the rib fracture detection information display service to the cloud. The rib fracture detection information to be displayed can be carried in the request. The cloud determines the computing node that responds to the request, and uses the processing resource in the computing node to perform the following steps: acquire an interactive interface for displaying rib fracture detection information, the rib fracture detection information including rib fracture lesions and three-dimensional position information corresponding to the rib fracture lesions; perform three-dimensional display of the rib fracture detection information based on the three-dimensional position information and different regions in the interactive interface; and in response to an execution operation input by a user in the interactive interface, make corresponding adjustments to the displayed rib fracture detection information.

[0198] ​Specifically, the implementation process, implementation principle and implementation effect of the method steps in the embodiment are similar to those of the method steps of the embodiment described above, and the parts not described in detail in the embodiment can refer to the related descriptions of the embodiment described above. Figures 11-12 The implementation process, implementation principle and implementation effect of the method steps in the embodiment are similar to those of the method steps of the embodiment described above, and the parts not described in detail in the embodiment can refer to the related descriptions of the embodiment described above. Figures 11-12 The implementation process, implementation principle and implementation effect of the method steps in the embodiment are similar to those of the method steps of the embodiment described above, and the parts not described in detail in the embodiment can refer to the related descriptions of the embodiment described above.

[0199] Figure 15 A structural schematic diagram of a rib fracture detection device provided by the embodiment of the present application is shown in FIG. 1. As shown in FIG. 1, the embodiment provides a rib fracture detection device for executing the rib fracture detection method shown above, and specifically, the rib fracture detection device can include a first acquisition module 11, a first detection module 12, a first generation module 13 and a first processing module 14. Figure 15 The implementation process, implementation principle and implementation effect of the method steps in the embodiment are similar to those of the method steps of the embodiment described above, and the parts not described in detail in the embodiment can refer to the related descriptions of the embodiment described above. Figure 2 The implementation process, implementation principle and implementation effect of the method steps in the embodiment are similar to those of the method steps of the embodiment described above, and the parts not described in detail in the embodiment can refer to the related descriptions of the embodiment described above.

[0200] The first acquisition module 11 is configured to acquire three-dimensional scanning data corresponding to the ribs.

[0201] The first detection module 12 is configured to perform a fracture detection operation based on the three-dimensional scanning data to obtain a detection result.

[0202] The first generation module 13 is configured to generate three-dimensional position information corresponding to the fracture lesion when the detection result is that there is a fracture lesion.

[0203] The first processing module 14 is configured to perform three-dimensional display on the fracture lesion based on the three-dimensional position information.

[0204] In some examples, when the first acquisition module 11 acquires the three-dimensional scanning data corresponding to the ribs, the first acquisition module 11 is configured to perform: acquiring three-dimensional original data corresponding to the ribs; and performing normalization processing on the three-dimensional original data to obtain the three-dimensional scanning data.

[0205] In some examples, when the first detection module 12 performs a fracture detection operation based on the three-dimensional scanning data to obtain a detection result, the first detection module 12 is configured to perform: acquiring a three-dimensional detection model, wherein the three-dimensional detection model is trained to perform a fracture detection operation based on the three-dimensional scanning data; and performing analysis processing on the three-dimensional scanning data by using the three-dimensional detection model to obtain the detection result.

[0206] In some examples, when the first detection module 12 performs analysis processing on the three-dimensional scanning data by using the three-dimensional detection model to obtain a detection result, the first detection module 12 is configured to perform: performing a rib segmentation operation on the three-dimensional scanning data to obtain rib segmentation data; and performing a fracture detection operation on the rib segmentation data by using the three-dimensional detection model to obtain the detection result.

[0207] In some examples, when the first detection module 12 performs the fracture detection operation on the rib segmentation data by using the three-dimensional detection model to obtain a detection result, the first detection module 12 is configured to perform: determining a target region corresponding to the ribs based on the rib segmentation data; performing sampling processing on the target region in a sliding window manner to obtain a plurality of sample data corresponding to the target region; and performing the fracture detection operation on the plurality of sample data by using the three-dimensional detection model to obtain the detection result.

[0208] In some examples, the rib segmentation data includes: an identity label of each rib, a rib region, and point-by-point coordinates of a center line of each rib.

[0209] In some examples, when the first detection module 12 performs the rib segmentation operation on the three-dimensional scanning data to obtain the rib segmentation data, the first detection module 12 is configured to perform: analyzing and identifying the three-dimensional scanning data by using a rib recognition model to obtain a rib region, a first pair of ribs, and a position feature of other pairs of ribs in the three-dimensional scanning data, wherein the rib recognition model is trained to identify the position feature of each of the rib region, the first pair of ribs, and the other pairs of ribs; determining point-by-point coordinates of a center line of each rib based on the position feature of each of the first pair of ribs and the other pairs of ribs; and determining an identity label and a rib region of each rib based on the point-by-point coordinates of the center line of each rib.

[0210] In some examples, the first processing module 14 in this embodiment is configured to perform: segmenting each rib based on the point-by-point coordinates of the center line of each rib to obtain a front segment region, a middle segment region, and a rear segment region of each rib; and obtaining positioning information of a fracture lesion based on the front segment region, the middle segment region, and the rear segment region of each rib and three-dimensional position information corresponding to the fracture lesion.

[0211] In some examples, when the first processing module 14 performs the three-dimensional display of the fracture lesion based on the three-dimensional position information, the first processing module 14 is configured to perform: detecting whether the three-dimensional position information is located on a rib in a rib region; when the three-dimensional position information is located on the rib, allowing the three-dimensional display of the fracture lesion based on the three-dimensional position information; and when the three-dimensional position information is not located on the rib, prohibiting the three-dimensional display of the fracture lesion based on the three-dimensional position information.

[0212] In some examples, when the three-dimensional position information is not located on the rib, the first processing module 14 in this embodiment is configured to perform: deleting a detection result corresponding to the three-dimensional position information.

[0213] In some examples, the detection result further includes: a lesion type corresponding to the fracture lesion and a confidence degree corresponding to the lesion type.

[0214] In some examples, after obtaining the detection result, the first processing module 14 in this embodiment is configured to perform: obtaining an editing operation input for the detection result; and editing the detection result based on the editing operation to obtain an edited result.

[0215] Figure 15 The apparatus shown can perform Figures 1-10 、 Figure 12 The method of the embodiment shown, the part not described in detail in this embodiment, can refer to the related description of the embodiment shown in Figures 1-10 、 Figure 12 The execution process and technical effects of the technical solution can be referred to the description in the embodiment shown in Figures 1-10 、 Figure 12 Here, no longer tedious.

[0216] In one possible design, the structure of the rib fracture detection apparatus shown can be implemented as an electronic device, which can be a mobile phone, a tablet computer, a server, or various devices. As shown in Figure 15 The electronic device can include a first processor 21 and a first memory 22. The first memory 22 is configured to store programs for the electronic device to perform the rib fracture detection method in the embodiments shown in Figure 16 、 Figures 1-10 、 Figure 12 The first processor 21 is configured to execute the programs stored in the first memory 22.

[0217] The programs include one or more computer instructions, and the one or more computer instructions can implement the following steps when executed by the first processor 21:

[0218] Obtain three-dimensional scanning data corresponding to the ribs.

[0219] Perform a fracture detection operation based on the three-dimensional scanning data to obtain a detection result.

[0220] When the detection result is a bone fracture lesion, generate three-dimensional position information corresponding to the bone fracture lesion.

[0221] Perform three-dimensional display of the bone fracture lesion based on the three-dimensional position information.

[0222] Further, the first processor 21 is further configured to perform all or part of the steps in the embodiments shown in Figures 1-10 、 Figure 12 .

[0223] The structure of the electronic device can further include a first communication interface 23 for communication between the electronic device and other devices or communication networks.

[0224] In addition, the embodiment of the present application provides a computer storage medium for storing computer software instructions for an electronic device, which includes a program for executing the method of the above Figures 1-10 、 Figure 12 The program involved in the rib fracture detection method in the method embodiment shown in the above

[0225] Figure 17 A structural schematic diagram of a rib fracture detection information display device provided by the embodiment of the present application; referring to the above Figure 17 The embodiment provides a rib fracture detection information display device for executing the rib fracture detection information display method shown in the above Figure 11 The rib fracture detection information display device can include a second acquisition module 31, a second display module 32 and a second processing module 33.

[0226] The second acquisition module 31 is configured to acquire an interactive interface for displaying rib fracture detection information, wherein the rib fracture detection information includes a rib fracture lesion and three-dimensional position information corresponding to the rib fracture lesion.

[0227] The second display module 32 is configured to perform three-dimensional display of the rib fracture detection information based on the three-dimensional position information and different regions in the interactive interface.

[0228] The second processing module 33 is configured to perform corresponding adjustment on the displayed rib fracture detection information in response to an execution operation input by a user in the interactive interface.

[0229] Figure 17 The device shown in the above Figures 11-12 The embodiment of the method shown in the above can perform the method of the embodiment of the above, and the parts not described in detail in the embodiment can refer to the related description of the embodiment of the above Figures 11-12 The execution process and technical effects of the technical solution can refer to the description in the embodiment of the above Figures 11-12 The execution process and technical effects of the technical solution can refer to the description in the embodiment of the above

[0230] In one possible design, Figure 17 The structure of the rib fracture detection information display device shown in the above can be implemented as an electronic device, which can be a mobile phone, a tablet computer, a server or various devices. As shown in the above Figure 18 The electronic device can include a second processor 41 and a second memory 42. The second memory 42 is configured to store a program for executing the rib fracture detection information display method of the above Figures 11-12 The embodiment shown in the above, and the second processor 41 is configured to execute the program stored in the second memory 42.

[0231] The program comprises one or more computer instructions, wherein the one or more computer instructions are executed by the second processor 41 to implement the following steps:

[0232] An interactive interface for displaying rib fracture detection information is acquired, the rib fracture detection information including a rib fracture lesion and three-dimensional position information corresponding to the rib fracture lesion;

[0233] The rib fracture detection information is displayed in three dimensions based on the three-dimensional position information and different regions in the interactive interface;

[0234] In response to an execution operation input by a user in the interactive interface, the displayed rib fracture detection information is adjusted accordingly.

[0235] Further, the second processor 41 is further configured to execute all or part of the steps of the method shown in the foregoing Figures 11-12

[0236] The electronic device can further include a second communication interface 43 for communication between the electronic device and other devices or communication networks.

[0237] In addition, the embodiment of the present application provides a computer storage medium for storing computer software instructions for the electronic device, which includes a program for implementing the display method of rib fracture detection information in the method embodiment shown in the foregoing Figures 11-12

[0238] Figure 19 Another structure diagram of a rib fracture detection device provided by the embodiment of the present application is shown in the foregoing Figure 19 The embodiment provides another rib fracture detection device for executing the rib fracture detection method shown in the foregoing Figure 13

[0239] The third determination module 51 is configured to determine a processing resource corresponding to a rib fracture detection service in response to a call of a rib fracture detection request;

[0240] The third processing module 52 is configured to execute the following steps by using the processing resource: acquiring three-dimensional scanning data corresponding to a rib; performing a fracture detection operation on the three-dimensional scanning data by using a three-dimensional fracture detection model to obtain a detection result, wherein the three-dimensional fracture detection model is trained to perform a fracture detection operation on three-dimensional scanning data; when the detection result is a fracture lesion in the rib, generating three-dimensional position information corresponding to the fracture lesion; and displaying the fracture lesion based on the three-dimensional position information.

[0241] Figure 19 The device shown in the foregoing​​​Figure 13 The method of the embodiment is not described in detail, and reference can be made to the related description of the embodiment. Figure 13 The execution process and technical effects of the technical solution are described in the embodiment, and will not be repeated here. Figure 13 The execution process and technical effects of the technical solution are described in the embodiment, and will not be repeated here.

[0242] In one possible design, Figure 19 The structure of the rib fracture detection device shown can be implemented as an electronic device, which can be a mobile phone, a tablet computer, a server, or various devices. As shown in the figure, Figure 20 The electronic device can include a third processor 61 and a third memory 62. The third memory 62 is configured to store programs for executing the rib fracture detection method in the above-described Figure 13 embodiment, and the third processor 61 is configured to execute the programs stored in the third memory 62.

[0243] The program includes one or more computer instructions, and the one or more computer instructions can implement the following steps when executed by the third processor 61:

[0244] In response to the call of the rib fracture detection request, determine the processing resource corresponding to the rib fracture detection service;

[0245] Use the processing resource to perform the following steps: obtain three-dimensional scanning data corresponding to the rib; use a three-dimensional fracture detection model to perform a fracture detection operation on the three-dimensional scanning data to obtain a detection result, wherein the three-dimensional fracture detection model is trained to perform a fracture detection operation on the three-dimensional scanning data; when the detection result is that there is a fracture lesion in the rib, generate three-dimensional position information corresponding to the fracture lesion; and display the fracture lesion based on the three-dimensional position information.

[0246] Further, the third processor 61 is further configured to execute all or part of the steps in the foregoing Figure 13 embodiment.

[0247] The structure of the electronic device can further include a third communication interface 63 for communication between the electronic device and other devices or communication networks.

[0248] In addition, the embodiment of the present application provides a computer storage medium for storing computer software instructions for an electronic device, which includes programs for executing the rib fracture detection method in the foregoing Figure 13 embodiment.

[0249] Figure 21 Another structure diagram of the rib fracture detection information display device provided by the embodiment of the present application is shown; refer to the accompanying Figure 21As shown, the embodiment provides another rib fracture detection information display device for performing the above-mentioned Figure 14 As shown, the rib fracture detection method, specifically, the rib fracture detection information display device can include a fourth determination module 71 and a fourth processing module 72:

[0250] The fourth determination module 71 is configured to determine the processing resource corresponding to the rib fracture detection information display service in response to the display request of the rib fracture detection information;

[0251] The fourth processing module 72 is configured to perform the following steps using the processing resource: obtaining an interactive interface for displaying the rib fracture detection information, the rib fracture detection information including a rib fracture lesion and three-dimensional position information corresponding to the rib fracture lesion; performing three-dimensional display on the rib fracture detection information based on the three-dimensional position information and different regions in the interactive interface; and performing corresponding adjustment on the displayed rib fracture detection information in response to the execution operation input by the user in the interactive interface.

[0252] Figure 21 The device can perform Figure 14 The method of the embodiment, the part not described in detail by the embodiment can refer to the related description of the Figure 14 The embodiment. The execution process and technical effects of the technical solution are described in the embodiment and will not be repeated here. Figure 14

[0253] In one possible design, Figure 21 The structure of the rib fracture detection information display device can be implemented as an electronic device, which can be a mobile phone, a tablet computer, a server, or various devices. As Figure 22 The electronic device can include a fourth processor 81 and a fourth memory 82. The fourth memory 82 is configured to store programs for the electronic device to perform the above-mentioned Figure 14 The rib fracture detection information display method in the embodiment, the fourth processor 81 is configured to execute the programs stored in the fourth memory 82.

[0254] The program includes one or more computer instructions, and the one or more computer instructions can implement the following steps when executed by the fourth processor 81:

[0255] In response to the display request of the rib fracture detection information, the processing resource corresponding to the rib fracture detection information display service is determined;

[0256] ​The processing resource is used to perform the following steps: obtaining an interactive interface for displaying rib fracture detection information, the rib fracture detection information including a rib fracture lesion and three-dimensional position information corresponding to the rib fracture lesion; and performing three-dimensional display of the rib fracture detection information based on the three-dimensional position information and different regions in the interactive interface.

[0257] Further, the fourth processor 81 is further configured to perform all or part of the steps of the foregoing Figure 14 embodiments.

[0258] The electronic device can further include a fourth communication interface 83 for communication between the electronic device and other devices or communication networks.

[0259] In addition, the embodiment of the present application provides a computer storage medium for storing computer software instructions for the electronic device, which includes programs for executing the display method of the rib fracture detection information in the foregoing Figure 14

[0260] Figure 23 A structural schematic diagram of a rib fracture detection system provided by the embodiment of the present application is shown in FIG. 1. Figure 23 The embodiment provides a rib fracture detection system, which can include:

[0261] The data scanning end 91 is configured to perform a scanning operation on a rib region of a human body to obtain three-dimensional scanning data, and send the three-dimensional scanning data to the rib fracture detection device.

[0262] The rib fracture detection device 92 is in communication connection with the data scanning end 91, and is configured to perform a fracture detection operation based on the three-dimensional scanning data to obtain a detection result; when the detection result is that there is a fracture lesion in the rib, generate three-dimensional position information corresponding to the fracture lesion; and display the fracture lesion based on the three-dimensional position information.

[0263] Figure 23 The execution process and technical effects of the rib fracture detection system shown in the embodiment are similar to those of the rib fracture detection device in the foregoing embodiments, and the details of the embodiment can be referred to the description of the foregoing embodiments, which will not be repeated here.

[0264] Figure 24 A flowchart of a fracture detection method provided by the embodiment of the present application is shown in FIG. 2. Figure 24 ​As shown, the embodiment provides a fracture detection method, which can perform fracture detection operation on any part of human or animal body, and the execution subject of the fracture detection method can be a fracture detection device. It can be understood that the fracture detection device can be implemented as software or a combination of software and hardware. Specifically, the fracture detection method can include the following steps:

[0265] Step S2401: Obtain three-dimensional image data corresponding to the set part.

[0266] In the fracture detection method, the set part can include at least one of the following: chest rib, spine, lower leg, knee joint, upper leg, ankle joint, hand, foot, etc. The set part can be configured according to the use requirement. It can be understood that different set parts can correspond to different structural characteristics, so the configuration parameters of the fracture detection device for implementing the fracture detection method can be adjusted when different set parts are detected.

[0267] In order to perform fracture detection operation on the set part, three-dimensional image data corresponding to the set part can be obtained first. The three-dimensional image data can include any one of the following: computed tomography (CT) data, nuclear magnetic resonance data, etc. Specifically, the specific implementation of obtaining three-dimensional image data corresponding to the set part in the embodiment is similar to the specific implementation of step S201 in the above embodiment. For details, please refer to the above description.

[0268] Step S2402: Perform fracture detection operation based on the three-dimensional image data to obtain a detection result.

[0269] Step S2403: When the detection result is a fracture lesion, generate three-dimensional position information corresponding to the fracture lesion.

[0270] Step S2404: Perform three-dimensional display of the fracture lesion based on the three-dimensional position information.

[0271] After obtaining the three-dimensional image data, a fracture detection operation can be performed based on the three-dimensional image data, so that a detection result can be obtained. Specifically, a three-dimensional detection model for performing the fracture detection operation is pre-trained. For a set part, different set parts can correspond to different structural features, and thus different three-dimensional detection models can correspond to different set parts. After obtaining the three-dimensional image data, a target detection model can be determined based on the set part, and the three-dimensional image data is input into the target detection model, so that the detection result can be obtained. When the detection result is a bone fracture lesion, three-dimensional position information corresponding to the bone fracture lesion can be generated, and the bone fracture lesion can be displayed in three dimensions based on the three-dimensional position information, so that the fracture detection operation on the set part is effectively realized.

[0272] It should be noted that the specific implementation manner and implementation effect of each step in this embodiment are similar to those of steps S202-S204 in the above embodiment, and reference can be made to the above statements.

[0273] The method in this embodiment can also include the related descriptions of the above-mentioned embodiments. Figures 1-10 、 Figure 12 The method in this embodiment is not described in detail, and reference can be made to the related descriptions of the above-mentioned embodiments. Figures 1-10 、 Figure 12 The execution process and technical effects of this technical solution are described in the above-mentioned embodiments, and will not be described here. Figures 1-10 、 Figure 12

[0274] Figure 25 A structure diagram of a fracture detection device provided in an embodiment of the present application is shown in the accompanying drawings. Figure 25 The fracture detection device can perform the fracture detection method shown in the above-mentioned embodiments. Specifically, the fracture detection device can include a fifth acquisition module 1001, a fifth detection module 1002, a fifth generation module 1003, and a fifth processing module 1004. Figure 24

[0275] The fifth acquisition module 1001 is configured to acquire three-dimensional image data corresponding to a set part.

[0276] The fifth detection module 1002 is configured to perform a fracture detection operation based on the three-dimensional image data to obtain a detection result.

[0277] The fifth generation module 1003 is configured to generate three-dimensional position information corresponding to a bone fracture lesion when the detection result is the bone fracture lesion.

[0278] ​​The fifth processing module 1004 is configured to perform three-dimensional display of the fracture focus based on the three-dimensional position information.

[0279] Figure 25 The device shown can perform Figure 24 The method of the embodiment shown, the part not described in detail in the embodiment, can refer to the related description of Figure 24 The embodiment. The execution process and technical effects of the technical solution are described in the embodiment shown, which will not be described here. Figure 24

[0280] In one possible design, Figure 25 The structure of the fracture detection device shown can be implemented as an electronic device, which can be a mobile phone, a tablet computer, a server, or various devices. As Figure 26 The electronic device can include a fifth processor 111 and a fifth storage 112. The fifth storage 112 is configured to store programs for the electronic device to perform the fracture detection method in the above Figure 24 The embodiment, and the fifth processor 111 is configured to execute the programs stored in the fifth storage 112.

[0281] The program includes one or more computer instructions, and the one or more computer instructions can implement the following steps when executed by the fifth processor 111:

[0282] Obtain three-dimensional image data corresponding to the set part.

[0283] Perform fracture detection operation based on the three-dimensional image data to obtain a detection result.

[0284] When the detection result is that there is a fracture focus, generate three-dimensional position information corresponding to the fracture focus.

[0285] Perform three-dimensional display of the fracture focus based on the three-dimensional position information.

[0286] Further, the fifth processor 111 is further configured to perform all or part of the steps in the foregoing Figure 24 The embodiment shown.

[0287] The structure of the electronic device can further include a fifth communication interface 113 for communication between the electronic device and other devices or communication networks.

[0288] In addition, the embodiment of the application provides a computer storage medium for storing computer software instructions for an electronic device, which includes programs involved in the fracture detection method in the above Figure 24 The method embodiment shown.

[0289] ​The apparatus embodiments described above are only illustrative, wherein the units described as separate components can or can not be physically separate, and the components displayed as units can or can not be physical units, i.e., can be located in one place, or can be distributed to multiple network units. Part or all of the modules can be selected to achieve the purposes of the embodiments according to actual needs. Those skilled in the art can understand and implement without creative labor.

[0290] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be realized by means of a general hardware platform as necessary, and of course can also be realized by means of combination of hardware and software. Based on such understanding, the above technical solutions can be embodied in the form of a computer program product, and the present application can be embodied in the form of a computer program product implemented on one or more computer usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer usable program codes.

[0291] The present application is described with reference to flowcharts and / or block diagrams of the method, device (system), and computer program product according to the embodiments of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and the combination of the flows and / or blocks in the flowcharts and / or block diagrams can be realized by computer program instructions. These computer program instructions can be provided to a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable devices to produce a machine, so that the instructions executed by the computer or other programmable devices produce a device implemented in the flowcharts and / or block diagrams. Figure 1 one or more flows and / or blocks Figure 1 an apparatus that implements the functions specified in the flow(s) or block(s).

[0292] These computer program instructions can also be stored in a computer readable storage medium capable of guiding the computer or other programmable devices to work in a specific manner, so that the instructions stored in the computer readable storage medium produce a manufactured product including instruction apparatus, which implements the flowcharts and / or block diagrams. Figure 1 one or more flows and / or blocks Figure 1 an apparatus that implements the functions specified in the flow(s) or block(s).

[0293] These computer program instructions can also be loaded into a computer or other programmable devices, so that a series of operation steps are performed on the computer or other programmable devices to produce a computer implemented process, so that the instructions executed on the computer or other programmable devices provide a process for implementing the flowcharts and / or block diagrams. Figure 1 one or more flows and / or blocks Figure 1The functions processes specified in a single block or multiple blocks.

[0294] In one typical arrangement, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0295] The memory can include non-persistent memory and / or volatile memory, such as random access memory (RAM) and / or cache memory, non-volatile memory, such as read-only memory (ROM), EPROM, and / or flash memory. The memory is an example of computer readable media.

[0296] Computer readable media includes permanent and non-permanent, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD), or other optical storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible to a computing device. According to the definition herein, computer readable media does not include transitory media, such as modulated data signals and carrier waves.

[0297] Finally, it should be noted that the above-mentioned embodiments are merely used to illustrate the technical solutions of the present application, rather than limiting them; even though the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that modifications can still be made to the technical solutions recorded in the foregoing embodiments, or some technical features can be replaced by equivalent replacements; and these modifications or replacements do not cause the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A rib fracture detection method characterized by, The method comprises the following steps: obtaining three-dimensional scanning data corresponding to the ribs; performing a fracture detection operation based on the three-dimensional scanning data to obtain a detection result; when the detection result is that there is a fracture lesion, generating three-dimensional position information corresponding to the fracture lesion; performing three-dimensional display of the fracture lesion based on the three-dimensional position information; wherein the detection result is obtained by performing a fracture detection operation on rib segmentation data, the rib segmentation data comprising an identity label of each rib, a rib region, and point-by-point coordinates of a center line of each rib; the rib segmentation data is obtained by the following steps: analyzing and identifying the three-dimensional scanning data using a rib recognition model to obtain the position characteristics of the rib region, the first pair of ribs, and other pairs of ribs in the three-dimensional scanning data, wherein the rib recognition model is trained to identify the respective position characteristics of the rib region, the first pair of ribs, and other pairs of ribs in the three-dimensional scanning data; determining the point-by-point coordinates of the center line of each rib based on the respective position characteristics of the first pair of ribs and other pairs of ribs; determining the identity label of each rib and the rib region based on the point-by-point coordinates of the center line of each rib.

2. The method of claim 1, wherein, Obtaining three-dimensional scanning data corresponding to the ribs comprises: obtaining three-dimensional original data corresponding to the ribs; performing normalization processing on the three-dimensional original data to obtain the three-dimensional scanning data.

3. The method of claim 1, wherein, Performing a fracture detection operation based on the three-dimensional scanning data to obtain a detection result comprises: obtaining a three-dimensional detection model, wherein the three-dimensional detection model is trained to perform a fracture detection operation based on the three-dimensional scanning data; analyzing and processing the three-dimensional scanning data using the three-dimensional detection model to obtain a detection result.

4. The method of claim 3, wherein, Analyzing and processing the three-dimensional scanning data using the three-dimensional detection model to obtain a detection result comprises: performing a rib segmentation operation on the three-dimensional scanning data to obtain rib segmentation data; performing a fracture detection operation on the rib segmentation data using the three-dimensional detection model to obtain the detection result.

5. The method of claim 4, wherein, Performing a fracture detection operation on the rib segmentation data using the three-dimensional detection model to obtain the detection result comprises: determining a target region corresponding to the ribs based on the rib segmentation data; sampling the target region in a sliding window manner to obtain a plurality of sample data corresponding to the target region; performing a fracture detection operation on the plurality of sample data using the three-dimensional detection model to obtain a detection result.

6. The method of claim 1, wherein, The method further comprises: segmenting each rib based on the point-by-point coordinates of the center line of each rib to obtain a front segment region, a middle segment region, and a rear segment region of each rib; obtaining positioning information of the fracture lesion based on the front segment region, the middle segment region, and the rear segment region of each rib, and the three-dimensional position information corresponding to the fracture lesion.

7. The method of claim 1, wherein, Performing three-dimensional display of the fracture lesion based on the three-dimensional position information comprises: detecting whether the three-dimensional position information is located on a rib in the rib region; When the three-dimensional position information is on the rib, then the three-dimensional display of the fracture focus based on the three-dimensional position information is allowed; When the three-dimensional position information is not on the rib, then the three-dimensional display of the fracture focus based on the three-dimensional position information is prohibited.

8. The method of claim 7, wherein, When the three-dimensional position information is not on the rib, the method further comprises: deleting the detection result corresponding to the three-dimensional position information.

9. The method according to any one of claims 1-8, characterized in that, After obtaining the detection result, the method further comprises: obtaining an editing operation input for the detection result; editing the detection result based on the editing operation to obtain an edited result.

10. A display method of rib fracture detection information, characterized by, Comprise: obtaining an interactive interface for displaying rib fracture detection information, wherein the rib fracture detection information comprises a rib fracture focus and three-dimensional position information corresponding to the rib fracture focus; The rib fracture detection information is obtained based on the method of any one of claims 1-9; based on the three-dimensional position information and different regions in the interactive interface, the rib fracture detection information is displayed in three dimensions; in response to a user input execution operation in the interactive interface, the displayed rib fracture detection information is adjusted accordingly.

11. A rib fracture detection method characterized by, Comprise: in response to invoking a rib fracture detection request, determining the processing resources corresponding to the rib fracture detection service; using the processing resources to perform the following steps: obtaining three-dimensional scanning data corresponding to the rib; using a three-dimensional fracture detection model to perform a fracture detection operation on the three-dimensional scanning data to obtain a detection result, wherein the three-dimensional fracture detection model is trained to perform a fracture detection operation on three-dimensional scanning data; when the detection result is a fracture focus in the rib, generate three-dimensional position information corresponding to the fracture focus; display the fracture focus based on the three-dimensional position information; wherein the detection result is obtained by performing a fracture detection operation on rib segmentation data, and the rib segmentation data comprises the identity label of each rib, the rib region, and the point-by-point coordinates of the center line of each rib; the rib segmentation data is obtained by the following steps: using a rib recognition model to analyze and recognize the three-dimensional scanning data to obtain the position characteristics of the rib region, the first pair of ribs, and other pairs of ribs in the three-dimensional scanning data, wherein the rib recognition model is trained to recognize the position characteristics of the rib region, the first pair of ribs, and other pairs of ribs in the three-dimensional scanning data; based on the position characteristics of the first pair of ribs and other pairs of ribs, determine the point-by-point coordinates of the center line of each rib; based on the point-by-point coordinates of the center line of each rib, determine the identity label of each rib and the rib region.

12. A rib fracture detection system characterized by, Comprise: a data scanning end for performing a scanning operation on a human rib region to obtain three-dimensional scanning data, and sending the three-dimensional scanning data to a rib fracture detection device; The rib fracture detection device is in communication connection with the data scanning end, is used for carrying out fracture detection operation based on the three-dimensional scanning data, and obtains a detection result; when the detection result is that there is a fracture focus in the rib, three-dimensional position information corresponding to the fracture focus is generated; The fracture focus is displayed based on the three-dimensional position information; The detection result is obtained by carrying out fracture detection operation on rib segmentation data, and the rib segmentation data includes identity labels of each rib, a rib region, and point-by-point coordinates of a center line of each rib; the rib segmentation data is obtained by the following steps: A rib recognition model is used to analyze and identify the three-dimensional scanning data, to obtain a rib region, a first pair of ribs, and position characteristics of other pairs of ribs in the three-dimensional scanning data, wherein the rib recognition model is trained to identify respective position characteristics of the rib region, the first pair of ribs, and other pairs of ribs in the three-dimensional scanning data; Point-by-point coordinates of a center line of each rib are determined based on the respective position characteristics of the first pair of ribs and other pairs of ribs; Identity labels of each rib and the rib region are determined based on the point-by-point coordinates of the center line of each rib.

Images