Ultrasonic apparatus, synovitis detection device, electronic apparatus, and storage medium
By using an image segmentation network in an ultrasound device to identify the articular bone and synovitis areas in ultrasound images, and automatically determine the synovitis level based on the positional relationship of these areas, the problem of accuracy and complexity of synovitis detection in the prior art is solved, and a more efficient and accurate detection effect is achieved.
Patent Information
- Application Number
- CN202311133214.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-09-01
- Publication Date
- 2025-03-04
AI Technical Summary
Existing ultrasound equipment relies on operator judgment in synovitis detection, and there are problems of accuracy and complexity, making it difficult to accurately identify synovitis and its severity.
An ultrasound device is designed, including an ultrasound probe and processing device, to identify the articular bone area and synovitis area from the target ultrasound image through an image segmentation network, and to automatically determine the level information of synovitis based on the positional relationship between these areas.
It reduces the workload of manual judgment, improves the accuracy and efficiency of synovitis detection, and can provide more accurately the presence and severity of synovitis.
Smart Images

Figure CN119548175A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of ultrasonic equipment, and in particular to an ultrasonic equipment, a synovitis detection device, an electronic device and a storage medium. Background Art
[0002] Synovitis is a common articular cartilage disease, and the use of ultrasound imaging technology for synovitis screening has been widely used in the clinical diagnosis of this disease.
[0003] In the prior art, in most cases, the operator uses an ultrasound probe to perform musculoskeletal ultrasound scanning and determines whether the scanned ultrasound image contains synovitis. The operator diagnoses the lesion based on the characteristics of the ultrasound image, combined with clinical experience and standards. This method is highly dependent on the musculoskeletal ultrasound operator and the joint structure is complex, so it is still difficult to accurately identify synovitis and make a diagnosis.
[0004] Therefore, a new ultrasonic device is urgently needed to solve the above problems. Summary of the invention
[0005] The present invention is proposed in view of the above problems. The present invention provides an ultrasonic device, a synovitis detection device, an electronic device and a storage medium.
[0006] According to one aspect of the present invention, there is provided an ultrasound device, comprising: an ultrasound probe and a processing device, wherein the ultrasound probe is used to collect a target ultrasound image at a target joint; the processing device is used to identify an articular side bone region and a synovitis region from the target ultrasound image, and when the synovitis region is identified, determine the level information of the synovitis based on the positional relationship between the synovitis region and the articular side bone region, wherein the level information is used to indicate the severity of the synovitis; wherein the articular side bone region is the region where the bones on both sides of the target joint are located, and the synovitis region is the region produced by synovial hyperplasia or the region produced by synovial hyperplasia combined with effusion.
[0007] Exemplarily, the processing device determines the level information of synovitis based on the positional relationship between the synovitis area and the joint-side bone area in the following manner, including: determining the bone top line corresponding to the joint-side bone area; determining the target vertex of the synovitis area; and determining the level information of synovitis based on the positional relationship between the bone top line and the target vertex.
[0008] Exemplarily, the articular side bone region includes a first articular side bone region and a second articular side bone region respectively located on both sides of the target joint, and the processing device is also used to identify a joint capsule region from the target ultrasound image, the joint capsule region being the region where the joint capsule is located, and the processing device determines the bone top line corresponding to the articular side bone region in the following manner: based on the two endpoints of the joint capsule region in the first direction, two truncation positions corresponding one to one to the two endpoints are determined; based on the two truncation positions, the first articular side bone region and the second articular side bone region are truncated along the second direction to obtain a third articular side bone region and a fourth articular side bone region located on both sides of the target joint; based on the line between the vertices in the third articular side bone region in the second direction and the vertices in the fourth articular side bone region in the second direction, the bone top line is determined; wherein the first direction and the second direction are perpendicular, and the first direction is a direction perpendicular to the cross-section of the target joint.
[0009] Exemplarily, the contour of the synovitis area includes an upper contour and a lower contour, and the dividing point between the upper contour and the lower contour is the two end points of the synovitis area in a first direction, the first direction is a direction perpendicular to the cross-section of the target joint, and the processing device determines the level information of the synovitis based on the positional relationship between the bone vertex line and the target vertex in the following manner, including: in the second direction, if the target vertex is below the bone vertex line, it is determined that the synovitis belongs to the first level; in the second direction, if the target vertex is on the bone vertex line or above the bone vertex line, the following determination operation is performed: determine the upper contour of the synovitis area, wherein the target vertex is the contour point at the highest point in the upper contour along the second direction; if the shape of the upper contour is a concave shape, it is determined that the synovitis belongs to the second level; if the shape of the upper contour is a convex shape, it is determined that the synovitis belongs to the third level; wherein the second direction is a direction parallel to the cross-section of the target joint, and the severity corresponding to the first level, the severity corresponding to the second level, and the severity corresponding to the third level increase in sequence.
[0010] Exemplarily, the processing device determines the upper contour of the synovitis area in the following manner: traversing each column of pixel points in the synovitis area located in the second direction along the first direction, and during the traversal process, taking the line formed by the first pixel point in each column of pixel points located in the second direction obtained by the traversal as the upper contour.
[0011] Exemplarily, the processing device identifies the joint side bone region and the synovitis region from the target ultrasound image in the following manner: using an image segmentation network to segment the target ultrasound image to identify the joint side bone region and the synovitis region from the target ultrasound image.
[0012] Exemplarily, the processing device identifies the joint capsule region from the target ultrasound image in the following manner: using an image segmentation network to segment the target ultrasound image to identify the joint capsule region from the target ultrasound image.
[0013] Exemplarily, the ultrasound apparatus further comprises a display device for outputting information on whether synovitis exists and outputting level information when synovitis exists.
[0014] According to another aspect of the present invention, there is also a synovitis detection device, comprising: an acquisition module, used to acquire a target ultrasonic image at a target joint; a first identification module, used to identify an articular side bone region and a synovitis region from the target ultrasonic image; a determination module, used to determine the level information of the synovitis based on the positional relationship between the synovitis region and the articular side bone region when the synovitis region is identified, wherein the level information is used to indicate the severity of the synovitis; wherein the articular side bone region is the region where the bones are located on both sides of the target joint, and the synovitis region is the region produced by synovial hyperplasia or the region produced by synovial hyperplasia combined with effusion.
[0015] Exemplarily, the determination module includes a first determination submodule, a second determination submodule and a third determination submodule. The first determination submodule is used to determine the bone top line corresponding to the joint side bone area; the second determination submodule is used to determine the target vertex of the synovitis area; the third determination submodule is used to determine the level information of synovitis based on the positional relationship between the bone top line and the target vertex.
[0016] Exemplarily, the joint side bone region includes a first joint side bone region and a second joint side bone region respectively located on both sides of the target joint, and the synovitis detection device also includes a second identification module, the second identification module is used to identify the joint capsule region from the target ultrasound image, the joint capsule region is the region where the joint capsule is located; the first determination submodule includes a first determination unit, a truncation unit and a second determination unit, wherein the first determination unit is used to determine two truncation positions corresponding to the two endpoints in the first direction based on the two endpoints of the joint capsule region; the truncation unit is used to truncate the first joint side bone region and the second joint side bone region along the second direction based on the two truncation positions to obtain the third joint side bone region and the fourth joint side bone region located on both sides of the target joint; the second determination unit is used to determine the bone top connection line based on the line between the vertices in the third joint side bone region in the second direction and the vertices in the fourth joint side bone region in the second direction; wherein the first direction and the second direction are perpendicular, and the first direction is a direction perpendicular to the cross-section of the target joint.
[0017] Exemplarily, the contour of the synovitis area includes an upper contour and a lower contour, the dividing point between the upper contour and the lower contour is the two end points of the synovitis area in the first direction, the first direction is the direction perpendicular to the cross section of the target joint, the third determination submodule includes a third determination unit, a fourth determination unit, a fifth determination unit and a sixth determination unit, the third determination unit is used to determine that the synovitis belongs to the first level if the target vertex is below the bone vertex line in the second direction; the fourth determination unit is used to determine the upper contour of the synovitis area if the target vertex is on the bone vertex line or above the bone vertex line in the second direction, wherein the target vertex The point is the highest contour point in the upper contour along the second direction; the fifth determination unit is used to determine that the synovitis belongs to the second level if the target vertex is on the bone top line or above the bone top line and the shape of the upper contour is concave in the second direction; the sixth determination unit is used to determine that the synovitis belongs to the third level if the target vertex is on the bone top line or above the bone top line and the shape of the upper contour is convex in the second direction; wherein the second direction is a direction parallel to the cross-section of the target joint, and the severity corresponding to the first level, the severity corresponding to the second level and the severity corresponding to the third level increase in sequence.
[0018] Exemplarily, the fourth determination unit includes a traversal subunit, which is used to traverse each column of pixel points in the synovitis area located in the second direction along the first direction. During the traversal process, the line formed by the first pixel point in each column of pixel points located in the second direction obtained by the traversal is used as the upper contour.
[0019] According to another aspect of the present invention, there is provided an electronic device comprising a processor and a memory, wherein a computer program is stored in the memory, and the computer program instructions are used by the processor to execute the following when the processor is running: acquiring a target ultrasound image at a target joint; identifying an articular side bone region and a synovitis region from the target ultrasound image, and determining level information of the synovitis based on the positional relationship between the synovitis region and the articular side bone region when the synovitis region is identified, wherein the level information is used to indicate the severity of the synovitis; wherein the articular side bone region is the region where the bones on both sides of the target joint are located, and the synovitis region is the region produced by synovial hyperplasia or the region produced by synovial hyperplasia combined with effusion.
[0020] According to another aspect of the present invention, a storage medium is provided, storing a computer program / instructions, which are used to perform the following operations when run: acquiring a target ultrasound image at a target joint; identifying an articular side bone region and a synovitis region from the target ultrasound image, and determining the level information of the synovitis based on the positional relationship between the synovitis region and the articular side bone region when the synovitis region is identified, wherein the level information is used to indicate the severity of the synovitis; wherein the articular side bone region is the region where the bones on both sides of the target joint are located, and the synovitis region is the region produced by synovial hyperplasia or the region produced by synovial hyperplasia combined with effusion.
[0021] According to the ultrasound equipment, synovitis detection device, electronic device and storage medium of the embodiments of the present invention, the joint side bone area and the synovitis area are identified from the target ultrasound image through the processing device, and when the synovitis area is identified, the level information of the synovitis is determined based on the positional relationship between the synovitis area and the joint side bone area. This can reduce the workload of manually determining whether the synovitis area exists and determining the level information of the synovitis when synovitis exists, and the information obtained about synovitis is also more accurate.
[0022] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS
[0023] The above and other purposes, features and advantages of the present invention will become more apparent by describing the embodiments of the present invention in more detail in conjunction with the accompanying drawings. The accompanying drawings are used to provide a further understanding of the embodiments of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings, the same reference numerals generally represent the same components or steps.
[0024] Figure 1 A schematic block diagram of an ultrasound device according to an embodiment of the present invention is shown;
[0025] Figure 2 A schematic diagram of a target ultrasound image according to an embodiment of the present invention is shown;
[0026] Figure 3 A schematic block diagram showing a synovitis detection device according to an embodiment of the present invention; and
[0027] Figure 4 A schematic block diagram of an electronic device according to an embodiment of the present invention is shown. DETAILED DESCRIPTION
[0028] In order to make the purpose, technical scheme and advantages of the present invention more obvious, the exemplary embodiments according to the present invention will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments of the present invention, and it should be understood that the present invention is not limited to the exemplary embodiments described herein. Based on the embodiments described in the present invention, all other embodiments obtained by those skilled in the art without creative work should fall within the protection scope of the present invention.
[0029] In order to solve the above technical problems, the present invention provides an ultrasonic device. Figure 1 1 is a schematic block diagram of an ultrasound device 100 according to an embodiment of the present invention. Figure 1 As shown, the ultrasound device 100 may include an ultrasound probe 110 and a processing device 120 .
[0030] Exemplarily, the ultrasound device 100 may be an ultrasound device dedicated to musculoskeletal testing, or may be a common ultrasound device with musculoskeletal testing function.
[0031] Exemplarily, the ultrasound probe 110 may be used to acquire a target ultrasound image at a target joint.
[0032] In one embodiment, any ultrasonic probe can be used to collect ultrasonic scanning videos at target joints. The target joints may include any human joints such as finger joints, wrist joints, ankle joints, etc. According to the obtained ultrasonic scanning video, the image corresponding to each frame in the ultrasonic scanning video can be obtained as an ultrasonic image. For example, a 100-frame ultrasonic scanning video can obtain 100 ultrasonic images, and the 100 ultrasonic images are sorted according to the scanning order of the ultrasonic scanning video. The target ultrasonic image may be all or part of the 100 ultrasonic images. For example, at the moment when the ultrasonic scanning video just starts scanning and the scanning is about to end, there may be a situation where the ultrasonic probe is unstable. Therefore, a part of the ultrasonic image located in the middle of the 100 ultrasonic images can be taken as the target ultrasonic image. In one embodiment of the present invention, the target ultrasonic image may be the 45th to 55th ultrasonic image of the 100 ultrasonic images.
[0033] Exemplarily, the processing device 120 can be used to identify the articular side bone area and the synovitis area from the target ultrasound image, and when the synovitis area is identified, determine the level information of the synovitis based on the positional relationship between the synovitis area and the articular side bone area, and the level information is used to indicate the severity of the synovitis; wherein the articular side bone area is the area where the bones are located on both sides of the target joint, and the synovitis area is the area produced by synovial hyperplasia or the area produced by synovial hyperplasia combined with effusion.
[0034] In one embodiment, the processing device 120 can use any type of semantic segmentation model, instance segmentation model and other network models to segment the various regions contained in the target ultrasound image to obtain the joint side bone region and the synovitis region in the target ultrasound image. Among them, the joint side bone region is the region where the bones on both sides of the target joint are located. The target ultrasound image may also include other regions, such as the region where the tendon is located, that is, the tendon region. The synovitis region is the region produced by synovial hyperplasia or the region produced by synovial hyperplasia combined with effusion. In an embodiment of the present invention, if the synovitis region is detected, it can be regarded that the subject has synovitis, and if the synovitis region is not detected, it can be regarded that the subject does not have synovitis. Whether the target ultrasound image contains a synovitis region is uncertain. Therefore, the target ultrasound image can be first identified to determine whether the synovitis region exists. For the target ultrasound image in which the synovitis region is identified, the level information of the synovitis can be determined based on the positional relationship between the synovitis region and the joint side bone region. The level information is used to indicate the severity of synovitis.
[0035] According to the ultrasound device of the embodiment of the present invention, the processing device identifies the joint side bone area and the synovitis area from the target ultrasound image, and when the synovitis area is identified, the level information of synovitis is determined based on the positional relationship between the synovitis area and the joint side bone area. This can reduce the workload of manually determining whether synovitis exists and determining the level information of synovitis when synovitis exists, and the information obtained about synovitis is also more accurate.
[0036] Exemplarily, the processing device can determine the level information of synovitis based on the positional relationship between the synovitis area and the joint-side bone area in the following manner, which may include: determining the bone top line corresponding to the joint-side bone area; determining the target vertex of the synovitis area; and determining the level information of synovitis based on the positional relationship between the bone top line and the target vertex.
[0037] In one embodiment, when the processing device "determines the level information of synovitis based on the positional relationship between the synovitis area and the articular side bone area", it can be implemented by the following operations. Based on the articular side bone area identified from the target ultrasound image, if the identified articular side bone area contains two articular side bone areas, for one of the articular side bone areas, the highest point of the articular side bone area can be determined as the bone vertex corresponding to the articular side bone area. Among them, the side of the articular side bone area close to the synovitis area can be used as the upper side, and the point at the top of the articular side bone area can be used as the highest point. Similarly, for the other articular side bone area, the bone vertex corresponding to the other articular side bone area can also be determined in the same way. Then the line between the two bone vertices is used as the bone top line corresponding to the articular side bone area. If the identified articular side bone area only contains one articular side bone area, the highest point of the area can be used as the bone vertex corresponding to the articular side bone area. Then a straight line is drawn through the bone vertex and in a direction perpendicular to the cross section of the target joint as the bone top line corresponding to the articular side bone area. Based on the synovitis areas identified from the target ultrasound image, if the number of identified synovitis areas is greater than or equal to 1, for each synovitis area, the highest point of the synovitis area can be determined as the vertex of the synovitis area. Among them, the side of the synovitis area away from the joint side bone area can be used as the upper side, and the top point of any synovitis area can be used as the highest point. According to the vertex of each synovitis area determined, the top vertex is used as the target vertex. If the number of identified synovitis areas is 1, the highest point of the area can be directly used as the target vertex of the synovitis area. Then, based on the positional relationship between the bone vertex line and the target vertex, the level information of synovitis can be determined.
[0038] According to the above technical solution, based on the positional relationship between the bone vertex line corresponding to the joint side bone area and the target vertex of the synovitis area, the level information of synovitis can be determined. This method does not require complex judgment criteria, so it has high accuracy and efficiency.
[0039] Exemplarily, the articular side bone region may include a first articular side bone region and a second articular side bone region respectively located on both sides of the target joint. The processing device is also used to identify a joint capsule region from the target ultrasound image, where the joint capsule region is located. The processing device determines the bone top line corresponding to the articular side bone region in the following manner: based on the two endpoints of the joint capsule region in the first direction, two truncation positions corresponding to the two endpoints are determined; based on the two truncation positions, the first articular side bone region and the second articular side bone region are truncated along the second direction to obtain a third articular side bone region and a fourth articular side bone region located on both sides of the target joint; based on the line between the vertices in the third articular side bone region in the second direction and the vertices in the fourth articular side bone region in the second direction, the bone top line is determined; wherein the first direction and the second direction are perpendicular, and the first direction is a direction perpendicular to the cross-section of the target joint.
[0040] Figure 2 FIG. 4 is a schematic diagram showing a target ultrasound image according to an embodiment of the present invention. Figure 2 As shown in the figure, the areas indicated by the two white arrows at the bottom are the joint side bone areas, which may include a first joint side bone area located on the left side of the target joint and a second joint side bone area located on the right side of the target joint. The processing device may also be used to identify the joint capsule area from the target ultrasound image. The joint capsule area is the area where the joint capsule is located. Figure 2 The arrows in the figure show the joint capsule area. Figure 2 The synovitis area is also shown by an arrow. The synovitis area may be contained in the joint capsule area. The way in which the processing device identifies the joint capsule area from the target ultrasound image is similar to the way in which the joint side bone area and the synovitis area are identified, and for the sake of brevity, it will not be repeated here. By way of example and not limitation, any two of the above-mentioned joint side bone area, synovitis area, and joint capsule area may be identified using the same image segmentation network, or may be identified using two different image segmentation networks.
[0041] The processing device determines the bone top line corresponding to the joint side bone region in the following manner: A direction perpendicular to the cross section of the target joint is used as a first direction. A direction perpendicular to the first direction is used as a second direction. Figure 2In the illustrated embodiment, the first direction is the horizontal direction, and the second direction is the vertical direction. Based on the two endpoints of the joint capsule area in the first direction, the first joint side bone area and the second joint side bone area are truncated along the second direction. Exemplarily, the two corresponding truncation positions can be determined based on the two endpoints of the joint capsule area in the first direction, and the first joint side bone area and the second joint side bone area are truncated from the truncation positions. Exemplarily, the distance difference between each of the two truncation positions and the position of the corresponding endpoint can be less than or equal to a preset distance threshold. The preset distance threshold can be set as needed, for example, the threshold can fall within the range of [0,3] mm. That is to say, a position can be taken from the area closer to the position where each endpoint is located as the corresponding truncation position. The following is an example of the truncation position being the position where the endpoint is located. Refer to Figure 2 The two endpoints of the joint capsule region in the first direction are endpoint G 1 and endpoint G 2 . Passing point G 1 and endpoint G 2 Draw two auxiliary lines (such as Figure 2 The third joint side bone region and the fourth joint side bone region located on both sides of the target joint can be obtained by cutting the first joint side bone region. The third joint side bone region is the region closer to the target joint of the two regions obtained by cutting the second joint side bone region. Similarly, the fourth joint side bone region is the region closer to the target joint of the two regions obtained by cutting the second joint side bone region. The vertex in the third joint side bone region in the second direction is C 1 The vertex in the second direction of the bone region on the fourth joint side is C 2 Based on vertex C 1 and vertex C 2 The connection between the two can determine the bone top connection (such as Figure 2 Midpoint C 1 and vertex C 2 white dashed line between them).
[0042] According to the above technical solution, based on the two endpoints of the joint capsule area in the first direction, the first joint side bone area and the second joint side bone area are truncated along the second direction, and the third side bone area and the fourth side bone area near the joint capsule area can be obtained. Since the bone itself may be curved, it may not be accurate to determine the bone top line by taking the vertices of the joint side bone area within a larger range. Therefore, after truncating the joint side bone area using the endpoints of the joint capsule area, the curvature of the bone part in the joint side bone area obtained by truncation will be relatively small, so the determined bone top line is more accurate. This helps to more accurately determine the condition of synovitis.
[0043] Exemplarily, the contour of the synovitis area includes an upper contour and a lower contour, and the dividing point between the upper contour and the lower contour is the two end points of the synovitis area in a first direction, the first direction is a direction perpendicular to the cross-section of the target joint, and the processing device determines the level information of the synovitis based on the positional relationship between the bone vertex line and the target vertex in the following manner, which may include: in the second direction, if the target vertex is below the bone vertex line, it is determined that the synovitis belongs to the first level; in the second direction, if the target vertex is on the bone vertex line or above the bone vertex line, the following determination operation is performed: determine the upper contour of the synovitis area, wherein the target vertex is the contour point at the highest point in the upper contour along the second direction; if the shape of the upper contour is a concave shape, it is determined that the synovitis belongs to the second level; if the shape of the upper contour is a convex shape, it is determined that the synovitis belongs to the third level; wherein the second direction is a direction parallel to the cross-section of the target joint, and the severity corresponding to the first level, the severity corresponding to the second level, and the severity corresponding to the third level increase in sequence.
[0044] In one embodiment, the processing device determines the level information of synovitis based on the positional relationship between the bone vertex line and the target vertex in the following manner. Figure 2 As shown, point H in the synovitis area is the target vertex. In the second direction, if the target vertex is below the bone vertex line ( Figure 2 In another embodiment, if the target vertex is located on the bone vertex line or above the bone vertex line (e.g. Figure 2 If the target vertex H shown in the figure is not found, the processing device can perform the following determination operation. Determine the upper contour of the synovitis area. The contour of the synovitis area may include an upper contour and a lower contour. For example, the contour of the synovitis area can be determined by the Hilbert method or local peak detection, spline fitting, etc. Among them, the upper contour of the synovitis area is the contour between the two endpoints of the synovitis area in the first direction and located in the upper half. For another example, each column of pixel points in the synovitis area located in the second direction can be traversed along the first direction, and the first pixel point in each column of pixel points located in the second direction obtained by the traversal can be used as the contour point of the upper contour of the synovitis area. The upper contour of the synovitis area can be obtained by connecting the contour points of each upper contour. Among them, the target vertex is the contour point in the upper contour that is located at the highest point along the second direction, such as Figure 2Point H shown. According to the morphology of the upper contour of the synovitis area obtained, if the morphology of the upper contour is a concave morphology, it can be determined that the synovitis belongs to the second level. In another embodiment, if the morphology of the upper contour is a convex morphology, it can be determined that the synovitis belongs to the third level. The severity corresponding to the first level, the severity corresponding to the second level, and the severity corresponding to the second level increase in sequence. That is, the severity corresponding to the third level>the severity corresponding to the second level>the severity corresponding to the first level. Exemplarily, any suitable function can be used to perform function fitting on the upper contour, such as performing quadratic function curve fitting. According to the fitting result, it is determined whether the morphology of the upper contour belongs to a concave morphology or a convex morphology. The higher the level, the greater the severity of the synovitis. If the first level indicates that the severity of the synovitis is mild, then the second level indicates that the severity of the synovitis is relatively serious.
[0045] According to the above technical solution, in the second direction, if the target vertex is below the bone vertex line, it can be determined that the synovitis belongs to the first level. If the target vertex is on the bone vertex line or above the bone vertex line, a determination operation can be performed: according to the shape of the upper contour of the synovitis area, it can be determined whether the synovitis area belongs to the second level or the third level. This method can quickly and accurately determine the severity of synovitis, and divide the severity of synovitis into three levels, which is convenient for selecting different solutions for different levels of synovitis.
[0046] Of course, the above-mentioned grading method of synovitis and the number of grading levels are examples rather than limitations of the present invention, and they can be changed as needed.
[0047] Exemplarily, the processing device determines the upper contour of the synovitis area in the following manner: traversing each column of pixel points in the synovitis area located in the second direction along the first direction, and during the traversal process, taking the line formed by the first pixel point in each column of pixel points located in the second direction obtained by the traversal as the upper contour.
[0048] As described above, the first direction (eg Figure 2 The synovitis area is traversed in the vertical direction of the second direction. During the traversal process, the first pixel point in each column of pixel points located in the second direction is obtained as a contour point. Then, the line connecting these points is used as the upper contour.
[0049] According to the above technical solution, the upper contour is obtained by traversing the pixel points of the synovitis area in the second direction along the first direction. The upper contour obtained by this method is relatively accurate and efficient, which can further ensure the accuracy and efficiency of determining the target vertex based on the upper contour.
[0050] Exemplarily, the processing device identifies the joint side bone region and the synovitis region from the target ultrasound image in the following manner: using an image segmentation network to segment the target ultrasound image to identify the joint side bone region and the synovitis region from the target ultrasound image.
[0051] In one embodiment, the target ultrasound image can be segmented using any image segmentation network such as Fully Convolutional Networks (FCN), U-Net, or Pyramid Scene Parseing Network (PSPNet). The joint side bone area and the synovitis area can be identified in the target ultrasound image after image segmentation. Of course, in the above-mentioned embodiment where the joint capsule area needs to be identified, the image segmentation network can be optionally used to identify the joint capsule area at the same time.
[0052] According to the above technical solution, the target ultrasound image is segmented using an image segmentation network to obtain the joint side bone area and the synovitis area. This method is relatively mature and can therefore ensure the efficiency and accuracy of identifying the joint side bone area and the synovitis area.
[0053] Exemplarily, the processing device identifies the joint capsule region from the target ultrasound image in the following manner: using an image segmentation network to segment the target ultrasound image to identify the joint capsule region from the target ultrasound image.
[0054] In one embodiment, an image segmentation network can be used to segment the target ultrasound image to identify the joint capsule region from the target ultrasound image. The image segmentation network has been described in detail in the previous embodiment, and for the sake of brevity, it will not be repeated here. The image segmentation network in this embodiment may be the same as or different from the image segmentation network in the previous embodiment, and the present invention is not limited to this.
[0055] According to the above technical solution, the target ultrasound image is segmented using an image segmentation network to obtain the joint capsule area. This method is relatively mature and can therefore ensure the efficiency and accuracy of identifying the joint capsule area.
[0056] Exemplarily, the ultrasound apparatus may further include a display device for outputting information on whether synovitis exists and outputting level information when synovitis exists.
[0057] In one embodiment, the ultrasound device may also include a display device. The display device may be used to output information about whether synovitis exists and output level information when it exists. For example, the display device may indicate the existence of synovitis by outputting characters such as "there is a synovitis area", or may indicate that the level information corresponding to the synovitis is the first level by outputting characters such as "first level". In another embodiment, the display device may indicate the existence of synovitis by highlighting the synovitis area, such as yellow highlighting, and if the display device does not contain a yellow highlighted area, it indicates that synovitis does not exist. In yet another embodiment, the character "A" may be output to indicate that the level information corresponding to the synovitis is the first level, and the character "B" may be output to indicate that the level information corresponding to the synovitis is the second level. It can be understood that the highlighted manner or characters in the embodiments of the present invention are merely exemplary, and may also be displayed in any manner such as graphics, and the present invention is not limited to this.
[0058] According to the above technical solution, through the display device, the user can quickly and accurately obtain information about whether synovitis exists or the level of synovitis.
[0059] According to another aspect of the present invention, a synovitis detection device is also provided. Figure 3 FIG. 3 is a schematic block diagram of a synovitis detection device 300 according to an embodiment of the present invention. Figure 3 As shown, the synovitis detection device 300 may include an acquisition module 310 , a first recognition module 320 and a determination module 330 .
[0060] The acquisition module 310 is used to acquire a target ultrasound image at a target joint.
[0061] The first recognition module 320 is used to recognize the joint side bone area and the synovitis area from the target ultrasound image.
[0062] The determination module 330 is used to determine the level information of the synovitis based on the positional relationship between the synovitis area and the articular side bone area when the synovitis area is identified, and the level information is used to indicate the severity of the synovitis; wherein the articular side bone area is the area where the bones are located on both sides of the target joint, and the synovitis area is the area produced by synovial hyperplasia or the area produced by synovial hyperplasia combined with effusion.
[0063] Exemplarily, the determination module 330 includes a first determination submodule, a second determination submodule, and a third determination submodule. The first determination submodule is used to determine the bone vertex line corresponding to the joint side bone region; the second determination submodule is used to determine the target vertex of the synovitis region; and the third determination submodule is used to determine the level information of synovitis based on the positional relationship between the bone vertex line and the target vertex.
[0064] Exemplarily, the joint side bone region includes a first joint side bone region and a second joint side bone region respectively located on both sides of the target joint, and the synovitis detection device 300 also includes a second identification module. The second identification module is used to identify the joint capsule region from the target ultrasound image, and the joint capsule region is the region where the joint capsule is located. The first determination submodule includes a first determination unit, a truncation unit, and a second determination unit, wherein the first determination unit is used to determine two truncation positions corresponding to the two endpoints in a first direction based on the two endpoints of the joint capsule region; the truncation unit is used to truncate the first joint side bone region and the second joint side bone region along the second direction based on the two truncation positions, and obtain the third joint side bone region and the fourth joint side bone region located on both sides of the target joint; the second determination unit is used to determine the bone top connection line based on the line between the vertices in the third joint side bone region in the second direction and the vertices in the fourth joint side bone region in the second direction; wherein the first direction and the second direction are perpendicular, and the first direction is a direction perpendicular to the cross section of the target joint.
[0065] Exemplarily, the contour of the synovitis area includes an upper contour and a lower contour, the dividing point between the upper contour and the lower contour is the two endpoints of the synovitis area in a first direction, the first direction is a direction perpendicular to the cross-section of the target joint, and the third determination submodule includes a third determination unit, a fourth determination unit, a fifth determination unit and a sixth determination unit. The third determination unit is used to determine that the synovitis belongs to the first level if the target vertex is located below the bone vertex line in the second direction; the fourth determination unit is used to determine the upper contour of the synovitis area if the target vertex is located on the bone vertex line or above the bone vertex line in the second direction, wherein the target vertex is the contour point located at the highest point in the upper contour along the second direction; the fifth determination unit is used to determine that the synovitis belongs to the second level if the target vertex is located on the bone vertex line or above the bone vertex line and the shape of the upper contour is concave in the second direction; the sixth determination unit is used to determine that the synovitis belongs to the third level if the target vertex is located on the bone vertex line or above the bone vertex line and the shape of the upper contour is convex in the second direction; wherein the second direction is a direction parallel to the cross-section of the target joint, and the severity corresponding to the first level, the severity corresponding to the second level and the severity corresponding to the third level increase in sequence.
[0066] Exemplarily, the fourth determination unit includes a traversal subunit, which is used to traverse each column of pixel points in the synovitis area located in the second direction along the first direction, and in the traversal process, use the line formed by the first pixel point in each column of pixel points located in the second direction obtained by the traversal as the upper contour.
[0067] Exemplarily, the first recognition module 320 includes a first segmentation submodule. The first segmentation submodule is used to segment the target ultrasound image using an image segmentation network to identify the joint side bone region and the synovitis region from the target ultrasound image.
[0068] Exemplarily, the second recognition module includes a second segmentation submodule. The second segmentation submodule is used to segment the target ultrasound image using an image segmentation network to identify the joint capsule region from the target ultrasound image.
[0069] Exemplarily, the synovitis detection device 300 further includes a display module, which is used to output information about whether synovitis exists and output level information when synovitis exists.
[0070] A person skilled in the art may understand the specific implementation scheme and beneficial effects of the above-mentioned synovitis detection device by reading the above-mentioned description of the ultrasonic device, and for the sake of brevity, they will not be described in detail here.
[0071] According to yet another aspect of the present invention, an electronic device is provided. Figure 4 FIG. 2 shows a schematic block diagram of an electronic device according to an embodiment of the present invention. Figure 4 As shown, the electronic device 400 includes a processor 410 and a memory 420, in which a computer program is stored. The computer program instructions are used by the processor 410 to execute the following when it is running: acquiring a target ultrasound image at a target joint; identifying an articular side bone region and a synovitis region from the target ultrasound image, and determining the level information of the synovitis based on the positional relationship between the synovitis region and the articular side bone region when the synovitis region is identified, wherein the articular side bone region is the region where the bones on both sides of the target joint are located, and the synovitis region is the region produced by synovial hyperplasia or the region produced by synovial hyperplasia combined with effusion.
[0072] Exemplarily, the steps of determining the level information of synovitis based on the positional relationship between the synovitis area and the articular side bone area executed by the computer program instructions when the processor 410 is running include: determining the bone top line corresponding to the articular side bone area; determining the target vertex of the synovitis area; and determining the level information of synovitis based on the positional relationship between the bone top line and the target vertex.
[0073] Exemplarily, the articular side bone region includes a first articular side bone region and a second articular side bone region respectively located on both sides of the target joint, and the computer program instructions are also used to execute when the processor 410 is running: identifying a joint capsule region from the target ultrasound image, the joint capsule region being the region where the joint capsule is located, and the steps of determining the bone top line corresponding to the articular side bone region executed when the computer program instructions are run by the processor 410 include: based on the two endpoints of the joint capsule region in the first direction, determining two truncation positions corresponding to the two endpoints one by one; based on the two truncation positions, truncating the first articular side bone region and the second articular side bone region along the second direction to obtain a third articular side bone region and a fourth articular side bone region located on both sides of the target joint; determining the bone top line based on the line between the vertices in the third articular side bone region in the second direction and the vertices in the fourth articular side bone region in the second direction; wherein the first direction and the second direction are perpendicular, and the first direction is a direction perpendicular to the cross-section of the target joint.
[0074] Exemplarily, the contour of the synovitis area includes an upper contour and a lower contour, the dividing point between the upper contour and the lower contour is the two end points of the synovitis area in a first direction, the first direction is a direction perpendicular to the cross-section of the target joint, and the computer program instructions are used by the processor 410 to execute the steps of determining the level information of synovitis based on the positional relationship between the bone vertex line and the target vertex when the processor 410 is running, including: in the second direction, if the target vertex is below the bone vertex line, it is determined that the synovitis belongs to the first level; in the second direction, if the target vertex is on the bone vertex line or above the bone vertex line, the following determination operation is performed: determine the upper contour of the synovitis area, wherein the target vertex is the contour point at the highest point in the upper contour along the second direction; if the shape of the upper contour is a concave shape, it is determined that the synovitis belongs to the second level; if the shape of the upper contour is a convex shape, it is determined that the synovitis belongs to the third level; wherein the second direction is a direction parallel to the cross-section of the target joint, and the severity corresponding to the first level, the severity corresponding to the second level, and the severity corresponding to the third level increase in sequence.
[0075] Exemplarily, the steps of determining the upper contour of the synovitis area executed by the processor 410 when the computer program instructions are executed include: traversing each column of pixel points in the synovitis area located in the second direction along the first direction, and during the traversal process, taking the line formed by the first pixel point in each column of pixel points located in the second direction obtained by the traversal as the upper contour.
[0076] Exemplarily, the steps of identifying the articular side bone region and the synovitis region from the target ultrasound image executed by the computer program instructions when the processor 410 is running include: using an image segmentation network to segment the target ultrasound image to identify the articular side bone region and the synovitis region from the target ultrasound image.
[0077] Exemplarily, the step of identifying the joint capsule region from the target ultrasound image performed by the processor 410 when the computer program instructions are executed includes: using an image segmentation network to segment the target ultrasound image to identify the joint capsule region from the target ultrasound image.
[0078] According to another aspect of the present invention, a storage medium is also provided, storing a computer program / instruction, and the storage medium may include, for example, a storage component of a tablet computer, a hard disk of a personal computer, an erasable programmable read-only memory (EPROM), a portable read-only memory (CD-ROM), a USB memory, or any combination of the above storage media. The storage medium may be any combination of one or more computer-readable storage media. The computer program / instruction is used by the processor to perform the following operations when running: acquiring a target ultrasound image at a target joint; identifying a joint side bone region and a synovitis region from the target ultrasound image, and determining the level information of synovitis based on the positional relationship between the synovitis region and the joint side bone region when the synovitis region is identified, and the level information is used to indicate the severity of synovitis; wherein the joint side bone region is the region where the bones on both sides of the target joint are located, and the synovitis region is the region produced by synovial hyperplasia or the region produced by synovial hyperplasia combined with effusion.
[0079] Exemplarily, the steps for determining the level information of synovitis based on the positional relationship between the synovitis area and the articular side bone area executed by the computer program / instructions at runtime include: determining the bone top line corresponding to the articular side bone area; determining the target vertex of the synovitis area; and determining the level information of synovitis based on the positional relationship between the bone top line and the target vertex.
[0080] Exemplarily, the articular side bone region includes a first articular side bone region and a second articular side bone region respectively located on both sides of the target joint, and the computer program / instructions are also used to execute when running: identifying a joint capsule region from a target ultrasound image, the joint capsule region being the region where the joint capsule is located, and the steps of determining the bone top line corresponding to the articular side bone region executed by the computer program / instructions when running include: based on the two endpoints of the joint capsule region in a first direction, determining two truncation positions corresponding to the two endpoints one by one; based on the two truncation positions, truncating the first articular side bone region and the second articular side bone region along the second direction to obtain a third articular side bone region and a fourth articular side bone region located on both sides of the target joint; determining the bone top line based on the line between the vertices in the third articular side bone region in the second direction and the vertices in the fourth articular side bone region in the second direction; wherein the first direction and the second direction are perpendicular, and the first direction is a direction perpendicular to the cross-section of the target joint.
[0081] Exemplarily, the contour of the synovitis area includes an upper contour and a lower contour, the dividing point between the upper contour and the lower contour is the two end points of the synovitis area in a first direction, the first direction is a direction perpendicular to the cross-section of the target joint, and the steps for determining the level information of synovitis based on the positional relationship between the bone vertex line and the target vertex that the computer program / instructions are used to execute at runtime include: in the second direction, if the target vertex is below the bone vertex line, it is determined that the synovitis belongs to the first level; in the second direction, if the target vertex is on the bone vertex line or above the bone vertex line, the following determination operation is performed: determine the upper contour of the synovitis area, wherein the target vertex is the contour point at the highest point in the upper contour along the second direction; if the shape of the upper contour is a concave shape, it is determined that the synovitis belongs to the second level; if the shape of the upper contour is a convex shape, it is determined that the synovitis belongs to the third level; wherein the second direction is a direction parallel to the cross-section of the target joint, and the severity corresponding to the first level, the severity corresponding to the second level, and the severity corresponding to the third level increase in sequence.
[0082] Exemplarily, the steps for determining the upper contour of the synovitis area executed by the computer program / instructions when running include: traversing each column of pixel points in the synovitis area located in the second direction along the first direction, and during the traversal process, using the line formed by the first pixel point in each column of pixel points located in the second direction obtained by the traversal as the upper contour.
[0083] Exemplarily, the steps of identifying the articular side bone region and the synovitis region from the target ultrasound image executed by the computer program / instructions during runtime include: using an image segmentation network to segment the target ultrasound image to identify the articular side bone region and the synovitis region from the target ultrasound image.
[0084] Exemplarily, the step of identifying the joint capsule region from the target ultrasound image performed by the computer program / instructions when running includes: using an image segmentation network to segment the target ultrasound image to identify the joint capsule region from the target ultrasound image.
[0085] A person skilled in the art may understand the specific implementation scheme of the above electronic device and storage medium by reading the above description of the ultrasonic device, which will not be described here for the sake of brevity.
[0086] It should be noted that the present invention is not limited to the implementation method of the corresponding directions in the embodiment. Specifically, the present invention relates to direction words such as "up" and "down", and these directions can be based on the directions displayed on the display screen of the ultrasound device, for example, Figure 2Or the orientation of the approximate image. In this orientation, the skin surface is located above and the joint area is located below the skin surface. If the orientation of the ultrasound image changes, the orientation in the scheme also needs to be adjusted accordingly. It is understandable that various adaptive adjustments should not be considered beyond the scope of the present invention.
[0087] Although example embodiments have been described herein with reference to the accompanying drawings, it should be understood that the above example embodiments are merely exemplary and are not intended to limit the scope of the present invention thereto. Various changes and modifications may be made therein by one of ordinary skill in the art without departing from the scope and spirit of the present invention. All such changes and modifications are intended to be included within the scope of the present invention as required by the appended claims.
[0088] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.
[0089] In the several embodiments provided by the present invention, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed.
[0090] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.
[0091] Similarly, it should be understood that in order to streamline the present invention and help understand one or more of the various inventive aspects, in the description of the exemplary embodiments of the present invention, the various features of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. However, the method of the present invention should not be interpreted as reflecting the following intention: the claimed invention requires more features than the features explicitly stated in each claim. More specifically, as reflected in the corresponding claims, the inventive point is that the corresponding technical problem can be solved with less than all the features of a single disclosed embodiment. Therefore, the claims following the specific embodiment are hereby expressly incorporated into the specific embodiment, wherein each claim itself serves as a separate embodiment of the present invention.
[0092] It will be understood by those skilled in the art that, except for mutually exclusive features, all features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed in this specification may be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature that provides the same, equivalent or similar purpose.
[0093] In addition, those skilled in the art will appreciate that, although some embodiments described herein include certain features included in other embodiments but not other features, the combination of features of different embodiments is meant to be within the scope of the present invention and form different embodiments. For example, in the claims, any one of the claimed embodiments may be used in any combination.
[0094] The various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all of the functions of some modules in an ultrasound device or a synovitis identification device according to an embodiment of the present invention. The present invention may also be implemented as a device program (e.g., a computer program and a computer program product) for executing part or all of the methods described herein. Such a program for implementing the present invention may be stored on a computer-readable medium, or may be in the form of one or more signals. Such a signal may be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.
[0095] It should be noted that the above embodiments illustrate the present invention rather than limit it, and that those skilled in the art may devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbol between brackets shall not be construed as a limitation on the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "one" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present invention may be implemented by means of hardware comprising a number of different elements and by means of a suitably programmed computer. In a unit claim enumerating a number of devices, several of these devices may be embodied by the same hardware item. The use of the words first, second, and third, etc., does not indicate any order. These words may be interpreted as names.
[0096] The above is only a specific embodiment of the present invention or an explanation of a specific embodiment. The protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. The protection scope of the present invention shall be based on the protection scope of the claims.
Claims
1. An ultrasonic device, characterized in that: include: Ultrasonic probe and processing device, wherein The ultrasonic probe is used to collect a target ultrasonic image at a target joint; The processing device is used to identify the joint side bone area and the synovitis area from the target ultrasound image, and when the synovitis area is identified, determine the level information of the synovitis based on the positional relationship between the synovitis area and the joint side bone area, wherein the level information is used to indicate the severity of the synovitis; The articular bone region is the region where the bones on both sides of the target joint are located, and the synovitis region is the region produced by synovial hyperplasia or the region produced by synovial hyperplasia combined with effusion.
2. The ultrasonic device according to claim 1, characterized in that The processing device determines the level information of the synovitis based on the positional relationship between the synovitis area and the joint side bone area in the following manner, including: Determine a bone top connecting line corresponding to the joint side bone region; determining a target vertex of the synovitis area; Based on the positional relationship between the bone vertex line and the target vertex, the level information of the synovitis is determined.
3. The ultrasonic device according to claim 2, characterized in that The joint side bone region includes a first joint side bone region and a second joint side bone region respectively located on both sides of the target joint, The processing device is further used to identify a joint capsule region from the target ultrasound image, wherein the joint capsule region is a region where the joint capsule is located. The processing device determines the bone top connection line corresponding to the joint side bone area in the following manner: Based on two endpoints of the joint capsule region in the first direction, determining two truncation positions corresponding to the two endpoints one by one; Based on the two truncation positions, the first joint side bone region and the second joint side bone region are truncated along a second direction to obtain a third joint side bone region and a fourth joint side bone region located on both sides of the target joint; Determining the bone top connection line based on a connection line between vertices in the third joint side bone region in the second direction and vertices in the fourth joint side bone region in the second direction; The first direction is perpendicular to the second direction, and the first direction is a direction perpendicular to a cross section of the target joint.
4. The ultrasonic device according to claim 2, characterized in that The contour of the synovitis area includes an upper contour and a lower contour, the dividing point between the upper contour and the lower contour is two end points of the synovitis area in a first direction, the first direction is a direction perpendicular to the cross section of the target joint, and the processing device determines the level information of the synovitis based on the positional relationship between the bone top line and the target vertex in the following manner, including: In the second direction, if the target vertex is located below the bone vertex connection line, it is determined that the synovitis belongs to the first level; In the second direction, if the target vertex is located on or above the bone vertex connection line, the following determination operation is performed: Determine the upper contour of the synovitis area, wherein the target vertex is a contour point located at the highest point in the upper contour along the second direction; If the shape of the upper contour is a concave shape, it is determined that the synovitis belongs to the second level; If the upper contour is convex, it is determined that the synovitis belongs to the third level; The second direction is a direction parallel to the cross section of the target joint, and the severity corresponding to the first level, the severity corresponding to the second level, and the severity corresponding to the third level increase in sequence.
5. The ultrasonic device according to claim 4, characterized in that The processing device determines the upper contour of the synovitis area by: Each column of pixel points in the synovitis area located in the second direction is traversed along the first direction. During the traversal process, a line formed by the first pixel point in each column of pixel points located in the second direction obtained through the traversal is used as the upper contour.
6. The ultrasonic device according to any one of claims 1 to 5, characterized in that: The processing device identifies the joint side bone area and the synovitis area from the target ultrasound image in the following manner: The target ultrasound image is segmented using an image segmentation network to identify the joint side bone area and the synovitis area from the target ultrasound image.
7. The ultrasonic device according to claim 6 as referred to claim 3, characterized in that The processing device identifies the joint capsule region from the target ultrasound image in the following manner: The target ultrasound image is segmented using the image segmentation network to identify the joint capsule region from the target ultrasound image.
8. The ultrasonic device according to any one of claims 1 to 5, characterized in that: The ultrasound device also includes a display device, The display device is used to output information about whether the synovitis exists and output the level information when the synovitis exists.
9. A synovitis detection device, characterized in that: include: An acquisition module, used for acquiring a target ultrasonic image at a target joint; A first recognition module is used to recognize the joint side bone area and the synovitis area from the target ultrasound image; a determination module, configured to determine level information of the synovitis based on the positional relationship between the synovitis area and the joint side bone area when the synovitis area is identified, wherein the level information is used to indicate the severity of the synovitis; The articular bone region is the region where the bones on both sides of the target joint are located, and the synovitis region is the region produced by synovial hyperplasia or the region produced by synovial hyperplasia combined with effusion.
10. The synovitis detection device according to claim 9, characterized in that: The determination module includes a first determination submodule, a second determination submodule and a third determination submodule. A first determination submodule is used to determine a bone top connection line corresponding to the joint side bone region; A second determination submodule is used to determine a target vertex of the synovitis area; The third determination submodule is used to determine the level information of the synovitis based on the positional relationship between the bone vertex line and the target vertex.
11. The synovitis detection device according to claim 10, characterized in that: The joint side bone region includes a first joint side bone region and a second joint side bone region respectively located on both sides of the target joint, and the synovitis detection device also includes a second identification module, The second recognition module is used to recognize a joint capsule region from the target ultrasound image, where the joint capsule region is a region where the joint capsule is located; The first determining submodule includes a first determining unit, a truncation unit, and a second determining unit, wherein: The first determining unit is used to determine two truncation positions corresponding to the two endpoints in a one-to-one manner based on the two endpoints of the joint capsule region in the first direction; The truncation unit is used to truncate the first joint side bone region and the second joint side bone region along the second direction based on the two truncation positions to obtain a third joint side bone region and a fourth joint side bone region located on both sides of the target joint; The second determining unit is used to determine the bone vertex connection line based on a connection line between vertices in the third joint side bone region in the second direction and vertices in the fourth joint side bone region in the second direction; The first direction is perpendicular to the second direction, and the first direction is a direction perpendicular to a cross section of the target joint.
12. The synovitis detection device according to claim 10, characterized in that: The contour of the synovitis area includes an upper contour and a lower contour, the dividing point of the upper contour and the lower contour is two end points of the synovitis area in a first direction, the first direction is a direction perpendicular to the cross section of the target joint, the third determining submodule includes a third determining unit, a fourth determining unit, a fifth determining unit and a sixth determining unit, The third determination unit is configured to determine that the synovitis belongs to the first level if the target vertex is located below the bone vertex line in the second direction; The fourth determining unit is used to determine the upper contour of the synovitis area if the target vertex is located on the bone vertex line or above the bone vertex line in the second direction, wherein the target vertex is a contour point located at the highest point in the upper contour along the second direction; The fifth determining unit is configured to determine that the synovitis belongs to the second level if, in the second direction, the target vertex is located on or above the bone vertex connection line, and the shape of the upper contour is a concave shape; The sixth determination unit is configured to determine that the synovitis belongs to the third level if, in the second direction, the target vertex is located on or above the bone vertex connection line, and the shape of the upper contour is a convex shape; The second direction is a direction parallel to the cross section of the target joint, and the severity corresponding to the first level, the severity corresponding to the second level, and the severity corresponding to the third level increase in sequence.
13. The synovitis detection device according to claim 12, characterized in that: The fourth determining unit includes a traversal subunit, The traversal subunit is used to traverse each column of pixel points in the synovitis area located in the second direction along the first direction. During the traversal process, the line formed by the first pixel point in each column of pixel points located in the second direction obtained through the traversal is used as the upper contour.
14. An electronic device, characterized in that: The invention comprises a processor and a memory, wherein a computer program is stored in the memory, and the computer program instructions are used by the processor to execute: acquiring a target ultrasound image at a target joint; Identifying a joint side bone region and a synovitis region from the target ultrasound image, and when the synovitis region is identified, determining level information of the synovitis based on a positional relationship between the synovitis region and the joint side bone region, wherein the level information is used to indicate the severity of the synovitis; The articular bone region is the region where the bones on both sides of the target joint are located, and the synovitis region is the region produced by synovial hyperplasia or the region produced by synovial hyperplasia combined with effusion.
15. A storage medium, characterized in that: A computer program / instruction is stored, which when executed is used to perform the following operations: acquiring a target ultrasound image at a target joint; Identifying a joint side bone region and a synovitis region from the target ultrasound image, and when the synovitis region is identified, determining level information of the synovitis based on a positional relationship between the synovitis region and the joint side bone region, wherein the level information is used to indicate the severity of the synovitis; The articular bone region is the region where the bones on both sides of the target joint are located, and the synovitis region is the region produced by synovial hyperplasia or the region produced by synovial hyperplasia combined with effusion.