Temporal joint observation method and system

Abstract

The embodiment of the invention provides a temporal joint observation method and system, and relates to the technical field of medical imaging, and the temporal joint observation method specifically comprises the steps: obtaining a to-be-detected scanning image, and obtaining a segmentation diagram corresponding to a target jaw bone according to the to-be-detected scanning image; the minimum bounding box of the mandibular condyle process in the target jaw bone is determined according to the segmentation schematic diagram, a target jaw joint reference line is constructed through the minimum bounding box and a preset coordinate system, the temporal joint is observed through the target jaw joint reference line, and the plane where the target jaw joint reference line is located is perpendicular to the plane where the temporal joint is located. Based on this, according to the observation method provided by the invention, the new observation plane is generated based on the minimum bounding box of the inferior zygopophysis, so that the observation plane is more perpendicular to the area needing to be observed, the limitation of the shooting body position of a patient in the prior art is overcome, the cross curve of the temporal joint is automatically generated, and the formed section is more beneficial to observation of the condition of the temporal joint; and meanwhile, the manual operation time is shortened.

Description

Technical Field

[0001] The present invention relates to the field of medical imaging technology, and in particular to a temporal joint observation method and system. Background Art

[0002] In the existing technology, temporal joint reference lines are often used to quantify the TMJ area in cone beam computed tomography (CBCT), thereby helping doctors to more accurately evaluate the anatomical structure and pathological conditions of the area.

[0003] Typically, temporal joint reference lines are generated manually. This involves the user selecting key points in the image and then automatically fitting them using an algorithm. Specifically, the user adjusts the CBCT data to a specific layer, uses the TMJ mode to determine the positions of the left and right temporal joints, and draws two crosshairs to generate two sections perpendicular to the crosshairs. However, this manual drawing method results in vertical cropping. When obtaining the observation section, if the patient's imaging position is unbalanced left to right or front to back, the user will not be able to fully observe the temporal joint. Summary of the Invention

[0004] In view of this, the purpose of the present invention is to provide a temporal joint observation method and system that can overcome the limitations of the patient's shooting position in the prior art, automatically generate temporal joint cross lines, make the formed section more conducive to observing the condition of the temporal joint, and at the same time improve the time of manual operation.

[0005] In order to achieve the above objectives, the technical solutions adopted in the embodiments of the present invention are as follows:

[0006] In a first aspect, the present invention provides a temporal joint observation method, the temporal joint observation method comprising:

[0007] Acquire a scanned image to be tested, and obtain a segmentation diagram corresponding to the target jaw based on the scanned image to be tested; wherein the scanned image to be tested includes oral CBCT data corresponding to a preset coordinate system;

[0008] Determine the minimum bounding box of the mandibular condyle in the target jaw according to the segmentation diagram;

[0009] A target jaw joint reference line is constructed based on the minimum bounding box and the preset coordinate system, so as to observe the temporal joint through the target jaw joint reference line;

[0010] The plane where the target jaw joint reference line is located is perpendicular to the plane where the temporal joint is located.

[0011] Optionally, the step of constructing a target jaw joint reference line based on the minimum bounding box and the preset coordinate system includes:

[0012] The target plane is selected in the minimum bounding box according to the preset coordinate system, and the target plane is perpendicular to the plane where the temporal joint is located;

[0013] An observation coordinate system is constructed based on the target plane to generate the target jaw joint reference line.

[0014] Optionally, the step of screening the target plane in the minimum bounding box according to the preset coordinate system includes:

[0015] A plane whose intersection angle between the minimum bounding box and the vertical axis in the preset coordinate system is less than a first preset value is selected as the target plane.

[0016] Optionally, the step of constructing an observation coordinate system based on the target plane and generating a target jaw joint reference line includes:

[0017] For any target plane, determine the value of any point on the current target plane on the vertical axis of the preset coordinate system;

[0018] The plane corresponding to the maximum value is taken as the final target plane, and the vertices in the minimum bounding box that pass through the final target plane are selected as target vertices;

[0019] Construct a geometric bounding box based on the target vertices;

[0020] The cross line formed by the lines connecting the center points of the opposite sides of the geometric bounding box is used as the target jaw joint reference line;

[0021] The observation coordinate system is obtained by taking the midpoint of the geometric bounding box as the origin, the target jaw joint reference line as the section of the observation axis, and the normal vector of the target plane as the extension direction of the section.

[0022] Optionally, the calculation expression for the intersection angle between the minimum bounding box and the plane where the longitudinal axis in the preset coordinate system is located satisfies:

[0023]

[0024] Where cosθ is the intersection angle; A, B, and C are the components of the normal vector on any plane on the horizontal axis, vertical axis, and vertical axis in the preset coordinate system, respectively.

[0025] Optionally, the step of determining the minimum bounding box of the mandibular condyle in the target jaw according to the segmentation schematic diagram includes:

[0026] Obtain the bounding box of the mandible and segment the mandible diagram of the target mandible along the vertical axis of the preset coordinate system;

[0027] According to the mandibular schematic diagram, a left mandibular schematic diagram and a right mandibular schematic diagram are obtained, and the mandibular condyle close to the occipital region in the mandibular schematic diagram is determined;

[0028] The minimum bounding box of the mandibular condyle is constructed based on the connected domain of the mandibular condyle.

[0029] Optionally, the step of obtaining a left mandibular schematic diagram and a right mandibular schematic diagram based on the mandibular schematic diagram, and determining the mandibular condyle close to the occipital region in the mandibular schematic diagram includes:

[0030] A deep learning method is used to determine the connected domains in the mandibular diagram, and based on the connected domains, the mandibular diagram is divided into a left mandibular diagram and a right mandibular diagram;

[0031] Based on the preset coordinate system, the connected domains corresponding to the vertical axis coordinate values less than the second preset value are screened to obtain the mandibular condyle close to the occipital bone in the mandibular schematic diagram.

[0032] Optionally, the step of constructing a minimum bounding box of the mandibular condyle based on the connected domain of the mandibular condyle includes:

[0033] Obtain all coordinates of the connected domain corresponding to the mandibular condyle, and calculate the covariance matrix corresponding to the mandibular condyle based on the coordinates;

[0034] Determine the rotation matrix corresponding to the minimum bounding box based on the covariance matrix;

[0035] The coordinates of each vertex of the connected domain of the mandibular condyle in a preset coordinate system are determined based on the rotation matrix to generate a minimum bounding box of the mandibular condyle.

[0036] Optionally, the step of determining a rotation matrix corresponding to the minimum bounding box according to the covariance matrix includes:

[0037] Calculate the eigenvalues of the covariance matrix and use them to construct the rotation matrix. The calculation formula of the rotation matrix is expressed as:

[0038] R = [v1v2v3];

[0039] Among them, R is the rotation matrix; ν1 is the column vector corresponding to the first eigenvalue; ν2 is the column vector corresponding to the second eigenvalue; ν3 is the column vector corresponding to the third eigenvalue.

[0040] In a second aspect, the present invention further provides a temporal joint observation system, comprising:

[0041] An acquisition module is used to acquire a scanned image to be tested and obtain a segmentation diagram corresponding to the target jaw based on the scanned image to be tested; wherein the scanned image to be tested includes oral CBCT data corresponding to a preset coordinate system;

[0042] A minimum bounding box determination module determines the minimum bounding box of the mandibular condyle in the target jaw according to the segmentation diagram;

[0043] The target jaw joint reference line generation module constructs the target jaw joint reference line based on the minimum bounding box and the preset coordinate system, so as to observe the temporal joint through the target jaw joint reference line;

[0044] The plane where the target jaw joint reference line is located is perpendicular to the plane where the temporal joint is located.

[0045] The temporal joint observation method and system provided by the embodiments of the present invention have the following beneficial effects:

[0046] The present invention provides a temporal joint observation method, which obtains a scanned image to be tested and obtains a segmentation schematic diagram corresponding to the target jaw based on the scanned image to be tested; then, the minimum bounding box of the mandibular condyle in the target jaw is determined based on the segmentation schematic diagram, and then the target mandibular joint reference line is constructed using the minimum bounding box and a preset coordinate system, and then the temporal joint is observed through the target mandibular joint reference line, wherein the plane where the target mandibular joint reference line is located is perpendicular to the plane where the temporal joint is located. Based on this, the observation method provided by the present invention generates a new observation plane based on the minimum bounding box of the mandibular condyle, so that the observation plane is more perpendicular to the area to be observed, with fewer non-focus areas and better observation effects.

[0047] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments. It should be understood that the following drawings only illustrate certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other relevant drawings can be obtained based on these drawings without paying any creative work.

[0049] Figure 1 A flowchart showing the steps of a temporal joint observation method provided by an embodiment of the present invention is shown;

[0050] Figure 2 A step-by-step flow chart of step 200 provided in an embodiment of the present invention is shown;

[0051] Figure 3 A step-by-step flow chart of step 203 provided in an embodiment of the present invention is shown;

[0052] Figure 4 A step-by-step flow chart of step 300 provided in an embodiment of the present invention is shown;

[0053] Figure 5 A step-by-step flow chart of step 302 provided in an embodiment of the present invention is shown;

[0054] Figure 6 A schematic diagram of an observation coordinate system in an embodiment of the present invention is shown;

[0055] Figure 7 shows a schematic cross-sectional view of an object to be observed in an embodiment of the present invention;

[0056] Figure 8 A schematic structural diagram of a temporal joint observation system according to an embodiment of the present invention is shown;

[0057] Figure 9 A schematic diagram of the structure of a server in an embodiment of the present invention is shown.

[0058] Icons: 10-temporal joint observation system; 11-acquisition module; 12-minimum bounding box determination module; 13-target jaw joint reference line generation module; 20-server; 21-memory; 22-processor; 23-communication module. DETAILED DESCRIPTION

[0059] The following will be combined with the accompanying drawings to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Generally, the components of the embodiments of the present invention described and shown in the drawings herein can be arranged and designed in various different configurations.

[0060] Therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the invention as claimed, but is merely intended to represent selected embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0061] It should be noted that relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus comprising the element.

[0062] As described in the background technology, most existing technologies use manually drawn reference lines to observe the condition of the temporal joint. This method is not only inefficient, but also because the manually drawn reference lines are mostly based on the Z plane to form an observation profile, which is limited by the patient's shooting position, resulting in the inability to fully observe the temporal joint.

[0063] Based on this, a temporal joint observation scheme is provided to overcome the above technical problems.

[0064] Please refer to Figure 1 , Figure 1 A flowchart of the steps of a temporal joint observation method provided by an embodiment of the present invention is shown; the temporal joint observation method includes steps 100 to 300.

[0065] Step 100: Acquire a scanned image to be tested, and obtain a segmentation diagram corresponding to the target jaw based on the scanned image to be tested.

[0066] The scanned image to be measured includes oral CBCT data corresponding to a preset coordinate system.

[0067] Step 200: Determine the minimum bounding box of the mandibular condyle in the target jaw according to the segmentation diagram.

[0068] Step 300: construct a target jaw joint reference line based on the minimum bounding box and the preset coordinate system to observe the temporal joint through the target jaw joint reference line.

[0069] The plane where the target jaw joint reference line is located is perpendicular to the plane where the temporal joint is located.

[0070] This embodiment obtains a scanned image to be tested, and obtains a segmentation schematic diagram corresponding to the target jaw based on the scanned image to be tested; then, the minimum bounding box of the mandibular condyle in the target jaw is determined based on the segmentation schematic diagram, and then the target jaw joint reference line is constructed using the minimum bounding box and a preset coordinate system, and then the temporal joint is observed through the target jaw joint reference line, wherein the plane where the target jaw joint reference line is located is perpendicular to the plane where the temporal joint is located. Based on this, the present invention uses the minimum bounding box of the mandibular condyle to generate a new observation plane, so that the observation plane is more perpendicular to the area to be observed, so as to overcome the limitations of the patient's shooting position in the prior art, automatically generate a temporal joint cross line, and make the formed section more conducive to observing the condition of the temporal joint, while reducing the time of manual operation.

[0071] In one possible implementation, step 100 in this embodiment is specifically as follows:

[0072] Oral CBCT data is used as the scanned image to be tested. The oral CBCT data includes point cloud data corresponding to a preset coordinate system. Then, conventional AI segmentation models, such as nnunet, vnet and other models, are used to segment the above-mentioned oral CBCT data to obtain the segmentation results of the maxilla and mandible.

[0073] In order to make the formed cross section more conducive to observing the temporal joint, this embodiment can use the mandible as the target mandible, and then construct a new observation plane based on the inferior articular process of the corresponding area of the mandible.

[0074] In one possible implementation, Figure 1 Based on the reference Figure 2 , Figure 2 A flowchart of step 200 in an embodiment of the present invention is shown; step 200 of determining the minimum bounding box of the mandibular condyle in the target jaw in this embodiment includes steps 201 to 203.

[0075] Step 201: Obtain the bounding box of the mandible, and segment the mandible schematic diagram in the target mandible along the vertical axis direction in the preset coordinate system.

[0076] Step 202: Segment the mandibular schematic diagram to obtain a left mandibular schematic diagram and a right mandibular schematic diagram, and determine the mandibular condyle close to the back of the head in the mandibular schematic diagram.

[0077] Step 203: construct a minimum bounding box of the mandibular condyle based on the connected domain of the mandibular condyle.

[0078] In this embodiment, a segmentation map corresponding to a preset area in the z-axis direction close to the maxillary bone can be obtained based on a preset coordinate system corresponding to the oral CBCT data. For example, an area approximately 1.2 cm in the z-axis direction close to the maxillary bone can be obtained. The selection of this preset area can be based on user settings. At this time, a schematic diagram of the mandible divided into two areas can be obtained, for example, a schematic diagram of the left mandible and a schematic diagram of the right mandible.

[0079] Subsequently, the connected domain corresponding to the above-mentioned mandibular schematic diagram can be obtained based on a deep learning algorithm, for example, the scipy.ndimage.label or skimage.measure.label algorithm, and then the left and right mandibules can be separated based on the connected domain. Then, based on the preset coordinate system, the connected domain corresponding to the vertical axis coordinate value less than the second preset value is filtered to obtain the mandibular condyle close to the back of the brain in the mandibular schematic diagram. For example, based on the preset coordinate system, the connected domain with a smaller Y coordinate corresponding value is filtered out to obtain the mandibular condyle close to the back of the brain.

[0080] Please Figure 2 Based on the reference Figure 3 , Figure 3The flowchart of step 203 in the embodiment of the present invention is shown; the step of constructing the minimum bounding box of the mandibular condyle based on the connected domain of the mandibular condyle includes steps 2031 to 2033.

[0081] Step 2031: Obtain all coordinates of the connected domain corresponding to the mandibular condyle, and calculate the covariance matrix corresponding to the mandibular condyle based on the coordinates.

[0082] Step 2032: Determine the rotation matrix corresponding to the minimum bounding box based on the covariance matrix;

[0083] Step 2033: Determine the coordinates of each vertex of the connected domain of the mandibular condyle in the preset coordinate system based on the rotation matrix to generate a minimum bounding box of the mandibular condyle.

[0084] In this embodiment, the minimum bounding box is used to represent the smallest cuboid in three-dimensional space that can completely contain a given object (such as a point set, polygon, curve, etc.). It should be noted that the minimum bounding box described in this embodiment is not necessarily parallel to the coordinate axes and can be rotated at any angle to minimize its volume.

[0085] In this embodiment, the method for constructing the minimum bounding box of the mandibular condyle may be:

[0086] Obtain all coordinates P of the mandibular condyle corresponding to the connected domain, satisfying P = {p1,p2,...p n}, where p n is the coordinate corresponding to the nth connected domain, which can be expressed as: p n =(x n ,y n ,z n ), where x n 、y n 、z n They are the distances of the coordinate points corresponding to the nth connected domain on the X-axis, Y-axis, and Z-axis in the preset coordinate system.

[0087] Then, based on the above coordinates P, the covariance matrix C of the point cloud corresponding to the connected domain of the mandibular condyle is determined, and the directionality of the point cloud is determined by the covariance matrix C. The calculation formula of the variance matrix C can be expressed as: Where, is the centroid of the point cloud, which can be expressed as: (.) T In this embodiment, the covariance matrix C is a 3*3 symmetric matrix.

[0088] In this embodiment, the eigenvalues of the covariance matrix can be calculated and the rotation matrix can be constructed using the eigenvalues. The calculation formula of the rotation matrix is expressed as follows:

[0089] R = [v1v2v3];

[0090] Where R is the rotation matrix; v1 is the column vector corresponding to the first eigenvalue; v2 is the column vector corresponding to the second eigenvalue; and v3 is the column vector corresponding to the third eigenvalue.

[0091] This embodiment solves the eigenvalues based on the covariance matrix C, and obtains three eigenvalues λ1, λ2, λ3 and corresponding eigenvectors v1, v2, ν3, where the eigenvectors represent the main directions of the corresponding connected domains.

[0092] The coordinate P is then mapped to the local coordinate system. The minimum and maximum values of each connected domain on the corresponding axis are determined based on the local coordinate system, and the coordinates of the eight vertices in the preset coordinate system are calculated to obtain the final minimum bounding box.

[0093] The corresponding coordinate point P′ in the local coordinate system in this embodiment can be expressed as: Based on this, the coordinates of the eight vertices corresponding to the minimum bounding box can be expressed as:

[0094] (x min ,y min ,z min ), (x max ,y min ,z min ), (x min ,y max ,z min ), (x max ,y max ,z min ), (x min ,y min ,z max ), (x max ,y min ,z max ), (x min ,y mam ,z max ), (x max ,y max ,z max ), where y min Used to represent the minimum value of each connected domain on the Y axis; max Used to represent the maximum value of each connected domain on the Y axis; min Used to represent the minimum value of each connected domain on the X-axis; max Used to represent the maximum value of each connected domain on the X-axis; min Used to represent the minimum value of each connected domain on the Z axis; max Used to represent the maximum value of each connected domain on the Z axis.

[0095] After getting the minimum bounding box, please Figure 1 Based on the reference Figure 4 , Figure 4 A flowchart of step 300 in an embodiment of the present invention is shown; the step of constructing a target jaw joint reference line based on a minimum bounding box and a preset coordinate system includes steps 301 to 302.

[0096] Step 301: Filter a target plane in a minimum bounding box according to a preset coordinate system.

[0097] The target plane is perpendicular to the plane of the temporal joint.

[0098] Step 302: construct an observation coordinate system based on the target plane and generate a target jaw joint reference line.

[0099] In this embodiment, step 301 of selecting a target plane in a minimum bounding box according to a preset coordinate system is as follows:

[0100] A plane whose intersection angle between the minimum bounding box and the vertical axis in the preset coordinate system is less than a first preset value is selected as the target plane.

[0101] This embodiment can determine the plane where the six faces of the minimum bounding box are located and any point on the plane to determine the plane with the smallest angle θ with the Z axis in the preset coordinate system as the target plane.

[0102] Among them, the normal vectors corresponding to the planes where the six faces of the minimum bounding box are located and any point M can be expressed as:

[0103] Plane 1: Normal vector v1, point M1 is (x min ,y min ,z min );

[0104] Plane 2: Normal vector -v1, point M2 is (x max ,y max ,z max );

[0105] Plane 3: Normal vector v2, point M3 is (x min ,y min ,z min );

[0106] Plane 4: Normal vector -ν2, point M4 is (x max ,y max ,z max );

[0107] Plane 5: Normal vector v3, point M5 is (x min ,y min ,z min );

[0108] Plane 6: Normal vector -v3, point M6 is (x max ,y max ,z max ).

[0109] In this embodiment, the calculation expression for the intersection angle between the minimum bounding box and the plane where the vertical axis in the preset coordinate system is located satisfies:

[0110]

[0111] Wherein, cosθ is the intersection angle; A, B, and C are the components of the normal vector on any plane on the horizontal axis X, vertical axis Y, and vertical axis Z in the preset coordinate system, respectively.

[0112] On this basis, please Figure 1 Based on the reference Figure 5 , Figure 5 A flow chart of step 302 in an embodiment of the present invention is shown; step 302 includes steps 3021 to 3025.

[0113] Step 3021: For any target plane, determine the value of any point on the current target plane on the vertical axis in the preset coordinate system.

[0114] Step 3022: Take the plane corresponding to the maximum value as the final target plane, and select the vertices in the minimum bounding box that pass through the final target plane as the target vertices.

[0115] Step 3023: Construct a geometric bounding box based on the target vertex.

[0116] Step 3024: Use the cross line formed by the lines connecting the center points of the opposite sides of the geometric bounding box as the target jaw joint reference line.

[0117] Step 3025, obtain the observation coordinate system with the midpoint of the geometric bounding box as the origin, the target jaw joint reference line as the section of the observation axis, and the normal vector of the target plane as the extension direction of the section.

[0118] In this embodiment, two planes will be found due to the properties of the minimum bounding box. At this time, the Z coordinate size corresponding to the point M on the plane can be determined, and the plane with the larger Z coordinate can be used as the final target plane that meets the requirements.

[0119] Subsequently, at least 4 vertices passing through the above plane are screened out from the 8 vertices in the final target plane, and a rectangle is formed with these 4 vertices. The center point of the rectangle is then used as the origin of the observation coordinate system, the cross line connecting the center points of the opposite sides of the rectangle is the section of the observation axis, and the normal vector of the plane is the extension direction of the section to form the observation coordinate system.

[0120] Please refer to Figure 6 , Figure 6 The diagram shows the observation coordinate system of this embodiment; wherein SI direction is the Z-axis direction, green is the cross section, S direction is above the Z-axis; PA direction is the Y-axis direction, the coronal plane, P is the smaller direction of the Y-axis; RL is the X-axis direction, the sagittal plane, R is the smaller direction of the X-axis, wherein the green cylinder is the object to be observed, the red frame is the bounding box, at this time the bounding box is perpendicular to the existing coordinate system, and the green cuboid is the minimum bounding box. It can be seen that the minimum bounding box is a minimum cuboid that can enclose this object. Figure 7 The cross section of the object to be observed in this embodiment is shown. The minimum bounding box forms a cuboid perpendicular to the object in three directions, but not necessarily perpendicular to the preset coordinate system (i.e., the coordinate system of the CBCT itself).

[0121] Based on this, the observation method provided in this embodiment generates a new observation plane based on the minimum bounding box of the inferior articular process, so that the observation plane is more perpendicular to the area to be observed, which can overcome the limitations of the patient's shooting position in the existing technology, automatically generate the temporal joint cross line, and make the formed section more conducive to observing the condition of the temporal joint, while reducing the time of manual operation.

[0122] The same idea as the previous embodiment, please refer to Figure 8 , Figure 8 FIG. 1 is a schematic structural diagram of a temporal joint observation system according to the present invention. The temporal joint observation system 10 includes:

[0123] An acquisition module 11 is configured to acquire a scanned image to be tested and obtain a segmentation diagram corresponding to the target jaw based on the scanned image to be tested; wherein the scanned image to be tested includes oral CBCT data corresponding to a preset coordinate system;

[0124] A minimum bounding box determination module 12 determines the minimum bounding box of the mandibular condyle in the target jaw according to the segmentation schematic diagram;

[0125] The target jaw joint reference line generating module 13 constructs the target jaw joint reference line according to the minimum bounding box and the preset coordinate system, so as to observe the temporal joint through the target jaw joint reference line;

[0126] The plane where the target jaw joint reference line is located is perpendicular to the plane where the temporal joint is located.

[0127] The observation system provided in this embodiment includes all the technical means and technical effects of the observation method in the previous embodiment, which will not be repeated here.

[0128] The same idea as the previous embodiment, please refer to Figure 9 , Figure 9A block diagram of a server according to the present invention is shown. The server 20 includes a memory 21, a processor 22, and a communication module 23. The memory 21, processor 22, and communication module 23 are electrically connected to each other, directly or indirectly, to enable data transmission or exchange. For example, these components may be electrically connected via one or more communication buses or signal lines.

[0129] The memory 21 is used to store programs or data. The memory 21 can be, but is not limited to, random access memory (RAM), read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), etc.

[0130] The processor 22 is used to read / write data or programs stored in the memory and perform corresponding functions, for example, obtaining a scanned image to be tested, and obtaining a segmentation schematic diagram corresponding to the target jaw based on the scanned image to be tested; determining the minimum bounding box of the mandibular condyle in the target jaw based on the segmentation schematic diagram; constructing a target jaw joint reference line based on the minimum bounding box and a preset coordinate system to observe the temporal joint through the target jaw joint reference line; wherein, the plane where the target jaw joint reference line is located is perpendicular to the plane where the temporal joint is located.

[0131] The communication module 23 is used to establish a communication connection between the server and other communication terminals through the network, and to send and receive data through the network.

[0132] It should be understood that Figure 9 The structure shown is only a schematic diagram of the server structure, and the server may also include Figure 9 More or fewer components than shown, or with Figure 9 Different configurations shown. Figure 9 Each component shown in the figure can be implemented by hardware, software or a combination thereof.

[0133] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely illustrative. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architectures, functions and operations of the devices, methods and computer program products according to multiple embodiments of the present invention. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a portion of code, and the module, program segment or a portion of code contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart, can be implemented using a dedicated hardware-based system that performs the specified function or action, or can be implemented using a combination of dedicated hardware and computer instructions.

[0134] In addition, the functional modules in the various embodiments of the present invention may be integrated together to form an independent part, or each module may exist independently, or two or more modules may be integrated to form an independent part.

[0135] If the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0136] The foregoing description is merely a preferred embodiment of the present invention and is not intended to limit the present invention. Those skilled in the art will readily appreciate that various modifications and variations of the present invention are possible. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of the present invention are intended to be within the scope of protection of the present invention.

Claims

1. A temporal joint observation method, characterized in that: The temporal joint observation method comprises: Acquire a scanned image to be tested, and obtain a segmentation diagram corresponding to the target jaw based on the scanned image to be tested; wherein the scanned image to be tested includes oral CBCT data corresponding to a preset coordinate system; determining a minimum bounding box of the mandibular condyle in the target jaw according to the segmentation schematic diagram; constructing a target jaw joint reference line according to the minimum bounding box and the preset coordinate system, so as to observe the temporal joint through the target jaw joint reference line; The plane where the target jaw joint reference line is located is perpendicular to the plane where the temporal joint is located.

2. The temporal joint observation method according to claim 1, characterized in that: The step of constructing a target jaw joint reference line based on the minimum bounding box and the preset coordinate system includes: Screening a target plane in the minimum bounding box according to the preset coordinate system, wherein the target plane is perpendicular to the plane where the temporal joint is located; An observation coordinate system is constructed based on the target plane to generate the target jaw joint reference line.

3. The temporal joint observation method according to claim 2, characterized in that: The step of screening a target plane in the minimum bounding box according to the preset coordinate system includes: A plane whose intersection angle between the minimum bounding box and the vertical axis in the preset coordinate system is smaller than a first preset value is selected as a target plane.

4. The temporal joint observation method according to claim 2 or 3, characterized in that: The steps of constructing an observation coordinate system based on the target plane and generating the target jaw joint reference line include: For any target plane, determine the value of any point on the current target plane on the vertical axis in the preset coordinate system; The plane corresponding to the maximum value is used as the final target plane, and the vertices in the minimum bounding box that pass through the final target plane are selected as target vertices; Constructing a geometric bounding box based on the target vertices; A cross line formed by connecting the center points of opposite sides of the geometric bounding box is used as the target jaw joint reference line; The observation coordinate system is obtained by taking the midpoint of the geometric bounding box as the origin, the target jaw joint reference line as the section of the observation axis, and the normal vector of the target plane as the extension direction of the section.

5. The temporal joint observation method according to claim 3, characterized in that: The calculation expression of the intersection angle between the minimum bounding box and the plane where the longitudinal axis in the preset coordinate system is located satisfies: Where cosθ is the intersection angle; A, B, and C are the components of the normal vector on any plane on the horizontal axis, vertical axis, and vertical axis in the preset coordinate system, respectively.

6. The temporal joint observation method according to claim 1, characterized in that: The step of determining the minimum bounding box of the mandibular condyle in the target jaw according to the segmentation schematic diagram comprises: Obtaining a bounding box of the mandible, and segmenting a mandibular schematic diagram of the target mandible along the vertical axis of the preset coordinate system; Segmenting the mandibular schematic diagram to obtain a left mandibular schematic diagram and a right mandibular schematic diagram, and determining the mandibular condyle close to the occipital region in the mandibular schematic diagram; A minimum bounding box of the mandibular condyle is constructed based on the connected domain of the mandibular condyle.

7. The temporal joint observation method according to claim 6, characterized in that: The steps of obtaining a left mandibular schematic diagram and a right mandibular schematic diagram according to the mandibular schematic diagram, and determining the mandibular condyle close to the occipital region in the mandibular schematic diagram include: Determine a connected domain in the mandibular schematic diagram using a deep learning method, and divide the mandibular schematic diagram into the left mandibular schematic diagram and the right mandibular schematic diagram based on the connected domain; Based on the preset coordinate system, the connected domains corresponding to the vertical axis coordinate values less than the second preset value are screened to obtain the mandibular condyle close to the occipital bone in the mandibular schematic diagram.

8. The temporal joint observation method according to claim 6, characterized in that: The step of constructing the minimum bounding box of the mandibular condyle based on the connected domain of the mandibular condyle comprises: Obtaining all coordinates of the connected domain corresponding to the mandibular condyle, and calculating the covariance matrix corresponding to the mandibular condyle based on the coordinates; Determining a rotation matrix corresponding to a minimum bounding box according to the covariance matrix; The coordinates of each vertex of the connected domain of the mandibular condyle in a preset coordinate system are determined based on the rotation matrix to generate a minimum bounding box of the mandibular condyle.

9. The temporal joint observation method according to claim 8, characterized in that: The step of determining the rotation matrix corresponding to the minimum bounding box according to the covariance matrix includes: Calculate the eigenvalues of the covariance matrix and construct a rotation matrix using the eigenvalues; the calculation formula of the rotation matrix is expressed as: R = [ν1ν2ν3]; Where R is the rotation matrix; ν1 is the column vector corresponding to the first eigenvalue; ν2 is the column vector corresponding to the second eigenvalue; and v3 is the column vector corresponding to the third eigenvalue.

10. A temporal joint observation system, characterized in that: include: An acquisition module is used to acquire a scanned image to be tested and obtain a segmentation diagram corresponding to the target jaw based on the scanned image to be tested; wherein the scanned image to be tested includes oral CBCT data corresponding to a preset coordinate system; a minimum bounding box determination module, which determines the minimum bounding box of the mandibular condyle in the target jaw according to the segmentation schematic diagram; a target jaw joint reference line generating module, which constructs a target jaw joint reference line according to the minimum bounding box and the preset coordinate system, so as to observe the temporal joint through the target jaw joint reference line; The plane where the target jaw joint reference line is located is perpendicular to the plane where the temporal joint is located.

Images