Software, method, and program for generating correction target head 3D data
The software and method utilize mesh deformation techniques constrained by medical indices to efficiently generate accurate correction target head data for cranial shape correction helmets, addressing the inefficiencies of manual processing and data distortion.
Patent Information
- Application Number
- JP2023081035
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-16
- Publication Date
- 2024-11-28
AI Technical Summary
Existing methods for generating 3D correction target head data for cranial shape correction helmets are manual, time-consuming, and prone to distortion, making it difficult to obtain accurate and desired data for effective treatment.
A software and method that applies a mesh deformation technique, such as Laplacian smoothing, constrained by medical indices like CVAI, CA, CI, symmetry ratio, Ear Offset, and neck shape, to process 3D head shape data for accurate correction target head data generation.
The method enables fast and effective generation of accurate correction target head data, reducing processing time and improving data quality compared to traditional manual methods.
Smart Images

Figure 2024165135000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to software, a method, a program, etc. for generating 3D data of a head orthodontic target. [Background technology]
[0002] Human infants, especially those over about three months of age, may develop a condition known as plagiocephaly, dolichocephaly, or brachycephaly, which is a distortion of the head shape. For example, plagiocephaly is a condition in which the back of the head is distorted at an angle and asymmetrical when viewed from above. If this condition is left untreated and the distortion progresses as the infant grows, the position of the ears and the face will remain asymmetrical.
[0003] For this reason, a treatment method (hereinafter also referred to as "helmet treatment") may be adopted in which, depending on the symptoms, a skull shape correction helmet is fitted to the baby's head for a certain period of time, for example up to about 18 months of age, and the baby lives daily in that state (Patent Document 1). Helmet treatment makes it possible to gradually return the distorted head shape to normal.
[0004] To manufacture a helmet for correcting cranial shape, 3D data of the head shape that is the correction target of the wearer (hereinafter also referred to as "correction target head 3D data") is usually required, which is created based on 3D data (hereinafter also referred to as "head shape 3D data") obtained from data obtained by scanning the wearer's head shape, etc. The correction target head 3D data can be created by processing the head shape 3D data (Patent Document 2). [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Patent No. 6833240 [Patent Document 2] Patent Publication No. 2021-074051 Summary of the Invention [Problem to be solved by the invention]
[0006] However, the method for processing 3D head shape data described in Patent Document 2 was cumbersome and time-consuming because it was performed manually by skilled engineers. Therefore, the present inventors attempted to develop software that can automate the method described in Patent Document 2 in order to obtain 3D head data to be corrected more easily.
[0007] However, the inventors have found a new problem that even if the method described in Patent Document 2 is reproduced in software, the data still contains distortions and the like, and as a result, the desired 3D head data to be corrected cannot be obtained.
[0008] Therefore, an object of the present invention is to provide software etc. that can obtain desired 3D head data for correction. [Means for solving the problem]
[0009] In light of the above problems, and after extensive research, the inventors unexpectedly discovered that the above problems could be solved by applying a mesh deformation method using medical indicators of head shape as constraints to 3D head shape data obtained from scanned data of the head shape, and thus completed the present invention.
[0010] Thus, the present invention provides the following. [1] Software for generating 3D data of a head correction target, The software includes a step of applying a mesh deformation method to 3D head shape data obtained based on the head shape, the mesh deformation method using at least medical indicators of the head shape as constraints. [2] The software according to [1], wherein the mesh deformation method is Laplacian smoothing. [3] The software described in [1], wherein the medical indices of head shape include at least one selected from the group consisting of CVAI, CA, CI, and head volume symmetry ratio. [4] The software described in [1], wherein the application of the mesh deformation method further includes at least one constraint selected from the group consisting of ear offset, shape of the neck area, and head depression. [5] A method for generating 3D data of a head to be corrected, comprising: A method comprising a step of applying a mesh deformation method using at least medical indicators of the head shape as constraints to 3D head shape data obtained based on the head shape. [6] The method according to [5], wherein the mesh deformation technique is Laplacian smoothing. [7] The method according to [5], wherein the medical index of head shape includes at least one selected from the group consisting of CVAI, CA, CI, and head volume symmetry ratio. [8] The method according to [5], wherein the application of the mesh deformation technique further includes at least one constraint selected from the group consisting of ear offset, shape of the neck area, and head depression. [9] A program for generating 3D data of a head to be corrected, A step of applying a mesh deformation method to the head shape 3D data obtained based on the head shape, the mesh deformation method being based on at least medical indicators of the head shape as constraints. A program for causing a terminal device to execute steps including the steps of: Effect of the Invention
[0011] According to the present invention, it is possible to obtain software etc. capable of obtaining desired 3D data of the head to be corrected. In addition, the present invention has an advantage that the processing speed is faster than other deformation methods (e.g., physical simulation, etc.) by adopting a mesh deformation method from among many deformation methods when obtaining desired 3D data of the head to be corrected. [Brief description of the drawings]
[0012] [Figure 1] FIG. 1 illustrates an example of a functional block diagram of a terminal device. [Diagram 2]FIG. 2 shows an example of a functional diagram of a terminal device. [Diagram 3] FIG. 3 shows an example of a conceptual diagram of the method described herein. [Figure 4] FIG. 4 illustrates an example of a functional block diagram of the server. [Diagram 5] FIG. 5 shows an example of a functional diagram of a server. [Figure 6] FIG. 6 shows an example of a plane on which medical indices and the like are measured. [Figure 7A] FIG. 7A shows an example of the measurement range of the shape around the neck. [Figure 7B] FIG. 7B shows an example of the measurement range of the shape around the neck. [Figure 8] FIG. 8 shows an example of the process flow of the software described herein. [Figure 9] FIG. 9 shows an example of the process flow of the software described herein. [Figure 10] FIG. 10 shows 3D data of the head to be corrected obtained in Example 1. [Figure 11] FIG. 11 shows 3D data of the head to be corrected obtained in Example 2. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] In one embodiment of the present invention, a software for generating correction target head 3D data includes: The present invention provides software including a step of applying a mesh deformation method using at least medical indicators of the head shape as constraints to 3D head shape data obtained based on the head shape.
[0014] The term "3D head shape data" used in this specification means 3D data of the head shape required for creating 3D correction target head data described later. Usually, the 3D head shape data is data of the head shape of the person who is going to wear the helmet before helmet treatment. The 3D head shape data may be, for example, data obtained by scanning or photographing the head shape of the patient with a known 3D scanner or camera, or may be data obtained by processing the data thus scanned.
[0015] The "correction target head 3D data" described in this specification means 3D data of the head shape that is the treatment target (i.e., the correction target) when performing helmet therapy. Since the head shape that is the treatment target differs from patient to patient, the correction target head 3D data differs for each patient. The correction target head 3D data is created based on the head shape 3D data.
[0016] The "mesh deformation method" described in this specification means a method of deforming 3D data (preferably meshed 3D data) by moving each vertex coordinate of 3D data (preferably meshed 3D data) based on the geometric properties obtained from the 3D data before deformation (preferably meshed 3D data). Mesh deformation methods include, but are not limited to, Laplacian smoothing, free form deformation, As-rigid-as possible deformation, Local-Global Solver, etc.
[0017] The term "Laplacian smoothing" used herein refers to a technique for smoothing 3D data (preferably meshed 3D data) based on a Laplacian matrix obtained from the connectivity of vertices of the 3D data. For example, Laplacian smoothing may be expressed by the following formula (O. Sorkine, et al, Eurographics, 2004, Symposium on Geometry Processing, Laplacian Surface Editing). Formula 1
[0018] TIFF2024165135000002.tif2379
[0019] L means the Laplacian for vertex i. vi means the three-dimensional coordinates of vertex i. di means the number of neighboring vertices (connected by edges) of vertex i.
[0020] The mesh deformation method (preferably, Laplacian smoothing) allows deformation of meshed 3D data by setting various constraints. In other words, if no constraints are set, the meshed 3D data cannot be deformed (i.e., the same 3D data as the 3D data before deformation is output). In the software etc. described in this specification, the head shape 3D data can be deformed by applying medical indicators of head shape to the mesh deformation method (preferably, Laplacian smoothing).
[0021] In one embodiment of the present invention, the mesh deformation technique is Laplacian smoothing.
[0022] The "reference position" described in this specification means data that serves as a reference when calculating medical indices of the head shape. Examples of the reference position include, but are not limited to, the position of the nose (preferably the position of the root of the nose), the position of the left ear (preferably the position of the left tragus), and the position of the right ear (preferably the position of the right tragus). The reference position may be specified manually or automatically using a desired program or the like. When the reference position is the position of the nose, it may be automatically detected based on, for example, the shape of the nose in the 3D head shape data or the degree of unevenness with respect to the head contour. When the reference position is the left ear and / or the right ear, it may be automatically detected based on, for example, the shape of the ear in the 3D head shape data or the degree of unevenness with respect to the head contour.
[0023] The term "medical index of head shape" used in this specification means a medical index of head shape. Examples of medical indexes of head shape include, but are not limited to, Cranial Asymmetry (hereinafter also referred to as "CA"), Cranial Vault Asymmetry Index (hereinafter also referred to as "CVAI"), Cephalic Index (hereinafter also referred to as "CI"), and head volume symmetry rate (e.g., bilateral symmetry).
[0024] CA is usually an index of plagiocephaly and can be calculated, for example, by the following method. In the 3D head shape data, a plane passing through the nose position (P1), the left ear position (P2), and the right ear position (P3) identified as the reference position is identified as the reference plane (PL0). If necessary, one or more planes parallel to the reference plane may be set in the head top direction and / or neck direction (FIG. 6). In any plane (e.g., PL0), the midpoint (P4) of the line connecting the left ear position (P2) and the right ear position (P3) identified as the reference position is identified. Next, a reference line is drawn that is a straight line connecting the nose position (P1) identified as the reference position and the midpoint (P4). Next, two inclined lines inclined in opposite directions at a predetermined angle (for example, about 1 to about 80°, preferably about 5 to about 60°, more preferably about 10 to about 50°, even more preferably about 20 to about 40°, and even more preferably about 30°) with respect to the reference line are identified as four intersection points between the head contour in the arbitrary plane (for example, PL0). If there is one or more other planes parallel to PL0, the two inclined lines drawn in PL0 are projected onto each plane, and four intersection points between the two inclined lines and the head contour in each plane are identified. In each plane, the absolute value (L1-L2) of the difference between the lengths (L1, L2) of the two inclined lines derived based on the four intersection points may be calculated as CA (Equation 1 assumes the case of L1>L2).
[0025] Formula 1 CA(mm)=L1-L2
[0026] CVAI is usually an index of the degree of plagiocephaly, and can be calculated, for example, by the following method. CVAI may be calculated by the following formula 2 using the absolute value calculated by the above formula 1 and the length of the shorter of the two sloping lines (in formula 2, it is assumed that L1>L2).
[0027] Equation 2 CVAI(%)=[(L1-L2) / L2]×100
[0028] CI is usually an index of brachycephaly (or dolichocephaly), and can be calculated, for example, by the following method. In the head shape 3D data, a plane passing through the nose position (P1), the left ear position (P2), and the right ear position (P3) specified as the reference positions is specified as the reference plane (PL0). If necessary, one or more planes parallel to the reference plane may be set in the direction of the top of the head and / or the direction of the neck (FIG. 6). In an arbitrary plane (e.g., PL0), the midpoint (P4) of the line connecting the left ear position (P2) and the right ear position (P3) specified as the reference positions is specified. Next, a center line is drawn that is perpendicular to the reference line that is a straight line passing through P1 and P4 and that passes through P4. Next, two intersection points between this center line and the contour of the head in the arbitrary plane (e.g., PL0) are calculated. If there are one or more other planes parallel to PL0, the reference line and center line drawn in PL0 are projected onto each plane, and two intersection points between the projected center line and the contour of the head in each plane are specified. Next, the length (L3) of the center line derived based on these two intersection points and the length (L4) of the reference line calculated based on two intersection points between the reference line and the head contour in the head shape 3D data are calculated. Then, CI may be calculated using the following formula 3 based on the calculated center line length (L3) and reference line length (L4).
[0029] Formula 3 CI(%)=L4 / L3×100
[0030] The symmetry rate of the head volume may mean, for example, the ratio of the left and right head volumes when the head is divided into left and right halves. The symmetry rate of the head volume may be calculated directly from the head volume. Alternatively, the symmetry rate of the head volume may be calculated based on another index that can estimate the head volume. That is, the symmetry rate of the head volume is not limited to these, but may be, for example, calculated and compared with the volumes of the left and right heads, or the symmetry rate of the head volume may be calculated by calculating the left-right symmetry on any plane (for example, a reference plane).
[0031] "Bilateral symmetry" is an index of bilateral symmetry in the lateral direction in the head shape, and can be calculated, for example, by the following method. In the 3D data of the head shape, a plane passing through the nose position (P1), the left ear position (P2), and the right ear position (P3) specified as the reference position is specified as the reference plane (PL0). If necessary, one or more planes parallel to the reference plane may be set in the direction of the top of the head and / or the direction of the neck (FIG. 6). In an arbitrary plane (e.g., PL0), arbitrary points (preferably corresponding points on the left and right) are specified on the left and right. Examples of arbitrary points on the left and right include the left ear position (P2) and the right ear position (P3) specified as the reference positions. Next, in an arbitrary plane (e.g., the reference plane), a straight line is drawn from the front of the face through the back of the head (e.g., a straight line passing through the nose position (P1) specified as the reference position). On a number of other planes parallel to PL0, the straight line drawn on PL0, P2 and P3 may be projected, and the distance between the projected straight line and the projected P2 (when the head contour is located inside the position of P2 on the plane, for example, the distance between the intersection of the horizontal line passing through P2 and the head contour and the projected straight line) and the distance between the projected straight line and the projected P3 (when the head contour is located inside the position of P3 on the plane, for example, the distance between the intersection of the horizontal line passing through P3 and the head contour and the projected straight line) may be calculated. Then, on each plane, the difference in distance between the specified left and right points and the projected straight line may be calculated as bilateral symmetry. For example, if any points on the left and right are P2 and P3, the distance (D1) between a line from the front of the face passing through the back of the head and P2, and the distance (D2) between a line from the front of the face passing through the back of the head and P3 can be calculated, and the absolute value of the difference between D1 and D2 can be calculated as the left-right symmetry (i.e., the smaller the absolute value of the difference between D1 and D2, the better the left-right symmetry can be evaluated).
[0032] In one embodiment of the present invention, the medical index of head shape includes at least one selected from the group consisting of CVAI, CA, CI, and symmetry rate of head volume (preferably, bilateral symmetry).
[0033] The "second index" described in this specification means an index other than a medical index of the head shape. The second index is not particularly limited as long as it is an index that can be useful as a constraint condition in the mesh deformation method to make the correction target head 3D data more suitable. The second index is not limited to these, but examples thereof include ear offset, shape around the neck, and the presence or absence of head depression.
[0034] The "Ear Offset" described in this specification is an index of the forward / backward shift of the positions of both ears, and can be calculated, for example, by the following method. In an arbitrary plane (for example, the reference plane (PL0)), an arbitrary point in both ears (preferably a corresponding point on the left and right, for example, the position of the left ear (P2) and the position of the right ear (P3) specified as the reference position) is specified. Next, in the arbitrary plane, a horizontal line passing through the arbitrary point of the right ear specified above and a horizontal line passing through the arbitrary point of the left ear specified above are drawn. The distance between these two horizontal lines (i.e., the deviation between the two horizontal lines) may be calculated as the Ear Offset. For example, if the arbitrary points in both ears are P2 and P3, a horizontal line (H1) passing through P2 and a horizontal line (H2) passing through P3 may be drawn in an arbitrary plane (for example, the reference plane (PL0)), and the distance between the two horizontal lines (H1 and H2) may be calculated as the Ear Offset (i.e., the smaller the distance between H1 and H2, the better the Ear Offset may be evaluated).
[0035] The "shape of the neck" described in this specification means, for example, the shape in the region below PL0 (preferably PL-1, more preferably PL-2) in FIG. 7. When the shape of the neck is a constraint in the mesh deformation method, the amount of displacement of the shape of the neck may be calculated, for example, as follows. For example, an arbitrary point (vi) (for example, an arbitrary vertex of the mesh shape) is set on each plane (for example, PL-1, PL-2, etc.) in the neck direction from the reference plane (PL0). Next, the positional relationship (movement distance) between the set arbitrary point (vi) and the position (v'i) moved to after applying the mesh deformation method (for example, Laplacian smoothing) may be applied to the following formula to determine the amount of change (Ei) in the shape of the neck. Ei may be calculated for multiple points on each plane. Formula 2
[0036] TIFF2024165135000003.tif3188
[0037] The shape of the neck area may be the whole area below PL0 (preferably PL-1, more preferably PL-2) (FIG. 7A), or may be the area below any line (e.g., curve) (FIG. 7B). The curve shown in FIG. 7B may be set manually or expressed by any mathematical expression (e.g., quadratic function, cubic function, cos function, sin function, or a combination thereof).
[0038] The term "presence or absence of head depression" used in this specification means the presence or absence of a depression in the head shape in the head shape 3D data and / or the head correction target 3D data. When the presence or absence of head depression is a constraint in the mesh deformation method, the degree of head depression may be calculated, for example, as follows. An arbitrary position (for example, a mesh vertex at an arbitrary position) of the head contour of the head shape 3D data is identified. For each position identified in this way, a change in position before and after application of the mesh deformation method is calculated. The presence or absence of head depression may be determined based on whether or not the arbitrary position after application of the mesh deformation method is inside the 3D data of the head shape compared to before application of the mesh deformation method. If the arbitrary position after application of the mesh deformation method is inside the 3D data of the head shape compared to before application of the mesh deformation method, the arbitrary position may be returned to the position before application of the mesh deformation method.
[0039] In one embodiment of the present invention, the application of the mesh deformation technique is further subject to at least one constraint selected from the group consisting of ear offset, shape of the neck area, and head depression degree.
[0040] The term "terminal device" used in this specification refers to, for example, a PC, a tablet, a smartphone, etc. The number of terminal devices may be one or more. The terminal device may be capable of communicating with other terminal devices, a scanning device, etc. via a communication network.
[0041] The "scanning device" described in this specification is not particularly limited as long as it is a device capable of scanning the head shape. Examples of scanning devices include, but are not limited to, 3D scanners, cameras, smartphones, etc.
[0042] The "communication network" described in this specification may be composed of one or more networks. The communication network may be a dedicated line or a public line, and may be wired or wireless. A part or all of the communication network may be a telephone line, the Internet, a VPN, or the like.
[0043] In another embodiment of the present invention, there is provided a method for generating corrective target head 3D data, comprising the steps of: The method includes a step of applying a mesh deformation technique using at least medical indicators of the head shape as constraints to 3D head shape data obtained based on the head shape.
[0044] In another embodiment of the present invention, a program for generating correction target head 3D data, A step of applying a mesh deformation method to the head shape 3D data obtained based on the head shape, the mesh deformation method being based on at least medical indicators of the head shape as constraints. The present invention provides a program for causing a terminal device to execute the steps including the steps of:
[0045] Hereinafter, an embodiment of the present invention will be described in more detail with reference to the drawings.
[0046] The terminal device 1 may be capable of installing software 4 for generating 3D data of the head to be corrected.
[0047] FIG. 1 shows a functional block diagram of the terminal device 1. The terminal device 1 includes, as functional blocks, an operation unit 10, a display unit 11, a storage unit 12, a processing unit 13, and an input / output unit 14. When the correction target head 3D data is not created on the server 2 but is created by the correction target head 3D data creating software 4, the correction target head 3D data creating software 4 (not shown) may be installed in the terminal device 1. In this case, the correction target head 3D data creating software 4 may be stored in the storage unit 14. The correction target head 3D data creating software 4 is realized by executing a correction target head 3D data creating software program, and may include a processing module 41. The processing module 41 is a module that manages the correction target head 3D data creating software 4 as a whole, and may display an operation screen (UI screen) on the display unit 11 and execute various processes. The terminal device 1 may be one or more.
[0048] The operation unit 10 is composed of a touch panel, a keyboard, a mouse, etc., and can be operated by an operator to input data.
[0049] The display unit 11 is configured with a liquid crystal panel, an organic EL panel, or the like, and is capable of displaying various screens.
[0050] The storage unit 12 is composed of a HDD, an SSD, etc., and can store various data. The storage unit 12 may store the correction target head 3D data generating software 4, head shape 3D data, etc.
[0051] The processing unit 13 can perform various types of processing.
[0052] The input / output unit 14 may input and output various data and the like via the network 3.
[0053] 2 shows a configuration block diagram of the terminal device 1. The terminal device 1 is a smartphone, a tablet terminal, a PC, etc., and has the configuration of these terminals. The terminal device 1 includes a CPU 15, a ROM 16, a RAM 17, an operation unit 10, a display unit 11, a storage unit 12, and a communication I / F 18, which may be connected by a bus.
[0054] One or more CPUs 15 may read out processing programs (including a software program for creating 3D head data to be corrected) stored in ROM 16 or storage unit 12, and execute various processes using RAM 17 as a working memory. When software 4 for creating 3D head data to be corrected is installed in terminal device 1, the various processes include, but are not limited to, correction of 3D head shape data, creation of mesh data, identification of reference position, creation of planes, identification of planes, projection onto each plane, calculation of medical indexes of head shape, calculation of second indexes, application of mesh deformation techniques, etc.
[0055] The head shape 3D data can be corrected as necessary. By correcting the head shape 3D data, the correction target head 3D data can be created more smoothly. The head shape 3D data can be corrected manually or automatically using a desired program. Corrections to the head shape 3D data include, but are not limited to, deletion of data (noise) of parts not related to the head, integration of scanned head shape data, correction of distortion, and the like.
[0056] The mesh data may be created by known software or programs (for example, "Grasshoppper" in the three-dimensional CAD software sold under the name "Rhinoceros").
[0057] Any method may be used to specify the reference position. For example, when the reference positions are the nose and both ears, the nose and both ears may be detected based on the unevenness of the head contour in the scanned 3D head shape data on the top, bottom, left and right. Alternatively, the operator of the terminal device 1 may manually specify the reference positions for the scanned 3D head shape data.
[0058] The plane may be created based on the reference position. For example, if the reference positions are the nose position, the right ear position, and the left ear position, a plane passing through these three points may be created as the reference plane. In addition, one or more planes parallel to the created reference plane may be created in the head top direction and / or neck direction.
[0059] The plane specification may specify one or more planes among the created planes. For the specified planes, medical indices or second indices of the head shape may be calculated, or constraints in the mesh deformation method may be set.
[0060] Projection onto each plane may be performed by projecting points or lines identified on the reference plane (eg, lines or points required to calculate a medical index or a second index) onto the other plane.
[0061] Calculation of the medical indices of head shape may be performed in any desired manner.
[0062] Calculation of the second indicator may be performed in any desired manner.
[0063] The mesh deformation technique can be applied to the meshed 3D head shape data by applying a mesh deformation technique (e.g., Laplacian smoothing) using medical indicators of the head shape as constraints to create 3D head data to be corrected.
[0064] The communication I / F 18 may transmit and receive data, etc., via the communication network NW. When the 3D data of the head to be corrected is created on the server 2, not on the software 4 for creating the 3D data of the head to be corrected installed in the terminal device 1, the communication I / F 18 may transmit and receive data, etc., to and from the server 2 and the scanning device 3 via the communication network NW (FIG. 3).
[0065] 4 shows an example of a functional block diagram of the server 2. The server 2 includes an input / output unit 20, a storage unit 21, a data correction unit 22, a reference position identification unit 23, a medical index calculation unit 24, a second index calculation unit 25, and a head correction target data creation unit 26. The server may be one or more. When there are multiple servers, the functional blocks may be divided among the servers.
[0066] The input / output unit 200 can transmit and receive data to and from the terminal device 1, the scanning device 3, and the like.
[0067] The memory unit 201 can store scanned head shape 3D data, identified reference positions, calculated medical indicators of the head shape, calculated second indicators, created correction target head 3D data, etc.
[0068] The data correction unit 202 can correct the scanned head shape 3D data as necessary. By correcting the head shape 3D data, the correction target head 3D data can be created more smoothly. The head shape 3D data may be corrected manually or automatically using a desired program. Examples of corrections to the head shape 3D data include, but are not limited to, deleting data (noise) of parts not related to the head, integrating data of the scanned head shape, correcting distortion, etc.
[0069] The mesh data creation unit 203 can create mesh data from the head shape 3D data. The mesh data may be created based on, for example, known software or programs (for example, "Grasshoppper" in the three-dimensional CAD software sold as "Rhinoceros").
[0070] The reference position identifying unit 204 can identify a reference position (for example, the position of the nose and the positions of both ears) in the scanned head shape 3D data. The method of identifying the reference positions (the position of the nose and the positions of both ears) is not particularly limited. When the reference positions are the position of the nose and the positions of both ears, for example, the positions of the nose and the positions of both ears may be detected based on the uneven parts of the head contour in the scanned head shape 3D data on the top, bottom, left and right. Alternatively, the operator of the terminal device 1 may manually identify the reference position for the scanned head shape 3D data.
[0071] The plane creating unit 205 can create a reference plane based on the reference positions. For example, when the reference positions are the nose position, the right ear position, and the left ear position, a plane passing through these three points can be created as the reference plane. The plane creating unit 205 can also create one or more planes parallel to the created reference plane in the head top direction and / or neck direction.
[0072] The plane identifying section 206 can identify one or more planes from among the planes created by the plane creating section 205. For the identified planes, medical indices or second indices of the head shape may be calculated, or constraint conditions in a mesh deformation method may be set.
[0073] The projection unit 207 can project points and lines specified on the reference plane (for example, lines and points required for calculating a medical index or a second index) onto another plane.
[0074] The head shape medical index calculation section 208 can calculate medical indexes of head shapes.
[0075] The second index calculation unit 209 can calculate the second index.
[0076] The mesh deformation method application unit 210 applies a mesh deformation method (for example, Laplacian smoothing) using medical indices as constraints to the meshed 3D head shape data, and can generate 3D correction target head data.
[0077] 5 shows an example of a configuration block diagram of the server 2. The server 2 includes a CPU 2a, a ROM 2b, a RAM 2c, an input / output interface (I / F) 2d, a storage device 2e, a communication interface (I / F) 2f, an input device 2g, and a display device 2h, which may be connected via a bus.
[0078] One or more CPUs 2a can read out the processing programs stored in the ROM 2b or the storage device 2e and execute various processes using the RAM 2c as a working memory. The various processes include a process of correcting the scanned 3D head shape data, a process of identifying a reference position, a process of calculating medical indices of the head shape, a process of calculating a second indices, a process of creating 3D head data to be corrected by a mesh deformation technique, etc.
[0079] The input / output I / F 2d is connected to an input device 2g and a display device 2h, and is capable of inputting and outputting data.
[0080] The storage device 2e is configured with an HDD, an SSD, etc., and can store various data. The storage device 2e includes the storage unit 21 in FIG.
[0081] The communication I / F 2f can transmit and receive data and the like to and from the terminal device 1 via the communication network NW. The communication I / F 2f includes the input / output unit 20 in FIG.
[0082] Hereinafter, a process flow for generating 3D data of the head to be corrected will be described with reference to FIG.
[0083] A scanning device is used to scan the shape of the head (S101).
[0084] The scanned head shape data is input to a terminal device or the like (S102).
[0085] When the scan data needs to be modified to execute the subsequent processing, the scan data is modified (S103, S104). Modifications of the scan data include removing noise, integrating data, correcting distortion, and, if the scan data is 2D, converting the scan data to 3D, etc. If the scan data does not need to be modified, S104 may be omitted.
[0086] Next, mesh data is created based on the scan data (S105).
[0087] Next, reference positions (e.g., nose position, right ear position, and left ear position) are specified (S106), and a reference plane is created based on the specified reference positions (S107). Also, based on the reference plane, one or more planes parallel to the reference plane may be created (S107). One or more planes may be specified as necessary (S108).
[0088] Next, medical indices and second indices of the head shape may be calculated (S109, S110). If there are one or more planes parallel to the reference plane, points and lines required for calculating the medical indices and second indices of the head shape may be projected onto these planes.
[0089] 8, the steps of identifying the three reference points, creating a plane, identifying the plane, calculating the medical index of the head shape, and calculating the second index are performed after the creation of the mesh data, but the steps of identifying the three reference points, creating a plane, identifying the plane, calculating the medical index of the head shape, and calculating the second index may be performed before the creation of the mesh data. Also, the steps of identifying the three reference points (S106), calculating the medical index (S109), and / or calculating the second index (S110) may be omitted.
[0090] Next, a mesh deformation method (preferably Laplacian smoothing) is applied using the medical indices of the head shape as constraints (preferably the medical indices of the head shape and a second indices as constraints) (S111).
[0091] When data obtained after applying a mesh deformation method using medical indices of head shape as constraints needs to be corrected, the corrected data may be used as the correction target head 3D data (S112, S113, S114).On the other hand, when data correction is not required, the data obtained after applying a mesh deformation method using medical indices of head shape as constraints may be used as the correction target head 3D data (S112, S114).
[0092] Next, the application of the mesh deformation technique will be described in more detail with reference to FIG.
[0093] If necessary, the 3D head shape data is read into a terminal device or the like to which a mesh deformation method can be applied (S111a).
[0094] Next, a mesh deformation technique (preferably Laplacian smoothing) is provided under a first constraint (S111b), which may be one or more head shape medical indices, one or more second indices, or a combination of one or more head shape medical indices and one or more second indices.
[0095] If the desired data is obtained as a result of applying the mesh deformation technique, the process may proceed to S112 (S111c). On the other hand, if the desired data is not obtained, the mesh deformation technique (preferably Laplacian smoothing) may be further applied under a second constraint (S111c, S111d). The second constraint may be one or more medical indicators of the head shape, one or more second indicators, or a combination of one or more medical indicators of the head shape and one or more second indicators.
[0096] If the desired data is obtained as a result of providing the mesh deformation technique, the process may proceed to S112 (S111e). On the other hand, if the desired data is not obtained, the mesh deformation technique (preferably Laplacian smoothing) may be further applied under a third constraint (S111e, S111f). The third constraint may be one or more medical indicators of head shape, one or more second indicators, or a combination of one or more medical indicators of head shape and one or more second indicators.
[0097] If the desired data is obtained as a result of providing the mesh deformation technique, the process may proceed to S112 (S111g). On the other hand, if the desired data is not obtained, the same flow may be repeated (S111g, S111h). The nth constraint may be one or more medical indicators of the head shape, one or more second indicators, or a combination of one or more medical indicators of the head shape and one or more second indicators. EXAMPLES
[0098] [Example 1] The 3D data (original data) obtained from the scanned head shape of the infant was imported into a computer, and mesh data was created using the "Grasshopper" function in the three-dimensional CAD software sold as "Rhinoceros". Next, three reference positions, the root of the nose (P1), the left tragus point (P2), and the right tragus point (P3), in the head shape 3D data were specified by a desired method. Next, a reference plane (PL0) including the three reference positions was set. Next, a plurality of planes parallel to the reference plane (PL0) were set in the vertex (top of the head) direction and the neck direction. Next, CA and CI were calculated based on the head shape 3D data using a desired program. Then, Laplacian smoothing was applied to the scanned head shape 3D data of the infant, with CA, CI, bilateral symmetry, and Ear Offset as constraint conditions. The constraint conditions were applied in the order of the first constraint condition, the second constraint condition, and the third constraint condition. In this way, the correction target head 3D data of Example 1 was obtained. First constraint: "Ear Offset constraint" + "CA constraint" Second constraint: "symmetry constraint" -Third constraint: "CI constraint"
[0099] The calculation method for each condition is as follows.
[0100] CA In the reference plane (PL0), the midpoint (P4) of the line connecting P2 and P3 is identified. Next, a reference line is drawn, which is a straight line connecting P1 and P4 identified as the reference positions. Next, four intersection points between two inclined lines, each inclined at about 30° in opposite directions with respect to the reference line, and the head contour in PL0 are identified. In multiple other planes parallel to PL0, the two inclined lines drawn in PL0 are projected, and four intersection points between the two inclined lines and the head contour are identified. In each plane, the absolute value (L1-L2) of the difference between the lengths (L1, L2) of the two inclined lines derived based on the four intersection points was calculated as CA.
[0101] CI In the reference plane (PL0), the midpoint (P4) of the line connecting P2 and P3 is identified. Next, a center line is drawn that is perpendicular to the reference line, which is a straight line passing through P1 and P4, and that passes through P4. Next, two intersection points between this center line and the head contour in PL0 are calculated. In a plurality of other planes that are parallel to PL0, the center line drawn in PL0 is projected, and two intersection points between the projected center line and the head contour are identified. In PL3 (FIG. 6) and each plane other than PL3 as necessary, the length (L3) of the center line derived based on these two intersection points and the length (L4) of the reference line calculated based on the two intersection points between the reference line and the head contour in the head shape 3D data are calculated. Then, in PL3 (FIG. 6) and each plane other than PL3 as necessary, CI was calculated based on L3 and L4 using the following formula. CI(%)=L4 / L3×100
[0102] In the first embodiment, the CI constraint is applied to PL3, and the amount of change in PL3 is applied to a plurality of planes other than PL3.
[0103] Symmetry On the reference plane (PL0), a straight line (a straight line passing through P1) is drawn from the front of the face through the back of the head. The distance (D1) between this line and P2, and the distance (D2) between this line and P3 are calculated. On multiple other planes parallel to PL0, the straight line drawn on PL0, P2, and P3 are projected, and the distance between the projected line and the projected P2 (if the head contour is located inside the position of P2, the distance between the line and the head contour) and the distance between the projected line and the projected P3 (if the head contour is located inside the position of P3, the distance between the line and the head contour) are calculated. Then, the absolute value of the difference between D1 and D2 on each plane was calculated as bilateral symmetry.
[0104] Ear Offset On the reference plane (PL0), draw a horizontal line (H1) that passes through P2 and a horizontal line (H2) that passes through P3. The distance between the two horizontal lines (H1 and H2) was calculated as the Ear Offset.
[0105] The constraints for each indicator are as follows: CA constraints in each plane: less than 6mm CI constraints in PL3: 80-94% · Symmetry constraints on each plane: close to 0 -Ear Offset constraint: Close to 0
[0106] [Example 2] The 3D data obtained from the scanned head shape of the infant was imported into a computer, and mesh data was created using the "Grasshopper" function of the three-dimensional CAD software sold as "Rhinoceros". Next, three reference positions, the root of the nose (P1), the left tragus point (P2), and the right tragus point (P3), in the head shape 3D data were specified by a desired method. Next, a reference plane (PL0) including the three reference positions was set. Next, a plurality of planes parallel to the reference plane (PL0) were set in the vertex (top of the head) direction and the neck direction. Next, CA and CI were calculated based on the head shape 3D data using a desired program. Then, Laplacian smoothing was applied to the scanned head shape 3D data of the infant, with CA, CI, left-right symmetry, Ear Offset, and the shape around the neck as constraints. The constraints were applied in the order of the first constraint, the second constraint, and the third constraint. In this way, the correction target head 3D data of Example 2 was obtained. First constraint: "Ear Offset constraint" + "CA constraint" + "Neck shape constraint" - Second constraint: "symmetry constraint" + "shape constraint around the neck" -Third constraint: "CI constraint" + "Constraint on shape of neck area"
[0107] The calculation methods for CA, CI, left-right symmetry, and Ear Offset were the same as in Example 1. The shape of the neck circumference was calculated as follows.
[0108] Neck Shape An arbitrary point (vi) (e.g., an arbitrary vertex of the mesh shape) is set on each plane (e.g., PL-1) in the neck direction from the reference plane (PL0). Next, the positional relationship (movement distance) between the arbitrary point (vi) and the position (v'i) moved to after applying Laplacian smoothing is applied to the following formula to determine the amount of change (Ei) in the shape around the neck. Ei is calculated for multiple points on each plane. Formula 3
[0109] TIFF2024165135000004.tif3188
[0110] The constraints for each indicator are as follows: CA constraints in each plane: less than 6mm CI constraints in PL3: 80-94% · Symmetry constraints on each plane: close to 0 -Ear Offset constraint: Close to 0 Constraints on neck shape in each plane: 0.3~0.5
[0111] [Reference example 1] The 3D data (original data) obtained from the scanned head shape of the infant was imported into a computer, and the three reference points of the root of the nose (P1), the left tragus point (P2) and the right tragus point (P3) in the head shape 3D data were specified by a desired method. Next, CA and CI were calculated based on the head shape 3D data using a desired program. Then, using 3D CAD software (the "Grasshopper" function in the three-dimensional CAD software sold as "Rhinoceros"), the scanned head shape 3D data of the infant was adjusted manually while checking the distortion of the head shape 3D data based on CA and CI. In this way, the correction target head 3D data of Reference Example 1 was obtained.
[0112] result The 3D data of the correction target head in Example 1 was comparable to the 3D data of the correction target head in Reference Example 1 (FIG. 10). It is considered that the correction target head 3D data of Example 2 reflects the actual human head shape (especially the shape around the neck) better than the correction target head 3D data of Example 1 (FIG. 11). Therefore, it is considered that by adding a second constraint (for example, a constraint around the neck) when applying Laplacian smoothing, it is possible to obtain correction target head 3D data that reflects the actual human head shape better. [Explanation of symbols]
[0113] 1: Terminal device 10:Operation unit 11: Display section 12: Storage part 13: Processing section 14: Input / output section 2: Server 20: Input / output section 21: Storage part 22: Data correction section 23: Mesh data creation section 24: Reference position identification section 25:Medical index calculation department 26: Second index calculation unit 27: Orthodontic target head 3D data creation section 3: Scanning device NW: Communication network
Claims
1. A software for generating 3D data of a head to be corrected, The software includes a step of applying a mesh deformation method to head shape 3D data obtained based on the head shape, the mesh deformation method using at least medical indicators of the head shape as constraints.
2. The software of claim 1 , wherein the mesh deformation technique is Laplacian smoothing.
3. The software of claim 1 , wherein the medical index of head shape includes at least one selected from the group consisting of CVAI, CA, CI, and head volume symmetry ratio.
4. The software according to claim 1 , wherein the application of the mesh deformation technique further includes at least one constraint selected from the group consisting of an Ear Offset, a shape around the neck, and a degree of head depression.
5. A method for generating 3D data of a correction target head, comprising: A method comprising a step of applying a mesh deformation technique using at least medical indicators of the head shape as constraints to 3D head shape data obtained based on the head shape.
6. The method of claim 5 , wherein the mesh deformation technique is Laplacian smoothing.
7. The method according to claim 5 , wherein the medical index of head shape includes at least one selected from the group consisting of CVAI, CA, CI, and head volume symmetry ratio.
8. The method according to claim 5 , wherein the application of the mesh deformation technique further includes at least one constraint selected from the group consisting of an ear offset, a shape of the neck area, and a head depression degree.
9. A program for generating 3D data of a head to be corrected, A step of applying a mesh deformation method to the head shape 3D data obtained based on the head shape, the mesh deformation method being based on at least medical indicators of the head shape as constraints. A program for causing a terminal device to execute steps including the steps of:
Citation Information
Patent Citations
Method for calculating correction target skull shape
JP2021074051A
Cranial shape correction helmet
JP6833240B1
