Apparatus and method for generation and real-time modification of margin line

Abstract

Disclosed are an apparatus and a method for generation and real-time modification of a margin line. A method performed by an electronic device according to the present disclosure may comprise the steps of: identifying an initial point on a three-dimensional oral model; determining, on the basis of curvature information about the three-dimensional oral model, a first search direction from the initial point; sequentially determining, on the basis of the curvature information and the first search direction, a plurality of first search points on the three-dimensional oral model, wherein each of the plurality of first search points is determined on the basis of the curvature information and one or more first search points determined immediately before; and generating, on the basis of the plurality of first search points, a margin line indicating a closed path on the three-dimensional oral model.

Description

Device and method for creating and modifying margin lines in real time

[0001] The technical idea of ​​the present disclosure relates to a device and method for generating and modifying a margin line in real time, and more particularly, to a device and method for generating and modifying a margin line of a tooth in real time based on a three-dimensional image of an oral cavity received from a three-dimensional scanner.

[0002] Typically, a 3D scanner can be used to obtain information about a patient's oral cavity, allowing the scanner to capture images of the oral cavity. For example, a doctor could insert a 3D scanner into a patient's mouth and scan the patient's teeth, gingiva, and / or soft tissues, thereby acquiring multiple 2D images of the patient's oral cavity. Using 3D modeling technology, the doctor could then construct a 3D image of the patient's oral cavity using the 2D images.

[0003] Meanwhile, artificial structures such as dental prostheses can be used as a method of treating a patient's teeth. One of the most important preprocessing steps in the process of creating a prosthesis is setting the margin line. Margin lines define the boundary between the exposed portion (outer surface) of the prosthesis when inserted into the patient's mouth and the remaining portion (inner surface). These margin lines can have a critical impact on whether the prosthesis properly contacts and supports the patient's oral structure. In particular, prosthetics such as inlays and veneers can have significant curvatures, making frequent and precise adjustments to margin lines time-consuming. Technologies for automatically generating and modifying margin lines are inadequate.

[0004] The technical idea of ​​the present disclosure is to provide a device and method for generating a margin line of a tooth and modifying the margin line in real time.

[0005] According to one aspect of the technical idea of ​​the present disclosure, a method performed by an electronic device may include the steps of identifying an initial point on a three-dimensional oral cavity model, determining a first search direction from the initial point based on curvature information about the three-dimensional oral cavity model, sequentially determining a plurality of first search points on the three-dimensional oral cavity model based on the curvature information and the first search direction, wherein each of the plurality of first search points is determined based on the curvature information and at least one first search point determined immediately before, and generating a margin line indicating a closed path on the three-dimensional oral cavity model based on the plurality of first search points.

[0006] An electronic device according to one aspect of the technical idea of ​​the present disclosure may include one or more processors, and one or more memories storing instructions executed by the one or more processors, and when the instructions are executed by the one or more processors, the one or more processors may be configured to execute any one of the methods according to one aspect of the technical idea of ​​the present disclosure.

[0007] A non-transitory computer-readable recording medium according to one aspect of the technical idea of ​​the present disclosure can record instructions that, when executed by one or more processors, cause the one or more processors to perform operations, and the instructions can be configured to cause the one or more processors to perform any one of the methods according to one aspect of the technical idea of ​​the present disclosure.

[0008] According to an exemplary embodiment of the present disclosure, a device and method can automatically and quickly generate a margin line of a tooth based on a three-dimensional image of the oral cavity.

[0009] According to an exemplary embodiment of the present disclosure, a device and method can allow a user to correct a margin line in real time by performing a minimum of work while viewing an incorrectly generated area during margin line generation.

[0010] According to the device and method according to the exemplary embodiment of the present disclosure, margin line work for producing a prosthesis can be performed quickly and efficiently through automatic generation and real-time modification of margin lines.

[0011] The effects that can be obtained from the exemplary embodiments of the present disclosure are not limited to the effects mentioned above, and other effects not mentioned can be clearly derived and understood by those skilled in the art to which the exemplary embodiments of the present disclosure pertain from the following description. In other words, unintended effects resulting from implementing the exemplary embodiments of the present disclosure can also be derived by those skilled in the art from the exemplary embodiments of the present disclosure.

[0012] FIG. 1 is a drawing for explaining a system for acquiring scan data using a three-dimensional scanner (200) according to an exemplary embodiment of the present disclosure.

[0013] FIG. 2 is a block diagram of an electronic device (100) and a 3D scanner (200) according to an exemplary embodiment of the present disclosure.

[0014] FIG. 3 is a perspective view of a three-dimensional scanner (200) according to an exemplary embodiment of the present disclosure.

[0015] FIG. 4A and FIG. 4B are drawings for explaining maxillary scan data (301), mandibular scan data (302), and bimaxillary scan data (300) of an intraoral structure according to an exemplary embodiment of the present disclosure.

[0016] FIG. 5 is a diagram illustrating a process for identifying an initial point for generating a margin line according to an exemplary embodiment of the present disclosure.

[0017] FIG. 6 is a drawing for showing curvature information for a three-dimensional oral model according to an exemplary embodiment of the present disclosure.

[0018] FIGS. 7A, 7B and 7C are diagrams illustrating a plurality of first search points, a plurality of second search points and an initial closed path according to an exemplary embodiment of the present disclosure.

[0019] FIG. 8A and FIG. 8B are diagrams illustrating the creation of a margin line according to an exemplary embodiment of the present disclosure.

[0020] FIG. 9 is a flowchart illustrating a method for generating a margin line according to an exemplary embodiment of the present disclosure.

[0021] FIG. 10 is a flowchart illustrating a method for sequentially determining search points according to an exemplary embodiment of the present disclosure.

[0022] FIG. 11 is a flowchart illustrating a method for generating a margin line according to an exemplary embodiment of the present disclosure.

[0023] FIG. 12 is a flowchart illustrating a method for generating a margin line indicating a closed path according to an exemplary embodiment of the present disclosure.

[0024] FIGS. 13a, 13b, 13c and 13d are diagrams illustrating a method for modifying a margin line according to an exemplary embodiment of the present disclosure.

[0025] FIG. 14 is a flowchart illustrating a method for modifying a margin line according to an exemplary embodiment of the present disclosure.

[0026] FIG. 15 is a flowchart illustrating a method for modifying a margin line based on a target line segment according to an exemplary embodiment of the present disclosure.

[0027] The various embodiments described in this document are exemplified for the purpose of clearly explaining the technical concept of the present disclosure and are not intended to limit it to a specific embodiment. The technical concept of the present disclosure includes various modifications, equivalents, alternatives, and embodiments selectively combining all or part of each embodiment described in this document. Furthermore, the scope of the technical concept of the present disclosure is not limited to the various embodiments presented below or the specific descriptions thereof.

[0028] Terms used in this document, including technical or scientific terms, unless otherwise defined, may have the meaning commonly understood by one of ordinary skill in the art to which this disclosure belongs.

[0029] The expressions "includes," "may include," "comprises," "may have," "have," and "may have" used in this document imply the presence of a target feature (e.g., a function, operation, or component), but do not exclude the presence of other additional features. In other words, such expressions should be understood as open-ended terms that imply the possibility of including other embodiments.

[0030] The singular forms used in this document may include the plural form unless the context clearly indicates otherwise, and this also applies to the singular forms set forth in the claims.

[0031] The expressions "first," "second," or "firstly," "secondly," etc. used in this document, unless the context indicates otherwise, are used to refer to multiple objects and to distinguish one object from another, and do not limit the order or importance among the objects.

[0032] As used herein, the expressions "A, B, and C," "A, B, or C," "A, B, and / or C," or "at least one of A, B, and C," "at least one of A, B, or C," "at least one of A, B, and / or C," "at least one selected from A, B, and C," "at least one selected from A, B, or C," "at least one selected from A, B, and / or C," and the like can mean each of the listed items or all possible combinations of the listed items. For example, "at least one selected from A and B" can refer to (1) A, (2) at least one of A, (3) B, (4) at least one of B, (5) at least one of A and at least one of B, (6) at least one of A and B, (7) at least one of B and A, and (8) both A and B.

[0033] The expression "based on" or "according to" as used in this document is used to describe one or more factors that influence the decision, act of judgment, or action described in the phrase or sentence containing the expression, and this expression does not exclude additional factors that influence the decision, act of judgment, or action.

[0034] As used herein, the expression that a component (e.g., a first component) is “connected” or “connected” to another component (e.g., a second component) may mean that the component is directly connected or connected to the other component, as well as connected or connected via a new other component (e.g., a third component).

[0035] The expression "configured to" as used in this document can have the meanings of "set to", "having the ability to", "modified to", "made to", and "capable of", depending on the context. The expression is not limited to the meaning of "specifically designed in hardware", and for example, a processor configured to perform a specific operation can mean a special purpose computer structured through programming to perform the specific operation.

[0036] FIG. 1 is a drawing for explaining a system for acquiring scan data using a three-dimensional scanner (200) according to an exemplary embodiment of the present disclosure.

[0037] According to one embodiment, the 3D scanner (200) may be a dental medical device for acquiring scan data of the surface of an object (20). Here, the surface of the object (20) may be an inner surface of the oral cavity of the object (20).

[0038] For example, the 3D scanner (200) may be an intraoral scanner. For example, a user (10) (e.g., a dentist, a dental hygienist) may use the 3D scanner (200) to obtain scan data on the intraoral structure of a subject (20) (e.g., a patient) from a subject (20).

[0039] For example, a user (10) may obtain an image of the oral structure of the subject (20) from a diagnostic model (e.g., plaster model, impression model) that mimics the shape of the oral structure of the subject (20).

[0040] Hereinafter, for convenience of explanation, it is described that scan data for the oral structure of the subject (20) is obtained by scanning the oral structure of the subject (20), but the present disclosure is not limited thereto, and it is also possible to obtain scan data for other parts of the subject (20).

[0041] For example, the 3D scanner (200) may have a form that can be inserted and withdrawn into the oral cavity, and may be a handheld scanner in which the user (10) can freely adjust the scanning distance and scanning angle.

[0042] In one embodiment, a 3D scanner (200) can be inserted into the oral cavity of a subject (20) to scan the oral cavity in a non-contact manner, thereby obtaining scan data on the oral cavity structure.

[0043] For example, scan data for an intraoral structure may represent an image including a dental region consisting of at least one tooth, a gingival region, an artificial structure that can be inserted into the oral cavity, etc. Here, the artificial structure may include an orthodontic device including a bracket and a wire, a prosthesis such as an inlay and a veneer, an implant, a denture, an orthodontic auxiliary device inserted into the oral cavity, a splint, etc.

[0044] For example, the 3D scanner (200) can irradiate light into the oral cavity of the subject (20) using a light source (or projector). As a specific example, the 3D scanner (200) can irradiate light to at least a portion of the oral cavity, such as a tooth area or a gingival area, and can receive light reflected from the oral cavity of the subject (20) through a camera (or an image sensor). As another example, the 3D scanner (200) can obtain scan data on the intraoral structure by scanning a diagnostic model of the oral cavity. If the diagnostic model of the oral cavity is a diagnostic model modeled after the intraoral structure of the subject (20), the scan data for the diagnostic model of the oral cavity can be scan data on the intraoral structure of the subject (20). For the convenience of explanation, the following description will assume a case in which scan data on the intraoral structure is obtained by scanning the inside of the oral cavity of the subject (20), but the present disclosure is not limited thereto.

[0045] In one embodiment, a three-dimensional scanner (200) can acquire two-dimensional scan data of an intraoral structure of a subject (20) based on information received through a camera. Here, the two-dimensional scan data of the intraoral structure can represent a two-dimensional image of the intraoral structure.

[0046] For example, two-dimensional scan data for the oral cavity structure of the subject (20) may represent a two-dimensional image including the tooth area, gingival area, artificial structure, tongue, etc. inside the oral cavity of the subject (20).

[0047] In one embodiment, two-dimensional scan data of an intraoral structure acquired from a three-dimensional scanner (200) can be transmitted to an electronic device (100) via a wired or wireless communication network.

[0048] For example, the electronic device (100) may be a computer device or a portable communication device. The electronic device (100) may generate three-dimensional scan data of an intraoral structure, which represents the intraoral structure in three dimensions, based on two-dimensional scan data of the intraoral structure received from a three-dimensional scanner (200). As a specific example, the electronic device (100) may generate three-dimensional scan data of the intraoral structure by three-dimensionally modeling the intraoral structure based on the two-dimensional scan data of the intraoral structure received.

[0049] In one embodiment, the 3D scanner (200) can scan the intraoral structure of the object (20) to obtain 2D scan data of the intraoral structure, and generate 3D scan data of the intraoral structure based on the scan data. That is, the 3D scanner (200) can generate 3D scan data of the intraoral structure and transmit it to the electronic device (100).

[0050] In one embodiment, the electronic device (100) may be connected to a cloud server (not shown) or a database (not shown).

[0051] For example, the electronic device (100) can transmit two-dimensional scan data or three-dimensional scan data of the oral structure of the object (200) to a cloud server or database, and the cloud server or database can store the two-dimensional scan data or three-dimensional scan data of the oral structure of the object (20) received from the electronic device (100).

[0052] Although the 3D scanner (200) was described above with a focus on a handheld scanner, the present disclosure can also be applied to a table scanner that is fixed to a specific location and used. That is, the method proposed in the present disclosure can also be implemented using a table scanner. The table scanner can generate 3D scan data for an oral cavity diagnostic model by scanning the oral cavity diagnostic model. Since the light source (or projector) and camera of the table scanner are fixed, the user (10) can scan the oral cavity diagnostic model while moving the oral cavity diagnostic model.

[0053] FIG. 2 is a block diagram of an electronic device (100) and a 3D scanner (200) according to an exemplary embodiment of the present disclosure.

[0054] In one embodiment, the electronic device (100) and the 3D scanner (200) can be connected to each other through a wired or wireless communication network and can transmit and receive various data to each other.

[0055] In one embodiment, the 3D scanner (200) may include at least one of a processor (201), a memory (202), a communication circuit (203), a light source (204), a camera (205), an input device (206), or a sensor module (sensor) (207). At least one of the components included in the 3D scanner (200) may be omitted, or another component may be added to the 3D scanner (200). Additionally or alternatively, some of the components may be implemented in an integrated manner, or may be implemented as a single or multiple entities. At least some of the components within the 3D scanner (200) may be connected to each other via a bus, a general purpose input / output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI), to exchange data and / or signals.

[0056] In one embodiment, the processor (201) of the 3D scanner (200) is a configuration capable of performing operations or data processing related to control or communication of each component of the 3D scanner (200) and may be operatively connected to the components of the 3D scanner (200). The processor (201) may load commands or data received from other components of the 3D scanner (200) into the memory (202), process the commands or data stored in the memory (202), and store the result data.

[0057] In one embodiment, the memory (202) of the 3D scanner (200) can store at least one instruction for the operation of the processor (201).

[0058] In one embodiment, the communication circuit (203) of the 3D scanner (200) can establish a wired or wireless communication channel with an external device including an electronic device (100) and transmit and receive various data with the external device.

[0059] For example, the communication circuit (203) may include at least one port for connecting to an external device via a wired cable in order to communicate with the external device via a wire. In this case, the communication circuit (203) may communicate with the external device connected via a wired cable through at least one port.

[0060] For example, the communication circuit (203) may be configured to connect to a cellular network (e.g., 3G, LTE, 5G, Wibro, or Wimax) by including a cellular communication module.

[0061] For example, the communication circuit (203) can transmit and receive data with an external device including an electronic device (100) using short-range communication (e.g., Wi-Fi, BLE (Bluetooth, Bluetooth Low Energy), UWB) by including a short-range communication module.

[0062] For example, the communication circuit (203) may include a contactless communication module for contactless communication. As a specific example, the contactless communication may include at least one contactless proximity communication technology, such as near field communication (NFC) communication, radio frequency identification (RFID) communication, or magnetic secure transmission (MST) communication.

[0063] In one embodiment, the light source (204) of the 3D scanner (200) can irradiate light toward the inside of the oral cavity of the object (20). For example, the light irradiated from the light source (204) may be structured light having a predetermined pattern. As a specific example, the predetermined pattern may be a stripe pattern in which straight lines of different colors appear continuously. The structured light pattern may be generated using a pattern mask or a digital micro-mirror device (DMD), but is not limited thereto.

[0064] In one embodiment, the camera (205) of the 3D scanner (200) can obtain 2D scan data of the intraoral structure of the object (20) by receiving reflected light reflected by the intraoral structure of the object (20).

[0065] For example, the camera (205) may include a left camera corresponding to the left eye field of view and a right camera corresponding to the right eye field of view to construct three-dimensional scan data according to an optical triangulation method. For example, the camera (205) may include at least one image sensor, such as a CCD sensor or a CMOS sensor.

[0066] In one embodiment, the input device (206) of the 3D scanner (200) can receive user input for controlling the 3D scanner (200). For example, the input device (206) can include at least one of a button for receiving a push operation from a user (10), a touch panel for detecting a touch from a user (10), or a voice recognition device including a microphone. For example, the user (10) can control the start or stop of scanning using the input device (206).

[0067] In one embodiment, the sensor module (207) of the 3D scanner (200) can detect the operating status of the 3D scanner (200) or an external environmental status (e.g., a user's movement) and generate an electrical signal corresponding to the detected status. For example, the sensor module (207) can include at least one of a gyro sensor, an acceleration sensor, a gesture sensor, a proximity sensor, or an infrared sensor.

[0068] For example, a user (10) can control the start or stop of scanning using a sensor module (207). As a specific example, when a user (10) holds a 3D scanner (200) in his / her hand and moves it, the 3D scanner (200) can control the processor (201) to start a scanning operation when the angular velocity measured through the sensor module (207) exceeds a predetermined threshold value.

[0069] In one embodiment, in response to receiving a user input to initiate a scan via an input device (206) of the 3D scanner (200) or an input device (109) of the electronic device (100), the 3D scanner (200) may initiate a scan.

[0070] In one embodiment, the 3D scanner (200) may start scanning according to processing in the processor (201) of the 3D scanner (200) or the processor (101) of the electronic device (100).

[0071] In one embodiment, when a user (10) scans the intraoral structure of an object (20) through a three-dimensional scanner (200), the three-dimensional scanner (200) can generate two-dimensional scan data for the intraoral structure of the object (20) and transmit the two-dimensional scan data for the intraoral structure of the object (20) to an electronic device (100) in real time.

[0072] For example, the electronic device (100) can display a two-dimensional image of the intraoral structure of the received object (20) represented by the two-dimensional scan data of the intraoral structure through the display (107).

[0073] For example, the electronic device (100) can generate three-dimensional scan data for the intraoral structure of the object (20) based on two-dimensional scan data for the intraoral structure of the object (20). In addition, the electronic device (100) can display a three-dimensional image for the intraoral structure represented by the three-dimensional scan data for the intraoral structure of the object (20) through the display (107). The electronic device (100) can also display the process of generating the three-dimensional scan data for the intraoral structure in real time through the display (107).

[0074] For example, the electronic device (100) may generate data for an intraoral attachment that can be mounted on at least a portion of the intraoral structure of the subject (20) based on three-dimensional scan data for the intraoral structure. Here, the intraoral attachment may be an attachment (device) that can be mounted inside the oral cavity of the patient and is designed for various purposes such as fixing teeth of the patient, orthodontic treatment, and tooth protection. For example, the intraoral attachment may be referred to as a tooth fixing device for fixing teeth of the patient, an orthodontic treatment device for correcting teeth of the patient, a tooth protection device for protecting teeth of the patient, etc. Meanwhile, the present disclosure is not limited thereto, and the intraoral attachment is a term encompassing various types of devices that can be mounted inside the oral cavity, and embodiments of the present disclosure may be applied to such devices even if they are referred to by terms having the same or similar meanings. The data for the intraoral attachment may represent an image of the shape of the intraoral attachment.

[0075] The electronic device (100) can display an image of the shape of the intraoral appliance through a display (107). The electronic device (100) can also display the process of generating data about the intraoral appliance in real time through the display (107). In addition, the electronic device (100) can display an image of the shape of the intraoral appliance through an external display connected via wire or wirelessly.

[0076] In one embodiment, the electronic device (100) may include at least one of one or more processors (101), one or more memories (103), communication circuits (105), a display (107), or an input device (109). At least one of the components included in the electronic device (100) may be omitted, or another component may be added to the electronic device (100). Additionally or alternatively, some of the components may be implemented in an integrated manner, or may be implemented as a single or multiple entities. At least some of the components within the electronic device (100) may be connected to each other via a bus, GPIO, SPI, MIPI, or the like, to exchange signals or data.

[0077] In one embodiment, one or more processors (101) of the electronic device (100) may be configured to perform operations or data processing related to control or communication of each component of the electronic device (100).

[0078] For example, one or more processors (101) may be operatively connected to components of the electronic device (100). The one or more processors (101) may load commands or data received from other components of the electronic device (100) into one or more memories (103), process commands or data stored in the one or more memories (103), and store result data.

[0079] In one embodiment, one or more memories (103) of the electronic device (100) may store at least one instruction for the operation of one or more processors (101). For example, one or more memories (103) may store data received from a three-dimensional scanner (200) (e.g., two-dimensional scan data or three-dimensional scan data of an intraoral structure).

[0080] In one embodiment, the communication circuit (105) of the electronic device (100) establishes a wired or wireless communication channel with an external device, including at least one of a 3D scanner (200), a cloud server (not shown), a printer, etc., and can transmit and receive various data with the external device. For example, the communication circuit (105) may include at least one port for connecting to the external device via a wired cable in order to communicate with the external device via a wired connection. In this case, the communication circuit (105) may communicate with the external device connected via a wired connection through at least one port.

[0081] For example, the communication circuit (105) may be configured to connect to a cellular network (e.g., 3G, LTE, 5G, Wibro, or Wimax) by including a cellular communication module.

[0082] For example, the communication circuit (105) can transmit and receive data with an external device including at least one 3D scanner (200), a cloud server (not shown), a printer, etc., using short-range communication (e.g., Wi-Fi, BLE, UWB) including a short-range communication module.

[0083] For example, the communication circuit (105) may include a contactless communication module for contactless communication. As a specific example, the contactless communication may include at least one contactless proximity communication technology, such as NFC communication, RFID communication, or MST communication.

[0084] In one embodiment, the display (107) of the electronic device (100) can display various screens based on the control of the processor (101). For example, the processor (101) of the electronic device (100) can control components of the electronic device (100) to display two-dimensional scan data or three-dimensional scan data regarding the intraoral structure of the object (20) through the display (107). For example, the processor (101) can control components of the electronic device (100) to display data regarding an intraoral attachment that can be mounted on at least a portion of the inside of the oral cavity of the object (20) through the display (107).

[0085] For example, a specific application execution screen may be displayed on the display (107) of the electronic device (100), and two-dimensional scan data or three-dimensional scan data of an intraoral structure may be displayed on the execution screen. In addition, data on an intraoral appliance may be displayed on the execution screen. Here, a web browser or application for executing a specific application may be installed on the electronic device (100). The user (10) may edit, save, and delete the two-dimensional scan data or three-dimensional scan data of an intraoral structure displayed on the display (107) using the input device (109). In addition, the user (10) may edit, save, and delete the data on an intraoral appliance displayed on the display (107) using the input device (109).

[0086] In one embodiment, an input device (109) of an electronic device (100) may receive commands or data to be used by components of the electronic device (100) (e.g., one or more processors (101)) from an external source of the electronic device (100) (e.g., a user (10)). For example, the input device (109) may be implemented in the form of a touch sensor panel that is coupled with a display (107) and can recognize contact or proximity of various external objects.

[0087] FIG. 3 is a perspective view of a three-dimensional scanner (200) according to an exemplary embodiment of the present disclosure.

[0088] In one embodiment, the 3D scanner (200) may include a main body (210) and a probe tip (220). For example, the main body (210) may be of a shape that is easy for a user (10) to hold by hand. For example, the probe tip (220) may be of a shape that is easy to insert and withdraw into the oral cavity of the object (20). For example, the main body (210) may be coupled to and separated from the probe tip (220). For example, components of the 3D scanner (200) described in FIG. 2A may be arranged inside the main body (210).

[0089] For example, an opening may be formed at one end of the main body (210) so that light output from a light source (204) can be irradiated into the oral cavity of the subject (20). The light irradiated through the opening may be reflected by the oral cavity structure of the subject (20) and then enter through the opening again. The reflected light entering through the opening may be captured by a camera (205) to generate two-dimensional scan data of the oral cavity structure of the subject (20).

[0090] For example, a user (10) can start scanning using an input device (206) (e.g., a button) of a 3D scanner (200). As a specific example, when the user (10) touches or presses the input device (206), light from a light source (204) can be irradiated onto the object (20).

[0091] In one embodiment, a user (10) can scan the intraoral structure of a subject (20) by moving a 3D scanner (200), and the 3D scanner (200) can obtain 2D scan data of the intraoral structure of the subject (20).

[0092] In one embodiment, a user may scan a diagnostic model of the oral cavity of a subject (20) by moving a three-dimensional scanner (200), and in the process, acquire two-dimensional scan data for the diagnostic model. Here, the two-dimensional scan data for the diagnostic model may represent an image of the shape of the intraoral structure.

[0093] For example, two-dimensional scan data for an oral cavity structure may represent a two-dimensional image for an area including the front teeth of the object (20), a two-dimensional image for an area including the molars of the object (20), etc.

[0094] For example, the 3D scanner (200) can transmit the acquired 2D scan data to the electronic device (100). In this case, the electronic device (100) can generate 3D scan data for the intraoral structure based on the received 2D scan data for the intraoral structure. Here, the 3D scan data for the intraoral structure can include at least one of maxillary scan data, mandibular scan data, or bimaxillary (occlusion) scan data of the intraoral structure.

[0095] FIG. 4A and FIG. 4B are drawings for explaining maxillary scan data (301), mandibular scan data (302), and bimaxillary scan data (300) of an intraoral structure according to an exemplary embodiment of the present disclosure.

[0096] In one embodiment, the three-dimensional scan data for the surface of the object (20) may include at least one of maxillary scan data (301), mandibular scan data (302), or bimaxillary scan data (300). Here, the surface of the object (20) may include the surface of an intraoral structure of the object (20).

[0097] In one embodiment, the maxillary scan data (301) may be three-dimensional scan data of the maxillary surface generated based on two-dimensional scan data obtained as a result of scanning the maxillary surface within the oral cavity. For example, the maxillary scan data (301) may represent a tooth region (311) and a gingival region (321) within the maxilla. For example, based on the maxillary scan data (301), data regarding an intraoral fixture that can be mounted on the maxilla within the oral cavity may be generated.

[0098] In one embodiment, the mandibular scan data (302) may be three-dimensional scan data of the mandibular surface generated based on two-dimensional scan data obtained as a result of scanning the mandibular surface within the oral cavity. For example, the mandibular scan data (302) may represent a tooth region (312) and a gingival region (322) within the mandible. For example, based on the mandibular scan data (302), data regarding an intraoral fixture that can be mounted on the mandible within the oral cavity may be generated.

[0099] In one embodiment, the bimaxillary scan data (300) may be three-dimensional scan data of the bimaxillary surfaces generated based on two-dimensional scan data obtained as a result of scanning the maxillary and mandibular surfaces within the oral cavity. Alternatively, the bimaxillary scan data (300) may be generated based on the maxillary scan data (301) and the mandibular scan data (302). That is, the bimaxillary scan data (300) may be scan data representing an image generated by synthesizing an image represented by the maxillary scan data (301) and an image represented by the mandibular scan data (302). For example, based on the bimaxillary scan data (300), data for an intraoral attachment that can be simultaneously mounted on the maxillary and mandibular surfaces within the oral cavity may be generated.

[0100] Hereinafter, the description of the data processing method proposed in the present disclosure will proceed assuming that data for an intraoral appliance is generated based on mandibular scan data (302). However, this is merely for convenience of explanation, and the embodiments of the present disclosure are not limited thereto. In other words, the description below can be equally applied even when data for an intraoral appliance is generated based on maxillary scan data (301) or bimaxillary scan data (300).

[0101] FIG. 5 is a diagram illustrating a process for identifying an initial point for generating a margin line according to an exemplary embodiment of the present disclosure.

[0102] Specifically, FIG. 5 illustrates a first tooth model (Tx) on an exemplary three-dimensional oral cavity model, which may be displayed via a display (107) of an electronic device (100) or an external display. The three-dimensional oral cavity model may be an example of the three-dimensional scan data described above. The first tooth model (Tx) may represent some of the tooth data constituting the bimaxillary scan data (300) described above.

[0103] The electronic device (100) can identify an initial point (P0) on the oral cavity model. The initial point (P0) can be used as an initial position for generating a margin line, which will be described below. According to an example, the electronic device (100) can identify the initial point (P0) by receiving an input specifying the initial point (P0) from the outside. The input specifying the initial point (P0) received from the outside can be a point specified by an external user, or can be a point suitable for generating a margin line derived from an external computing device, etc. In addition, the electronic device (100) can identify the initial point (P0) by deriving an appropriate point through internal calculations using a configuration such as a processor (101) and a memory (103). For example, the initial point (P0) can be derived through a computing operation utilizing artificial intelligence (AI), and the initial point (P0) can be identified based on curvature information of the oral cavity model.

[0104] An initial point (P0) according to an example may be located on an area where a margin line is to be formed on the first tooth model (Tx). Here, the margin line may refer to a boundary line formed by artificial structures such as the aforementioned prosthesis and the tooth. The margin line may indicate a boundary between the inner and outer surfaces of a prosthesis for a specific tooth of a target oral cavity expressed by a 3D oral cavity model. The outer surface of the prosthesis may be a part that is exposed when the prosthesis is actually inserted into the target oral cavity, and the inner surface of the prosthesis may be a part that is not exposed when the prosthesis is actually inserted into the target oral cavity. At this time, the margin line may refer to a line spaced apart by a certain distance from the boundary line between the artificial structure and the tooth, taking into account the thickness or step of the artificial structures such as the prosthesis. An initial point (P0) according to an example may be located on an area where a margin line is to be formed on the first tooth model (Tx), for example, an area where an artificial structure is to be inserted, and having a large curvature on the tooth surface.

[0105] The electronic device (100) can identify the initial point (P0) and determine the search direction for generating a margin line. The method by which the electronic device (100) determines the search direction and thus the search points will be described in detail later in FIG. 6 and elsewhere.

[0106] FIG. 6 is a drawing for showing curvature information for a three-dimensional oral model according to an exemplary embodiment of the present disclosure.

[0107] Specifically, FIG. 6 is a diagram showing curvature information for a portion of the first tooth model (Tx) of FIG. 5. The curvature information may be derived from data regarding a three-dimensional oral cavity model, or may be input as curvature information corresponding to the three-dimensional oral cavity model from the outside. The curvature information for the three-dimensional oral cavity model may include principal curvature values ​​for points forming the curved surface of the oral cavity model. The curvature information according to an example may be displayed through the display (107) of the electronic device (100) or an external display; however, the curvature information does not necessarily need to be displayed, and the process of displaying it through the display may be omitted. In addition, the electronic device (100) may display the curvature information on the display in response to a request received from the outside. The display of the curvature information according to an example may represent curvature distributions distributed on the curved surface of the oral cavity model in different colors or shades.

[0108] The electronic device (100) may determine a search direction from an identified initial point (P0) based on curvature information for the 3D oral cavity model. For example, the electronic device (100) may identify points of the oral cavity model adjacent to the initial point (P0) and identify points that satisfy a predetermined curvature criterion among the points of the oral cavity model adjacent to the initial point (P0). In one example, the electronic device (100) may determine a direction from the initial point (P0) toward a point with the largest curvature among the points of the oral cavity model adjacent to the initial point (P0) as a search direction. In addition, the electronic device (100) may determine a direction opposite to a point with the largest curvature among the points of the oral cavity model adjacent to the initial point (P0) as a search direction. Details related to the determination of the search direction and the search of search points will be described in detail later with reference to FIGS. 7A to 7C.

[0109] FIGS. 7A, 7B and 7C are diagrams illustrating a plurality of first search points, a plurality of second search points and an initial closed path according to an exemplary embodiment of the present disclosure.

[0110] Specifically, FIG. 7A illustrates a plurality of first search points positioned along a first search direction according to an exemplary embodiment of the present disclosure, FIG. 7B illustrates a plurality of second search points positioned along a second search direction according to an exemplary embodiment of the present disclosure, and FIG. 7C illustrates an initial closed path according to an exemplary embodiment of the present disclosure. Hereinafter, FIGS. 7A, 7B, and 7C will be described with reference to the drawings described above, and any description overlapping with the above will be omitted.

[0111] Referring to FIGS. 7A and 7B , the electronic device (100) according to an example may determine a direction from the initial point (P0) toward the point with the largest curvature magnitude among the points of the oral cavity model adjacent to the initial point (P0) as a first search direction. In addition, the electronic device (100) according to an example may determine a direction opposite to the point with the largest curvature magnitude among the points of the oral cavity model adjacent to the initial point (P0) as a second search direction. In other words, the electronic device (100) may determine a direction reverse or opposite to the first search direction as the second search direction. Alternatively, the electronic device (100) may determine a direction from the initial point (P0) toward the point with the second largest curvature magnitude among the points of the oral cavity model adjacent to the initial point (P0) as the second search direction. In addition, the electronic device (100) according to the example may determine, as a second search direction, a direction from the initial point (P0) to a point having the largest curvature magnitude among the points of the oral model adjacent to the initial point (P0) and located in an opposite direction to the point having the largest curvature magnitude. The first search direction and the second search direction may be directions moving in different directions from the initial point (P0). The method of determining the first search direction and the second search direction is exemplary, and other suitable methods for forming a margin line may also be used.

[0112] An electronic device (100) according to an example can sequentially determine a plurality of first search points (L1) on a three-dimensional oral cavity model based on curvature information and a first search direction. For example, the electronic device (100) can determine each of the plurality of first search points based on the curvature information and one or more first search points determined immediately before.

[0113] Specifically, the electronic device (100) according to an example can update the first search direction based on two or more first search points that were determined immediately before. For example, the electronic device (100) can update the first search direction based on six previous points from the currently searched point. The six previous points are merely exemplary values, and the search direction update may be performed with reference to a number of points (different from six) appropriate for updating the first search direction. In addition, the update of the first search direction may be performed after a sufficient number of first search points are initially determined. For example, when the electronic device (100) updates the first search direction, if the first search point that was determined immediately before is based on six previous points, the first search point may be determined based on the first search direction that was initially determined from the initial point (P0) and the curvature information before initially determining the six first search points. After determining six or more first search points, the electronic device (100) can update the first search points based on the six first search points previously determined. It should be noted that the number of first search points previously determined described above is exemplary, and the search direction can be updated based on a different number of search points.

[0114] The electronic device (100) can determine the next first search point based on the curvature information and the updated first search direction. The electronic device (100) can determine a plurality of first search points (L1) while sequentially determining the first search points. The electronic device (100) can generate a margin line indicating a closed path on the three-dimensional oral cavity model based on the plurality of first search points (L1).

[0115] Meanwhile, the electronic device (100) according to an example can sequentially determine a plurality of second search points (L2) on a three-dimensional oral cavity model based on curvature information and a second search direction. For example, the electronic device (100) can determine each of the plurality of second search points based on the curvature information and one or more second search points determined immediately before. As described above, the second search direction may be the reverse direction of the first search direction.

[0116] Specifically, the electronic device (100) according to an example can update the second search direction based on two or more second search points that have been determined immediately before. For example, the electronic device (100) can update the second search direction based on six previous points from the currently searched point. The six previous points are exemplary values, and the search direction update may be performed with reference to a number of points appropriate for updating the second search direction. The electronic device (100) can determine the next second search point based on the curvature information and the updated second search direction. The electronic device (100) can determine a plurality of second search points (L2) while sequentially determining the second search points.

[0117] The electronic device (100) may terminate the operation of sequentially determining search points (e.g., a first search point, a second search point, etc.) upon satisfaction of a predetermined termination condition. Specifically, the electronic device (100) may terminate the operation of sequentially determining search points in response to a determination that the predetermined termination condition has been satisfied. At this time, the determination that the termination condition has been satisfied may be based on various conditions. Exemplary termination conditions may be based on at least one of the number of a plurality of search points, the length of a path including at least some of the plurality of search points, the absence of a point in the current search direction from a previously determined search point, or the absence of a point adjacent to a previously determined search point in the current search direction and satisfying a predetermined curvature criterion. For example, when the number of consecutive search points reaches a certain number (e.g., 200), the electronic device (100) may determine that sufficient search points have been found and terminate the operation of sequentially determining search points. As another example, when the path indicated by the search points reaches a certain length (e.g., 20 mm), the electronic device (100) may terminate the operation of sequentially determining search points, deeming that sufficient search points have been found. Furthermore, the electronic device (100) may terminate the operation of sequentially determining search points if no point matches the current search direction or no point among adjacent points satisfies the curvature criterion. The above-described conditions are exemplary, and different conditions may be used depending on the case.

[0118] Referring to FIG. 7C, the electronic device (100) may determine an initial closed path (L3) including a plurality of first search points (L1) and a plurality of second search points (L2). For example, the electronic device (100) may remove overlapping points among the plurality of first search points (L1) and the plurality of second search points (L2). In addition, the electronic device (100) may generate an initial closed path (L3) by connecting the search point with the minimum distance from the corresponding search point to each of the plurality of first search points (L1) and the plurality of second search points (L2). However, this is exemplary, and the electronic device (100) may also determine the initial closed path (L3) based on additional search points in addition to the first search point (L1) and the plurality of second search points (L2). Additionally, the electronic device (100) may generate an initial closed path (L3) based on only one of the plurality of first search points (L1) or the plurality of second search points (L2). Additionally, the electronic device (100) may determine whether the initial closed path (L3) is twisted or folded, and in response to a determination that it is twisted or folded, may remove the twisted or folded portion of the initial closed path (L3).

[0119] The electronic device (100) can generate a margin line based on the initial closed path (L3). For example, the electronic device (100) can perform post-processing on the initial closed path (L3) to generate the margin line. A specific method for ultimately generating the margin line will be described in detail later in FIGS. 8A and 8B .

[0120] FIG. 8A and FIG. 8B are diagrams illustrating the creation of a margin line according to an exemplary embodiment of the present disclosure.

[0121] Specifically, FIG. 8A illustrates the generation of a margin line (MLx) corresponding to a first tooth model (Tx) according to an exemplary embodiment of the present disclosure, and FIG. 8B illustrates the generation of a margin line (MLy) corresponding to a second tooth model (Ty) according to an exemplary embodiment of the present disclosure. Hereinafter, FIGS. 8A and 8B will be described with reference to the drawings described above, and any description overlapping with the above will be omitted.

[0122] Referring to FIG. 8A, the electronic device (100) can generate a margin line (MLx) based on the initial closed path (L3) illustrated in FIGS. 7A to 7C. For example, the electronic device (100) can generate the margin line (MLx) by performing a post-processing operation, such as line smoothing, on the initial closed path (L3) at least once. In addition, the electronic device (100) can generate the margin line (MLx) by performing projection on a three-dimensional oral model on the initial closed path (L3) at least once. According to an example, the electronic device (100) can generate the margin line (MLx) formed as a smooth curve by performing line smoothing and projection on the three-dimensional oral model on the initial closed path (L3) several times. The generated margin line (MLx) can be utilized later to generate a prosthesis corresponding to the first tooth model (Tx). In addition, the electronic device (100) can perform a task of appropriately modifying the margin line for use in manufacturing a prosthesis according to a real-time modification method to be described later.

[0123] Referring to FIG. 8B, the electronic device (100) can generate a margin line (MLy) corresponding to a second tooth model (Ty) that is different from the first tooth model (Tx). The margin line (MLx) and the margin line (MLy) are margin lines generated corresponding to exemplary embodiments, and it is noted that the electronic device (100) can generate margin lines for different tooth models, and a margin line different from the margin line (MLx) and the margin line (MLy) can be generated.

[0124] According to the aforementioned embodiments, margin lines for teeth can be automatically and quickly generated based on a three-dimensional image of the oral cavity. Furthermore, automatic margin line generation allows for quick and efficient margin line work for prosthetic device creation.

[0125] FIG. 9 is a flowchart illustrating a method for generating a margin line according to an exemplary embodiment of the present disclosure.

[0126] Referring to FIG. 9, the electronic device (100) can perform a method (S100) for generating a margin line that includes at least some of the multiple steps (S110 to S140). Hereinafter, FIG. 9 will be described with reference to the drawings described above, and any description that overlaps with the above will be omitted.

[0127] In step S110, the electronic device (100) can identify an initial point (P0) on a three-dimensional oral model. According to an example, the electronic device (100) can identify the initial point (P0) by receiving an input specifying the initial point (P0) from the outside. The input specifying the initial point (P0) received from the outside can be a point specified by an external user, or can be a point suitable for generating a margin line derived through an external computing device, etc. In addition, the electronic device (100) can identify the initial point (P0) by deriving an appropriate point through internal calculations through a configuration such as a processor (101) and a memory (103).

[0128] In step S120, the electronic device (100) may determine a first search direction from the initial point based on curvature information for the three-dimensional oral cavity model. For example, the electronic device (100) may identify points of the oral cavity model adjacent to the initial point (P0), and may identify points that satisfy a predetermined curvature criterion among the points of the oral cavity model adjacent to the initial point (P0). In one example, the electronic device (100) may determine a direction from the initial point (P0) to a point having the largest curvature magnitude among the points of the oral cavity model adjacent to the initial point (P0) as the search direction.

[0129] In step S130, the electronic device (100) may sequentially determine a plurality of first search points (L1) on the three-dimensional oral cavity model based on the curvature information and the first search direction. For example, the electronic device (100) may determine each of the plurality of first search points based on the curvature information and one or more first search points determined immediately before. The electronic device (100) may determine the plurality of first search points (L1) while sequentially determining the first search points.

[0130] Additionally, the electronic device (100) may terminate the operation of sequentially determining search points (e.g., a first search point, a second search point, etc.) upon satisfaction of a predetermined termination condition. Specifically, the electronic device (100) may terminate the operation of sequentially determining search points in response to a determination that a predetermined termination condition has been satisfied.

[0131] In step S140, the electronic device (100) may generate a margin line (MLx) indicating a closed path on a three-dimensional oral cavity model based on a plurality of first search points (L1). For example, the electronic device (100) may perform a post-processing operation on a plurality of first search points (L1) to generate a margin line (MLx) indicating a closed path. Any content overlapping with the above-described content regarding the generation of the margin line will be omitted.

[0132] FIG. 10 is a flowchart illustrating a method for sequentially determining search points according to an exemplary embodiment of the present disclosure.

[0133] Referring to FIG. 10, the electronic device (100) can perform step S130 described above in FIG. 9, including a plurality of steps (S131 to S132). Hereinafter, FIG. 11 will be described with reference to the drawings described above, and descriptions overlapping with those described above will be omitted.

[0134] In step S131, the electronic device (100) may update the first search direction based on two or more first search points determined immediately before. For example, the electronic device (100) may update the first search direction based on six previous points from the currently searched point. The six previous points are exemplary values, and the search direction may be updated by referring to a number of points appropriate for updating the first search direction.

[0135] In step S132, the electronic device (100) can determine the next first search point based on the curvature information and the updated first search direction. The electronic device (100) can determine a plurality of first search points (L1) while sequentially determining the first search points.

[0136] According to the aforementioned embodiments, margin lines for teeth can be automatically and quickly generated based on a three-dimensional image of the oral cavity. Furthermore, automatic margin line generation allows for quick and efficient margin line work for prosthetic device creation.

[0137] FIG. 11 is a flowchart illustrating a method for generating a margin line according to an exemplary embodiment of the present disclosure.

[0138] Referring to FIG. 11, the electronic device (100) can perform a method of generating a margin line by performing a plurality of steps (S210 to S250). Hereinafter, FIG. 11 will be described with reference to the drawings described above, and any description overlapping with the above will be omitted.

[0139] In step S210, the electronic device (100) can identify an initial point (P0) on the three-dimensional oral model. Step S210 may be an example of step S110 of FIG. 9.

[0140] In step S220, the electronic device (100) may determine a first search direction from an initial point based on curvature information about the three-dimensional oral cavity model. For example, the electronic device (100) may identify points of the oral cavity model adjacent to the initial point (P0), and may identify points that satisfy a predetermined curvature criterion among the points of the oral cavity model adjacent to the initial point (P0). Step S220 may be an example of step S120 of FIG. 9.

[0141] In step S230, the electronic device (100) may sequentially determine a plurality of first search points (L1) on the three-dimensional oral cavity model based on the curvature information and the first search direction. The electronic device (100) may determine a plurality of first search points (L1) while sequentially determining the first search points. Step S230 may be an example of step S130 of FIG. 9.

[0142] In step S240, the electronic device (100) may sequentially determine a plurality of second search points (L2) on the three-dimensional oral cavity model based on the curvature information and the second search direction. For example, the electronic device (100) may determine each of the plurality of second search points based on the curvature information and one or more second search points determined immediately before.

[0143] Specifically, the electronic device (100) according to an example can update the second search direction based on two or more second search points that have been determined immediately before. For example, the electronic device (100) can update the second search direction based on six previous points from the currently searched point. The six previous points are exemplary values, and the search direction update may be performed with reference to a number of points appropriate for updating the second search direction. The electronic device (100) can determine the next second search point based on the curvature information and the updated second search direction. The electronic device (100) can determine a plurality of second search points (L2) while sequentially determining the second search points.

[0144] The electronic device (100) may terminate the operation of sequentially determining search points (e.g., a first search point, a second search point, etc.) upon satisfaction of a predetermined termination condition. Specifically, the electronic device (100) may terminate the operation of sequentially determining search points in response to a determination that a predetermined termination condition has been satisfied.

[0145] In step S250, the electronic device (100) may generate a margin line (MLx) indicating a closed path on a three-dimensional oral cavity model based on a plurality of first search points (L1) and a plurality of second search points (L2). A specific example of step S250 will be described in detail in FIG. 12 below.

[0146] FIG. 12 is a flowchart illustrating a method for generating a margin line indicating a closed path according to an exemplary embodiment of the present disclosure.

[0147] Referring to FIG. 12, the electronic device (100) can perform step S250 described above in FIG. 11, including a plurality of steps (S251 to S252). Hereinafter, FIG. 12 will be described with reference to the drawings described above, and descriptions that overlap with those described above will be omitted.

[0148] In step S251, the electronic device (100) may determine an initial closed path (L3) including a plurality of first search points (L1) and a plurality of second search points (L2). For example, the electronic device (100) may remove overlapping points among the plurality of first search points (L1) and the plurality of second search points (L2). In addition, the electronic device (100) may generate an initial closed path (L3) by connecting the search point having the minimum distance from the corresponding search point to each of the plurality of first search points (L1) and the plurality of second search points (L2).

[0149] In step S252, the electronic device (100) can generate a margin line (MLx) based on the initial closed path (L3). For example, the electronic device (100) can generate the margin line (MLx) by performing a post-processing operation, such as line smoothing, on the initial closed path (L3) at least once. In addition, the electronic device (100) can generate the margin line (MLx) by performing projection on a three-dimensional oral cavity model on the initial closed path (L3) at least once. In one example, the electronic device (100) can generate the margin line (MLx) formed as a smooth curve by performing line smoothing and projection on the three-dimensional oral cavity model on the initial closed path (L3) several times.

[0150] According to the aforementioned embodiments, margin lines for teeth can be automatically and quickly generated based on a three-dimensional image of the oral cavity. Furthermore, automatic margin line generation allows for quick and efficient margin line work for prosthetic device creation.

[0151] FIGS. 13a, 13b, 13c and 13d are diagrams illustrating a method for modifying a margin line according to an exemplary embodiment of the present disclosure.

[0152] Specifically, FIGS. 13A to 13D illustrate a method for modifying a margin line (MLy) generated in response to a second tooth model (Ty) according to an exemplary embodiment of the present disclosure. Hereinafter, FIGS. 13A to 13D will be described with reference to the aforementioned drawings, and any descriptions that overlap with those described above will be omitted.

[0153] Referring to FIGS. 13A to 13D, the electronic device (100) can modify the generated margin line (MLy) in real time. Prior to modification, the electronic device (100) according to an example can display a 3D oral cavity model and the margin line (MLy) through the display (107) or an external display. Thereafter, the electronic device (100) can receive an input for entering a modification mode of the margin line (MLy). For example, the input for entering the modification mode can be a mouse click, a mouse click while pressing the control key on the keyboard, or a touch input for a specific interactive element on the display. This is an exemplary input, and other different inputs can be inputs for entering the modification mode of the margin line (MLy). Meanwhile, the input for entering the modification mode can also be used as an input for maintaining the modification mode. For example, all modifications can be maintained while pressing the control key on the keyboard and the mouse click are maintained.

[0154] The electronic device (100) may initiate a modification mode in which movement input is continuously received in response to an input for entering the modification mode. The electronic device (100) may exit the modification mode upon receiving an input to release the modification mode. The movement input according to an example may be a mouse drag or a touch input on the display. However, this is merely exemplary, and different inputs may be presented as the movement input, and the movement input may be changed according to settings.

[0155] The electronic device (100) may, in response to a determination that a predetermined repetition condition has been satisfied during the duration of the modification mode, modify the margin line based on the target line segment (Ls) indicated by the movement input up to the present. For example, the predetermined repetition condition may include the passage of a predetermined time interval, or may include the arrival of a predetermined distance interval of the movement distance indicated by the movement input. If other predetermined repetition conditions are satisfied during the duration of the modification mode, the electronic device (100) may modify the margin line based on the target line segment (Ls) indicated by the movement input up to the present. Specifically, the electronic device (100) may select one or more points among the points constituting the margin line (MLy) based on the target line segment (Ls). Thereafter, the electronic device (100) may move each of the one or more selected points in a direction toward the target line segment (Ls).

[0156] For example, to select one or more points, the electronic device (100) may determine a correction reference point on the margin line (MLy) based on the last point of the target line segment (Ls), and select one or more points based on the correction reference point. Specifically, to determine the correction reference point, the electronic device (100) according to an example may project the last point of the target line segment (Ls) onto the oral cavity curve of the three-dimensional oral cavity model to derive a first point. Thereafter, the electronic device (100) may project the first point onto the margin line (MLy) to derive a second point located on the margin line. The electronic device (100) according to an example may determine the second point as the correction reference point, but this is exemplary, and other points on different margin lines (MLy) may also be determined as the correction reference point.

[0157] An electronic device (100) according to an example may, when selecting one or more points based on a correction reference point, select points on a margin line (MLy) within a predetermined distance from the correction reference point. At this time, the predetermined distance may be designated as a constant value, or may be given as a function of the distance between the correction reference point and the target line segment (Ls). For example, the predetermined distance value may be determined by a negative correlation such that the closer the distance between the correction reference point and the target line segment (Ls), the larger the value of the predetermined distance. In addition, the predetermined distance value may be a value that can be changed by an external input.

[0158] An electronic device (100) according to an example can move each of one or more selected points in a direction toward a target line segment (Ls). The degree to which each of the selected points moves in the direction toward the target line segment (Ls) may be designated as a constant value, or may be given as a function of the distance between the correction reference point and the target line segment (Ls). For example, the closer the distance between the correction reference point and the target line segment (Ls), the greater the degree to which each of the selected points moves in the direction toward the target line segment (Ls). It should be noted that the above-described examples are exemplary cases and are not limited to the above description.

[0159] The electronic device (100) may update the display of the margin line (MLy) on the display in response to the margin line (MLy). For example, in response to determining that a predetermined repetition condition has been satisfied while the modification mode continues, the electronic device (100) may modify the margin line (MLy) based on a first target line segment indicated by the movement input. The electronic device (100) may modify the margin line (MLy) based on the first target line segment to generate a first modified margin line (MLy1). Furthermore, the electronic device (100) may update the display of the margin line (MLy) on the display to the first modified margin line (MLy1).

[0160] A continuous modification mode may be performed even after the first target line segment. Based on a second target line segment indicated by a movement input input during the continuation of the modification mode, the electronic device (100) may modify the first modification margin line (MLy1). The electronic device (100) may modify the first modification margin line (MLy1) based on the second target line segment to generate a second modification margin line (MLy2). In addition, the electronic device (100) may update the display of the first modification margin line (MLy1) to the second modification margin line (MLy2) on the display.

[0161] A continuous modification mode may be performed even after the second target line segment. Based on a third target line segment indicated by a movement input input during the continuation of the modification mode, the electronic device (100) may modify the second modification margin line (MLy2). The electronic device (100) may modify the second modification margin line (MLy2) based on the third target line segment to generate a third modification margin line (MLy3). In addition, the electronic device (100) may update the display of the second modification margin line (MLy2) to the third modification margin line (MLy3) on the display.

[0162] A continuous modification mode may be continued even after the third target line segment. Based on the fourth target line segment indicated by the movement input input during the continuation of the modification mode, the electronic device (100) may modify the third modification margin line (MLy3). The electronic device (100) may modify the third modification margin line (MLy3) based on the fourth target line segment to generate a fourth modification margin line (MLy4). In addition, the electronic device (100) may update the display of the third modification margin line (MLy3) to the fourth modification margin line (MLy4) on the display.

[0163] The interval at which each modified margin line is generated can be determined statically or dynamically so that the user can perceive that the margin line is modified in real time according to his / her movement input while efficiently utilizing the resources of the electronic device (100).

[0164] An electronic device (100) according to an example can receive an input for exiting from the margin line modification mode. The end of the input for entering the modification mode can be used as an input for exiting from the modification mode. The electronic device (100) can exit from the modification mode in response to the input for exiting from the modification mode. Along with the exit from the modification mode, the electronic device (100) can generate a final modified margin line (Mlyf) after the real-time modification of the margin line is finally completed. That is, the electronic device (100) can modify the margin line (MLy) several times during the duration of the modification mode, and ultimately generate the final modified margin line (MLYf). In addition, the electronic device (100) can display the final modified margin line (MLyf) on the display.

[0165] Meanwhile, the margin line (MLy) generated through the aforementioned margin line generation process can fix some of the points constituting the margin line (MLx), like the margin line (MLx) of Fig. 8a. For example, points constituting the margin line (MLy) can be fixed at predetermined intervals. For convenience of description, some of the fixed points among the points constituting the margin line (MLy) will be referred to as "fixed points" hereinafter.

[0166] The electronic device (100) may, in response to an input for entering the modification mode, additionally fix some of the points constituting the margin line (MLy). The fixed points may maintain their positions even during the modification mode unless released. That is, even when entering the modification mode and modifying the margin line (MLy), the electronic device (100) may modify the margin line (MLy) while maintaining the positions of the fixed points.

[0167] At this time, the electronic device (100) can determine that the above-described correction reference point is located between two specific fixed points. That is, the electronic device (100) can determine two fixed points adjacent to the correction reference point among the fixed points based on the correction reference point. According to an example, the electronic device (100) can select one or more points to be moved toward the target line segment (Ls) from among the points located between the correction reference point and the two adjacent fixed points. That is, the electronic device (100) can determine that one or more points to be moved toward the target line segment (Ls) are located between two fixed points on the margin line (MLy).

[0168] Additionally, the electronic device (100) may release some fixed points based on movement input received while the modification mode continues. For example, the electronic device (100) may release the passed fixed point in response to a determination that the modification reference point has passed one of the fixed points on the margin line (MLy) based on a change in the last point of the target line segment (Ls). The released point may have its position modified based on movement input while the modification mode continues.

[0169] According to the aforementioned embodiments, margin lines for teeth can be automatically and quickly generated based on a three-dimensional image of the oral cavity. The aforementioned embodiments allow the user to view areas where margin lines were incorrectly created during margin line generation and perform minimal work to correct the margin lines in real time. Furthermore, automatic margin line generation and real-time correction enable the quick and efficient creation of margin lines for prosthetic devices.

[0170] FIG. 14 is a flowchart illustrating a method for modifying a margin line according to an exemplary embodiment of the present disclosure.

[0171] Referring to FIG. 14, the electronic device (100) can modify a margin line by performing a plurality of steps (S310 to S350). FIG. 14 will be described below with reference to the drawings described above, and any description that overlaps with the above will be omitted.

[0172] Prior to step S310, the electronic device (100) may perform the aforementioned margin line generation method (S100). Any description overlapping with that of FIG. 9 regarding the margin line generation method (S100) will be omitted. Furthermore, the electronic device (100) may receive a margin line generated through external input without performing the margin line generation method (S100).

[0173] In step S310, the electronic device (100) can display a three-dimensional oral model and margin line (MLy) through a display (107) or an external display.

[0174] In step S320, the electronic device (100) may receive an input for entering the margin line (MLy) editing mode. For example, the input for entering the editing mode may be a mouse click, or a mouse click combined with a control key. This is an exemplary input, and other different inputs may be inputs for entering the margin line (MLy) editing mode.

[0175] In step S330, the electronic device (100) may initiate a modification mode in which a movement input is continuously received in response to an input for entering the modification mode. The movement input according to an example may be a mouse drag or a touch input of a display.

[0176] In step S340, in response to determining that a predetermined repetition condition has been satisfied during the duration of the modification mode, the electronic device (100) may modify the margin line based on the target line segment (Ls) indicated by the movement input up to the present. For example, the predetermined repetition condition may include the passage of a predetermined time interval, or may include the arrival of a movement distance indicated by the movement input at a predetermined distance interval. If other predetermined repetition conditions are satisfied during the duration of the modification mode, the electronic device (100) may modify the margin line based on the target line segment (Ls) indicated by the movement input up to the present. A specific example of step S340 will be described in detail below with reference to FIG. 15.

[0177] In step S350, the electronic device (100) can update the display of the margin line on the display in response to the modification of the margin line (MLy). Any description overlapping with that described above in FIGS. 13A to 13D regarding the modification and display update of the margin line will be omitted.

[0178] FIG. 15 is a flowchart illustrating a method for modifying a margin line based on a target line segment according to an exemplary embodiment of the present disclosure.

[0179] Referring to FIG. 15, the electronic device (100) can perform step S340 described above in FIG. 14, including a plurality of steps (S341 to S342). Hereinafter, FIG. 15 will be described with reference to the drawings described above, and descriptions that overlap with those described above will be omitted.

[0180] In step S341, the electronic device (100) may select one or more points among the points constituting the margin line (MLy) based on the target line segment (Ls). For example, to select one or more points, the electronic device (100) may determine a correction reference point on the margin line (MLy) based on the last point of the target line segment (Ls), and select one or more points based on the correction reference point.

[0181] In step S342, the electronic device (100) can move each of one or more selected points in a direction toward the target line segment (Ls).

[0182] According to the aforementioned embodiments, margin lines for teeth can be automatically and quickly generated based on a three-dimensional image of the oral cavity. The aforementioned embodiments allow the user to view areas where margin lines were incorrectly created during margin line generation and perform minimal work to correct the margin lines in real time. Furthermore, automatic margin line generation and real-time correction enable the quick and efficient creation of margin lines for prosthetic devices.

[0183] As described above, exemplary embodiments have been disclosed in the drawings and specification. While specific terminology has been used to describe embodiments herein, it is intended solely to illustrate the technical concept of the present disclosure and is not intended to limit the scope of the present disclosure as defined in the claims. Therefore, those skilled in the art will understand that various modifications and equivalent embodiments are possible. Therefore, the true technical protection scope of the present disclosure should be defined by the technical concept of the appended claims.

Claims

1. In a method performed by an electronic device, A step of identifying initial points on a 3D oral model; A step of determining a first search direction from the initial point based on curvature information for the three-dimensional oral model; A step of sequentially determining a plurality of first search points on the three-dimensional oral model based on the curvature information and the first search direction, wherein each of the plurality of first search points is determined based on the curvature information and one or more first search points determined immediately before; and A step of generating a margin line indicating a closed path on the three-dimensional oral model based on the plurality of first search points. A method comprising:

2. In paragraph 1, The step of identifying the above initial point is: A step of receiving an input specifying the above initial point A method comprising:

3. In paragraph 1, The step of sequentially determining the plurality of first search points is: A step of updating the first search direction based on two or more first search points determined immediately before; and A step of determining a next first search point based on the above curvature information and the updated first search direction. A method comprising:

4. In paragraph 1, The step of sequentially determining the plurality of first search points is: Terminates in response to a determination that a predetermined termination condition has been satisfied; A decision that the above termination conditions have been satisfied is made by A method based on at least one of the number of the plurality of first search points, the length of a path including at least some of the plurality of first search points, the absence of a point in the current search direction from the first search point determined previously, or the absence of a point adjacent to the first search point determined previously in the current search direction and satisfying a predetermined curvature criterion.

5. In paragraph 1, A step of sequentially determining a plurality of second search points on the three-dimensional oral model based on the curvature information and a second search direction from the initial point, wherein the second search direction is a reverse direction of the first search direction, and each of the plurality of second search points is determined based on the curvature information and one or more second search points determined immediately before. In addition, it includes A method wherein the step of generating the above margin line is further based on the plurality of second search points.

6. In paragraph 3, The steps for creating the above margin line are: determining an initial closed path including the plurality of first search points and the plurality of second search points; and A step of generating the margin line based on the initial closed path. A method comprising:

7. In paragraph 6, The step of determining the initial closed path is: For each of the plurality of first search points and the plurality of second search points, a step of connecting the search point having the minimum distance from the search point to the search point How to include.

8. In paragraph 6, The step of generating the margin line based on the initial closed path is: A step of generating the margin line by performing smoothing and projection on the three-dimensional oral model at least once for the initial closed path. A method comprising:

9. In paragraph 1, The above margin line is a method of indicating the boundary between the inner and outer surfaces of a prosthesis for a specific tooth of a target oral cavity represented by the three-dimensional oral cavity model.

10. In paragraph 1, A step of displaying the above 3D oral model and the above margin line through a display. A method further comprising:

11. In paragraph 10, A step of receiving an input for entering the modification mode of the above margin line; In response to an input for entering the above modification mode, a step of initiating the above modification mode for continuously receiving movement input; In response to a determination that a predetermined iteration condition has been satisfied during the continuation of the above modification mode, a step of modifying the margin line based on the target line segment indicated by the movement input up to the present; In response to modification of the above margin line, a step of updating the display of the above margin line on the display. A method of additionally including:

12. In paragraph 11, A method wherein the predetermined repetition condition comprises the elapse of a predetermined time interval.

13. In paragraph 11, A method wherein the predetermined repetition condition includes that the movement distance indicated by the movement input reaches a predetermined distance interval.

14. In paragraph 11, The steps to modify the above margin line are: A step of selecting one or more points among the points constituting the margin line based on the target line segment; and A step of moving each of the one or more selected points in a direction toward the target line segment. A method comprising:

15. In paragraph 14, The step of selecting one or more of the above points is: A step of determining a correction reference point on the margin line based on the last point of the target line segment. A step of selecting one or more points based on the above modification reference points. A method comprising:

16. In paragraph 15, The step of selecting one or more points based on the above modification reference points is: A step of determining that each of the above one or more points is within a predetermined distance from the above correction reference point. A method further comprising:

17. In paragraph 15, A step of fixing some of the points constituting the margin line in response to an input for entering the above modification mode. In addition, including The step of selecting one or more of the above points is: A step of determining two fixed points among the fixed points based on the above-mentioned correction reference point, wherein the correction reference point is located between the two fixed points on the margin line; and A step of determining that the one or more points are located between the two fixed points on the margin line. A method further comprising:

18. In paragraph 17, A step of releasing the passed point in response to a determination that the correction reference point has passed one of the fixed points on the margin line in response to a change in the last point of the target line segment. A method comprising:

19. One or more processors; and One or more memories storing instructions executed by the one or more processors Including, An electronic device, wherein when the instructions are executed by the one or more processors, the one or more processors are configured to execute a method according to any one of claims 1 to 18.

20. In a non-transitory computer-readable recording medium having recorded thereon instructions that, when executed by one or more processors, cause the one or more processors to perform an operation, A non-transitory computer-readable recording medium, wherein the instructions are configured to cause the one or more processors to execute a method according to any one of claims 1 to 18.

Images