Scanning image processing method for oral cavity scanner, apparatus therefor, and recording medium on which instructions for same are recorded

Abstract

A method of the present disclosure may comprise the steps of: receiving an input for selecting a plurality of teeth of a target oral cavity; arranging the first standard teeth in the three-dimensional space; moving the plurality of second standard teeth in a three-dimensional space such that the plurality of second standard teeth corresponding to the plurality of teeth among the first standard teeth are arranged in a space corresponding to the plurality of teeth in the three-dimensional image of the target oral cavity; and overlapping and displaying the three-dimensional image of the target oral cavity and the plurality of second standard teeth.

Description

Technical Field

[0001] This disclosure relates to a method for processing scanned images of an oral scanner, an apparatus thereof, and a recording medium on which instructions thereof are recorded. Background Technology

[0002] A three-dimensional (3D) image of the oral cavity refers to scan data acquired by a 3D scanner that scans teeth and the oral cavity, or a target object obtained by modeling or reconstructing it. This can be used to obtain 3D images of a patient's oral cavity to design dental prostheses or implants or to manufacture orthodontic appliances during restorative treatments such as inlays, onlays, crowns, and implants, as well as other dental treatments such as orthodontics.

[0003] Traditionally, dental prostheses, implants, or orthodontic appliances are handmade after taking impressions of the oral cavity using materials such as alginate. In recent years, digital methods have been widely used, employing 3D scanners to acquire 3D intraoral scans of patients, designing dental prostheses, implants, or orthodontic appliances using computers, and then 3D printing them. Summary of the Invention

[0004] Technical issues

[0005] Various embodiments of this disclosure provide a method for displaying a plurality of first standard library teeth selected by a user to be overlaid with a three-dimensional (3D) image of the oral cavity.

[0006] Various embodiments of this disclosure provide a method for determining the positional information of a plurality of standard teeth and arranging the standard teeth using segmentation and / or edge lines, wherein the segmentation and / or edge lines separate the tooth region and the gingival region in a 3D image of the oral cavity.

[0007] Various embodiments of this disclosure provide a method for displaying multiple standard teeth in a 3D image of the oral cavity so that a user can edit the multiple standard teeth without switching screens.

[0008] Various embodiments of this disclosure provide a method for creating customized standard teeth using actual dental data of a patient (3D images of the oral cavity).

[0009] The problems to be solved by this disclosure are not limited to those described above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

[0010] Technical solution

[0011] In one embodiment, an image processing method implemented by an electronic device may include: arranging a three-dimensional (3D) image of a target oral cavity in a 3D space; receiving input for selecting a plurality of teeth of the target oral cavity; arranging a first standard tooth corresponding to the 3D image of the target oral cavity in a 3D space; moving a plurality of second standard teeth in a 3D space such that the plurality of second standard teeth corresponding to a plurality of teeth in the first standard teeth are arranged in a space corresponding to a plurality of teeth in the 3D image of the target oral cavity; and displaying the 3D image of the target oral cavity and the plurality of second standard teeth to overlap each other.

[0012] In one embodiment, the method further includes acquiring a plurality of edge lines corresponding to a plurality of teeth, wherein arranging the first standard teeth in 3D space comprises: arranging the first standard teeth in 3D space based on the plurality of edge lines, and wherein each of the plurality of edge lines is a boundary at which a complete tooth begins to emerge from the gingival region of a 3D image of a target oral cavity.

[0013] In one embodiment, obtaining multiple edge lines includes: obtaining multiple edge lines based on the boundary between the tooth region and the gingival region obtained as a segmentation result; or obtaining multiple edge lines based on user input.

[0014] In one embodiment, arranging the first standard tooth in 3D space includes: identifying tooth position numbers corresponding to tooth regions obtained as a segmentation result; and arranging the first standard tooth in 3D space based on the tooth position numbers.

[0015] In one embodiment, the method further includes generating a first standard tooth.

[0016] In one embodiment, generating a first standard tooth includes: expanding the first standard tooth along the direction of the gingival region based on mesh information of at least a portion of the first standard tooth corresponding to a tooth region in a 3D image of a target oral cavity and a tooth region in a tooth region and a gingival region.

[0017] In one embodiment, generating the first standard tooth further includes processing the enlarged region in the enlarged first standard tooth based on multiple edge lines.

[0018] In one embodiment, receiving input for selecting a plurality of teeth in a target oral cavity includes receiving input for selecting a tooth position number for each of the plurality of teeth in the target oral cavity.

[0019] In one embodiment, moving a plurality of second standard teeth in 3D space includes: generating first location information based on each of a plurality of edge lines, the first location information including the center point of a first bounding box of each of the plurality of second standard teeth; generating second location information including the center point of a second bounding box of each of the teeth in a 3D image of a target oral cavity; and generating a correlation between the first location information and the second location information for each of the plurality of second standard teeth based on the origin located in the dental arch of the target oral cavity.

[0020] In one embodiment, generating the correlation includes: generating a tooth-specific transformation matrix based on the origin, the tooth-specific transformation matrix indicating the correlation between first position information of each of a plurality of second standard teeth and second position information having the same tooth position number as each of the plurality of second standard teeth.

[0021] In one embodiment, displaying a 3D image of a target oral cavity and a plurality of second standard teeth to overlap each other includes: displaying a plurality of second standard teeth in 3D space to overlap with a 3D image of a target oral cavity having the same tooth position number as the plurality of second standard teeth, based on a tooth-specific transformation matrix.

[0022] In one embodiment, the origin is the point between the two central incisors in the dental arch.

[0023] In one embodiment, displaying a 3D image of the target oral cavity and a plurality of second standard teeth to overlap each other includes: displaying standard teeth corresponding to the removed teeth to overlap with the 3D image of the target oral cavity based on a tooth-specific transformation matrix corresponding to the removed teeth.

[0024] In one embodiment, the tooth-specific transformation matrix corresponding to the removed tooth is generated based on second position information including points in the dental arch corresponding to tooth position numbers, and the standard tooth corresponding to the removed tooth includes a dental prosthesis corresponding to the removed tooth.

[0025] In one embodiment, displaying a 3D image of the target oral cavity and a plurality of second standard teeth to overlap each other includes: displaying standard teeth corresponding to the prepared teeth to overlap with the 3D image of the target oral cavity based on a tooth-specific transformation matrix corresponding to the prepared teeth.

[0026] In one embodiment, the tooth-specific transformation matrix corresponding to the prepared tooth is generated based on second location information, the center point of the second bounding box of the second location information is changed based on the difference between the height of the highest point of the prepared tooth and the height of the highest point of the standard tooth corresponding to the prepared tooth, and the standard tooth corresponding to the prepared tooth includes the dental prosthesis corresponding to the prepared tooth.

[0027] In one embodiment, displaying a 3D image of the target oral cavity and a plurality of second standard teeth overlapping each other includes: displaying connectors between the plurality of second standard teeth based on a determination that the plurality of second standard teeth corresponding to the plurality of teeth are connected via connectors.

[0028] In another embodiment, an electronic device includes: a processor; a network interface communicatively connected to an oral scanner; a display; a memory; and a computer program loaded into the memory and executed by the processor, wherein the computer program is configured to: arrange a three-dimensional (3D) image of a target oral cavity in 3D space; receive input for selecting a plurality of teeth of the target oral cavity; arrange a first standard tooth corresponding to the 3D image of the target oral cavity in 3D space; move a plurality of second standard teeth in 3D space such that the plurality of second standard teeth corresponding to a plurality of teeth in the first standard teeth are arranged in a space corresponding to a plurality of teeth in the 3D image of the target oral cavity; and display the 3D image of the target oral cavity and the plurality of second standard teeth overlapping each other.

[0029] In another embodiment, a non-transitory computer-readable recording medium is provided having a computer program executed by a processor, the computer program including: instructions for arranging a three-dimensional (3D) image of a target oral cavity in 3D space; instructions for receiving input for selecting a plurality of teeth of the target oral cavity; instructions for arranging first standard teeth corresponding to the 3D image of the target oral cavity in 3D space; instructions for moving a plurality of second standard teeth in 3D space such that the plurality of second standard teeth corresponding to a plurality of teeth in the first standard teeth are arranged in a space corresponding to a plurality of teeth in the 3D image of the target oral cavity; and instructions for displaying the 3D image of the target oral cavity and the plurality of second standard teeth overlapping each other.

[0030] Beneficial effects

[0031] According to some embodiments of this disclosure, a method is provided for displaying a plurality of first standard teeth selected by a user to be superimposed on a three-dimensional (3D) image of the oral cavity.

[0032] According to some embodiments of this disclosure, a method is provided for determining the positional information of a plurality of standard teeth and arranging the standard teeth using segmentation and / or edge lines, wherein the segmentation and / or edge lines separate the tooth region and the gingival region in a 3D image of the oral cavity.

[0033] According to some embodiments of this disclosure, a method is provided to display multiple standard teeth to overlap with a 3D image of the oral cavity, thereby allowing a user to edit multiple standard teeth without switching screens.

[0034] According to some embodiments of this disclosure, a method is provided for forming customized standard teeth using actual dental data of a patient (3D images of the oral cavity). Attached Figure Description

[0035] Figure 1 This is a diagram illustrating a scanning environment according to an embodiment of the present disclosure.

[0036] Figure 2 It is shown Figure 1 The diagram shows the electronic device and the dental scanner.

[0037] Figure 3 It shows a reference. Figure 2 A diagram describing an oral scanner.

[0038] Figure 4a and 4b This is a diagram showing a three-dimensional (3D) image of the target oral cavity according to the present disclosure.

[0039] Figure 4c This is a diagram showing a first standard tooth according to this disclosure.

[0040] Figure 5 This is a diagram showing the edge lines according to this disclosure.

[0041] Figure 6 This is a diagram illustrating a method for selecting multiple teeth according to the present disclosure.

[0042] Figure 7 This is a diagram showing second positional information in a 3D image of the oral cavity according to the present disclosure.

[0043] Figure 8 This is a diagram showing the first position information of a standard tooth according to this disclosure.

[0044] Figure 9 This indicates that the reference will be made. Figure 8 The standard teeth described and the reference Figure 7 A diagram describing a method for overlaying 3D images of the oral cavity.

[0045] Figure 10 This is a flowchart illustrating a method according to the present disclosure for displaying a standard tooth by a server to overlap with a 3D image of the oral cavity. Detailed Implementation

[0046] The embodiments described herein are used to illustrate the technical ideas of this disclosure. The scope of this disclosure is not limited to the following embodiments or their detailed descriptions.

[0047] All technical or scientific terms used herein have the meanings commonly understood by one of ordinary skill in the art to which this disclosure pertains, unless otherwise stated. The terminology used herein is for the purpose of clarifying this disclosure and is not intended to limit the scope of rights under this disclosure.

[0048] As used herein, expressions such as “include,” “provided with,” and “have” should be understood as open-ended terms, implying the possibility of including other embodiments, unless otherwise mentioned in the phrase or sentence that includes such expression.

[0049] Singular expressions may include the meaning of plural expressions, unless otherwise specified, and this also applies to singular expressions recited in the claims. The terms “first,” “second,” etc., used herein are used to distinguish multiple components from one another and are not intended to limit the order or importance of the relevant components.

[0050] As used in this disclosure, the term "cell" refers to a software component or hardware component, such as a field-programmable gate array (FPGA) and an application-specific integrated circuit (ASIC). However, a "cell" is not limited to software and hardware; it can be configured in addressable memory or configured to run on one or more processors. For example, a "cell" can include components such as software components, object-oriented software components, class components, and task components, as well as processors, functions, properties, procedures, subroutines, program code segments, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functionality provided in components and "cells" can be combined into a smaller number of components and "cells," or further subdivided into additional components and "cells."

[0051] The term "based on" as used in this document is used to describe one or more factors that influence a decision, judgment, or action described in a phrase or sentence that includes the relevant statement, and does not exclude additional factors that influence the decision, judgment, or action.

[0052] When a component is described as being "coupled to" or "connected to" another component, it should be understood that the component can be directly coupled to or connected to the other component, or that the component can be coupled to or connected to the other component via a new intermediate component.

[0053] In the following description, embodiments of the present disclosure will be described with reference to the accompanying drawings. In the drawings, the same or related components are indicated by the same reference numerals. Repeated descriptions of the same or related components will be omitted in the following description of the embodiments. However, even if a component is omitted, it does not mean that the component is excluded from the embodiments.

[0054] Figure 1 This is a diagram illustrating a scanning environment according to an embodiment of the present disclosure. Specifically, Figure 1The scanning environment shown is an environment in which an oral scanner 200 according to an embodiment of the present disclosure is used to acquire images of a patient's oral cavity. Here, the oral scanner 200 may be a dental device for acquiring images of the oral cavity of a target object 20 (e.g., a patient).

[0055] like Figure 1 As shown, user 10 (e.g., dentist, dental hygienist) can use oral scanner 200 to acquire oral images of target object 20 from target object 20. As another example, user 10 can acquire oral images of target object 20 from a diagnostic model (e.g., plaster cast, impression model) that replicates the oral cavity of target object 20. In the following description, for ease of description, the description will be based on an example of acquiring oral images of target object 20, but the scope of this disclosure is not limited to this example. Furthermore, the area to be photographed to acquire images is not limited to the oral cavity of target object 20, and images of other areas of target object 20 (e.g., the ears of target object 20) can also be acquired.

[0056] In the following description, Figure 1 The operation of the components shown will be described in detail.

[0057] Figure 1 The electronic device 100 shown can receive two-dimensional (2D) images of the oral cavity of the target subject 20 from the oral scanner 200. Here, the electronic device 100 can communicate with the oral scanner 200 via a wired or wireless communication network. Furthermore, the electronic device 100 can generate a 3D image of the oral cavity by modeling the internal structure of the oral cavity based on the received 2D image; detailed operations related to this will be described later with reference to FIG4. The 3D image of the oral cavity generated in this way can be displayed to the user 10 or the target subject 20 via the display of the electronic device 100. In this case, the user 10 can provide appropriate medical services to the target subject 20 by referring to the 3D image displayed on the display of the electronic device 100.

[0058] In some embodiments, the electronic device 100 may receive a 3D image of the oral cavity generated by the oral scanner 200. Here, the oral scanner 200 may scan the oral cavity of the target object 20 and acquire a 2D image of the oral cavity, and may generate a 3D image of the oral cavity based on the acquired 2D image. That is, regardless of where the operation of generating the 3D image is processed, it should be noted that such operation is included within the scope of this disclosure.

[0059] Furthermore, the electronic device 100 can be communicatively connected to a cloud server (not shown). In this case, the electronic device 100 can send 2D or 3D images of the oral cavity of the target object 20 to the cloud server, and the cloud server can store the 2D or 3D images of the oral cavity of the target object 20 received from the electronic device 100.

[0060] The electronic device 100 described so far can be implemented as a computing device, and examples of computing devices will be referred to later. Figure 2 Detailed description.

[0061] Figure 1 The oral scanner 200 shown can be inserted into and removed from the oral cavity, and can be a handheld scanner whose scanning distance and scanning angle can be freely adjusted by the user 10.

[0062] An oral scanner 200 can be inserted into the oral cavity and perform a non-contact scan of the internal oral cavity to acquire images of the oral cavity. The images of the oral cavity may include at least one tooth, gums, or artificial structures that can be inserted into the oral cavity (e.g., orthodontic appliances including brackets and archwires, implants, dentures, orthodontic attachments configured for insertion into the oral cavity, etc.). Specifically, the oral scanner 200 can project light onto the oral cavity of the target subject 20 using a light source (or projector) and receive the light reflected from the oral cavity of the target subject 20 via a camera (or at least one image sensor).

[0063] Furthermore, the oral scanner 200 can acquire a 2D image of the surface of the oral cavity of the target object 20 based on information received via a camera. Here, the surface image of the oral cavity of the target object 20 may include at least one of the target object 20's teeth, gums, artificial structures, cheeks, tongue, or lips.

[0064] As described above, in some embodiments, the oral scanner 200 can scan the oral cavity to obtain a 2D image of the oral cavity, and can generate a 3D image of the oral cavity based on the obtained 2D image of the oral cavity.

[0065] The described oral scanner 200 can be implemented as a computing device, and an example of such a computing device will be referred to later. Figure 2 Detailed description.

[0066] Figure 2 It is shown Figure 1 Block diagram of electronic device 100 and oral scanner 200 shown. Figure 2 The block diagrams shown herein illustrate only exemplary embodiments for achieving the purposes of this disclosure, and some components may be added or removed as needed. Furthermore, Figure 2 The components of the block diagram shown are functional elements based on their functional divisions, and it should be noted that multiple different components may be integrated and implemented in a real physical environment. Each component of the block diagram will be described in detail below.

[0067] Figure 2The electronic device 100 shown may include at least one processor 101, at least one memory 103, communication circuitry 105, a display 107, and / or an input device 109. As described above, at least one of the components included in the electronic device 100 may be omitted, or other components may be added to the electronic device 100. Additionally or alternatively, some components may be integrated and implemented, or may be implemented as a single entity or multiple entities. At least some components in the electronic device 100 may be interconnected via a bus, general purpose input / output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI), and may transmit and receive data and / or signals.

[0068] One or more processors 101 of the electronic device 100 may be configured to perform operations or data processing associated with control and / or communication with components of the electronic device 100 (e.g., memory 103). One or more processors 101 may be operatively connected to components of the electronic device 100, for example. Furthermore, one or more processors 101 may load instructions or data received from other components of the electronic device 100 into one or more memories 103, process instructions or data stored in one or more memories 103, and store resulting data.

[0069] Subsequently, one or more memories 103 of the electronic device 100 may store various data, instructions, and / or information. Specifically, one or more memories 103 may store instructions associated with the operation of the processor 101 as a computer program. In addition, one or more memories 103 may store relevant models constructed according to machine learning algorithms. Furthermore, one or more memories 103 may store data received from the oral scanner 200 (e.g., 2D or 3D images of the oral cavity).

[0070] Subsequently, the communication circuit (network interface) 105 of the electronic device 100 can establish a wired or wireless communication channel with an external device (e.g., an oral scanner 200, a cloud server (not shown)) and can send and receive various data with the external device. In some embodiments, for wired communication with an external device, the communication circuit 105 may include at least one port for connection to the external device via a wired cable. In this case, the communication circuit 105 can communicate with the external device connected via at least one port in a wired manner. In some embodiments, the communication circuit 105 may include a cellular communication module and may be configured to connect to a cellular network (e.g., 3G, LTE, 5G, Wibro, or WiMAX). In some embodiments, the communication circuit 105 may include a short-range communication module and can send and receive data with the external device via short-range communication (e.g., Wi-Fi, Bluetooth, Bluetooth Low Energy (BLE), UWB). In some embodiments, the communication circuit 105 may include a contactless communication module for contactless communication. Here, contactless communication may include at least one contactless short-range communication technology, such as near field communication (NFC), radio frequency identification (RFID) communication, or magnetic secure transmission (MST) communication. In addition to the examples above, the electronic device 100 may be implemented using various known methods for communicating with external devices, and it should be noted that the scope of this disclosure is not limited to the examples described above.

[0071] Subsequently, the display 107 of the electronic device 100 can display various screens under the control of the processor 101. Here, under the control of the processor 101, 2D images of the oral cavity of the target object 20 received from the oral scanner 200 and / or 3D images obtained by modeling the internal structure of the oral cavity in three dimensions can be displayed on the display 107. In this case, in order to display the 2D and / or 3D images of the oral cavity on the display 107, for example, a web browser or a dedicated application can be installed in the electronic device 100. In some embodiments, the web browser or dedicated application can be implemented to provide the user 10 with the function of editing, storing, and deleting 2D and / or 3D images of the oral cavity via a user interface.

[0072] Subsequently, the input device 109 of the electronic device 100 can receive instructions or data for components of the electronic device 100 (e.g., processor 101) from outside the electronic device 100 (e.g., a user). The input device 109 may include, for example, a microphone, mouse, or keyboard. In some embodiments, the input device 109 may be coupled to a display 107 and may be implemented as a touch sensor panel capable of recognizing the touch or proximity of various external objects. However, the scope of this disclosure is not limited to the examples described above, and for user convenience, various known input devices 109 may be included within the scope of this disclosure.

[0073] Figure 2 The dental scanner 200 shown may include a processor 201, a memory 202, a communication circuit 203, a light source 204, a camera 205, and / or an input device 206. As described above, at least one of the components included in the dental scanner 200 may be omitted, or other components may be added to the dental scanner 200. Additionally or alternatively, some components may be integrated and implemented, or may be implemented as a single entity or multiple entities. At least some components in the dental scanner 200 may be connected to each other via a bus, general purpose input / output (GPIO), serial peripheral interface (SPI), or mobile industrial processor interface (MIPI), and may send and receive data and / or signals.

[0074] The processor 201 of the oral scanner 200 may be a component capable of performing operations or data processing associated with the control and / or communication of the components of the oral scanner 200, and is operatively connected to the components of the oral scanner 200. Furthermore, the processor 201 may load instructions or data received from other components of the oral scanner 200 into the memory 202, process the instructions or data stored in the memory 202, and store result data.

[0075] Subsequently, the memory 202 of the oral scanner 200 may store instructions associated with the aforementioned operations of the processor 201.

[0076] Subsequently, the communication circuitry 203 of the dental scanner 200 can establish a wired or wireless communication channel with an external device (e.g., electronic device 100) and can send and receive various data with the external device. In some embodiments, for wired communication with an external device, the communication circuitry 203 may include at least one port for connection to the external device via a wired cable. In this case, the communication circuitry 203 can communicate with the external device connected via at least one port in a wired manner. In some embodiments, the communication circuitry 203 may include a cellular communication module and may be configured to connect to a cellular network (e.g., 3G, LTE, 5G, Wibro, or WiMAX). In some embodiments, the communication circuitry 203 may include a short-range communication module and can perform data transmission and reception with the external device via short-range communication (e.g., Wi-Fi, Bluetooth, Bluetooth Low Energy (BLE), UWB). In some embodiments, the communication circuitry 203 may include a contactless communication module for contactless communication. Here, contactless communication may include at least one contactless short-range communication technology, such as near-field communication (NFC), radio frequency identification (RFID) communication, or magnetic secure transmission (MST) communication. In addition to the examples above, the oral scanner 200 may be implemented using various known methods for communicating with external devices, and it should be noted that the scope of this disclosure is not limited to the examples described above.

[0077] Subsequently, the light source 204 of the oral scanner 200 can project light onto the oral cavity of the target object 20. For example, the light projected from the light source 204 can be structured light with a predetermined pattern (e.g., a stripe pattern including a pattern of a series of straight lines with different colors). Here, the pattern of the structured light can be generated, for example, using a pattern mask or a digital micro-mirror device (DMD), but this disclosure is not limited thereto.

[0078] Subsequently, the camera 205 of the oral scanner 200 can receive reflected light from the oral cavity of the target object 20 and acquire a 3D image of the oral cavity of the target object 20. Here, the camera 205 may include a left camera corresponding to the left eye's field of view and a right camera corresponding to the right eye's field of view to construct a 3D image based on optical triangulation. In addition, the camera 205 may include at least one image sensor, such as a CCD sensor or a CMOS sensor.

[0079] Subsequently, the input device 206 of the oral scanner 200 can receive user input for controlling the oral scanner 200. For example, the input device 206 may include a button for receiving press operations by the user 10, a touch panel for detecting the user 10's touch, and a voice recognition device including a microphone. In this case, the user 10 can use the input device 206 to control the start or stop of the scan.

[0080] The operation of the oral scanner 200 controlled by the input device 206 will be described in detail. The oral scanner 200 can receive user input for starting a scan via the input device 206 of the oral scanner 200 or the input device 206 of the electronic device 100, and can begin scanning according to processing implemented by the processor 201 of the oral scanner 200 or the processor 201 of the electronic device 100. Here, when the user 10 uses the oral scanner 200 to scan the internal oral cavity of the target object 20, the oral scanner 200 can generate a 2D image of the oral cavity of the target object 20 and can send the 2D image of the oral cavity of the target object 20 to the electronic device 100 in real time. In this case, the electronic device 100 can display the received 2D image of the oral cavity of the target object 20 on the display 107. Furthermore, based on the 2D image of the oral cavity of the target object 20, the electronic device 100 can generate (construct) a 3D image of the oral cavity of the target object 20 and can display the 3D image of the oral cavity on the display 107. In this case, the electronic device 100 can display the 3D image being generated in real time on the display 107.

[0081] Subsequently, the sensor module 207 of the oral scanner 200 can detect the operating state of the oral scanner 200 or the external environmental state (e.g., user's actions), and can generate an electrical signal corresponding to the detected state. The sensor module 207 may include at least one of a gyroscope sensor, an accelerometer, a gesture sensor, a proximity sensor, or an infrared sensor. In this case, the user 10 can use the sensor module 207 to control the start or stop of the scan. Specifically, for example, if the user 10 holds the oral scanner 200 and moves it, the processor 201 can control the oral scanner 200 to start the scanning operation when the angular velocity measured via the sensor module 207 exceeds a predetermined value.

[0082] In the following description, reference will be made to Figure 3 The oral scanner 200 described above is described in detail. Figure 3 It shows a reference. Figure 2 A diagram describing an oral scanner 200.

[0083] Figure 3The oral scanner 200 shown may include a body 210 and a probe tip 220. Here, the body 210 of the oral scanner 200 may be shaped to allow the user 10 to easily hold it for use, and the probe tip 220 may be shaped to allow easy insertion into and removal from the oral cavity of the target object 20. Furthermore, the body 210 can be joined and separated from the probe tip 220. Additionally, a reference [device / structure] may be provided inside the body 210. Figure 2 The components of the described oral scanner 200 are shown. An opening may be formed at one end of the main body 210, which is open to allow light emitted from the light source 204 to be projected onto the target object 20. The light projected through the opening can be reflected by the target object 20 and re-enter the opening. Here, the reflected light entering the opening can be captured by a camera, thereby generating an image of the target object 20. Furthermore, the user 10 can start the scan using the input device 206 (e.g., a button) of the oral scanner 200. For example, when the user 10 touches or presses the input device 206, light from the light source 204 can be projected onto the target object 20.

[0084] Reference Figures 1 to 3 The scanning environment and its components, according to some embodiments of the present disclosure, have been described in detail.

[0085] In this disclosure, a standard tooth is a sample tooth (standard tooth) used for manufacturing dental prostheses, implants, orthodontic appliances, etc., and may have a typical tooth shape. A standard tooth can be represented as a 3D image and can be displayed based on mesh information. There can be one sample tooth (standard tooth) for each tooth position number. Each sample tooth may include general features of a natural tooth shape corresponding to its tooth position number. For example, when a patient's intended tooth is missing or extracted for treatment and a dental prosthesis is needed for the missing or extracted tooth, the shape of the corresponding sample tooth can be used to effectively manufacture a dental prosthesis with a natural shape. Furthermore, a 3D image of the oral cavity can be captured by an oral scanner 200, and the mesh may have a relatively low level of completion. When the mesh has a low level of completion, it may not be suitable for manufacturing dental prostheses, implants, orthodontic appliances, etc., via 3D printing. On the other hand, a standard tooth can be a dental model with a highly complete mesh. Therefore, it may be suitable to use a 3D printing approach to manufacture dental prostheses, implants, orthodontic applications, etc., by modifying standard teeth. By arranging standard teeth in a 3D image of a patient's mouth, these standard teeth can serve as intermediate models suitable for digitally manufacturing dental prostheses, implants, orthodontic appliances, etc.

[0086] In another embodiment, a standard tooth can be generated based on a 3D image of the oral cavity. The standard tooth can be generated based on mesh information corresponding to tooth regions in the segmented tooth and gingival regions of the 3D image of the oral cavity. Through the above, the electronic device 100 can generate a standard tooth that resembles the patient's actual teeth.

[0087] In another embodiment, a standard tooth can be generated based on past 3D images of the oral cavity of a predetermined target. For example, a 3D image of the patient's oral cavity, acquired before the predetermined tooth is lost or extracted, can be stored in memory 103. Electronic device 100 can generate a standard tooth based on a 3D image of the oral cavity including the complete predetermined tooth. In this case, the standard tooth may include the patient's original natural tooth shape.

[0088] Standard teeth can be used to manufacture dental prostheses, implants, orthodontic appliances, and dental instruments. Therefore, the time and effort required to manufacture dental prostheses, implants, orthodontic appliances, and dental instruments can be reduced, the accuracy and productivity of dental prostheses, implants, orthodontic appliances, and dental instruments can be improved, and the amount of computing resources consumed to obtain the same results can be reduced.

[0089] In this disclosure, standard teeth, pre-designed to some extent for each tooth position number (dental formula), can be used. For the fabrication of dental prostheses, implants, and orthodontic appliances, the standard teeth can be displayed to overlap (align) with a 3D image of the oral cavity. When the process of overlapping or aligning standard teeth in a 3D image is performed manually, dentist or dental technician fatigue may increase, and the accuracy and productivity of the output may decrease. Therefore, the amount of computational resources consumed to obtain equivalent results may increase.

[0090] Furthermore, when using more than two standard teeth, the standard teeth may be selected one by one and may need to be edited and manually arranged in a separate editing screen. Therefore, the following description will detail a method for arranging and displaying two or more standard teeth in a 3D image of the oral cavity, and for editing two or more standard teeth on the same screen without switching screens.

[0091] In one embodiment, the electronic device 100 can arrange 3D images of the target oral cavity in 3D space.

[0092] Figure 4a and 4b This is a diagram showing a three-dimensional (3D) image of the target oral cavity of this disclosure.

[0093] Figure 4aAn example of a 3D image 400 of a mouth is shown. The 3D image 400 of the mouth may include a gingival region and a tooth region. An electronic device 100 may separate the gingival region and the tooth region in the 3D image 400 via segmentation. Segmentation may be image segmentation. Image segmentation is a technical process of dividing a digital image into separate, distinguishable parts or objects. This process aims to divide the image into multiple meaningful regions to facilitate the analysis and processing of each part. Specifically, image segmentation is implemented by classifying pixels into groups, each group sharing the same attributes or categories. The regions obtained through segmentation may, for example, include object boundaries, surfaces, or other important factors.

[0094] Figure 4b An example of a tooth region 420 obtained solely from a 3D image 400 of the oral cavity is shown. An electronic device 100 can use the tooth region 420 to generate a standard tooth. By generating a standard tooth from a 3D image of the oral cavity of a predetermined target subject obtained through a scan of the oral cavity, the electronic device 100 can generate a standard tooth suitable for the individual characteristics of the target subject. According to one embodiment, the electronic device 100 can use the tooth region 420 to generate the surface of the standard tooth. The surface of the standard tooth may consist of a mesh. According to one embodiment, the interior of the standard tooth may be represented as a hollow space. According to another embodiment, the interior of the standard tooth may be represented as a solid form based on mesh information associated with the tooth.

[0095] Figure 4c This is a diagram showing the first standard tooth of this disclosure.

[0096] The standard tooth can be provided as a sample tooth with a typical tooth shape, and / or as a tooth generated based on a 3D image of the oral cavity of a predetermined target subject. Therefore, the electronic device 100 can retrieve a standard tooth provided as a sample tooth from the memory 103, or a newly generated standard tooth based on a 3D image of the oral cavity of a predetermined target subject.

[0097] Figure 4c A first standard tooth 440 is shown, generated based on a tooth region 420 obtained from a 3D image 400 of the oral cavity. The first standard tooth 440 may be a 3D image including all standard teeth corresponding to the 3D image of the oral cavity. For example, the first standard tooth 440 may be a 3D image including all standard teeth from tooth position 1 to tooth position 32.

[0098] In this disclosure, the second standard tooth may include at least a portion of the first standard tooth, and for ease of description, they are distinguished. The second standard tooth may be a standard tooth corresponding to a plurality of selected teeth.

[0099] According to one embodiment, electronic device 100 can generate a first standard tooth. The tooth may include a crown region (e.g., a region exposed from the gum line) and a root region (e.g., a region hidden within the gum line). Based on mesh information of the crown region of the standard tooth, electronic device 100 can expand the standard tooth along the direction of the gum line. Since an actual tooth extends from the crown region to the root region, electronic device 100 can form the root region by extending it in the direction of the gum line, so that the standard tooth has a shape similar to that of an actual tooth. A 3D image of the oral cavity may not include the root region. In the case of an actual tooth, the root region is hidden within the gum line, and therefore may not be included in the scan results. Therefore, electronic device 100 can obtain the tooth region and gum region from the 3D image of the oral cavity as a result of segmentation. In this case, the tooth region in the 3D image of the oral cavity may be the crown region of the tooth. Electronic device 100 can generate the crown region of the standard tooth based on the tooth region of the 3D image of the oral cavity. Based on mesh information of a portion of the crown region, the first standard tooth can be expanded along the direction of the gum line. Based on the above, the electronic device 100 can also represent the root region when generating the first standard tooth.

[0100] Electronic device 100 can expand the standard tooth along the direction of the gingival region based on mesh information of region 461, which is at least a part of the standard tooth in the dental region. For example, electronic device 100 can extend the mesh of region 461 along the direction of the gingival region based on the central axis perpendicular to the tooth and perpendicular to the tooth to form a root region. The mesh information of the expanded region 462 can be the same as that of region 461. The expanded region 462 can be used to represent the root region of the standard tooth. When electronic device 100 expands the standard tooth so that the standard tooth overlaps with the 3D image 400, no gaps are visible between the dental region and the gingival region. In this way, the 3D image of the oral cavity overlapping with the standard tooth can facilitate realistic simulation, reduce worker confusion, achieve high efficiency, and reduce the amount of computational resources required to obtain equivalent results.

[0101] According to another embodiment, the standard tooth may represent the crown region but may not represent the root region. When the standard tooth only represents the crown region, the height of the dental prosthesis included in the standard tooth may be lower than that of the actual dental prosthesis to be placed. In this case, the user may need to arbitrarily adjust the height of the dental prosthesis. Therefore, for a realistic simulation, the electronic device 100 may expand the standard tooth based on the mesh information of the crown region of the standard tooth to represent the root region in addition to the crown region of the standard tooth.

[0102] According to one embodiment, the electronic device 100 can process the enlarged region of the first standard tooth based on multiple edge lines. For example, the electronic device 100 can modify the mesh information of the edge line 450 so that the existing region and the enlarged region are distinguished based on the corresponding edge line 450. The electronic device 100 can apply an implicit surfacing scheme to the crown and root regions of the standard tooth to smoothly represent the connection between the crown and root regions. Implicit surfacing is a scheme that defines a surface based on the function values ​​of a mathematical function, specifically points where the function value at any point (x, y, z) is a predetermined value. This scheme mathematically defines the surface, thus ensuring the continuity and smoothness of the surface. Furthermore, by using the implicit surfacing scheme, local details of the model can be handled effectively.

[0103] For example, electronic device 100 can remove a region along the gingival region from a standard tooth based on the edge line of the standard tooth to generate a tooth shape with the actual required length. Electronic device 100 can process the standard tooth to resemble the form of an actual tooth.

[0104] In one embodiment, based on determination that a plurality of teeth include at least one of removed teeth or prepared teeth, electronic device 100 can generate a standard tooth comprising a dental prosthesis corresponding to the plurality of teeth. Removed teeth in dental treatment can be teeth removed by external factors or through dental surgery. Prepared teeth can be teeth pre-prepared for dental restorations or surgery. Prepared teeth can include forms made by various carving or sculpting of teeth to suit predetermined requirements. Prepared teeth are essential for placing various types of dental prostheses, such as crowns, bridges, veneers, etc. Dental prostheses are medical devices designed to replace removed teeth or repair damaged teeth. The prosthesis can include crowns, bridges, dentures, etc., and can be manufactured according to a predetermined purpose and design. Crowns are used to surround and protect damaged teeth, and bridges are used to fill missing portions using abutment teeth. Dentures are used for dental function and aesthetics in patients with remaining teeth or no teeth. Electronic device 100 can identify, via a 3D image of the oral cavity, whether a tooth corresponding to a predetermined tooth position number is a removed tooth or a prepared tooth. As another example, electronic device 100 can determine, based on user input, that a plurality of teeth are at least one of removed teeth or prepared teeth.

[0105] According to one embodiment, the electronic device 100 can receive input for selecting multiple teeth in a target oral cavity. Based on Figure 4a and 4b From the 3D image, the user can determine the teeth for which standard teeth should be generated and arranged. Input for selecting multiple teeth will refer to... Figure 6 Describe it.

[0106] Figure 5 This is a diagram showing the edge lines according to this disclosure.

[0107] The edge line indicates the boundary where a complete tooth begins to emerge from the gingival region of a 3D image of the target oral cavity. For a complete tooth in the target oral cavity, the edge line can be the boundary line between the gingival region and the tooth region in the 3D image of the oral cavity. For example, as... Figure 5 As shown, the edge line 510 can be displayed in the 3D image 400 of the oral cavity. On the other hand, in the case of a removed tooth or a prepared tooth in the target oral cavity, the edge line can be generated by assuming that a complete tooth exists in the corresponding position.

[0108] According to one embodiment, the electronic device 100 can acquire multiple edge lines corresponding to multiple teeth respectively. The electronic device 100 can acquire the edge lines based on the boundary between the tooth region and the gingival region obtained as a segmentation result. According to another embodiment, the electronic device 100 can configure edge lines corresponding to multiple teeth respectively in a 3D image of the oral cavity based on user input. With the above, the user can edit the edge lines automatically configured by the electronic device 100.

[0109] In one embodiment, the electronic device 100 can arrange a first standard tooth 440 in 3D space. The first standard tooth 440 can be placed in the same 3D space as the 3D image 400 of the oral cavity, but can be arranged to be spaced apart from the 3D image 400 of the oral cavity. The first standard tooth 440 can be omitted or can be displayed on a screen.

[0110] In one embodiment, the electronic device 100 can arrange first standard teeth 440 in 3D space based on multiple edge lines. The electronic device 100 can use multiple edge lines such that the first standard teeth 440 are arranged in 3D space to match the oral structure of a 3D image 400 of the oral cavity. The multiple edge lines may each correspond to a tooth position number. For example, in a 3D image of the oral cavity, there may be an edge line A corresponding to tooth position number 1 and an edge line B corresponding to tooth position number 2. The edge lines may each include arrangement information of multiple teeth in the 3D image of the oral cavity. For example, the position of the edge lines in the 3D image of the oral cavity may indicate the position of the teeth in the dental arch. Therefore, the electronic device 100 can arrange the first standard teeth in 3D space by matching the edge lines and the tooth position numbers of the standard teeth. For example, edge line A may correspond to tooth position number 1 in the standard teeth, and edge line B may correspond to tooth position number 2. Therefore, the electronic device 100 can store the edge lines corresponding to each first standard tooth as position information of the 3D tooth image. The position information may include the center point of the edge line. The electronic device 100 can arrange the first standard teeth in 3D space based on the positional information (e.g., edge lines) corresponding to each first standard tooth.

[0111] In another embodiment, electronic device 100 can generate a two-dimensional (2D) image of the oral cavity based on a 3D image of the oral cavity. Electronic device 100 can generate a 2D image of the oral cavity corresponding to the tooth regions obtained from the 3D image of the oral cavity as a segmentation result. Electronic device 100 can identify multiple teeth included in the 2D image by using a tooth position number recognition model and can determine the 2D center coordinates of each tooth. For example, electronic device 100 can determine the 2D center coordinates of tooth position number 6, tooth position number 7, etc. The tooth position number recognition model can be an artificial neural network model and can implement the reasoning process of receiving a 2D image of the oral cavity and identifying teeth from the 2D image of the oral cavity. Electronic device 100 can identify each of the multiple teeth from the 2D image by using the tooth position number recognition model. Electronic device 100 can determine the tooth position number of each of the multiple teeth in the 2D image by using the tooth position number recognition model. The tooth position number can be determined based on a system used for classifying multiple teeth (e.g., Federation of Dentaire International (FDI) or a universal numbering system). For example, a tooth position number recognition model can receive a 2D image and output multiple tooth position numbers from the 2D image based on at least one shape and a color indicating curvature for each tooth. The tooth position number recognition model can be a model trained on the correlation between the 2D image and the tooth position numbers. Electronic device 100 can recognize multiple teeth from the 2D image based on inference results obtained from the tooth position number recognition model, which includes the tooth position numbers. Electronic device 100 can align a first standard tooth in 3D space using positional information corresponding to the tooth position numbers in the 2D image.

[0112] In another embodiment, the electronic device 100 can arrange first standard teeth 440 in 3D space using tooth regions obtained as a segmentation result. The electronic device 100 can identify tooth position numbers corresponding to the tooth regions obtained as a segmentation result. The electronic device 100 can compare a first tooth shape corresponding to a tooth region in a 3D image of the oral cavity with a second tooth shape corresponding to a tooth position number using a tooth position number recognition model, and can identify the tooth position number with the shape most similar to the first tooth shape. The tooth position number recognition model can be a model trained to obtain similarity between images. The tooth position number recognition model can identify a second tooth shape similar to the first tooth shape as an input 3D image, and can output a predetermined tooth position number corresponding to the second tooth shape. The tooth position number recognition model can be a model trained on the correlation between tooth shapes and tooth position numbers in 3D images. In one embodiment, the electronic device 100 can arrange the first standard teeth 440 in 3D space based on tooth position numbers. The tooth position number can indicate the position information of teeth in the dental arch. Therefore, the electronic device 100 can know the position information corresponding to the predetermined tooth position number. For example, electronic device 100 can know the position of tooth number 6 and the position of tooth number 7 in the dental arch. Electronic device 100 can arrange the first standard tooth in 3D space using the position information corresponding to the tooth number. Through the above, the first standard tooth 440 can be arranged in a 3D image to be the same as the oral structure in the 3D image 400 of the oral cavity.

[0113] Figure 6 This is a diagram illustrating a method for selecting multiple teeth according to the present disclosure.

[0114] The screen 600 can display the tooth arrangement and tooth position numbers. The user can select multiple tooth position numbers. The electronic device 100 can receive input for selecting tooth position numbers for each of multiple teeth in the target oral cavity. For example, the user can select teeth 6 (610), 7 (620), 8 (630), and 9 (640) that are adjacent to each other. As another example, the user can also select teeth 1, 5, 14, and 19 that are not adjacent to each other.

[0115] In one embodiment, the electronic device 100 may receive input for selecting multiple teeth and may display a standard tooth corresponding to the selected tooth position number to be superimposed on a 3D image 400 of the oral cavity.

[0116] Through screen 600, the user can select the type of dental prosthesis to be generated for the selected tooth position. For example, when the user selects a tooth position and a crown, post-processing can be performed to align the corresponding standard tooth onto the tooth and generate data for manufacturing the crown. As another example, when the user selects a tooth position and an inlay, post-processing can be performed to align the corresponding standard tooth onto the tooth and generate data for manufacturing the inlay. Furthermore, the user can add a connector 650 for the selected tooth position.

[0117] Figure 7 This is a diagram showing second positional information in a 3D image of the oral cavity according to the present disclosure.

[0118] The second standard teeth and the 3D image can be arranged in different planes. Therefore, the electronic device 100 can move the second standard teeth corresponding to multiple teeth, such that the second standard teeth are arranged in a space corresponding to the multiple teeth in the 3D image of the oral cavity. For this purpose, the electronic device 100 can use first position information corresponding to each second standard tooth and second position information of each tooth in the 3D image of the oral cavity.

[0119] In one embodiment, the electronic device 100 can move a plurality of second standard teeth corresponding to a plurality of teeth in a first standard tooth in a 3D space, such that the plurality of second standard teeth are arranged in a space corresponding to a plurality of teeth in a 3D image of the oral cavity.

[0120] In one embodiment, electronic device 100 can generate second location information of the center point of a second bounding box for each tooth in a 3D image of the oral cavity. Second location information can be generated for each tooth included in the 3D image of the oral cavity. For example, tooth 6 (610), tooth 8 (630), and tooth 9 (640) can correspond to second bounding boxes A (710), C (730), and D (740), respectively. A bounding box refers to the smallest closed rectangular outline that includes an object, primarily used in computer graphics and data analysis. A 3D bounding box is an extension of this concept to 3D space. This can be defined as the narrowest 3D rectangular parallelepiped that includes a specified object. A first bounding box is associated with a standard tooth, and a second bounding box is associated with a tooth included in the 3D image of the oral cavity.

[0121] In another embodiment, electronic device 110 may make the second location information of the removed tooth include a point in the dental arch corresponding to the tooth position number. For the removed tooth, a second bounding box may not be generated. Therefore, electronic device 110 may determine the point in the dental arch corresponding to the tooth position number of the removed tooth as the second location information of the removed tooth. For example, when tooth 7 620 is the removed tooth, electronic device 100 may determine that the second location information includes a point 725 in the dental arch corresponding to tooth position number 7. By placing the point corresponding to the removed tooth in the dental arch, electronic device 100 may represent the standard tooth corresponding to the removed tooth to overlap with its normal position in a 3D image of the oral cavity.

[0122] A dental arch can be represented as a curve. Electronic device 100 can determine the dental arch based on the center points of a second bounding box for each tooth in a 3D image of the oral cavity. The position and shape of the dental arch can be determined by passing through the center points of a maximum number of second bounding boxes. The curve representing the dental arch may not be displayed on the screen.

[0123] In another embodiment, electronic device 110 can store second position information by changing the center point of the second bounding box of the prepared tooth. Based on the difference between the height of the highest point of the prepared tooth and the height of the highest point of the standard tooth corresponding to the prepared tooth, electronic device 100 can store second position information in which the center point of the second bounding box is changed. For example, teeth corresponding to tooth 610, tooth 830, and tooth 9640, respectively, can be prepared teeth. The center points of second bounding boxes A 710, C 730, and D 740 can be center points 713, 733, and 743, respectively. However, given the characteristics of prepared teeth, the height of the prepared tooth may be higher or lower than that of the normal tooth. Therefore, when the first position information of the standard tooth changes based on the center point of the second bounding box of the prepared tooth, a large portion of the standard tooth may be hidden by the gingival region. Therefore, electronic device 100 can change the second position information of the prepared tooth to include a correction point relative to the center point of the second bounding box. For example, the electronic device 100 can move the center point of the second bounding box by a difference, which is the difference between the height of the highest point of the prepared tooth and the height of the highest point of the standard tooth corresponding to the prepared tooth. For example, the electronic device 100 can move the center points 713, 733, and 743, which are the center points of the second bounding boxes A710, C730, and D740, to positions 715, 735, and 745, respectively, and can include the corresponding points in the second position information. For example, the height difference between points 713 and 715 can be the height difference between the height of the highest point of tooth 610 and the height of the highest point of the standard tooth 6.

[0124] Figure 8 This is a diagram showing the first position information of a standard tooth according to this disclosure.

[0125] In one embodiment, based on each of a plurality of edge lines, electronic device 100 may generate first location information including the center point of a first bounding box of each of a plurality of standard teeth. The first location information may refer to the location information of the standard teeth in 3D space. The first standard teeth may be arranged based on the plurality of edge lines. Thus, the plurality of standard teeth may be arranged to resemble the dental structures in a 3D image of the oral cavity in 3D space. Once placed, each standard tooth may have coordinates in 3D space. As an example, the bounding box may be used to determine the coordinates of the standard teeth. Electronic device 100 may generate a first bounding box for each of the plurality of standard teeth (e.g., a second standard tooth). For example, electronic device 100 may generate first bounding boxes A 810, B 820, C 830, and D 840 for teeth 6 610, 7 620, 8 630, and 9 640, respectively. Electronic device 100 may include the center point of the first bounding box in the first location information. For example, the electronic device 100 may include the center point 815 of the first bounding box A 810 of the standard tooth 611 corresponding to tooth 610 in the first position information. In the same manner, the first position information of the standard tooth 621 may include the center point 825 of the first bounding box B 820, the first position information of the standard tooth 631 may include the center point 835 of the first bounding box C 830, and the first position information of the standard tooth 641 may include the center point 845 of the first bounding box D 840.

[0126] In one embodiment, the standard tooth corresponding to the removed tooth can be based on the shape of the dental prosthesis corresponding to the removed tooth. For example, refer to Figure 7 Tooth #7 (620) can be the tooth to be removed. Therefore, standard tooth #7 (621) can be the basis for the shape of the tooth to be removed.

[0127] In one embodiment, the standard tooth corresponding to the prepared tooth can be based on the shape of the dental prosthesis corresponding to the prepared tooth. For example, refer to Figure 7 Teeth 610, 830, and 940 can be prepared teeth. Therefore, standard teeth 611, 831, and 941 can be the basis for the shape of the prosthesis corresponding to the prepared teeth.

[0128] In one embodiment, the electronic device 100 may include connectors between standard teeth based on a determination indicating that multiple standard teeth corresponding to multiple teeth are connected via connectors. For example, based on a determination indicating that standard teeth 611, 721, 831, and 941 are connected via connectors, the electronic device 100 may represent the connectors between standard teeth as a 3D image. The connectors may be represented based on mesh information. A dental bridge is one of the dental treatments used to replace removed teeth. Unlike prepared teeth, in the case of removed teeth, there is no object to attach a dental prosthesis; therefore, a dental bridge provides a structure that retains an artificial tooth by using abutment teeth as support. A dental bridge may include connectors for connecting dental prostheses. Dental bridges may be made of metal, porcelain, or composite materials thereof and may be provided in various forms according to the patient's needs and oral condition.

[0129] Figure 9 This indicates that the reference will be made. Figure 8 The standard teeth described and the reference Figure 7 A diagram describing a method for overlaying 3D images of the oral cavity.

[0130] In one embodiment, the electronic device 100 can move a standard tooth (e.g., a second standard tooth) to the position of a tooth with the same position number in a 3D image of the oral cavity, based on an origin (e.g., the origin in the dental arch of the oral cavity).

[0131] In one embodiment, electronic device 100 can generate a correlation between first and second position information for each of a plurality of second standard teeth, based on an origin in the dental arch of the oral cavity. The correlation between the first and second position information can be generated for each tooth. For example, the correlation between the first and second position information can be generated for each of tooth positions 1, 2, ..., 32. The dental arch of the oral cavity refers to the anatomical structure associated with the arrangement of teeth in which maxillary and mandibular teeth are arranged, and may include a form in which teeth are arranged continuously in an arch-like shape. The maxilla and mandible are respectively distinguished as the maxillary arch and the mandibular arch, and each dental arch is symmetrical relative to the midline. The origin in the dental arch can be determined based on a point between two central incisors. For example, the point between tooth positions 8 and 9 can be determined as the origin in the maxillary arch, and the point between tooth positions 24 and 25 can be determined as the origin in the mandibular arch. As another example, the origin can be the intersection of the dental arch and the midline. The origin can be different for each of the maxilla and mandible. For example, when teeth are present in the maxilla, electronic device 1000 can generate correlations based on the origin of the maxilla. When teeth are present in the mandible, electronic device 100 can generate correlations based on the origin of the mandible.

[0132] In one embodiment, the electronic device 100 can generate a tooth-based transformation matrix based on the origin, the transformation matrix indicating the correlation between first position information of each of a plurality of standard teeth and second position information having the same tooth position number as each of a plurality of second standard teeth. The tooth-based transformation matrix can be a matrix that moves points included in the first position information to the origin and corresponding points to points included in the second position information.

[0133] For example, the transformation matrix of tooth 610 can indicate the correlation between the first positional information of standard tooth 611 based on the origin 601 of the maxillary arch and the second positional information of tooth 610 in a 3D image of the oral cavity. As another example, the transformation matrix of tooth 830 can indicate the correlation between the first positional information of standard tooth 831 based on the origin of the maxillary arch and the second positional information of tooth 8630 in a 3D image of the oral cavity.

[0134] In one embodiment, electronic device 100 may display a 3D image of a target oral cavity and a plurality of second standard teeth to overlap each other. Electronic device 100 may display the plurality of second standard teeth in 3D space to overlap with the 3D image of the oral cavity containing teeth (each having the same tooth position number as the plurality of second standard teeth) based on a tooth-based transformation matrix. Specifically, by applying a tooth-based transformation matrix to all points of a grid included in the second standard teeth, all points of the grid included in the second standard teeth can be arranged in the 3D image of the oral cavity. For example, electronic device 100 may apply a transformation matrix for tooth position number 6 to all points of a grid included in standard tooth 611 to move all points of the grid included in standard tooth 611 to the location in the 3D image of the oral cavity where tooth position number 6 is placed.

[0135] Through the above, the electronic device 100 can display standard tooth 611 6 to overlap with the position of tooth 610 6 in a 3D image of the oral cavity (e.g., the position based on the second position information). In the same manner, the electronic device 100 can display standard tooth 7 621, standard tooth 8 631, and standard tooth 9 641 respectively to overlap with the positions of tooth 7 620, tooth 8 630, and tooth 9 640 6 in a 3D image of the oral cavity.

[0136] In this disclosure, the operation of overlaying multiple standard teeth in a 3D image of the oral cavity involves overlaying the standard teeth while maintaining the 3D image of the oral cavity, and displaying existing teeth in the 3D image of the oral cavity when the standard teeth are moved.

[0137] In one embodiment, the electronic device 100 can display a standard tooth corresponding to the removed tooth to be overlaid on a 3D image of the target oral cavity based on a tooth-based transformation matrix corresponding to the removed tooth. For example, when the removed tooth is tooth 7 620, the electronic device 100 can move the standard tooth 7 621 to the position of tooth 7 620 based on the transformation matrix of tooth 7 620.

[0138] In one embodiment, the electronic device 100 can display a standard tooth corresponding to the prepared tooth to be overlaid with a 3D image of the target oral cavity based on a tooth-based transformation matrix corresponding to the prepared tooth. For example, when the prepared tooth is tooth 610, the electronic device 100 can move the standard tooth 611 to the position of tooth 610 based on the transformation matrix of tooth 610.

[0139] In one embodiment, based on a determination that indicates that multiple standard teeth corresponding to multiple adjacent teeth are connected via connectors, the electronic device 100 may display connectors 910 to connect standard tooth 7 621 and standard tooth 8 631 via connectors.

[0140] Figure 10 This is a flowchart illustrating a method according to the present disclosure for displaying a standard tooth by a server to overlap with a 3D image of the oral cavity.

[0141] In one embodiment, the server may arrange 3D images of the target oral cavity in 3D space during operation S1010.

[0142] In one embodiment, the server may receive input for selecting multiple teeth in a target oral cavity during operation S1020.

[0143] In one embodiment, the server may arrange a first standard tooth corresponding to a 3D image of the target oral cavity in 3D space during operation S1030.

[0144] In one embodiment, the server may move a plurality of second standard teeth corresponding to a plurality of teeth in a first standard tooth in a 3D space during operation S1040, such that the plurality of second standard teeth are arranged in a space corresponding to a plurality of teeth in a 3D image of the oral cavity.

[0145] In one embodiment, the server may display a 3D image of the target oral cavity in operation S1050 to overlap with a plurality of second standard teeth.

[0146] Reference Figures 1 to 10 Various embodiments of this disclosure and their effects have been described. The effects of the technical concept of this disclosure are not limited to those described above, and other effects not mentioned will be clearly understood by those skilled in the art from the description.

[0147] Reference Figures 1 to 10 The described technical ideas can be implemented in the form of computer-readable code in a computer-readable medium that can be read by a computing device (e.g., an electronic device). Here, a computer program implemented by code, when loaded into the memory of a computing device, may include at least one instruction that causes the processor of the computing device to perform operations according to various embodiments of this disclosure. The computer-readable recording medium may be, for example, a removable recording medium (e.g., CD, DVD, Blu-ray disc, USB storage device, removable hard disk, etc.) or a fixed recording medium (e.g., ROM, RAM, hard disk drive included in a computer, etc.). Furthermore, the recording medium may be a non-transitory recording medium. Here, regardless of whether the data is semi-permanently or temporarily stored, a non-transitory recording medium may be a tangible medium and excludes signals propagated in a temporary manner. Furthermore, a computer program stored in the recording medium can be transmitted to another computing device via a network such as the Internet and can be installed in another computing device for use thereon.

[0148] Although the technical concept of this disclosure has been described by way of examples in some embodiments and illustrated in the accompanying drawings, it should be noted that various substitutions, modifications and alterations can be made without departing from the scope of this disclosure, the scope of which can be understood by those skilled in the art to which this disclosure pertains. Furthermore, it should be noted that such substitutions, modifications and alterations are intended to fall within the scope of the appended claims.

Claims

1. An image processing method implemented by an electronic device, the method comprising: Arrange three-dimensional (3D) images of the target oral cavity in 3D space; Receive input for selecting multiple teeth in the target oral cavity; Arrange first standard teeth corresponding to the 3D image of the target oral cavity in the 3D space; Multiple second standard teeth are moved in the 3D space such that the multiple second standard teeth corresponding to multiple teeth in the first standard teeth are arranged in the space corresponding to multiple teeth in the 3D image of the target oral cavity; as well as The 3D image of the target oral cavity and the plurality of second standard teeth are displayed overlapping each other.

2. The method according to claim 1 further includes obtaining a plurality of edge lines corresponding to the plurality of teeth respectively. in, Arranging the first standard teeth in the 3D space includes: Based on the plurality of edge lines, the first standard teeth are arranged in the 3D space, and Each of the plurality of edge lines is the boundary at which a complete tooth begins to emerge from the gingival region of the 3D image of the target oral cavity.

3. The method according to claim 2, wherein, Obtaining the plurality of edge lines includes: Based on the boundary between the tooth region and the gingival region obtained as a segmentation result, the plurality of edge lines are obtained; or Based on user input, the multiple edge lines are obtained.

4. The method according to claim 1, wherein, Arranging the first standard teeth in the 3D space includes: Identify the tooth position number corresponding to the tooth region obtained as a segmentation result; and Based on the tooth position number, the first standard tooth is arranged in the 3D space.

5. The method according to claim 1, further comprising generating the first standard tooth.

6. The method according to claim 5, wherein, Generating the first standard tooth includes: Based on the mesh information of at least a portion of the first standard tooth corresponding to the tooth region in the tooth region and gingival region included in the 3D image of the target oral cavity, the first standard tooth is expanded along the direction of the gingival region.

7. The method according to claim 6, wherein, Generating the first standard tooth also includes: Based on the multiple edge lines, the enlarged area in the enlarged first standard tooth is processed.

8. The method according to claim 1, wherein, Receiving input for selecting multiple teeth in the target oral cavity includes: Receive input for selecting a tooth position number for each of the plurality of teeth in the target oral cavity.

9. The method according to claim 1, wherein, Moving multiple second standard teeth in the 3D space includes: Based on each of the plurality of edge lines, first position information is generated, the first position information including the center point of the first bounding box of each of the plurality of second standard teeth; Generate second location information, the second location information including the center point of a second bounding box of each tooth in the 3D image of the target oral cavity; and Based on the origin located in the dental arch of the target oral cavity, the correlation between the first position information and the second position information of each of the plurality of second standard teeth is generated.

10. The method according to claim 9, wherein, Generating the correlation includes: Based on the origin, a tooth-specific transformation matrix is ​​generated, which indicates the correlation between the first position information of each of the plurality of second standard teeth and the second position information having the same tooth position number as each of the plurality of second standard teeth.

11. The method according to claim 10, wherein, Displaying the 3D image of the target oral cavity and the plurality of second standard teeth overlapping each other includes: Based on the tooth-specific transformation matrix, the plurality of second standard teeth are displayed in the 3D space to overlap with the 3D image of the target oral cavity having the same tooth position number as the plurality of second standard teeth.

12. The method according to claim 11, wherein, The origin is the point between the two central incisors in the dental arch.

13. The method according to claim 1, wherein, Displaying the 3D image of the target oral cavity and the plurality of second standard teeth overlapping each other includes: Based on a tooth-specific transformation matrix corresponding to the removed tooth, a standard tooth corresponding to the removed tooth is displayed to overlap with the 3D image of the target oral cavity.

14. The method according to claim 13, wherein, The tooth-specific transformation matrix corresponding to the removed tooth is generated based on second position information, which includes points in the dental arch corresponding to tooth position numbers, and The standard tooth corresponding to the removed tooth includes the dental prosthesis corresponding to the removed tooth.

15. The method according to claim 1, wherein, Displaying the 3D image of the target oral cavity and the plurality of second standard teeth overlapping each other includes: Based on a tooth-specific transformation matrix corresponding to the prepared tooth, a standard tooth corresponding to the prepared tooth is displayed to overlap with the 3D image of the target oral cavity.

16. The method according to claim 15, wherein, The tooth-specific transformation matrix corresponding to the prepared tooth is generated based on second position information. The center point of the second bounding box of the second position information changes based on the difference between the height of the highest point of the prepared tooth and the height of the highest point of the standard tooth corresponding to the prepared tooth. The standard tooth corresponding to the prepared tooth includes a dental prosthesis corresponding to the prepared tooth.

17. The method according to claim 1, wherein, Displaying the 3D image of the target oral cavity and the plurality of second standard teeth overlapping each other includes: Based on the determination that the plurality of second standard teeth corresponding to the plurality of teeth are connected via connectors, the connectors are displayed between the plurality of second standard teeth.

18. An electronic device comprising: processor; The network interface is communicatively connected to the oral scanner. monitor; Memory; as well as The computer program is loaded into the memory and executed by the processor. The computer program is configured as follows: Arrange three-dimensional (3D) images of the target oral cavity in 3D space; Receive input for selecting multiple teeth in the target oral cavity; Arrange first standard teeth corresponding to the 3D image of the target oral cavity in the 3D space; In the 3D space, a plurality of second standard teeth are moved such that the plurality of second standard teeth corresponding to a plurality of teeth in the first standard teeth are arranged in a space corresponding to a plurality of teeth in the 3D image of the target oral cavity; and The 3D image of the target oral cavity and the plurality of second standard teeth are displayed overlapping each other.

19. A non-transitory computer-readable recording medium having a computer program executed by a processor, the computer program comprising: Instructions for arranging a three-dimensional (3D) image of the target oral cavity in 3D space; For receiving instructions for selecting multiple teeth in the target oral cavity; Instructions for arranging first standard teeth corresponding to the 3D image of the target oral cavity in the 3D space; Instructions for moving a plurality of second standard teeth in the 3D space such that the plurality of second standard teeth corresponding to a plurality of teeth in the first standard teeth are arranged in a space corresponding to a plurality of teeth in the 3D image of the target oral cavity; as well as Instructions for displaying the 3D image of the target oral cavity and the plurality of second standard teeth overlapping each other.

Images