Image processing apparatus, oral scanner and image processing method

Abstract

An image processing apparatus, an oral scanner, and an image processing method are disclosed. The image processing apparatus includes: a communication unit for sending and receiving information to and from the oral scanner; a memory for storing one or more instructions; and a processor for executing the one or more instructions stored in the memory. The processor performs the following operations by executing the one or more instructions: identifying an oral image acquisition pattern based on tip information regarding tips included in the oral scanner; and acquiring an oral image based on two-dimensional image data received from the oral scanner via the communication unit and the identified oral image acquisition pattern. The tip information includes at least one of tip fastening direction information and tip size information.

Description

Technical Field

[0001] The disclosed embodiments relate to an oral cavity image processing apparatus and an oral cavity image processing method. Specifically, they relate to an oral cavity image processing apparatus and method that processes oral cavity images according to a tip coupled to an oral scanner. Background Technology

[0002] Recently, dental scanners, which acquire images of the patient's oral cavity by being inserted into the patient's mouth, have been used as a method for obtaining information about the patient's oral cavity. Dental scanners acquire two-dimensional scan data by scanning images inside the patient's mouth. Data processing devices such as PCs connected to the dental scanner can then use the two-dimensional scan data to generate a three-dimensional virtual model and output it to a display screen.

[0003] Because the data processing device cannot identify whether the two-dimensional scan data obtained by the oral scanner is upper jaw scan data, lower jaw scan data, or upper and lower jaw occlusal scan data, doctors and others need to operate the data processing device to input which part of the body the two-dimensional scan data obtained by the oral scanner is about.

[0004] However, operating the data processing device to select scan data while simultaneously taking pictures of the patient's mouth with an oral scanner is not only cumbersome, but also poses hygiene problems.

[0005] In addition, children have smaller mouths than adults, making it difficult to scan the inside of the mouth using a standard-sized tip made to fit an adult's mouth. Summary of the Invention

[0006] means for solving problems

[0007] An image processing apparatus according to an embodiment includes: a communication unit for sending information to and receiving information from an oral scanner; a memory for storing one or more instructions; and a processor for executing the one or more instructions stored in the memory. The processor performs the following operations by executing the one or more instructions: identifying an oral image acquisition pattern based on tip information about tips included in the oral scanner; and acquiring an oral image based on two-dimensional image data received from the oral scanner via the communication unit and the identified oral image acquisition pattern. The tip information may include at least one of tip fastening direction information and tip size information. Attached Figure Description

[0008] Figure 1 This is a diagram illustrating the oral image processing system of the disclosed embodiments.

[0009] Figure 2This is a diagram illustrating a method for acquiring surface data using an oral scanner according to an embodiment.

[0010] Figure 3 This is a perspective view of an oral scanner according to an embodiment.

[0011] Figure 4 This is a block diagram of the interior of the oral cavity image processing device according to an embodiment.

[0012] Figure 5 This is a diagram illustrating how an oral scanner, according to an embodiment, uses sensors to acquire information about the tip.

[0013] Figure 6 This is a diagram illustrating how an oral scanner, according to an embodiment, uses sensors to acquire information about the tip.

[0014] Figure 7 This is a diagram illustrating how an oral scanner, according to an embodiment, uses sensors to acquire information about the tip.

[0015] Figure 8 This is a diagram illustrating different surface colors according to the size or position of the tip, based on an embodiment.

[0016] Figure 9 This is a diagram illustrating how an oral scanner, according to an embodiment, identifies a scanning pattern and transmits it to a data processing device.

[0017] Figure 10 This is a diagram illustrating the operation of an oral scanner in a small projection mode when the tip is small, according to an embodiment.

[0018] Figure 11 This is a diagram illustrating a method for obtaining tip information from two-dimensional image data and detecting a projection area based on the tip information, according to an embodiment.

[0019] Figure 12 This is a diagram used to illustrate the acquisition of tip information from two-dimensional image data according to an embodiment.

[0020] Figure 13 This is a diagram used to illustrate how the size of the projection area and the size of the region of interest scanned by the camera are adjusted in small projection mode according to an embodiment.

[0021] Figure 14 This diagram illustrates the scanning of the region of interest under different projection modes according to the embodiments.

[0022] Figure 15 An oral cavity image processing system according to an embodiment is shown.

[0023] Figure 16 A sequence diagram of an oral cavity image processing method according to an embodiment is shown.

[0024] Figure 17 This is a sequence diagram illustrating the process of acquiring tip information using an oral imaging processing system according to an embodiment.

[0025] Figure 18 This is a sequence diagram illustrating a method for acquiring oral cavity images in a recognized scanning pattern according to an embodiment.

[0026] Figure 19 This is a sequence diagram illustrating a method for acquiring oral cavity images using different projection patterns based on the size of the tip, according to an embodiment.

[0027] Figure 20 This is a diagram illustrating the sequence of how the oral scanner adjusts the projection mode according to the image processing device in accordance with the embodiment. Detailed Implementation

[0028] In an embodiment, the processor can perform the following operations by executing one or more instructions: receiving the tip information from the oral scanner via the communication unit, or obtaining the tip information from the two-dimensional image data received via the communication unit.

[0029] In an embodiment, the processor can perform the following operations by executing one or more instructions: detecting a mirror region in the two-dimensional image data, and acquiring the tip information based on at least one of the size and shape of the mirror region.

[0030] In an embodiment, the processor can perform the following operations by executing one or more instructions: based on the tip information including the tip size information, identify a projection pattern according to the tip size information, generate control information according to the projection pattern, transmit the control information to the dental scanner through the communication unit, and receive new two-dimensional image data acquired by the dental scanner based on the control information through the communication unit; the control information is information that controls the dental scanner to operate in a first projection pattern when the tip is a first-sized tip, and controls the dental scanner to operate in a second projection pattern when the tip is a second-sized tip.

[0031] In an embodiment, the processor identifies a scanning mode based on the tip information, including the tip fastening direction information, and processes the two-dimensional image data according to the identified scanning mode to obtain an oral cavity image. The identified scanning mode may be one of an upper jaw scanning mode, a lower jaw scanning mode, and an occlusal scanning mode.

[0032] An oral scanner according to an embodiment includes: an oral scanner body and a tip detachably attached to the oral scanner body; the oral scanner body includes: a camera for acquiring two-dimensional image data by scanning the oral cavity, a memory for storing one or more instructions, and a processor for executing the one or more instructions stored in the memory; the processor performs the following operation by executing the one or more instructions: acquiring tip information regarding the tip attached to the oral scanner body; the tip information may include at least one of tip fastening direction information and tip size information.

[0033] In one embodiment, the oral scanner body further includes a sensor, and the wall of the tip has at least one of different thicknesses and different colors depending on the direction. The sensor can sense the tip and acquire tip information based on at least one of the distance from the sensor to the wall of the tip and the color of the wall of the tip.

[0034] In one embodiment, the oral scanner body further includes a sensor, the tip includes a plurality of protrusions and is rotatable in a state coupled to the oral scanner body, the sensor can sense the tip and acquire tip information based on at least one of the distance from the sensor to the protrusions identified according to the rotation of the tip and the color of the protrusions.

[0035] In an embodiment, the processor can perform the following operations by executing one or more instructions: detecting a mirror region in the two-dimensional image data acquired by the camera, and acquiring the tip information based on at least one of the size and shape of the mirror region.

[0036] In one embodiment, the main body of the oral scanner may further include: a communication unit that sends information to and receives information from the image processing device; the communication unit transmits the acquired two-dimensional image data and the tip information to the image processing device.

[0037] In one embodiment, the main body of the oral scanner further includes: a projector for projecting light; the communication unit receives control information generated based on the tip information from the image processing device, the control information being information that controls the oral scanner to operate in a first projection mode when the tip is a first-sized tip, and controls the oral scanner to operate in a second projection mode when the tip is a second-sized tip; the processor can perform the following operations by executing one or more instructions: when the control information requires operation in the first projection mode, causing the projector to project light in a first projection area and causing the camera to acquire two-dimensional image data in a first region of interest; and when the control information requires operation in the second projection mode, causing the projector to project light into a second projection area smaller than the first projection area and causing the camera to acquire two-dimensional image data in the second region of interest smaller than the first region of interest.

[0038] In an embodiment, the processor can perform the following operations by executing one or more instructions: identifying an oral cavity image acquisition pattern based on the tip information, and acquiring an oral cavity image based on the two-dimensional image data and the identified oral cavity image acquisition pattern.

[0039] In an embodiment, the processor performs the following operations by executing one or more instructions: based on the tip information including the tip fastening direction information, identifying a scanning mode according to the tip fastening direction information, and processing the two-dimensional image data according to the identified scanning mode to obtain the oral cavity image. The identified scanning mode may be one of the maxillary scanning mode, mandibular scanning mode, and occlusal scanning mode.

[0040] In one embodiment, the oral scanner body further includes: a projector for projecting light; and a processor that can perform the following operations by executing one or more instructions: based on the tip information including the tip size information, identifying a projection mode according to the tip size information; when the identified projection mode is a first projection mode, causing the projector to project light in a first projection area and causing the camera to acquire the two-dimensional image data in a first region of interest; and when the identified projection mode is a second projection mode, causing the projector to project light into a second projection area smaller than the first projection area and causing the camera to acquire the two-dimensional image data in the second region of interest smaller than the first region of interest.

[0041] In an embodiment, the second projection region and the second region of interest can be determined based on the size of the mirror region included in the two-dimensional image data.

[0042] The image processing method according to an embodiment may include the following steps: acquiring two-dimensional image data by scanning the oral cavity, acquiring tip information about a tip attached to the body of the oral scanner, identifying an oral image acquisition pattern based on the tip information, and acquiring an oral image based on the two-dimensional image data and the identified oral image acquisition pattern; the tip information includes at least one of tip fastening direction information and tip size information.

[0043] An image processing system according to an embodiment includes: an oral scanner for acquiring two-dimensional image data by scanning an oral cavity; and an image processing device for processing the two-dimensional data received from the oral scanner to generate an oral image; the oral scanner includes: an oral scanner body and a tip detachably attached to the oral scanner body; the image processing device acquires tip information about the tip, identifies an oral image acquisition pattern based on the tip information, and processes the two-dimensional data received from the oral scanner based on the identified oral image acquisition pattern to acquire an oral image.

[0044] This specification describes the principles of the invention and discloses embodiments to clarify the scope of the invention and to enable those skilled in the art to practice the invention. The disclosed embodiments can be implemented in various forms.

[0045] Throughout this specification, the same reference numerals refer to the same constituent elements. The disclosed embodiments do not illustrate all elements of the embodiments, and general content belonging to the technical field of the invention or repetitive content between embodiments is omitted. The term "part" (portion) as used in this specification can be implemented by software or hardware. According to embodiments, multiple "parts" can be implemented as a single element, or a single "part" can contain multiple elements. The operating principle and embodiments of the invention are described below with reference to the accompanying drawings.

[0046] In this specification, images may include images showing at least one tooth or an oral cavity including at least one tooth (hereinafter referred to as "oral cavity images").

[0047] Furthermore, the images in this specification may be two-dimensional images of the object, or three-dimensional models or images of the object.

[0048] In addition, the data in this specification may refer to information required for two-dimensional or three-dimensional representation of an object, such as raw data acquired using at least one camera.

[0049] Specifically, raw data refers to data acquired to generate oral images. It can be data (e.g., two-dimensional data) acquired from at least one image sensor in an intraoral scanner when the patient's oral cavity is scanned using an intraoral scanner. Raw data acquired in an intraoral scanner can also be referred to as scan data or two-dimensional image data. Raw data can also refer to two-dimensional images acquired from different perspectives using multiple cameras when scanning an object with an intraoral scanner.

[0050] In this specification, "object" refers to the object being photographed, which may include a person, an animal, or a part thereof. The object may include the oral cavity, which includes at least one tooth. For example, the object may include teeth, gums, at least a portion of the oral cavity, and / or artificial structures that can be inserted into the oral cavity (e.g., orthodontic appliances, dental implants, artificial teeth, orthodontic aids inserted into the oral cavity, etc.).

[0051] The embodiments will now be described in detail with reference to the accompanying drawings.

[0052] Figure 1 This is a diagram illustrating an oral image processing system according to a disclosed embodiment.

[0053] Reference Figure 1 The oral image processing system may include an oral scanner 110 and a data processing device 120, which is connected to the oral scanner 110 via a communication network 130.

[0054] The oral scanner 110 is a medical device for acquiring images of the oral cavity. Specifically, the oral scanner 110 can acquire images of the oral cavity, including at least one tooth, by being inserted into the oral cavity and scanning the teeth non-contactly. Furthermore, the oral scanner 110 may have a shape capable of entering and exiting the cavity, using at least one image sensor (e.g., an optical camera, etc.) to scan the inside of the patient's oral cavity. As a handheld scanner, the oral scanner 110 can acquire surface information about an object as two-dimensional image data and generate three-dimensional data.

[0055] Two-dimensional image data acquired in the oral scanner 110 can be transmitted to the data processing device 120 connected via the communication network 130.

[0056] The data processing device 120 may be any electronic device that is connected to the oral scanner 110 via a wired or wireless communication network 130, receives two-dimensional image data acquired by scanning the oral cavity from the oral scanner 110, and generates, processes, displays and / or transmits oral images based on the received two-dimensional image data.

[0057] The data processing device 120 can generate at least one of information generated by processing the two-dimensional image data and an oral cavity image generated by processing the two-dimensional image data, based on the two-dimensional image data received from the oral scanner 110, and display the generated information and the oral cavity image on the display 125.

[0058] The data processing device 120 can be a computing device such as a smartphone, laptop, desktop computer, PDA, or tablet computer, but is not limited thereto.

[0059] The data processing device 120 may also exist in the form of a server (or server device) for processing oral images.

[0060] The oral scanner 110 can transmit the raw data acquired by scanning the oral cavity to the data processing device 120 as is. In this case, the data processing device 120 can generate a three-dimensional oral image representing the oral cavity based on the received raw data. Furthermore, the "three-dimensional oral image" can be generated by three-dimensional modeling of the internal structure of the oral cavity based on the received raw data, and therefore can be referred to as a "three-dimensional oral model". Hereinafter, models or images representing the oral cavity in two or three dimensions will be collectively referred to as "oral images".

[0061] The data processing device 120 can analyze and / or process the generated oral cavity images and output or transmit them to the display 125 and / or external devices.

[0062] As another example, the oral scanner 110 can acquire raw data by scanning the oral cavity, process the acquired raw data to generate an image corresponding to the oral cavity as the object, and transmit it to the data processing device 120.

[0063] In this embodiment, the oral scanner 110 obtains three-dimensional data representing the shape of the object by projecting patterned light onto the object and scanning the object with the illuminated patterned light, using the triangulation principle caused by pattern deformation.

[0064] In this embodiment, the dental scanner 110 can also acquire three-dimensional data of the object using a confocal method. The confocal method is a non-destructive optical imaging technique for measuring three-dimensional surfaces, which can acquire optical cross-sectional images with high spatial resolution using a pinhole structure. The dental scanner 110 can obtain three-dimensional data by stacking two-dimensional images along the axial direction.

[0065] However, in this embodiment, the oral scanner 110 can acquire oral images from raw data using various methods other than those described above. The oral scanner 110 transmits the three-dimensional data to the data processing device 120. In this case, the data processing device 120 can analyze, process, display, and / or transmit the received images.

[0066] Figure 2 This is a diagram illustrating a method for acquiring surface data using an oral scanner according to an embodiment.

[0067] In one embodiment, the oral scanner may utilize at least one camera to acquire images and obtain three-dimensional data based on the acquired images. Figure 2 In this context, the oral scanner can be an optical 3D scanner. To acquire 3D data about the surface of the object 210, the oral scanner can utilize structured light with stereovision.

[0068] The oral scanner may include two or more cameras (including an L camera 230 and an R camera 240) and a projector 220 capable of projecting structured light 225. In an embodiment, the oral scanner may project structured light 225 onto a subject 210 and acquire an L image 235 corresponding to the left field of view and an R image 245 corresponding to the right field of view from the L camera 230 (corresponding to the left field of view) and the R camera 240 (corresponding to the right field of view), respectively. The L image 235 and the R image 245 can be reconstructed into a three-dimensional frame representing the surface of the subject 210.

[0069] The dental scanner can continuously acquire two-dimensional image frames including L-image 235 and R-image 245 concerning the object 210. The dental scanner or data processing device can acquire three-dimensional image frames representing the surface shape of the object 210 from the two-dimensional image frames including L-image 235 and R-image 245. Figure 2 The text describes how an oral scanner acquires 3D data from two images obtained using two cameras (L camera 230 and R camera 240). However, this is one embodiment, and the oral scanner can also acquire images using only one of the two cameras (L camera 230 and R camera 240).

[0070] The oral scanner can move around the object 210 while scanning the object 210 at regular time intervals (e.g., 10 to 30 frames per second), thereby acquiring multiple two-dimensional frames. The oral scanner or data processing device can acquire multiple three-dimensional image frames from the multiple two-dimensional image frames.

[0071] The data processing device can acquire the three-dimensional image data of the entire object 210 by merging or aligning multiple three-dimensional image frames.

[0072] Figure 3 This is a perspective view of an oral scanner according to an embodiment.

[0073] Reference Figure 3 The oral scanner 300 may include a body 310 and a tip 320.

[0074] The main body 310 may include: a light irradiation unit for projecting light; and a camera for capturing images of the object.

[0075] The tip 320, which is mounted on the body 310 and inserted into the oral cavity, is elongated to facilitate easy entry into the oral cavity. The tip 320 is detachably attached to the body 310 and includes a light path changing device that directs light irradiated from the body 310 toward the object and directs light received from the object toward the body 310.

[0076] One end of the tip 320 can be coupled to the body 310. The tip 320 is not fixed to the body 310, but is mounted on the body 310 in a detachable structure.

[0077] The other end of the tip 320 may include an opening. The opening may be formed on a side orthogonal to the longitudinal direction of the tip 320. Light irradiated by the light irradiation unit can flow out through the opening, and light reflected from the object can flow into the camera.

[0078] The opening may be equipped with a device to change the light path, for example, a mirror. The mirror can reflect light along a certain path so that the light emitted from the light irradiation part is directed towards the object. In addition, the mirror can adjust the light path so that the light reflected from the object and incident on the opening at the tip 320 is directed towards the lens of the camera.

[0079] The mirror is fixedly attached to the inside of the tip 320, so the direction of light irradiated by the projector is also fixed. Therefore, typically, in order to scan a patient's oral cavity, the user of the oral scanner 300 mounts the tip 320 onto the body 310 in a fixed direction, for example, the upper part of the tip 320 is joined to the upper part of the body 310.

[0080] On the other hand, the data acquired by the dental scanner 300 can be processed within the main body 310 of the dental scanner or transmitted to a data processing device for processing. In this case, the main body 310 of the dental scanner or the data processing device cannot distinguish whether the acquired data is data from a scan of the maxilla, a scan of the mandible, or occlusal data of the maxilla and mandible. Therefore, before acquiring scan data by scanning the oral cavity, the user can set the scanning mode to one of the maxilla scanning mode, mandible scanning mode, or occlusal scanning mode in the main body 310 of the dental scanner or the data processing device before scanning. Otherwise, even if the dental scanner 300 scans the mandible, the main body 310 of the dental scanner or the data processing device may mistakenly identify the data received from the dental scanner 300 as maxilla or occlusal data instead of mandible data, thus generating incorrect images. However, it is not only cumbersome but also unhygienic for the user to operate the main body 310 of the dental scanner or the data processing device to set the scanning mode each time they scan their oral cavity.

[0081] In this embodiment, the tip 320 attached to the body 310 does not necessarily have to be attached to the body 310 in a constant direction. For example, it is not necessary for only the upper part of the tip 320 to be attached to the upper part of the body 310; the upper part, lower part, or side of the tip 320 may also be attached to the upper part of the body 310.

[0082] In one embodiment, the oral scanner 300 may have a sensor 315 disposed in the body 310 to identify the fastening direction of the tip 320 by sensing the tip 320 mounted on the body 310.

[0083] In an embodiment, the oral scanner 300 can also acquire information about the tip 320 based on two-dimensional image data of the oral cavity acquired by the camera included in the main body 310. That is, when the oral scanner 300 can distinguish between mirror areas and other areas in the image data acquired by the camera, it identifies the mirror areas and determines the clamping direction of the tip 320 based on the shape of the mirror areas. In an embodiment, the oral scanner 300 can identify the scanning mode based on the identified clamping direction of the tip 320. The identified scanning mode can be one of an upper jaw scanning mode, a lower jaw scanning mode, and an occlusal scanning mode.

[0084] In this embodiment, the oral scanner 300 can process the raw data obtained by scanning the patient's upper or lower jaw or occlusion according to the scanning mode, and directly acquire a three-dimensional oral image representing the upper or lower jaw or occlusion, and transmit it to the data processing device.

[0085] In another embodiment, the oral scanner 300 can transmit the identified scanning pattern to a data processing device. In this case, the data processing device can identify, based on the scanning pattern received from the oral scanner 300, whether the scanned object is the upper jaw, the lower jaw, or an occlusion that includes both the upper and lower jaws.

[0086] Furthermore, the oral scanner 300 can scan the patient's upper or lower jaw or occlusion to acquire raw data and transmit it to a data processing device. The data processing device receives the scan pattern and raw data from the oral scanner 300, processes the raw data according to the received scan pattern, thereby acquiring a three-dimensional oral image representing the upper or lower jaw or occlusion, and outputs it to a display. Additionally, the data processing device can also display the scan pattern received from the oral scanner 300 on the display.

[0087] Therefore, according to the embodiment, the oral scanner 300 can use the sensor 315 or the two-dimensional image data acquired by the camera to identify the fastening direction of the tip 320 and transmit it to the data processing device. Thus, the data processing device can automatically acquire oral images in a scanning mode that corresponds to the direction of the tip 320, so the user does not need to operate the data processing device separately to set the scanning mode.

[0088] On the other hand, in addition to identifying the fastening direction of the tip 320, the sensor 315 can also identify the size of the tip.

[0089] Unlike adults, children have smaller mouths and smaller teeth. Therefore, it is difficult to accurately scan a child's mouth and obtain accurate data using a standard-sized probe made to fit an adult's mouth. Furthermore, even when acquiring scan data of a child's mouth using a standard-sized probe made to fit an adult's mouth, there is a problem of performing image processing on the remaining, unnecessary areas, even if the acquired image contains a small portion of the child's mouth.

[0090] In the embodiments, the tip 320 does not have a fixed size, but can have various different sizes.

[0091] In an embodiment, the tip 320 may include a first-sized tip having a first dimension and a second-sized tip having a second dimension. The first dimension may refer to a dimension different from the second dimension.

[0092] For example, the first size tip is a standard size tip, and the second size tip can be a smaller size tip than the standard size tip.

[0093] Small-sized tips refer to tips that, compared to standard-sized tips, have a smaller mirror surface and a smaller tip width.

[0094] In one embodiment, sensor 315 can sense tip 320 to identify whether tip 320 is a standard-sized tip or a small-sized tip.

[0095] In this embodiment, the oral scanner 300 can identify whether the tip 320 is a standard-sized tip or a small-sized tip based on two-dimensional image data of the oral cavity acquired by a camera. The oral scanner 300 can also identify mirror areas in the image data acquired by the camera and determine the size of the tip 320 based on the size of the mirror areas.

[0096] Compared to a standard-sized tip, a small-sized tip has a smaller mirror surface and a smaller tip width. When the same area of ​​light is shone on it as when using a standard-sized tip, the light may collide with the walls of the tip and cause diffuse reflection.

[0097] Therefore, in this embodiment, the oral scanner 300 can acquire oral images using different projection modes depending on the size of the tip 320. That is, when the size of the tip 320 is a normal size and a small size, the oral scanner 300 can acquire oral images by adjusting the projection area and the region of interest (ROI) of the camera differently.

[0098] As described above, according to the embodiments, the oral scanner 300 can use a sensor 315 or a camera to identify the fastening direction of the tip 315 or the size of the tip, and acquire oral images in different scanning modes or in different projection modes based on this.

[0099] Figure 4 This is a block diagram of the interior of the oral cavity image processing device 400 according to an embodiment.

[0100] The oral imaging device 400 may include an oral scanner and a data processing device.

[0101] Reference Figure 4 The oral cavity image processing device 400 includes a processor 410, a memory 420, a sensing unit 430, a light irradiation unit 440, and an image processing unit 450.

[0102] The memory 420 may store at least one instruction. Furthermore, the memory 420 may store at least one instruction executed by the processor 410. Additionally, the memory 420 may store at least one program executed by the processor 410.

[0103] The sensing unit 430 may include at least one sensor. The sensor included in the sensing unit 430 may include a proximity sensor. The sensing unit 430 senses the tip and acquires tip information from the tip based on at least one of the distance between the proximity sensor and the wall of the tip and the color of the wall of the tip.

[0104] In one embodiment, the tip may include multiple protrusions. Furthermore, the tip can rotate while mounted to the body. The multiple protrusions included in the tip may have different thicknesses or different colors.

[0105] When the tip includes a protrusion and can be attached to and rotated with the body, the sensing unit 430 can acquire at least one of the distance from the sensor to the protrusion and the color of the protrusion for the protrusion identified according to the rotation of the tip, so as to acquire tip information.

[0106] The light irradiation unit 440 can irradiate light. The light irradiation unit 440 may include a projector that projects light from a light source. The light irradiated by the light irradiation unit 440 is directed towards the opening side via a mirror mounted on a tip, and then towards the object through the opening. However, this disclosure is not limited to this; a prism for refracting the projected light may also be mounted on the tip instead of the mirror. The prism can refract the light projected from the light irradiation unit 440 to varying degrees depending on the type of medium or the angle between the prisms.

[0107] In this embodiment, the light irradiation unit 440 can irradiate light onto different projection areas according to the projection mode.

[0108] In an embodiment, the projection mode can have different modes depending on the tip size. For example, the projection mode may include: a first projection mode, in which light is irradiated with an area corresponding to the first-sized tip when the tip is a first-sized tip, and a second projection mode, in which light is irradiated with an area corresponding to the second-sized tip when the tip is a second-sized tip.

[0109] The first projection mode is the normal projection mode, and the second projection mode is the small projection mode.

[0110] The light irradiation unit 440 can irradiate light with projection areas of different sizes in both normal projection mode and small projection mode.

[0111] The image processing unit 450 can perform actions for image generation and / or processing. The image processing unit 450 may include at least one camera. The image processing unit 450 can use the camera to capture images of an object onto which light is projected by the light irradiation unit 440 to acquire data corresponding to at least one of the left and right fields of view. The image processing unit 450 can scan the oral cavity to acquire two-dimensional image data.

[0112] In this embodiment, the image processing unit 450 can acquire one of an overbite image, a mandibular image, and an occlusal image using two-dimensional image data acquired by a camera. In this embodiment, when the tip information pertains to the tip's clamping direction, the image processing unit 450 can process the image in a specific scanning mode under the control of the processor 410. That is, the image processing unit 450 can process raw data according to the scanning mode recognized by the processor 410 to acquire an overbite, mandibular, or occlusal image.

[0113] The processor 410 controls the entire oral cavity image processing device 400. The processor 410 can identify oral cavity image acquisition patterns based on tip information. When the tip information indicates a tip clamping direction, the processor 410 can identify the scanning pattern according to the tip clamping direction. The processor 410 can identify one of an maxillary scanning pattern, a mandibular scanning pattern, and an occlusal scanning pattern, and cause the image processing unit 450 to acquire oral cavity images according to the identified pattern.

[0114] The processor 410 can identify whether the tip size is normal or small based on the tip information. When the tip is small, the processor 410 can control the oral cavity image processing device 400 to acquire an oral cavity image in accordance with the mirror size included by the small tip. That is, the processor 410 can control the light irradiation unit 440 to reduce the area of ​​light irradiated by the light irradiation unit 440. In addition, the processor 410 can control the image processing unit 450 to reduce the region of interest of the camera used to acquire the image.

[0115] In this embodiment, the processor 410 can directly detect the mirror area included in the small-sized tip. Therefore, the processor 410 can detect the mirror area included in the small-sized tip in the image acquired by the image processing unit 450.

[0116] In an embodiment, the processor 410 may also utilize two-dimensional image data acquired by the camera included in the image processing unit 450 to acquire tip information. For example, even if a small-sized tip is installed, if the area projected by the projector and the region of interest of the image acquired by the camera are set to conform to a normal-sized tip, some of the light irradiated by the projector will hit the inner wall of the tip and cause diffuse reflection, and only the light reflected by the specular surface inside the small-sized tip will be irradiated onto the object. In this case, the two-dimensional image data acquired by the camera may include the area acquired for the object, i.e., the specular area and the non-spectral area. In an embodiment, the oral scanner 300 detects the specular area in the two-dimensional image data and can identify the direction or size of the tip based on at least one of the size and shape of the specular area.

[0117] The processor 410 can control the light irradiation unit 440 and the image processing unit 450 to adjust the area of ​​the irradiated light and the region of interest of the camera based on the detected mirror area.

[0118] The processor 410 can control at least one component included within the oral cavity image processing device 400 to perform a desired action. Therefore, even if the description is based on the processor 410 performing a predetermined action, it can also mean that the processor 410 controls at least one component included within the oral cavity image processing device 400 to perform a predetermined action.

[0119] To implement the embodiments disclosed in this specification, the oral cavity image processing device 400 may include Figure 4 The components shown may also include, in addition to Figure 4 More constituent elements beyond those shown.

[0120] Figure 5 This is a diagram illustrating how an oral scanner, according to an embodiment, uses sensors to acquire information about the tip.

[0121] Reference Figure 5 The oral scanner 500 may include a body 510 and a tip 520. The tip 520 and the body 510 are detachably connected.

[0122] In one embodiment, the body 510 may be provided with a sensor 515 for sensing the tip 520. The sensor 515 may be located in the area where the body 510 and the tip 520 are joined.

[0123] like Figure 5 As shown in (a) and (b), when the tip 520 is attached to the body 510 in a manner that covers the body 510, the sensor 515 can be disposed in the area where the body 510 and the tip 520 are attached, on the upper or lower periphery of the body 510. However, this is only one embodiment, and the position of the sensor 515 mounted on the body 510 can be changed depending on the attachment structure of the tip 520 and the body 510.

[0124] like Figure 5 As shown in (a) and (b), the tip 520 can be coupled to the body 510 at a predetermined distance d1 from the sensor 515. Figure 5 As shown, the outer periphery of the main body 510 and the inner wall of the tip 520 are joined together.

[0125] Sensor 515 can be a proximity sensor that can detect the presence of surrounding objects without physical contact. Sensor 515 can emit electromagnetic fields or electromagnetic waves, ultrasonic waves, etc., and measure the amount of light or the return time of the emitted signal reflected and returned by the wall portion 525 of the tip 520, which is the object, to identify the distance between the wall portion of the tip 520 and sensor 515.

[0126] In an embodiment, the thickness of the inner wall of the tip 520 may have different values ​​depending on the fastening direction of the tip 520, for example, the upper part, lower part and side of the tip 520.

[0127] Figure 5 In (b), the inner wall thickness of the upper and lower parts of the tip 520 is different. Depending on whether the tip 520, which is attached to the upper part of the body 510, is oriented upwards or downwards, the distance between the sensor 515 and the inner wall of the tip 520 will become d1 or d2.

[0128] Figure 5 (c) and (d) show that the inner walls 525 of the upper and lower parts of the tip 520 have different thicknesses. Figure 5 (c) shows the distance from sensor 515 to inner wall 525 when the upper part of tip 520 is engaged with the upper part of body 510. Figure 5 (d) in the figure shows the distance from sensor 515 to inner wall 525 when the lower part of tip 520 is joined to the upper part of body 510. It can be seen that the distance between the inner wall 525 of the lower part of tip 520 and sensor 515 is longer by a length d than the distance between the inner wall 525 of the upper part of tip 520 and sensor 515.

[0129] In this embodiment, sensor 515 can sense the distance between the inner wall 525 and sensor 515. Sensor 515 can emit ultrasonic waves or infrared rays towards the inner wall 525, and sense the distance to the inner wall 525 based on the amount of light reflected back by the emitted ultrasonic waves or infrared rays after being reflected by the inner wall 525. Alternatively, sensor 515 can emit infrared rays, and measure the distance to the inner wall 525 by measuring the time it takes for the emitted signal to be reflected by the inner wall 525 and return to sensor 515.

[0130] Based on the distance between the inner wall 525 and the sensor 515, the sensor 515 can acquire the fastening direction of the tip 520 as tip information. That is, the sensor 515 can identify whether the upper part, lower part, or side of the tip 520 is fastened.

[0131] In this embodiment, the thickness of the inner wall 525 of the tip 520 can vary depending on the size of the tip 520. For example, the tip 520 may have inner walls 525 of different thicknesses in cases where the tip 520 is of a standard size and cases where it is of a small size.

[0132] In this embodiment, sensor 515 can sense the distance between the inner wall 525 and sensor 515, and obtain the size of tip 520 as tip information based on the sensed distance, that is, whether the tip is a normal size or a small size.

[0133] Figure 6 This is a diagram illustrating how an oral scanner, according to an embodiment, uses sensors to acquire information about the tip.

[0134] and Figure 5 The same, in Figure 6 In this structure, the tip 620 can be a structure integrated with the body in a manner that covers the main body. The sensor 615 can be located on the periphery of the main body. The interior of the tip 620 can be separated from the sensor 615 by a predetermined distance and integrated with the main body.

[0135] In this embodiment, the inner wall 625 of the tip 620 may have different colors depending on the direction. For example, the surface colors of the inner wall 625 of the upper, lower and side parts of the tip 620 may be different colors.

[0136] Figure 6 (a) and (b) show that the inner walls 625 of the upper and lower parts of the tip 620 have different colors.

[0137] In this embodiment, sensor 615 can acquire tip information using the color of the inner wall 625. For example, sensor 615 can emit infrared light towards the inner wall 625 and identify the color of the inner wall 625 by measuring the amount of light reflected back from the signal emitted to the inner wall 625. Infrared signals have the property that brighter colors are more easily reflected by objects, while darker colors are more easily absorbed by objects. Therefore, a large amount of reflected light may mean that the inner wall 625 is bright, and a small amount of light may mean that the inner wall 625 is dark. That is, when the distance between sensor 615 and the inner wall 625 is the same, the brighter the color of the object, the greater the amount of light reflected back.

[0138] The sensor 615 can also calculate chromaticity coordinates from the light reflected from the tip 620 and compare them with stored reference chromaticity to detect the surface color of the inner wall 625.

[0139] In this embodiment, the sensor 615 can identify the color of the inner wall 625 and detect whether the fastening direction of the tip 620 is the upper, lower, or side portion based on the identified color.

[0140] In this embodiment, the color of the inner wall 625 can vary depending on the size of the tip 620. That is, the inner wall 625 of a standard-sized tip 620 and a small-sized tip 620 can have different colors.

[0141] In one embodiment, sensor 615 can sense the color of inner wall 625 and obtain information about tip 620 based on the sensed color, thereby identifying whether the tip is of normal or small size.

[0142] Figure 7 This is a diagram illustrating how an oral scanner, according to an embodiment, uses sensors to acquire information about the tip.

[0143] Figure 7 The dental scanner 700 shown is Figure 5 and Figure 6 Unlike the dental scanner shown, the tip 720 enters the interior of the body 710 and is integrated with the body 710. That is, the inner wall of the body 710 and the outer wall of the tip 720 are integrated facing each other.

[0144] In this embodiment, the sensor may be mounted on the main body 710. The sensor may be mounted on the inner wall of the main body 710. The sensor may be located in the upper or lower region inside the main body 710, etc.

[0145] Alternatively, the sensor may be located at the point where the body 710 and the tip 720 engage, facing towards the tip 720. In an embodiment, the tip 720 can rotate while engaged with the body 710. For example, the areas where the tip 720 and the body 710 are fastened can each be cylindrical. The tip 720 can rotate while engaged with the body 710.

[0146] In another embodiment, such as Figure 5 and Figure 6 As shown in the structure, the main body 710 can also be a structure that enters the interior of the tip 720 and the tip 720 is attached to the main body 710. In this case, the tip 720 can be attached to the main body 710 in a cylindrical shape and rotate from the outside of the main body 710 while covering the main body 710.

[0147] In one embodiment, the user can rotate the tip 720 attached to the body 710 to manually rotate the tip 720.

[0148] In one embodiment, the body 710 further includes a rotatable rotating member, and the tip 720 may also be attached to the rotating member of the body 710. The user rotates the rotating member using a user interface (not shown) such as control keys installed on the body 710, thereby causing the tip 720 installed on the rotating member to rotate as well.

[0149] Alternatively, the main body 710 can be linked to the data processing device, and the rotating component can rotate according to the control of the data processing device. More specifically, the main body 710 can rotate the rotating component according to the scanning mode set in the data processing device, thereby adjusting the fastening direction of the tip 720. For example, when the tip 720 is engaged with the rotating component included in the main body 710, and the upper part of the tip 720 is engaged with the upper part of the main body 710 in the same direction, and the user sets the scanning mode to the jaw scanning mode using the data processing device, the main body 710 and the data processing device are linked, and the rotating component rotates 180 degrees, so that the lower part of the tip 720 and the upper part of the main body 710 face the same direction, thereby facilitating jaw scanning.

[0150] Alternatively, when the rotating member of the main body 710 rotates, the main body 710 senses the fastening direction of the tip 720 based on the rotation angle of the rotating member, and transmits the fastening direction or a scanning pattern based on the fastening direction to the data processing device. The data processing device identifies the scanning pattern based on the fastening direction of the tip 720 and acquires an image using the identified scanning pattern.

[0151] In an embodiment, the tip 720 may include a plurality of protrusions. For example, the plurality of protrusions may be formed in a serrated manner. The region in the body 710 that engages with the tip 720 may have a structure that engages with and rotates with the protrusions of the tip 720.

[0152] The sensor mounted on the body 710 can identify one of the multiple protrusions formed on the tip 720 by rotation of the tip 720. That is, the sensor can identify the protrusion that approaches the upper part or front of the sensor as it rotates.

[0153] In an embodiment, the multiple protrusions included in the tip 720 have different thicknesses or colors depending on their positions. For example, the protrusions located at the upper end of the tip 720, the protrusions located at the lower end of the tip 720, and the protrusions located on the sides of the tip 720 may have different thicknesses or different surface colors.

[0154] In the embodiments, the thickness or color of the multiple protrusions included in the tip 720 may differ depending on whether the tip 720 is of a standard size or a small size. For example, the thickness or color of the protrusions included in a standard-sized tip 720 may differ from the thickness or color of the protrusions included in a small-sized tip 720.

[0155] The sensor can sense the distance between the sensor and the protrusion by utilizing the thickness of the protrusion, or by sensing the color of the protrusion. Using the sensed information, the sensor identifies at least one of the fastening direction and size of the tip 720.

[0156] The sensor can identify each rotation of the tip 720. The main body 710 can notify the user of the completion of one rotation by means of vibration, sound, light, etc., each time the tip 720 rotates.

[0157] As described above, according to the embodiment, the tip 720 can rotate while attached to the body 710. The body 710 can be linked with a data processing device, causing the tip 720 to rotate automatically according to a pattern set in the data processing device. Alternatively, the data processing device can acquire an image in a predetermined scanning pattern based on the fastening direction of the tip 720, which depends on the degree of rotation of the rotating member of the body 710.

[0158] Furthermore, according to an embodiment, the tip 720 may include multiple protrusions with different colors or thicknesses. A sensor can identify the size or fastening orientation of the tip 720 by recognizing the color or thickness of one of the multiple protrusions included in the tip 720.

[0159] Figure 8 This is a diagram illustrating different surface colors according to the size or position of the tip, based on an embodiment.

[0160] Figure 8 The tip 800 shown is... Figure 7 The tip 720 shown is the same as the tip 800, which enters the interior of the main body and is attached to the main body. That is, the outer wall 820 of the tip 800 and the inner wall of the main body are attached to each other.

[0161] In one embodiment, the outer wall 820 of the tip 800 may have different surface colors depending on the direction. That is, the upper, lower, and side portions of the outer wall 820 of the tip 800 may each have different colors. In this case, in one embodiment, a sensor mounted on the main body can sense the fastening direction of the tip 800 based on the surface color of the outer wall 820.

[0162] In an embodiment, the outer wall 820 of the tip 800 may have different surface colors depending on whether the tip 800 is a standard-sized tip or a small-sized tip.

[0163] In this embodiment, the outer wall 820 of the tip 800 may have different colors depending on the size of the tip 800 or the direction of the tip 800. That is, the outer walls 820 of the upper, lower, and side directions of the tip 820 with a normal size, and the outer walls 820 of the upper, lower, and side directions of the tip 820 with a small size, may have different colors.

[0164] In an embodiment, the sensor can sense the color of the outer wall 820 of the tip 820, and use the sensed color to detect whether the size of the tip 820 is normal and fixed in the upper direction, or whether the size of the tip 820 is small and fixed in the lower direction, etc.

[0165] In another embodiment, the tip 800 may be a structure external to and integrated with the body. That is, the inner wall of the tip 800 may be coupled to the outer wall of the body. The outer wall of the body may be fitted with a sensor. In this case, the surface color of the inner wall of the tip 800 may vary depending on the orientation or size.

[0166] As described above, according to the embodiment, the outer wall 820 or the inner wall of the tip 820 may have different surface colors according to size or according to fastening direction.

[0167] According to an embodiment, the sensor can sense the surface color of the tip 820 to identify at least one of the tip size and fastening direction.

[0168] Figure 9 This is a diagram illustrating how an oral scanner, according to an embodiment, identifies a scanning pattern and transmits it to a data processing device.

[0169] Reference Figure 9 The oral scanner 910 can send information to or receive information from the data processing device 920.

[0170] In one embodiment, the oral scanner 910 may utilize a sensor mounted on the body to sense a tip coupled to the body. The oral scanner 910 may identify an oral image acquisition pattern based on tip information acquired by the sensor. In another embodiment, the sensor may acquire tip information based on at least one of the distance from the sensor to the wall of the tip and the color of the wall.

[0171] In one embodiment, the oral scanner 910 can acquire tip information simultaneously or separately from acquiring tip information via a sensor, using two-dimensional image data acquired by means of a camera mounted on the main body. The oral scanner 910 can also acquire tip information by detecting the mirror area mounted on the tip from the two-dimensional image data.

[0172] Tip information may include at least one of tip fastening direction and tip size.

[0173] In this embodiment, when the tip information indicates the tip fastening direction, the oral scanner 910 can identify the scanning pattern based on the tip fastening direction. That is, when the tip is fastened to the body, the oral scanner 910 can identify different scanning patterns depending on whether the fastening direction is the upper part, lower part, or side of the tip.

[0174] For example, when the tip is fastened upwards, that is, when the upper part of the tip is in the same direction as the upper part of the body, the oral scanner 910 can recognize the maxillary scanning pattern. When the tip is fastened to the side, such as the left or right side of the tip, the oral scanner 910 can recognize the occlusal scanning pattern.

[0175] The oral scanner 910 can transmit the recognized scanning pattern to the data processing device 920. Furthermore, the oral scanner 910 can transmit two-dimensional image data acquired by scanning a patient's oral cavity to the data processing device 920. The two-dimensional image acquired by the oral scanner 910 can be an image based on the recognized scanning pattern. For example, when the upper part of the tip is secured to the body, the user can use the oral scanner 910 to scan the patient's palate to acquire data about the palate. The oral scanner 910 can transmit the data about the palate to the data processing device 920.

[0176] In an embodiment, the data processing device 920 can receive a scanning pattern from the oral scanner 910 and process the image according to the scanning pattern. For example, when the scanning pattern received from the oral scanner 910 is a palatal scanning pattern, the data processing device 920 can identify that the data transmitted from the oral scanner 910 is palatal scanning data for generating a palatal image, and use the transmitted data to generate a three-dimensional virtual model of the palatal.

[0177] The data processing device 920 can output a scanning mode menu 927, indicating the part of the object currently being scanned, to the user via a display 925. The scanning mode menu 927 can contain information indicating whether the object being scanned is the upper jaw, lower jaw, or occlusion of the oral cavity.

[0178] In this embodiment, the data processing device 920 can display and output the scanning mode received from the oral scanner 910 on the scanning mode menu 927. For example, when the scanning mode transmitted from the oral scanner 910 is the jaw scanning mode, the data processing device 920 can highlight the jaw scanning mode in the scanning mode menu 927.

[0179] In this embodiment, the data processing device 920 can use the raw data received from the oral scanner 910 to acquire a three-dimensional image 926 that conforms to the identified scanning pattern. That is, when the identified scanning pattern is a jaw scanning pattern, the data processing device 920 can use the raw data received from the oral scanner 910 to acquire a three-dimensional image 926 that conforms to the jaw scanning pattern and output it through the display 925.

[0180] In one embodiment, the oral scanner 910 can acquire a three-dimensional image 926 based on two-dimensional image data obtained by scanning a patient's oral cavity, according to a recognized scanning pattern. The oral scanner 910 can transmit the scanning pattern and the acquired three-dimensional image 926 to a data processing device 920. The data processing device 920 can output the scanning pattern and three-dimensional image 926 received from the oral scanner 910 to a display 925.

[0181] Figure 9 The illustration shows the case where the dental scanner 910 transmits the scanning pattern to the data processing device 920, but in another embodiment, the data processing device 920 may also transmit the scanning pattern to the dental scanner 910.

[0182] For example, a user can select the object to be scanned using the scan data by utilizing the user interface screen output through the display 925 of the data processing device 920. That is, the user can utilize... Figure 9 The display 925 shows the scanning mode menu 927, which allows you to select whether the image to be generated using the raw data is an image of the upper jaw, lower jaw, or occlusion of the oral cavity.

[0183] In this embodiment, the data processing device 920 can transmit the scanning mode selected by the user in the scanning mode menu 927 to the oral scanner 910. The oral scanner 910 can adjust the direction of the tip attached to the body according to the scanning mode received from the data processing device 920. For example, when the tip is currently fastened to the upper part of the body and the scanning mode received from the data processing device 920 is an occlusal scanning mode, the oral scanner 910 can automatically rotate the fastening direction of the tip so that the side of the tip is fastened to the body. Alternatively, the user can be notified by light, sound, or image that the fastening direction of the tip needs to be rotated.

[0184] As described above, according to the embodiment, the oral scanner 910 and the data processing device 920 can be linked to the tip clamping direction and the scanning mode, so that the scanning mode is automatically set according to the tip clamping direction. Therefore, the user can avoid the following inconveniences: operating the data processing device 920 to input the scanning mode while scanning the oral cavity with the oral scanner 910, or adjusting the tip clamping direction to match the scanning mode after setting the scanning mode through the data processing device 920.

[0185] Figure 10 This is a diagram illustrating the operation of an oral scanner in a small projection mode when the tip is small, according to an embodiment.

[0186] In this embodiment, the tip can be categorized into standard-sized tips and small-sized tips based on its size. A small-sized tip is one in which both the mirror installed inside the tip and the width of the tip are smaller than those of a standard-sized tip.

[0187] The projection area of ​​the light emitted by the optical system of a dental scanner can be a predetermined area. Therefore, when the optical system of the dental scanner is not adjusted, the dental scanner can emit light with a predetermined basic projection area. Hereinafter, for ease of explanation, the basic projection area determined by the optical system of the dental scanner will be referred to as the first projection area.

[0188] In one embodiment, when the tip is a standard-sized tip, the oral scanner can illuminate the first projection area.

[0189] Figure 10 (a) is a diagram illustrating the light path of light emitted from the optical system of the dental scanner when the tip 1010 is of a standard size. Figure 10 In (a), light from the optical system of the oral scanner is reflected by the mirror 1011 of the tip 1010 and shines onto the object through the opening of the tip 1010.

[0190] Figure 10 (b) shows that when the tip 1020 is small, compared to Figure 10 The same as (a), where light is shone onto the first projection area. For example... Figure 10 As shown in (b), the mirror 1021 included in the small-sized tip 1020 is smaller than the mirror 1011 included in the ordinary-sized tip 1010.

[0191] Although the tip 1020 is small, if the dental scanner illuminates the same area as when illuminating a tip 1010 of a normal size, a portion of the illuminated light 1013 will hit the inner wall of the small tip 1020 instead of the mirror surface 1011, causing diffuse reflection. The light hitting the inner wall enters the camera lens within the body as noise. In this situation, noise caused by diffuse reflection is added to the image acquired by the camera within the body, making it impossible to obtain accurate scan data. Furthermore, because the data processing device generates a 3D virtual model that includes noise, an accurate 3D virtual model cannot be generated.

[0192] In this embodiment, the dental scanner can use images acquired by a camera to identify the size of the tip. For example, even if tip 1020 is a small tip, if light is shone on the area of ​​a tip 1010 of a normal size, a portion of the shone light will be reflected by the mirror 1021 of the small tip 1020 and will illuminate the object. The light illuminating the object will be captured as an image by the camera. The remaining light will not hit the mirror 1021, but will undergo diffuse reflection on the wall and return to the camera lens.

[0193] In this embodiment, the dental scanner can distinguish between the image data regions acquired for the subject, i.e., the mirror area and other areas, within the two-dimensional image data acquired by the camera. Thus, the dental scanner can identify whether the tip is a small-sized tip or a standard-sized tip.

[0194] In this embodiment, the dental scanner can identify the size of the tip via a sensor or from image data acquired by a camera. When the identified tip is small, it can operate in a small projection mode. In the small projection mode, the dental scanner can adjust the projection area from a first projection area to a second projection area. The second projection area is smaller than the first projection area.

[0195] Figure 10 (c) illustrates the light path of the dental scanner when adjusting the projection area according to the small projection pattern, provided the tip 1020 is small. Figure 10 In (c), the oral scanner can illuminate a reduced area of ​​light 1023 by narrowing the projection area to a second projection area. The light 1023 emitted from the second projection area does not hit the inner wall of the small tip 1020, but instead illuminates the mirror 1021 and is reflected from the mirror 1021 toward the object.

[0196] As described above, according to the embodiment, when the tip is detected to be small, the oral scanner can correspondingly reduce the projection area to obtain accurate scan data.

[0197] Figure 11 This is a diagram illustrating a method for obtaining tip information from two-dimensional image data and detecting a projection area based on the tip information, according to an embodiment.

[0198] In one embodiment, the oral scanner can obtain information about the size of the tip from two-dimensional image data acquired via a camera.

[0199] Figure 11 (a) shows the mirror 1110 included within the small-sized tip. The mirror 1110 included within the small-sized tip is smaller than the mirror included within the ordinary-sized tip.

[0200] Figure 11 (b) shows the basic projection area 1120 of the projector illuminating the oral scanner. The basic projection area 1120 can be a projection area set according to a standard-sized tip. The basic projection area 1120 can be an area of ​​a predetermined size. If the tip mounted on the oral scanner body is of standard size, the oral scanner can illuminate the predetermined basic projection area 1120. The camera of the oral scanner can acquire an image of the subject through the basic area of ​​focus.

[0201] A small tip is mounted on the oral scanner, but when the scanner illuminates the basic projection area 1120, the area of ​​the illuminated light is larger than the mirror surface 1110 of the small tip. Therefore, a portion of the illuminated light is reflected by the mirror surface 1110 included in the small tip and is then reflected onto the object, but the remaining light hits the inner wall of the tip, causing diffuse reflection.

[0202] The camera of the oral scanner can acquire images from light that shines onto the object through the mirror 1110 included in the small tip.

[0203] Figure 11 (c) shows image data 1130 acquired by the camera through the basic scan area of ​​interest. The image data 1130 acquired through the basic scan area of ​​interest may include an image data area 1140 of the object acquired by the mirror 1110 included in the small tip, and an area acquired by the diffuse reflection of light emitted by the projector in the wall, which then returns to the camera lens.

[0204] In an embodiment, in the image data 1130 acquired through the basic area of ​​focus scanning, the oral scanner can distinguish between the image data area 1140 acquired for the subject and other areas.

[0205] In an embodiment, to more easily distinguish between the image data region 1140 acquired for the subject and other regions in the image data 1130 acquired through the basic area of ​​focus scanning, the dental scanner may utilize light in a predetermined pattern. For example, as Figure 11 As shown in (b), the oral scanner can utilize light with a checkered pattern, but this is one embodiment, and light with multiple patterns that can easily distinguish areas can be used.

[0206] Even when the small tip is mounted on the body of the oral scanner, when the oral scanner emits light of a predetermined pattern into the basic projection area 1120, a portion of the emitted light of the predetermined pattern collides with the wall of the small tip and is then re-intruded into the camera lens, so the incident light retains the original predetermined pattern.

[0207] In the light emitted by the dental scanner in a predetermined pattern, the light that strikes the small-tipped mirror 1110 illuminates the object. The light illuminating the object is captured as an image by a camera inside the dental scanner. The image captured by the camera can be an image of the object. In this case, the pattern contained in the illuminating light is almost invisible in the image captured by the camera. Therefore, the dental scanner can identify the area containing the predetermined pattern and the area where the predetermined pattern is almost invisible—that is, the image data area 1140 acquired for the object—from the image data 1130 acquired through the basic area of ​​focus scanning. The dental scanner can identify the size of the image data area 1140 acquired for the object where the predetermined pattern is almost invisible.

[0208] The dental scanner can identify the size of the image data region 1140 acquired for a subject where a predetermined pattern is not visible. For example, the dental scanner can identify the number of grid patterns that correspond to the horizontal or vertical dimensions of the image data region 1140 acquired for the subject, and can determine the size of the image data region 1140 acquired for the subject based on the number of grid patterns identified. Since the size of the image region acquired for the subject is smaller than a predetermined reference value than the image data 1130 with a basic area of ​​interest, the dental scanner can identify that the tip attached to the dental scanner body is a small-sized tip.

[0209] In embodiments, the dental scanner may also transmit image data acquired through a basic area of ​​focus to a data processing device. For example, the dental scanner may transmit image data such as... Figure 11 The image data shown in (c) is transmitted to the data processing device.

[0210] In this case, the data processing device can receive image data from the oral scanner and thereby identify the image data region 1140 acquired for the subject.

[0211] The data processing device can identify the number of grid patterns corresponding to the mirrored areas included in the image data, thereby recognizing that the size of the tip is different from the current projection pattern. The data processing device can identify the projection pattern corresponding to the size of the tip, generate control information based on the identified pattern, transmit it to the oral scanner, and control the oral scanner to operate according to the projection pattern of the control information.

[0212] Alternatively, the data processing device may cut only the region corresponding to the identified image data region 1140 from the image data received from the oral scanner, and use only that region as raw data to obtain a three-dimensional oral image.

[0213] In one embodiment, when receiving control information from the data processing device, the dental scanner can adjust the projection mode according to the control information. Alternatively, when the dental scanner detects that the tip size does not match the current projection mode, it can automatically operate with a projection mode that matches the tip size.

[0214] For example, when the tip size is small, the dental scanner can adjust the projection mode to a small projection mode, reducing the projection area from the first projection area to the second projection area. The sizes of the first and second projection areas are predetermined values, pre-stored inside the dental scanner.

[0215] In another embodiment, when the size of the tip does not match the current projection pattern, the oral scanner can directly detect the projection area that matches the tip.

[0216] The tip may have a specified width or length, as well as the position or angle at which the mirror is mounted. However, since the tip is composed of multiple parts, the dimensions specified in the design may have an allowable range of error. Furthermore, because the tip is not fixed to the main body of the dental scanner but is detachable, tolerances may exist depending on the degree of detachment from the main body, such as whether it is loose or secure.

[0217] Therefore, in this embodiment, when the size of the installed tip differs from the size according to the current projection pattern, the oral scanner can directly detect and use the new projection area based on the installed tip.

[0218] In one embodiment, the oral scanner can detect the projection area that corresponds to the tip each time a new tip is installed.

[0219] In this embodiment, when the tip mounted on the dental scanner is identified as small, the dental scanner can identify regions including a predetermined pattern and regions where the pattern is barely visible in the image data 1130 acquired through the basic scanning region of interest of the camera, and can detect the image data region 1140 for the object, thereby acquiring a second projection region corresponding to the detected image data region 1140. The dental scanner can then illuminate the mirror surface 1110 of the small-sized tip through the second projection region. At this time, the illuminated light can be structured light with a pattern different from the predetermined pattern.

[0220] The dental scanner can also acquire a second region of interest corresponding to the second projection region. The dental scanner can acquire an image of the object by scanning a reduced region of interest, i.e., the second region of interest. Figure 11 (d) shows the oral scanner illuminating a second projection area, and the camera of the oral scanner acquiring the illuminated light as image data 1150 through a second region of interest. (See reference...) Figure 11 As can be seen from (d), the image data 1150 obtained through the second region of interest contains only image data corresponding to the small-sized tip of the mirror, and there is no unnecessary data.

[0221] Although for the sake of explanation, in Figure 11 The image data region 1140 is illustrated as a square, but is not limited to this; the image data region 1140 can also be a quadrilateral shape with upper and lower lengths that are different from each other. For this, refer to... Figure 12 Please provide a detailed explanation.

[0222] In an embodiment, Figure 11 The illustration is based on a small-sized tip mounted on an oral scanner, but the disclosure of this application is not limited thereto.

[0223] In this embodiment, the tip can have various sizes, such as large, small, and medium sizes. In this case, the projection area of ​​the dental scanner has an area corresponding to a mirror larger than the size of the mirror mounted on the large tip, and the region of interest of the camera can also be set to an area corresponding to a mirror larger than the size of the mirror mounted on the large tip.

[0224] An oral scanner can identify the image region of a subject from image data acquired via a camera, thereby determining the size of the tip mounted on the scanner. The scanner can identify the size of the image region encompassing the subject within the image data, and determine the tip size based on the range within which the identified image region falls. For example, if the identified image region is smaller than a first reference size, the scanner identifies the tip as small; if the image region is larger than the first reference size but smaller than a second reference size, the scanner identifies the tip as medium-sized; and if the image region is larger than the second reference size, the scanner identifies the tip as large.

[0225] In this embodiment, the dental scanner can adjust the projection area and the camera's region of interest (ROI) according to the size of the identified tip. For example, when the identified tip is large, the dental scanner can adjust the projection area to have an area corresponding to the mirror mounted on the large tip. Furthermore, the dental scanner can adjust the camera's ROI to match the large ROI.

[0226] As described above, according to an embodiment, the oral scanner can identify the size of the tip mounted on the body by using two-dimensional image data scanned by a camera.

[0227] In addition, the dental scanner can illuminate the basic projection area with light in a pre-defined pattern that is easy to identify, thereby more accurately identifying the size of the tip mounted on the body.

[0228] In addition, the dental scanner can adjust the projection area and the scanning region of interest to match the mirror size included by the small-sized tip, and use the adjusted projection area and scanning region of interest to acquire two-dimensional image data.

[0229] Figure 12 This is a diagram used to illustrate the acquisition of tip information from two-dimensional image data according to an embodiment.

[0230] Figure 12 (a) illustrates the situation where a small tip mounted on an oral scanner illuminates a normal projection area. The mirrors included in the small tip are smaller than those included in a normal-sized tip, and the width of the small tip is also smaller than the top and bottom widths of a normal-sized tip. Despite the small size of the tip, when the oral scanner illuminates the same area as when illuminating a normal-sized tip, a portion of the illuminated light hits the inner wall of the small tip instead of the mirrors, causing diffuse reflection and entering the camera lens as noise.

[0231] also, Figure 12 (a) shows the upper part of the tip and the upper part of the oral scanner body connected and joined in the same direction.

[0232] Figure 12 (b) shows that even like Figure 12 Similar to (a), a small-sized tip is installed, and when light is shone onto the general projection area, the camera acquires image data 1210 through the basic focus scan area. The image data 1210 acquired through the basic focus scan area includes an image area 1220 of the object acquired through the mirror included in the small-sized tip, and also includes the area acquired by the diffuse reflection of light emitted by the projector on the wall, which then returns to the camera lens.

[0233] The oral scanner and / or the data processing device that receives two-dimensional image data from the oral scanner can identify that the tip attached to the oral scanner body is a small-sized tip based on the fact that the size of the image region 1220 acquired for the object is smaller than the image data 1210 having a basic area of ​​interest by a predetermined reference value.

[0234] On the other hand, in order to change the light path, a mirror mounted on the tip is installed at a predetermined angle. The mirror changes the light path, directing the light emitted from the projector towards the object, and also changes the light reflected from the object and incident on the opening of the tip towards the camera lens. Therefore, the mirror is installed at a predetermined angle different from the direction of the light emitted from the projector and the direction of the light incident on the object. Consequently, the distance from the camera to the upper end of the mirror is different from the distance from the camera to the lower end of the mirror. That is, the distance from the camera to the upper end of the mirror is shorter than the distance from the camera to the lower end of the mirror. In this case, as... Figure 12 As shown in (a), when light is shone onto a normal projection area with a small tip installed and image data 1210 is acquired by basic scanning of the region of interest, as Figure 12 As shown in (b), the image region 1220 of the image data 1210 about the object has a shape in which the upper end of the image region 1220 is longer than the lower end.

[0235] In an embodiment, the oral scanner and / or the data processing device receiving image data 1210 from the oral scanner can identify the mirror region by detecting an image region 1220 about the object from the image data 1210. The oral scanner can identify the tightening direction of the tip based on the shape of the image region 1220 about the object. The oral scanner and / or the data processing device can determine the tightening direction of the tip based on, for example... Figure 12 As shown in (b), the number of grid patterns corresponding to the upper end of image region 1220 is greater than the number of grid patterns corresponding to the lower end, indicating that the upper end is longer.

[0236] When the upper end of the image area 1220 is longer, the oral scanner and / or data processing device can identify the tip for orthogonal mounting.

[0237] Figure 12 (c) and Figure 12 Similar to (a), this illustrates how, despite the small size of the tip mounted on the dental scanner, the scanner illuminates the general projection area. However, Figure 12 (c) is where the lower part of the tip connects to the upper part of the main body of the oral scanner and is joined in a reverse direction, which differs from the forward connection. Figure 12 (a) is different.

[0238] Figure 12 (d) shows that even like Figure 12 Similar to (c), a small-sized tip is installed, and when light is shone onto the general projection area, the camera acquires image data 1230 through the basic focus scan area. The image data 1230 acquired through the basic focus scan area includes an image area 1240 of the object acquired through the mirror included in the tip, and also includes the area acquired when light that causes diffuse reflection in the wall returns to the camera lens.

[0239] In an embodiment, the oral scanner and / or the data processing device that receives image data 1230 from the oral scanner can respectively identify the lengths of the upper and lower ends of the image region 1240 of the image data 1230 concerning the object. For example, the oral scanner and / or the data processing device can identify the number of grid patterns corresponding to the lengths of the upper and lower ends of the image region 1240, identify the lengths of the upper and lower ends of the image region 1240 according to the identified number of grid patterns, and identify which one is longer.

[0240] The oral scanner and / or data processing device can identify a small-sized tip attached to the oral scanner body for reverse mounting on the oral scanner, based on the fact that the lower end of the image area 1240 is longer than the upper end.

[0241] In an embodiment, the oral scanner and / or data processing device can identify the orientation of an image region targeting a subject from the image data. The oral scanner and / or data processing device can identify the lengths of the upper and lower ends of the image region, thereby identifying whether the tip is mounted in a forward or reverse orientation. In an embodiment, the oral scanner and / or data processing device can identify a scanning pattern based on the identified tip orientation and process the image data according to the identified scanning pattern.

[0242] As described above, according to embodiments, the oral scanner and / or data processing device can utilize two-dimensional image data scanned by a camera to identify the size and orientation of the tip mounted on the body.

[0243] Figure 13 This is a diagram showing how the size of the projection area and the size of the region of interest scanned by the camera are adjusted in small projection mode according to the illustrative embodiment.

[0244] Dental scanners utilize a projector to illuminate the light. The projector in a dental scanner forms a pattern by illuminating the light with an RGB light source and controlling each of the multiple mirrors within a digital micromirror device (DMD). A DMD is an assembly of tiny lenses, with tens of thousands of mirrors arranged like a chessboard, each mirror functioning as a pixel. The projector can control the mirrors within the DMD to be either on or off. Each mirror has a different tilt angle in its on and off states, allowing light to flow out or not, thus adjusting the brightness.

[0245] In this embodiment, the dental scanner can identify the size of the tip and operate in different projection modes depending on the identified tip size. When the tip size is normal, the dental scanner can operate in a normal projection mode. In normal projection mode, the dental scanner can illuminate a predetermined first projection area.

[0246] Figure 13 (a) simplifies the DMD used when projecting light. In the embodiment, Figure 13 The entire DMD area shown in (a) can be the area corresponding to the first projection area 1300. That is, in normal projection mode, the projector can illuminate light by controlling all mirrors included in the entire DMD area to be in the open state.

[0247] In this embodiment, when the identified tip size is small, the oral scanner can operate in a small projection mode. In small projection mode, the oral scanner can reduce the first projection area to a second projection area.

[0248] In this embodiment, the second projection area may be an area defined by the size of the mirror mounted on the small-sized tip. Within the second projection area, the irradiated light will not strike the wall of the tip and can fully illuminate the mirror surface included by the small-sized tip.

[0249] exist Figure 13 In (a), in order to operate in a small projection mode, the dental scanner can reduce the first projection area 1300 to a second projection area 1310. The dental scanner controls only the mirrors included in the second projection area 1310 to be in the open state and controls the mirrors included in the remaining areas to be in the closed state, so that the mirrors located at the edges of the entire DMD area can be used for light projection only using the mirrors of the reduced second projection area 1310.

[0250] In small projection mode, the oral scanner projects light into a second projection area, where the projected light is reflected by a mirror-like surface included in the small-sized tip and then onto the object.

[0251] An oral scanner can use one or more cameras to acquire two-dimensional image data of the oral cavity under illumination. At this time, the oral scanner can acquire two-dimensional image data corresponding to the scanned region of interest. The scanned region of interest is a selected area from the entire image, which can refer to the image processing area actually processed for image analysis.

[0252] The size of the region of interest (ROI) can be predetermined. An oral scanner can acquire two-dimensional image data within the predetermined ROI. For ease of explanation, the predetermined basic ROI will be referred to hereafter as the first ROI.

[0253] If the tip mounted on the main body of the dental scanner is small, the mirror surface included in the small tip is smaller than that included in a standard-sized tip. Therefore, the area of ​​light incident on the object through reflection from the mirror surface included in the small tip is also smaller. Even with a small tip, when acquiring an image through a pre-defined basic region of interest, unnecessary data, besides the object, may be included in the image. Furthermore, due to this unnecessary data, data processing speed and computational load will increase.

[0254] Therefore, in this embodiment, when the tip is small, the dental scanner can only acquire oral images within the reduced region of interest by narrowing the camera's scanning region of interest. In this embodiment, when the tip is small, the dental scanner can adjust the scanning region of interest from a first region of interest to a second region of interest. The second region of interest can be a smaller area than the first region of interest.

[0255] Figure 13 (b) is a diagram showing the scanned region of interest for image data acquired by the camera. In the embodiment, Figure 13 The scanning region of interest shown in (b) can be a basic scanning region of interest, namely the first region of interest 1320. That is, in normal projection mode, the camera can acquire images in the first region of interest 1320. The images acquired in the first region of interest 1320 can be used to generate a 3D virtual model.

[0256] In an embodiment, when the size of the identified tip is small, the oral scanner can reduce the scanning region of interest of the camera from the first region of interest 1320 to the second region of interest 1330.

[0257] In an embodiment, the second region of interest 1330 may be determined by corresponding to the size of the mirror mounted on a small-sized tip.

[0258] exist Figure 13 In (b), to operate in a small projection mode, the dental scanner can reduce the scanning region of interest from a first region of interest 1320 to a second region of interest 1330. The dental scanner can adjust the size of the first region of interest 1320 horizontally (by adjustment 'a') and vertically (by adjustment 'b') to reduce the scanning region of interest to the second region of interest 1330. The dental scanner can acquire image data within the reduced second region of interest 1330. The image data acquired in the second region of interest 1330 can be used to generate a three-dimensional virtual model.

[0259] As described above, according to the embodiment, the dental scanner can operate in different projection modes depending on the size of the identified tip. When the tip size is small, the dental scanner can reduce the projection area and scan the region of interest to accommodate the mirror size of the small tip, thereby obtaining accurate scan data.

[0260] Figure 14 This diagram illustrates the scanning of the region of interest under different projection modes according to the embodiments.

[0261] Figure 14 (a) shows the basic scanning region of interest, namely, the first region of interest 1400. The size of the first region of interest 1400 may include 54 points, with a horizontal and vertical dimension of 6×9. In basic projection mode, the dental scanner can acquire image data in the first region of interest 1400. The data processing device can acquire a three-dimensional virtual model by extracting all 54 points or a portion thereof included in the image data acquired by the dental scanner in the first region of interest 1400.

[0262] In one embodiment, when the installed tip is small, the oral scanner can adjust the scanning region of interest to a second region of interest.

[0263] Figure 14 (b) shows the second region of interest 1410. The dental scanner can adjust the scanning region of interest from the first region of interest 1400 to the second region of interest 1410. The size of the second region of interest 1410 can be determined corresponding to the size of the mirror mounted on a small-sized tip. Figure 14 In (b), the second region of interest 1410 may include 20 points, with a horizontal and vertical dimension of 4×5.

[0264] When the tip is small, the dental scanner can acquire image data within the second region of interest 1410. The data processing device can obtain a three-dimensional virtual model by extracting all 20 points or a portion thereof included in the image data acquired by the dental scanner through the second region of interest 1410.

[0265] In another embodiment, when operating in small projection mode, the data processing device can improve the resolution of the adjusted scanning region of interest. Figure 14 (c) shows the second region of interest 1420 with improved resolution.

[0266] The data processing device can improve the resolution of the adjusted scanned region of interest by extracting 8×10 points from the second region of interest 1420 and using them for data processing. The data processing device can obtain a more accurate 3D virtual model by increasing the resolution of the adjusted scanned region of interest.

[0267] Figure 15 An oral cavity image processing system according to an embodiment is shown.

[0268] In an embodiment, the oral image processing system may include an oral scanner 1510, a data processing device 1520, and a communication network 1530.

[0269] The oral scanner 1510 can transmit two-dimensional data obtained by scanning a patient's oral cavity or dental mold model to a data processing device 1520 via a communication network 1530, or process the two-dimensional data to generate a three-dimensional virtual model and transmit it to the data processing device 1520.

[0270] The data processing device 1520 can generate a three-dimensional virtual model by processing two-dimensional data received from the oral scanner 1510, or it can display the three-dimensional virtual model received from the oral scanner 1510 on a monitor or transmit it to an external device.

[0271] exist Figure 15 In this device, the oral scanner 1510 may include a processor 1511, a memory 1512, a sensing unit 1513, an optical unit 1514, a user interface 1515, a communication interface 1516, and an image processing unit 1517.

[0272] The memory 1512 can store at least one instruction. Furthermore, the memory 1512 can store at least one instruction executed by the processor. Additionally, the memory can store at least one program executed by the processor 1511. Furthermore, the memory 1512 can temporarily store two-dimensional image data acquired by the camera included in the image processing unit 1517, or a three-dimensional virtual model generated therefrom, for transmission to the data processing device 1520.

[0273] In an embodiment, memory 1512 may store oral image acquisition patterns mapped to tip information. The oral image acquisition pattern information may be information used to identify patterns corresponding to the tip information. For example, the oral image acquisition pattern may include a scanning pattern for each tip fastening direction. The tip fastening direction can be obtained using a sensor based on the distance or color of the wall from the sensor to the tip, and simultaneously or separately, based on the shape of a mirrored region included in the two-dimensional image data acquired by the camera. Furthermore, the oral image acquisition pattern may include a projection pattern based on the tip size. The tip size can be obtained using a sensor based on the distance or color of the wall from the sensor to the tip, and simultaneously or separately, based on the size of a mirrored region included in the two-dimensional image data acquired by the camera.

[0274] The sensing unit 1513 may include at least one sensor. The sensing unit 1513 is disposed on the body of the oral scanner 1510 and can sense the tip attached to the body. The sensing unit 1513 may include at least one proximity sensor. The sensing unit 1513 can emit electromagnetic fields, electromagnetic waves, ultrasonic waves, etc., and measure the amount of light or the return time of the emitted signal reflected back by the tip to identify the distance to the tip or to identify the surface color of the tip. The sensing unit 1513 can use the distance to the tip or the surface color of the tip to obtain tip information about the tip. The tip information may include at least one of the tip fastening direction and tip size.

[0275] The optical unit 1514 may include a light source and a projector for projecting light from the light source. The optical unit 1514 can project patterned light or structured light, etc. The optical unit 1514 can form a pattern by illuminating light with an RGB light source and controlling each of the micromirrors included in the DMD. The optical unit 1514 can illuminate light by controlling the opening or closing of the mirrors included in the DMD.

[0276] The light emitted by the optical section 1514 is directed through a mirror mounted on the tip to the opening, and then through the opening to the object.

[0277] In this embodiment, the optical unit 1514, under the control of the processor 1511, can illuminate the basic projection area, i.e., the first projection area, when the tip size is a normal size and the tip size does not match the current projection mode.

[0278] In this embodiment, the optical unit 1514, under the control of the processor 1511, can adjust the projection area according to the small-sized tip and illuminate the adjusted second projection area when the tip size is small and does not conform to the current projection mode.

[0279] In one embodiment, the optical unit 1514 can illuminate a predetermined pattern of light, such as a grid, that is easy to divide into regions, in order to identify the tip size.

[0280] The user interface 1515 can receive user input for controlling the oral scanner 1510. The user interface 1515 may include a touch panel for detecting user touch, buttons for receiving user press operations, a voice recognition device including a microphone, etc.

[0281] In an embodiment, the user interface 1515 may include an input device for rotating the tip. For example, the user interface 1515 may receive control signals from the user for rotating the tip using a device such as a button type, a ring type, a hub type, or a touchpad type.

[0282] The communication interface 1516 can communicate with the data processing device 1520 via a wired or wireless communication network 1530. Specifically, the communication interface 1516 can perform communication with the data processing device 1520 under the control of the processor 1511. The communication interface 1516 can transmit two-dimensional image data or oral cavity images acquired by the image processing unit 1517 to the data processing device 1520.

[0283] The communication interface 1516 may include: at least one short-range communication module that communicates according to communication specifications such as Bluetooth, Wi-Fi, Bluetooth Low Energy (BLE), NFC / RFID, Wi-Fi Direct, UWB, or ZigBee; a long-range communication module that communicates with a server that supports long-range communication according to long-range communication specifications; and at least one port that connects to an external electronic device via a wired cable for wired communication.

[0284] In an embodiment, when the sensing unit 1513 acquires tip information or the processor 1511 acquires tip information from the two-dimensional image data acquired by the image processing unit 1517, the communication interface 1516 can send the tip information to the data processing device 1520 through the communication network 1530.

[0285] In addition, the communication interface 1516 can receive control information based on the projection mode from the data processing device 1520 via the communication network 1530.

[0286] The image processing unit 1517 can perform actions for generating and / or processing images. The image processing unit 1517 may include at least one camera. The image processing unit 1517 can acquire two-dimensional image data using the camera.

[0287] For example, to reconstruct a three-dimensional image using optical triangulation, the image processing unit 1517 may include an L-camera corresponding to the left field of view and an R-camera corresponding to the right field of view. The L-camera and R-camera can respectively acquire L-image data corresponding to the left field of view and R-image data corresponding to the right field of view. The image processing unit 1517 can perform data transmission and other processing operations on the raw data, including the L-image data and R-image data, and output it to the communication interface 1516 for transmission to the data processing device 1520.

[0288] Alternatively, the image processing unit 1517 can directly process the two-dimensional image data acquired by the camera, generate a three-dimensional virtual model, and transmit it to the data processing device 1520 through the communication interface 1516.

[0289] In this embodiment, the image processing unit 1517, under the control of the processor 1511, can adjust the scanning region of interest according to the tip size when the tip size does not match the current scanning region of interest, and acquire two-dimensional image data based on the adjusted scanning region of interest.

[0290] The processor 1511 controls the entire oral scanner 1510.

[0291] In one embodiment, the processor 1511 can acquire tip information through the sensing unit 1513.

[0292] In one embodiment, the processor 1511 detects the mirror region from the two-dimensional image data acquired by the image processing unit 1517, and obtains at least one of the tip direction and tip size based on at least one of the size and shape of the mirror region.

[0293] In one embodiment, the processor 1511 can send tip information and two-dimensional image data to the data processing device 1520 via the communication interface 1516.

[0294] Alternatively, in another embodiment, the processor 1511 may directly acquire an oral cavity image from two-dimensional image data based on tip information and send the acquired oral cavity image to the data processing device 1520.

[0295] The processor 1511 can identify oral image acquisition patterns based on tip information. The processor 1511 retrieves the oral image acquisition pattern from the memory 1512 and uses the pattern to identify the oral image acquisition pattern based on tip information.

[0296] If the tip information pertains to the tip fastening direction, processor 1511 can identify the scanning pattern based on the tip fastening direction. For example, processor 1511 can identify one of the following scanning patterns: maxillary scanning pattern, mandibular scanning pattern, or occlusal scanning pattern, depending on whether the tip fastening direction is upper, lower, or lateral. Processor 1511 can process the two-dimensional image data according to the identified pattern to obtain an oral cavity image and transmit it to data processing device 1520 via communication interface 1516.

[0297] In this embodiment, the processor 1511 can receive control information from the data processing device 1520 and adjust the projection mode according to the control information. That is, when the data processing device 1520 identifies the projection mode based on the tip information, the processor 1511 can receive control information based on the projection mode generated by the data processing device 1520 and perform actions accordingly. The control information may be that when the tip is a normal-sized tip, the oral scanner is controlled to operate in a normal projection mode, and when the tip size is a small-sized tip, the oral scanner is controlled to operate in a small projection mode.

[0298] Alternatively, in an embodiment, the processor 1511 may identify the oral image acquisition pattern as a projection pattern based on the tip information, and may directly control the oral scanner so that the oral scanner operates according to the identified projection pattern.

[0299] In an embodiment, if the tip information is about the tip size, the processor 1511 can control the oral scanner 1510 to operate in different projection modes when the tip size is normal and small.

[0300] When the tip is small and the current projection mode is set to normal projection mode, the processor 1511 can control the oral scanner 1510 to operate in small projection mode, thereby causing the optical unit 1514 to reduce the projection area from the first projection area to the second projection area and project light, and the image processing unit 1517 can reduce the scanning region of interest of the camera from the first region of interest to the second region of interest.

[0301] Alternatively, the processor 1511 can directly detect the projection area that corresponds to the tip size. To this end, the processor 1511 causes the optics unit 1514 to project light of a predetermined pattern onto the predetermined projection area, and enables the image processing unit 1517 to acquire an oral cavity image within the predetermined area. The processor 1511 can detect the mirror region of the tip using the predetermined pattern in the oral cavity image acquired from the predetermined region of interest. The processor 1511 can change the projection area to a projection area corresponding to the detected mirror region.

[0302] The processor 1511 can change the region of interest to a scanned region of interest corresponding to the changed projection region.

[0303] The processor 1511 can control at least one structure inside the oral scanner to perform a predetermined action. Therefore, even though the example illustrates the processor performing a predetermined action, it also means that the processor controls at least one structure inside the data processing device to perform the predetermined action.

[0304] The data processing apparatus 1520 will now be described. The data processing apparatus 1520 may also be referred to as an oral cavity image processing apparatus.

[0305] The data processing device 1520 may include a communication interface 1524, a user interface 1523, a display 1525, an image processing unit 1526, a memory 1522, and a processor 1521.

[0306] The communication interface 1524 can communicate with at least one external electronic device via a wired or wireless communication network. Specifically, the communication interface 1524 can communicate with the oral scanner 1510 under the control of the processor 1521. The communication interface 1524 can also communicate with external electronic devices or servers connected via a wired or wireless communication network 1530, depending on the control of the processor 1521.

[0307] In this embodiment, the communication interface 1524 can receive two-dimensional image data and tip information from the oral scanner 1510. Furthermore, the communication interface 1524 can transmit control information to the oral scanner 1510.

[0308] Alternatively, the communication interface 1524 can transmit oral images acquired by the oral scanner 1510 based on cutting-edge information to the oral scanner 1510.

[0309] Specifically, the communication interface 1524 may include at least one short-range communication module, which communicates according to communication standards such as Bluetooth, Wi-Fi, Bluetooth Low Energy (BLE), Near Field Communication / Radio Frequency Identification (NFC / RFID), Wi-Fi Direct, Ultra Wideband (UWB), or ZigBee.

[0310] Furthermore, the communication interface 1524 may also include a remote communication module that communicates with a server supporting long-distance communication in accordance with remote communication standards. Specifically, the communication interface 1524 may include a remote communication module that communicates via a network used for Internet communication. Additionally, the communication interface 1524 may include a remote communication module that communicates via a communication network conforming to communication standards such as 3G, 4G, and / or 5G.

[0311] Furthermore, the communication interface 1524 may include at least one port that connects to an external electronic device (e.g., an oral scanner) via a wired cable for wired communication with the external electronic device. Thus, the communication interface 1524 is capable of communicating with an external electronic device that is wiredly connected via at least one port.

[0312] The user interface 1523 can receive user input for controlling the data processing device 1520. The user interface 1523 may include: a touch panel for sensing user touch; buttons for receiving user press operations; and user input devices, including, but not limited to, a mouse or keyboard for specifying or selecting a point on the user interface screen.

[0313] Furthermore, the user interface 1523 may include a voice recognition device for speech recognition. For example, the voice recognition device may be a microphone, capable of receiving voice commands or voice requests from the user. Thus, the processor can control the execution of actions corresponding to the voice commands or voice requests.

[0314] Display 1525 displays a screen. Specifically, display 1252 can display a predetermined screen under the control of processor 1521. Specifically, display 1525 can display a user interface screen including a generated oral image based on data acquired by scanning the patient's oral cavity through oral scanner 15100. Alternatively, display 1525 can display a user interface screen including information related to the patient's dental treatment.

[0315] In one embodiment, the display 1525 can output a scanning pattern received from the dental scanner 1510 according to the tip fastening direction onto a screen. The display 1525 can also output a three-dimensional virtual model generated based on the scanning pattern identified from the raw data received from the dental scanner 1510.

[0316] The image processing unit 1526 can perform actions for generating and / or processing images. Specifically, the image processing unit 1526 can receive raw data acquired from the oral scanner 1510 and generate an oral image based on the received data. Specifically, the image processing unit 1526 can generate a three-dimensional virtual model based on the scan data received from the oral scanner 1510.

[0317] Memory 1522 may store at least one instruction. Furthermore, memory 1522 may store at least one instruction executed by a processor. Additionally, memory may store at least one program executed by processor 1521. Furthermore, memory 1522 may store data received from oral scanner 1510 (e.g., raw data acquired by scanning the oral cavity). Alternatively, memory may store an oral cavity image representing a three-dimensional oral cavity. According to one embodiment, memory 1522 may include more than one instruction for acquiring the final position of teeth in an oral cavity image during orthodontic planning. According to one embodiment, memory 1522 may include more than one instruction for generating a resolution-enhanced three-dimensional virtual model based on an adjusted scanned region of interest.

[0318] The processor 1521 executes at least one instruction stored in the memory 1522 to control the execution of a desired action. The at least one instruction may be stored in the internal memory of the processor 1521 or in the memory 1522, which is separately included in the data processing device from the processor 1521.

[0319] Specifically, processor 1521 executes at least one instruction to control at least one structure within the data processing device, thereby performing a predetermined action. Therefore, even though the example illustrates processor 1521 performing a predetermined action, it also means that processor 1521 controls at least one structure within the data processing device to perform the predetermined action.

[0320] According to one embodiment, when the processor 1521 reduces the size of the scanned region of interest by executing one or more instructions stored in the memory 1522, it can improve the resolution of the scanned region of interest.

[0321] According to one example, processor 1521 may be embodied in the form of at least one internal processor and a memory device (e.g., random access memory (RAM), read-only memory (ROM), etc.) for processing or using programs, instructions, signals, and data stored in the internal processor.

[0322] Furthermore, the processor 1521 may include a graphics processing unit (GPU) for processing graphics corresponding to the video. Additionally, the processor may be implemented as a system-on-a-chip (SoC) integrating cores and a GPU. Furthermore, the processor may include multiple cores beyond a single core. For example, the processor 1521 may include dual-core, triple-core, quad-core, hexa-core, octa-core, deca-core, dodecathlon, hexadecimal, and so on.

[0323] In the disclosed embodiments, processor 1521 can generate an oral cavity image based on a two-dimensional image received from oral scanner 1510. Specifically, communication interface 1524 can receive data acquired from oral scanner 1510, such as raw data acquired by scanning the oral cavity, under the control of processor 1521. Moreover, processor 1521 can generate a three-dimensional oral cavity image representing the oral cavity based on the raw data received from the communication interface.

[0324] In one embodiment, processor 1521 may receive tip information from oral scanner 1510.

[0325] In one embodiment, the processor 1521 can detect the mirror region from the raw data received by the oral scanner 1510, and can directly obtain tip information based on at least one of the size and shape of the mirror region.

[0326] In an embodiment, when the tip information includes tip fastening direction information, the processor 1521 can identify a scanning pattern based on the tip fastening direction information and process the two-dimensional image data according to the identified scanning pattern to obtain an oral cavity image.

[0327] In an embodiment, when the tip information includes tip size information, the processor 1521 can identify a projection pattern based on the tip size information and generate control information based on the projection pattern. The control information may include information that controls the oral scanner to operate in a projection pattern that matches the tip size when the tip size does not match the current projection pattern of the oral scanner.

[0328] In an embodiment, when the tip information includes tip size information, the processor 1521 can adjust the size of the image to conform to the image area according to the mirror size included in the tip, and can obtain three-dimensional information by using only the image with adjusted size.

[0329] The communication interface 1524 can transmit raw data received from the oral scanner 1510 to the processor 1521, and the processor 1521 generates a three-dimensional oral image representing the oral cavity based on the received raw data.

[0330] Furthermore, the processor 1521 can directly receive three-dimensional oral cavity images from external servers, medical devices, etc., via the control communication interface 1524. In this case, the processor 1521 can acquire three-dimensional oral cavity images without generating three-dimensional oral cavity images based on raw data.

[0331] According to the disclosed embodiments, the processor 1521 performing actions such as "extracting", "acquiring", and "generating" can refer to the case where the processor 1521 directly performs the actions described above by executing at least one instruction in the processor 1521, and the case where it controls other constituent elements to perform the actions described above.

[0332] To implement the embodiments disclosed in this specification, the data processing apparatus 1520 may include Figure 15 A portion of the constituent elements shown may also include Figure 15 More constituent elements than those shown.

[0333] Furthermore, the data processing device 1520 can store and execute dedicated software that is linked to the oral scanner 1510. This dedicated software can be referred to as a dedicated program, a dedicated tool, or a dedicated application. When the data processing device 1520 and the oral scanner 1510 are linked and operating, the dedicated software stored in the data processing device 1520 is connected to the oral scanner 1510 and can receive data acquired through scanning the oral cavity in real time.

[0334] Furthermore, the dedicated software can perform at least one action for acquiring, processing, storing, and / or transmitting oral images. The dedicated software may be stored in a processor. Additionally, the dedicated software can provide a user interface for using data acquired from the oral scanner. The user interface screen provided by the dedicated software may include oral images generated according to the disclosed embodiments.

[0335] Figure 16 A sequence diagram of an oral cavity image processing method according to an embodiment is shown.

[0336] Reference Figure 16 The oral imaging system can detect the reflective mirror area using sensors mounted on the oral scanner body or from two-dimensional image data acquired from a camera mounted on the oral scanner body to obtain tip information about the tip attached to the oral scanner body (step 1610). In embodiments, the tip information may include at least one of tip fastening direction and tip size.

[0337] The oral image processing system can identify oral image acquisition patterns based on cutting-edge information (step 1620).

[0338] Oral image acquisition patterns vary depending on tip information. For example, if the tip information is the tip clamping direction, it could mean a scanning pattern based on the tip clamping direction. Oral image processing systems can identify scanning patterns based on the tip clamping direction. The identified scanning pattern can be one of the following: maxillary scanning pattern, mandibular scanning pattern, or occlusal scanning pattern.

[0339] Alternatively, if the tip information is about tip size, then the oral imaging pattern can imply a projection pattern. Projection patterns can include a normal projection pattern performed with a standard-sized tip and a small projection pattern performed with a small-sized tip.

[0340] The oral cavity image processing system can acquire oral cavity images based on the recognized patterns (step 1630).

[0341] When a scanning pattern is identified based on the direction of tip fastening, the oral image processing system can acquire an image of the oral cavity based on the identified scanning pattern. For example, when the identified scanning pattern is a mandibular scanning pattern, the oral image processing system can generate a three-dimensional image of the mandible using the raw data obtained from photographing the subject.

[0342] When the projection pattern is identified based on the tip size, the oral image processing system can adjust the projection area and the region of interest of the camera according to the projection pattern to acquire oral images.

[0343] Figure 17 This is a sequence diagram illustrating the process of acquiring tip information using an oral imaging processing system according to an embodiment.

[0344] The oral image processing system uses a camera mounted on the main body of the oral scanner to acquire two-dimensional image data of the object (step 1710). At this time, the oral image processing system projects light in a predetermined pattern and photographs the object illuminated by the predetermined pattern of light, thereby acquiring two-dimensional image data.

[0345] The oral cavity image processing system can detect the mirror region from two-dimensional image data (step 1720). By identifying the image region acquired for the object and other regions included in the two-dimensional image data, the oral cavity image processing system can detect the mirror region corresponding to the image region acquired for the object. The oral cavity image processing system can detect the mirror region by distinguishing between regions containing and excluding light with a predetermined pattern.

[0346] The oral cavity image processing system can acquire tip information using the reflective mirror area (step 1730).

[0347] Oral image processing systems can identify tip dimensions based on the size of the mirror region. For example, an oral image processing system can identify the number of patterns corresponding to the lateral or longitudinal dimensions of the mirror region, and can determine the size of the image region acquired for the subject based on the number of identified patterns.

[0348] In addition, the oral image processing system identifies the number of patterns corresponding to the lengths of the upper and lower ends of the reflector area, and identifies the direction of the longer length of the upper and lower ends, thereby identifying whether the tip is mounted face-up or face-down on the oral scanner body.

[0349] Figure 18 This is a sequence diagram illustrating a method for acquiring oral cavity images in a recognized scanning pattern according to an embodiment.

[0350] Reference Figure 18 The oral imaging system can acquire tip information (step 1810). The oral imaging system can acquire tip information from image data obtained by using a sensor or camera mounted on the body of the oral scanner.

[0351] The oral imaging system can obtain the tip fastening direction from the tip information (step 1820).

[0352] The oral imaging system can identify scanning patterns based on the direction of tip fastening (step 1830). For example, when the upper part of the tip is fastened in the same direction as the upper part of the body, the oral imaging system can identify a maxillary scanning pattern. When the lower part of the tip is fastened in the same direction as the upper part of the body, the oral imaging system can identify a mandibular scanning pattern. Furthermore, when the side of the tip is fastened in the same direction as the upper part of the body, the oral imaging system can identify an occlusal scanning pattern.

[0353] The oral image processing system can acquire oral images through the identified scanning pattern (step 1840). When the identified scanning pattern is a maxillary scanning pattern, the oral image processing system can acquire a three-dimensional oral image of the maxilla using two-dimensional image data. When the identified scanning pattern is a mandibular scanning pattern, the oral image processing system can acquire a three-dimensional oral image of the mandible based on the raw data. When the identified scanning pattern is an occlusal scanning pattern, the oral image processing system can acquire a three-dimensional oral image of occlusion from the raw data.

[0354] Figure 19 This is a sequence diagram illustrating a method for acquiring oral cavity images using different projection patterns based on the size of the tip, according to an embodiment.

[0355] The oral imaging system can acquire tip information (step 1910).

[0356] When the tip information includes information about the tip size, the oral imaging system can determine whether the tip is small (step 1920).

[0357] When the tip is not small but of a normal size, the oral imaging system can project light in a normal projection mode (step 1930). In normal projection mode, the area projected by the projector can be the first projection area.

[0358] The oral cavity image processing system can illuminate a first projection area and obtain raw data from the light reflected from the object. At this point, the oral cavity image processing system can obtain two-dimensional image data through a common region of interest (step 1940). The common region of interest can be the scanning region of interest of the camera, which is set as the default basic area.

[0359] When the tip is small, the oral imaging system can operate in a small projection mode. The oral imaging system can reduce the projection area to project light in a small projection mode (step 1950). Projecting light in a small projection mode can mean that the projector reduces the projected area to a smaller area than the first projection area, i.e., a second projection area, thereby illuminating the light. The second projection area can be the area where all the illuminated light can be specularly reflected when illuminating a small tip.

[0360] The oral cavity image processing system can illuminate a second projection area and acquire raw data about the object by using light reflected from it. The system can then reduce the region of interest to a second region of interest smaller than the basic region, thereby obtaining two-dimensional image data (step 1960). The reduced region of interest can be an area corresponding to the mirror size included by the small-sized tip.

[0361] Figure 20 This is a diagram illustrating the sequence of how the oral scanner adjusts the projection mode according to the image processing device in accordance with the embodiment.

[0362] Reference Figure 20 The image processing device can receive tip information from the oral scanner or obtain tip information by analyzing two-dimensional image data received from the oral scanner. The image processing device can obtain tip size information from the tip information (step 2010).

[0363] The image processing device can identify the projection pattern based on the tip size information (step 2020). The projection pattern may include a normal projection pattern and a small projection pattern.

[0364] The image processing device can generate control information based on the projection pattern (step 2030). When the image processing device determines that the tip size does not match the projection pattern of the oral scanner, it can generate control information.

[0365] The image processing device can transmit control information to the oral scanner (step 2040).

[0366] The oral scanner can receive control information from the image processing device and operate according to the projection pattern of the control information to acquire new two-dimensional image data (step 2050).

[0367] For example, if the control information requests that the projection mode be set to normal projection mode, the dental scanner can change the current projection mode to normal projection mode. In normal projection mode, the dental scanner can project light onto a first projection area and obtain new two-dimensional image data in a first region of interest.

[0368] For example, if the control information requests that the projection mode be set to a small projection mode, the dental scanner can change the current projection mode to a small projection mode. In small projection mode, the dental scanner can project light into a second projection area that is smaller than the first projection area, and obtain new two-dimensional image data in the second region of interest that is smaller than the first region of interest.

[0369] The oral scanner can transmit the new two-dimensional image data to the image processing device (step 2060).

[0370] The image processing device can acquire a three-dimensional oral image by receiving new two-dimensional image data from the oral scanner (step 2070).

[0371] A method for processing oral images according to an embodiment of the present disclosure is implemented in the form of program commands executable by various computer mechanisms and recorded in a computer-readable medium. Furthermore, embodiments of the present disclosure may use a computer-readable storage medium containing one or more programs including at least one instruction for performing the method for processing oral images.

[0372] Furthermore, the oral image processing method according to the embodiments of the present disclosure described above can be implemented as a computer program product including a computer-readable recording medium, the computer-readable recording medium recording a program for implementing the oral image processing method, the oral image processing method including the following steps: acquiring two-dimensional image data by scanning the oral cavity, acquiring tip information about a tip attached to the body of an oral scanner, identifying an oral image acquisition pattern based on the tip information, and acquiring an oral image based on the two-dimensional image data and the identified pattern; the tip information includes at least one of tip fastening direction information and tip size information.

[0373] The computer-readable storage medium may include program commands, data files, data structures, etc., individually or in combination. Examples of computer-readable storage media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical media such as CD-ROMs and DVDs; magneto-optical media such as floppy disks; and hardware devices configured to store and execute program commands, such as read-only memory (ROM), random access memory (RAM), and flash memory.

[0374] The machine-readable storage medium can be provided as a non-transitory storage medium. "Non-transitory storage medium" means that the storage medium is a tangible device. Furthermore, "non-transitory storage medium" can include buffers for temporarily storing data.

[0375] According to one embodiment, methods for processing oral images according to various embodiments disclosed in this specification can be provided by being included in a computer program product. The computer program product can be distributed in the form of a device-readable storage medium (e.g., a compact disc read-only memory, CD-ROM). Alternatively, it can be distributed (e.g., downloaded or uploaded) directly or online between two user devices (e.g., smartphones) through an app store (e.g., the Play Store). Specifically, the computer program product according to the disclosed embodiments may include a storage medium recording a program comprising at least one instruction to perform the methods for processing oral images according to the disclosed embodiments.

[0376] The embodiments have been described in detail above, but the scope of the present invention is not limited thereto. Various modifications and improvements made by those skilled in the art that utilize the basic concepts of the present invention as defined in the claims also fall within the scope of the present invention.

Claims

1. An image processing apparatus, wherein, include: The communication unit sends information to and receives information from the oral scanner. Memory, used to store more than one instruction, and A processor for executing the one or more instructions stored in the memory; The processor performs the following operations by executing one or more instructions: Based on the tip information of the tip included in the oral scanner, an oral image acquisition pattern is identified, and an oral image is acquired based on the two-dimensional image data received from the oral scanner through the communication unit and the identified oral image acquisition pattern. The tip information includes at least one of tip fastening direction information and tip size information.

2. The image processing apparatus according to claim 1, wherein, The processor performs the following operations by executing one or more instructions: The tip information is received from the oral scanner via the communication unit, or the tip information is obtained from the two-dimensional image data received via the communication unit.

3. The image processing apparatus according to claim 2, wherein, The processor performs the following operations by executing one or more instructions: In the two-dimensional image data, a mirror region is detected, and the tip information is obtained based on at least one of the size and shape of the mirror region.

4. The image processing apparatus according to claim 1, wherein, The processor performs the following operations by executing one or more instructions: Based on the tip information, including the tip size information, a projection pattern based on the tip size information is identified. Control information is generated based on the projection pattern. The control information is transmitted to the oral scanner via the communication unit, and The communication unit receives new two-dimensional image data acquired by the oral scanner based on the control information. The control information is information that controls the oral scanner to operate in a first projection mode when the tip is a first-sized tip, and controls the oral scanner to operate in a second projection mode when the tip is a second-sized tip.

5. The image processing apparatus according to claim 1, wherein, The processor, based on the tip information including the tip fastening direction information, identifies a scanning pattern according to the tip fastening direction information, and processes the two-dimensional image data according to the identified scanning pattern to acquire an oral cavity image. The identified scanning pattern is one of the maxillary scanning pattern, mandibular scanning pattern, and occlusal scanning pattern.

6. An oral scanner, in, include: The main body of the oral scanner, and The tip is detachably attached to the main body of the oral scanner. The main body of the oral scanner includes: The camera acquires two-dimensional image data by scanning the oral cavity. Memory, used to store more than one instruction, and A processor for executing the one or more instructions stored in the memory; The processor performs the following operations by executing one or more instructions: Obtain tip information about the tip attached to the body of the oral scanner; The tip information includes at least one of tip fastening direction information and tip size information.

7. The oral scanner according to claim 6, wherein, The main body of the oral scanner also includes sensors. The wall of the tip has at least one of different thicknesses and different colors depending on the direction. The sensor senses the tip and acquires tip information based on at least one of the distance from the sensor to the wall of the tip and the color of the wall of the tip.

8. The oral scanner according to claim 6, wherein, The main body of the oral scanner also includes sensors. The tip includes multiple protrusions and is rotatable in a state of being attached to the body of the oral scanner. The sensor senses the tip and acquires tip information based on at least one of the distance from the sensor to a protrusion identified according to the rotation of the tip and the color of the protrusion.

9. The oral scanner according to claim 6, wherein, The processor performs the following operations by executing one or more instructions: The mirror region is detected in the two-dimensional image data acquired by the camera, and the tip information is obtained based on at least one of the size and shape of the mirror region.

10. The oral scanner according to claim 6, wherein, Also includes: The communication unit sends information to the image processing device and receives information from the image processing device. The communication unit transmits the acquired two-dimensional image data and the tip information to the image processing device.

11. The oral scanner according to claim 10, wherein, The main body of the oral scanner also includes: A projector is used to project light. The communication unit receives control information generated based on the tip information from the image processing device. The control information is information that controls the oral scanner to operate in a first projection mode when the tip is a first-sized tip, and controls the oral scanner to operate in a second projection mode when the tip is a second-sized tip. The processor performs the following operations by executing one or more instructions: When the control information requests operation in the first projection mode, the projector projects light into the first projection area, and the camera acquires two-dimensional image data in the first region of interest. When the control information is a request to operate in the second projection mode, the projector projects light into a second projection area that is smaller than the first projection area, and the camera acquires two-dimensional image data in the second region of interest that is smaller than the first region of interest.

12. The oral scanner according to claim 6, wherein, The processor performs the following operations by executing one or more instructions: Based on the aforementioned cutting-edge information, an oral image acquisition pattern is identified, and an oral image is acquired based on the two-dimensional image data and the identified oral image acquisition pattern.

13. The oral scanner according to claim 12, wherein, The processor performs the following operations by executing one or more instructions: Based on the tip information, including the tip fastening direction information, a scanning pattern is identified according to the tip fastening direction information, and the two-dimensional image data is processed according to the identified scanning pattern to obtain the oral cavity image. The identified scanning pattern is one of the maxillary scanning pattern, mandibular scanning pattern, and occlusal scanning pattern.

14. The oral scanner according to claim 12, wherein, The main body of the oral scanner also includes: A projector is used to project light. The processor performs the following operations by executing one or more instructions: Based on the tip information, including the tip size information, a projection pattern based on the tip size information is identified. When the identified projection mode is the first projection mode, the projector projects light into the first projection area, and the camera acquires the two-dimensional image data in the first region of interest. When the identified projection mode is the second projection mode, the projector projects light into a second projection area that is smaller than the first projection area, and the camera acquires the two-dimensional image data in the second region of interest that is smaller than the first region of interest.

15. An image processing method, wherein, Includes the following steps: Two-dimensional image data is obtained by scanning the oral cavity. Obtain tip information about the tip integrated into the body of the oral scanner. Based on the aforementioned advanced information recognition, oral image acquisition patterns are obtained, and Oral images are acquired based on the two-dimensional image data and the identified oral image acquisition pattern; The tip information includes at least one of tip fastening direction information and tip size information.

Images