Intraoral camera system and image display method

By detecting the posture of the imaging head and rotating the image data in an intraoral camera system, the problem of inaccurate tooth image display in existing technologies is solved, enabling users to intuitively grasp the state of their teeth.

CN115515472BActive Publication Date: 2026-11-17PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202280003885.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2021-02-22
Filing Date
2022-02-17
Publication Date
2026-11-17
Estimated Expiration
2042-02-17

AI Technical Summary

Technical Problem

Existing intraoral camera systems struggle to properly display images of the teeth being photographed, making it difficult for users to intuitively understand the condition of their teeth.

Method used

An intraoral camera system is used, including a camera unit, a sensor, an image processing unit, and a display unit. By detecting the posture of the camera unit and rotating the image data within a specific angular range, the image data is positioned so that the top of the vertical axis becomes the top of the image, ensuring the correct display of the image.

Benefits of technology

It provides users with an image that allows them to intuitively confirm the relationship between their upper and lower teeth, which is identical to the actual image, thus improving user convenience and their ability to understand the state of their teeth.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115515472B_ABST
    Figure CN115515472B_ABST
Patent Text Reader

Abstract

The intraoral camera system includes a photography unit and an image processing unit (102). The image processing unit (102) rotates the image data at a third angle (θ) when the first angle (α) formed by the imaging plane (S) perpendicular to the optical axis (LA) of the photography unit and the first direction (LA or LS) along the vertical axis is less than a predetermined second angle. This rotates the image data so that the vertical upper side of the vertical axis becomes the upper side of the image. The third angle is the angle formed by the second direction (LB) and the first direction (LS) from the handle (10b) toward the head (10a).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to an intraoral camera system and an image display method. Background Technology

[0002] Patent document 1 discloses an intraoral camera system for capturing images of teeth inside the oral cavity.

[0003] (Existing technical literature)

[0004] (Patent Documents)

[0005] Patent Document 1: Japanese Patent Application Publication No. 2019-141582

[0006] For such intraoral camera systems, the expectation is that they can properly display images of the teeth being photographed. Summary of the Invention

[0007] Therefore, the purpose of this disclosure is to provide an intraoral camera system and an image display method capable of properly displaying images of photographed teeth.

[0008] One aspect of this disclosure relates to an intraoral camera system comprising: a camera unit for capturing images of teeth within the oral cavity and generating image data; the camera unit including a handle, a head, and a neck; the head including an imaging element for generating image data; and the neck connecting the handle to the head; a sensor for detecting the posture of the camera unit; an image processing unit for processing the image data based on the posture of the camera unit detected by the sensor; and a display unit for displaying the image data after image processing. The image processing unit rotates the image data at a third angle when a first angle formed by an imaging plane perpendicular to the optical axis of the camera unit and a first direction along the vertical axis upwards is less than a predetermined second angle, thereby rotating the image data such that the upper vertical side of the vertical axis becomes the upper side of the image. The third angle is the angle formed by the second direction from the handle towards the head and the first direction.

[0009] This disclosure provides an intraoral camera system and an image display method capable of properly displaying images of captured teeth. Attached Figure Description

[0010] Figure 1 This is an oblique view of the intraoral camera in the intraoral camera system described in the implementation method.

[0011] Figure 2 This is a schematic structural diagram of the intraoral camera system in the implementation method.

[0012] Figure 3 This is a diagram illustrating the flow of intraoral imaging operations in the intraoral camera system of the embodiment.

[0013] Figure 4 This is a functional block diagram of the portable terminal in the implementation method.

[0014] Figure 5 This is a flowchart of the image processing in the implementation method.

[0015] Figure 6 This is a diagram that schematically illustrates the relationship between the intraoral camera and the imaging surface in the implementation method.

[0016] Figure 7 This is a diagram illustrating an example of the angle α between the vertical axis and the imaging plane in an embodiment.

[0017] Figure 8 This is a diagram illustrating an example of the angle α between the vertical axis and the imaging plane in an embodiment.

[0018] Figure 9 This is a diagram illustrating an example of the axial direction LB of the intraoral camera in the embodiment.

[0019] Figure 10 This is a diagram illustrating an example of the directions LB and LS in an implementation scheme.

[0020] Figure 11 This is a diagram illustrating an example of the directions LB and LS in an implementation scheme.

[0021] Figure 12A This is a diagram illustrating an example of the photographic state in an implementation method.

[0022] Figure 12B This is a diagram illustrating an example of a captured image in an embodiment.

[0023] Figure 13A This is a diagram illustrating an example of the photographic state in an implementation method.

[0024] Figure 13B This is a diagram illustrating an example of a captured image in an embodiment.

[0025] Figure 13C This is a diagram illustrating an example of an image after image processing in an embodiment.

[0026] Figure 14 This is a flowchart of another specific example of the rotation process in the implementation method.

[0027] Figure 15 This is a diagram showing the tilt of the portable terminal in the embodiment.

[0028] Figure 16 This is a flowchart of image processing in a variation of embodiment 1.

[0029] Figure 17 This is a diagram illustrating a variation of embodiment 1.

[0030] Figure 18 This is a diagram illustrating a variation of embodiment 1.

[0031] Figure 19 This is a flowchart of image processing in variation 2 of the implementation method.

[0032] Figure 20 This is a diagram illustrating an example of a captured image in a variation of embodiment 2.

[0033] Figure 21 This is a diagram illustrating an example of a captured image in a variation of embodiment 2.

[0034] Figure 22 This is a diagram illustrating an example of angle γ in a variation of embodiment 2.

[0035] Figure 23 This is a diagram illustrating an example of angle γ in a variation of embodiment 2.

[0036] Figure 24 This is a diagram showing the relationship between the projected surfaces of the user in the standing state in a variation of the embodiment 3.

[0037] Figure 25 This is a diagram illustrating an example of the user's posture when using an intraoral camera in a variation of the embodiment 3.

[0038] Figure 26 This is a diagram illustrating an example of the user's posture when using an intraoral camera in a variation of the embodiment 3.

[0039] Figure 27 This is a flowchart of image processing in variation 3 of the implementation method.

[0040] Figure 28 This is a diagram illustrating an example of the initial posture in a variation of embodiment 3.

[0041] Figure 29 This is a diagram showing an example of the initial posture setting screen in a variation of embodiment 3.

[0042] Figure 30 This is a diagram showing an example of the initial posture setting screen in a variation of embodiment 3.

[0043] Figure 31This is a diagram illustrating an example of the initial posture in a variation of embodiment 3.

[0044] Figure 32 This is a diagram illustrating an example of posture correction in a variation of embodiment 3. Detailed Implementation

[0045] One aspect of this disclosure relates to an intraoral camera system comprising: a camera unit for capturing images of teeth within the oral cavity and generating image data; the camera unit including a handle, a head, and a neck; the head including an imaging element for generating image data; and the neck connecting the handle to the head; a sensor for detecting the posture of the camera unit; an image processing unit for processing the image data based on the posture of the camera unit detected by the sensor; and a display unit for displaying the image data after image processing. The image processing unit rotates the image data at a third angle when a first angle formed by an imaging plane perpendicular to the optical axis of the camera unit and a first direction along the vertical axis upwards is less than a predetermined second angle, thereby rotating the image data such that the upper vertical side of the vertical axis becomes the upper side of the image. The third angle is the angle formed by the second direction from the handle towards the head and the first direction.

[0046] As described above, this intraoral camera system can accurately display images of the teeth. For example, users can confirm that the upper and lower teeth are in the same position as in the actual image, thus gaining a clear understanding of their condition.

[0047] For example, the image processing unit may rotate the image data such that the side of the image data corresponding to the head side becomes the upper side of the image when the first angle is greater than or equal to the second angle.

[0048] For example, if the first angle is less than the second angle, the image processing unit may display an image on the display unit that is a side view of the teeth taken by the camera unit inside the user's mouth. If the first angle is greater than or equal to the second angle, the image on the display unit may display an image of the teeth taken by the camera unit from the crown side inside the user's mouth.

[0049] As described above, this intraoral camera system displays the imaging direction of the teeth. This allows users to easily identify the imaging direction of the teeth in the current image, thus improving user convenience.

[0050] For example, the image processing unit may, when the difference between the first angle and the second angle is less than a predetermined value, detect a tooth region and a gingival region along the tooth region in the image data. If the gingival region is detected on both the cheek side and the tongue side relative to the tooth region, the image data may be rotated such that the side corresponding to the head side in the image data becomes the upper side of the image. If the gingival region is detected only on either the cheek side or the tongue side relative to the tooth region, the cosine of a fourth angle formed by the first direction and the third direction may be calculated, where the third direction is the direction from the camera unit toward the subject along the optical axis of the camera unit. If the calculated cosine value is positive, the image data may be rotated such that the tooth region is below the gingival region in the image data. If the cosine value is negative, the image data may be rotated such that the tooth region is above the gingival region in the image data.

[0051] Through the above, this intraoral camera system, when the first angle is near the second angle, rotates the image data based on the relationship between the gingival region and the tooth region, as well as the cosine of the fourth angle. Therefore, this intraoral camera system can improve the judgment accuracy when the first angle is near the second angle.

[0052] For example, the image processing unit may further reverse the image data horizontally, and the display unit may display the rotated and reversed image data.

[0053] Through the above, for example, users can confirm their own teeth by seeing the same state as reflected in a mirror, thus gaining a direct understanding of the condition of their teeth.

[0054] For example, the image processing unit may further rotate the image data according to the orientation of the display unit.

[0055] Through the above, for example, users can confirm that the relationship between the upper and lower teeth is the same as the actual image, so they can intuitively grasp the state of the teeth.

[0056] For example, a predetermined posture of the camera unit can be obtained as an initial posture, and the first direction can be corrected using the initial posture.

[0057] Through the above, the intraoral camera system corrects the posture of the imaging unit according to the user's posture, thereby improving the processing accuracy.

[0058] For example, the prescribed posture could be the posture of the camera unit in which the user's posture and the posture of the camera unit form a pre-defined relationship.

[0059] For example, the prescribed posture could be a state in which the user's coronal plane is parallel to the camera plane of the camera unit, and the user's vertical axis in the planar view of the camera plane is consistent with or orthogonal to the second direction.

[0060] For example, the prescribed posture can be a state in which the teeth are parallel to and face each other on the camera surface of the camera unit, and the second direction in the plan view of the camera surface is consistent with or orthogonal to the height direction of the teeth.

[0061] Through the above methods, users can easily obtain the initial posture. Furthermore, by improving the accuracy of the initial posture, the accuracy of the correction can be improved.

[0062] Furthermore, one aspect of this disclosure relates to an image display method in which a camera unit photographs teeth inside a mouth and generates image data. The camera unit includes a handle, a head, and a neck. The head includes a camera element that generates the image data. The neck connects the handle to the head. The posture of the camera unit is detected. Based on the detected posture of the camera unit, the image data is processed, and the processed image data is displayed. In the image processing, if a first angle formed by the camera plane perpendicular to the optical axis of the camera unit and a first direction along the vertical axis upward is less than a predetermined second angle, the image data is rotated at a third angle, such that the upper vertical side of the vertical axis becomes the upper side of the image. The third angle is the angle formed by the second direction from the handle towards the head and the first direction.

[0063] Through the above-described image display method, the image of the captured teeth can be displayed appropriately. For example, the user can confirm that the upper and lower teeth are in the same position as in the actual image, thus gaining a clear understanding of the teeth's condition.

[0064] Furthermore, these general or specific solutions can be implemented through systems, methods, integrated circuits, computer programs, or computer-readable CD-ROMs and other recording media, or through any combination of systems, methods, integrated circuits, computer programs, and recording media.

[0065] The embodiments will now be described in detail with reference to the accompanying drawings. However, sometimes necessary detailed descriptions will be omitted. For example, detailed descriptions of well-known matters and repetitive descriptions of substantially the same structure will be omitted. This is to avoid unnecessary verbosity in the following description and to facilitate understanding by those skilled in the art.

[0066] Furthermore, the inventors have provided the accompanying drawings and the following description in order to enable those skilled in the art to fully understand this disclosure, but their purpose is not to limit the subject matter of the technical solutions described.

[0067] (Implementation Method)

[0068] Figure 1 This is an oblique view of the intraoral camera in the intraoral camera system of this embodiment. For example... Figure 1 As shown, the intraoral camera 10 has a toothbrush-shaped housing that can be used with one hand. The housing includes: a head 10a that is positioned inside the user's mouth when photographing the teeth, a handle 10b that the user holds, and a neck 10c that connects the head 10a and the handle 10b.

[0069] A photographic optical system 12 is embedded in the head 10a and neck 10c. The photographic optical system 12 includes an imaging element 14 and a lens disposed on the optical axis LA. Figure 1 (Not shown in the image).

[0070] The imaging element 14, such as a C-MOS sensor or CCD element, is an imaging device that uses a lens to image the teeth. The imaging element 14 outputs a signal (image data) corresponding to the image to the outside.

[0071] Furthermore, the intraoral camera 10, serving as an illumination device for illuminating the teeth of the photographed subject during filming, is equipped with multiple first to fourth LEDs 26A to 26D. The first to fourth LEDs 26A to 26D are, for example, white LEDs.

[0072] Figure 2 This is a schematic structural diagram showing the intraoral camera system in this embodiment. Figure 2 As shown, the intraoral camera system in this embodiment is generally configured as follows: an intraoral camera 10 is used to photograph the dental arch, and image processing is performed on the photographed image.

[0073] like Figure 2 As shown, the intraoral camera system includes an intraoral camera 10, a portable terminal 70, and a cloud server 80. The portable terminal 70 is, for example, a smartphone or tablet capable of wireless communication. The portable terminal 70 serves as both an input and output device, and for example, includes a touchscreen 72 capable of displaying images of the dental arch. The portable terminal 70 functions as the user interface for the intraoral camera system.

[0074] Cloud server 80 provides applications for using intraoral camera 10 to portable terminal 70 via a server capable of communication, such as the Internet. For example, a user can download and install the application from cloud server 80 onto portable terminal 70. Furthermore, cloud server 80 obtains images of the dental arch captured by intraoral camera 10 via portable terminal 70.

[0075] The intraoral camera system, as the main part for system control, includes: a central control unit 50, an image processing unit 52 for processing images of the teeth from the camera element 14, an LED control unit 54 for controlling multiple LEDs 26A to 26D, a lens driver 56 for controlling the actuator 36 of the composition adjustment mechanism and the actuator 40 of the focusing mechanism, and a position sensor 90.

[0076] In addition, the intraoral camera system includes: a wireless communication module 58 that communicates wirelessly with the portable terminal 70, and a power control unit 60 that supplies power to the central control unit 50.

[0077] The central control unit 50 of the intraoral camera system is, for example, mounted on the handle 10b of the intraoral camera 10. The central control unit 50 may also include, for example, a controller 62 such as a CPU or MPU that performs various processes (described later), and a memory 64 such as RAM or ROM that stores programs for causing the controller 62 to perform various processes. In addition to the programs, the memory 64 also stores images of the teeth captured by the imaging element 14 (image data) or various setting data.

[0078] The image processing unit 52, for example, mounted on the handle 10b of the intraoral camera 10, acquires the dental arch image (image data) captured by the imaging element 14 according to the control signal from the controller 62 of the central control unit 50, performs image processing on the acquired dental arch image, and outputs the image-processed dental arch image to the central control unit 50. The image processing unit 52 is configured, for example, by circuitry, and performs image processing such as noise removal and AWB (Automatic White Balance) processing on the dental arch image. The controller 62 transmits the dental arch image output from the image processing unit 52 to the portable terminal 70 via the wireless communication module 58. The portable terminal 70 displays the transmitted dental arch image on the touch screen 72, thereby displaying the dental arch image to the user.

[0079] The LED control unit 54, for example, is mounted on the handle 10b of the intraoral camera 10. Based on control signals from the controller 62, it controls the lighting and extinguishing of LEDs 26A to 26D from the first to the fourth LED. The LED control unit 54 is, for example, constructed from circuitry. For instance, when a user activates the intraoral camera 10 using the touchscreen 72 of the portable terminal 70, a corresponding signal is transmitted from the portable terminal 70 to the controller 62 via the wireless communication module 58. The controller 62, based on the received signal, sends a control signal to the LED control unit 54 to activate LEDs 26A to 26D from the first to the fourth LED.

[0080] The lens driver 56, for example, mounted on the handle 10b of the intraoral camera 10, controls the actuator 36 of the composition adjustment mechanism and the actuator 40 of the focusing mechanism according to the control signal from the controller 62 of the central control unit 50. The lens driver 56 is, for example, composed of circuitry. For example, when a user performs an operation related to composition adjustment or focus adjustment on the touch screen 72 of the portable terminal 70, the corresponding signal is sent from the portable terminal 70 to the central control unit 50 via the wireless communication module 58. The controller 62 of the central control unit 50 sends a control signal to the lens driver 56 to perform composition adjustment or focus adjustment according to the received signal. Furthermore, for example, the controller 62 calculates the control amount of the actuators 36 and 40 required for composition adjustment or focus adjustment based on the tooth image from the image processing unit 52, and sends a control signal corresponding to the calculated control amount to the lens driver 56.

[0081] The wireless communication module 58, for example, mounted on the handle 10b of the intraoral camera 10, wirelessly communicates with the portable terminal 70 based on control signals from the controller 62. Wireless communication between the wireless communication module 58 and the portable terminal 70 follows existing communication standards such as WiFi (registered trademark) or Bluetooth (registered trademark). The wireless communication module 58 transmits images of the dental arch D projected from the intraoral camera 10 to the portable terminal 70, or sends operation signals from the portable terminal 70 to the intraoral camera 10.

[0082] In this embodiment, the power control unit 60, mounted on the handle 10b of the intraoral camera 10, distributes power from the battery 66 to the central control unit 50, image processing unit 52, LED control unit 54, lens driver 56, and wireless communication module 58. The power control unit 60 is, for example, constructed from circuitry. Furthermore, in this embodiment, the battery 66 is a rechargeable secondary battery, wirelessly charged via a coil 68 mounted on the intraoral camera 10 and connected to an external charger 69 connected to a commercial power source.

[0083] Position sensor 90 is a sensor used to detect the posture and position of intraoral camera 10, such as a multi-axis (here, three axes: x, y, and z) accelerometer. For example, position sensor 90 could be a six-axis sensor with a three-axis accelerometer and a three-axis gyroscope. Figure 1 As shown, the z-axis coincides with the optical axis LA. The y-axis is parallel to the imaging plane and extends along the length of the intraoral camera 10. Furthermore, the X-axis is parallel to the imaging plane and orthogonal to the y-axis. The outputs (sensor data) of each axis of the position sensor 90 are transmitted to the portable terminal 70 via the central control unit 50 and the wireless communication module 58.

[0084] As the position sensor 90, a piezoresistive, capacitive, or thermal sensing type MEMS sensor can be used. Furthermore, although not illustrated, a correction circuit can be provided to balance the sensitivity of the sensors on each axis, correct for the temperature characteristics of the sensitivity, and adjust for temperature drift. Additionally, a bandpass filter (low-pass filter) can be provided to eliminate dynamic acceleration components or noise. Furthermore, noise can be reduced by smoothing the output waveform of the accelerometer.

[0085] The following describes the intraoral imaging action of the intraoral camera system. Figure 3 This is a diagram illustrating the flow of intraoral imaging actions in an intraoral camera system. Additionally, Figure 3 The processing shown is, for example, real-time processing, performed each time one or more frames of image data are acquired.

[0086] The user uses the intraoral camera 10 to capture images of their teeth and gums inside their mouth, generating image data (S101). Next, the intraoral camera 10 sends the captured image data and sensor data obtained by the position sensor 90 during capture to the portable terminal 70 (S102). Here, the image data can be a moving image or one or more still images. Furthermore, if the image data is a moving image or multiple still images, sensor data is sent for each frame of the moving image or each still image. Alternatively, if the image data is a moving image, sensor data can be sent every multiple frames.

[0087] Furthermore, the transmission of image data and sensor data does not have to be done in real time; it can be summarized and transmitted after a series of images (such as images of all the teeth in the mouth).

[0088] The portable terminal 70 rotates the received image data based on the received sensor data (S103) and displays the rotated image data (S104).

[0089] By using such an intraoral camera system, users can capture images of their own mouths with the intraoral camera 10 and confirm the state of their mouths as displayed on the portable terminal 70. This allows users to easily check the health of their teeth.

[0090] Furthermore, the portable terminal 70 can, for example, generate a three-dimensional model of multiple teeth inside the oral cavity based on multiple captured image data. Additionally, the portable terminal 70 can display images based on the generated three-dimensional model.

[0091] Additionally, an example of rotating an image of teeth is illustrated here by the portable terminal 70, but this processing can be performed part or all by the intraoral camera 10.

[0092] Figure 4 This is a functional block diagram of a portable terminal 70. The portable terminal 70 includes a position sensor 101, an image processing unit 102, and a display unit 103.

[0093] Position sensor 101 is a sensor used to detect the posture and position of portable terminal 70, such as a multi-axis (e.g., tri-axis) accelerometer.

[0094] The image processing unit 102 performs image processing, including rotation processing, based on sensor data sent from the intraoral camera 10 and sensor data obtained from the position sensor 101. The function of the image processing unit 102 can be implemented, for example, by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.

[0095] The display unit 103 is a display device provided on the portable terminal 70, which displays image data after image processing by the image processing unit 102.

[0096] Figure 5 This is a flowchart of the image processing in the image processing unit 102. First, the image processing unit 102 determines whether the angle α between the vertical axis LV in the actual space and the imaging plane S is greater than or equal to 0 degrees and less than 45 degrees (S151). Here, the pose of the imaging plane S is calculated based on sensor data obtained from the intraoral camera 10.

[0097] Figure 6 This is a diagram that schematically illustrates the relationship between the intraoral camera 10 and the imaging plane S. The imaging plane S is a plane perpendicular to the optical axis LA.

[0098] Figure 7 as well as Figure 8This diagram illustrates an example of the angle α between the vertical axis LV and the imaging plane S. Here, angle α ranges from 0 to 90 degrees. Furthermore, angle α is also expressed as 90 degrees – (the angle formed by the vertical axis LV and the optical axis LA).

[0099] Figure 7 In an example where the angle α is less than 45 degrees, the camera plane S becomes an angle that is close to perpendicular. Figure 8 This is an example where the angle α is 45 degrees or more, and the camera plane S becomes an angle close to horizontal. This occurs when photographing teeth from the side (cheek side or tongue side), such as... Figure 7 As shown, the imaging plane S is at a near-vertical angle, and when the tooth is photographed from the crown side (occlusal surface), the imaging plane S is at a near-horizontal angle. Therefore, if the angle α is less than 45 degrees ("Yes" in S151), the image processing unit 102 determines that the tooth is being photographed from the side, and if the angle α is 45 degrees or more ("No" in S151), it determines that the tooth is being photographed from the crown side.

[0100] Additionally, while a 45-degree threshold is used here as an example to determine the radiographic direction of teeth, the threshold value is not limited to 45 degrees. For example, this threshold can be in the range of 40 to 50 degrees, or in the range of 30 to 60 degrees.

[0101] First, the case where the angle α is less than 45 degrees ("Yes" in S151) will be explained. When the angle α is less than 45 degrees ("Yes" in S151), the image processing unit 102 determines that the teeth were photographed from the user's cheek side or tongue side. The image processing unit 102 then rotates the image data so that the vertically upper side becomes the upper side of the image (S152). A specific example of this processing will be explained below.

[0102] Figure 9 This diagram illustrates an example of the axial direction LB of the intraoral camera 10. Direction LB is the direction along the length of the intraoral camera 10, from the handle portion 10b towards the head portion 10a, passing through the center of the intraoral camera 10's longitudinal direction. In this example, it also passes through the center of the vertical direction (column direction) of the image plane S (image data). In other words, the upper side of the image data generated by the intraoral camera 10 is the front end side (head 10a side) of the intraoral camera 10, and the lower side is the root side (handle portion 10b side) of the intraoral camera 10. Furthermore, direction LB is calculated based on sensor data obtained from the intraoral camera 10.

[0103] Figure 10 as well as Figure 11 This is a diagram illustrating an example of direction LB and direction LS. Direction LS is the vertically upward direction along the vertical axis. Furthermore, Figure 10 as well as Figure 11 The angle θ represents the angle formed by directions LB and LS, and is in the range of 0 to 180 degrees. The image processing unit 102 rotates the image data by the angle θ, with the vertically upper side becoming the upper side of the image. Additionally, as... Figure 9 As shown, when the upper side of the original image data is aligned with the front end of the intraoral camera 10, the image processing unit 102 does not rotate the image data.

[0104] As an example, the actions performed by the image processing unit 102 when a user takes a picture of the anterior teeth (central incisors and lateral incisors) of the upper jaw will be explained.

[0105] Figure 12A This diagram shows a user holding the intraoral camera 10 vertically and taking a picture of the cheek (lip) side of the maxillary anterior teeth. Figure 12A The LB direction and the LS direction become parallel.

[0106] Figure 12B It is shown that Figure 12A An example image of anterior teeth taken in the shown state. The image data is displayed with the front side (head 10a side) of the intraoral camera 10 at the top of the image. Direction LB is parallel to direction LS, so it is possible to... Figure 12B The system displays the gum area (also known as the gingival region) above the teeth area, allowing users to intuitively understand the condition of their teeth.

[0107] on the other hand, Figure 13A This diagram shows the state of the maxillary anterior teeth being photographed from the cheek side (lip side) while the user holds the intraoral camera 10 horizontally. Figure 13A The angle θ formed by the directions LB and LS is set to 90 degrees.

[0108] Figure 13B It is shown that Figure 13A An example image of anterior teeth taken in the shown state. The image data is displayed with the front side (head 10a side) of the intraoral camera 10 at the top of the image, so the gingival region is shown on the right and the tooth region is shown on the left.

[0109] Figure 13C This diagram shows an image of the anterior teeth after processing by the image processing unit 102. The image processing unit 102 rotates the image data by 90 degrees so that its vertical upper side is the top of the image. As a result, the gingival region, including the gums, is displayed above the tooth region, allowing the user to intuitively grasp the state of the teeth.

[0110] As a specific example of this rotation process, the following method can be used. Figure 14 This is a flowchart of another specific example of rotation processing. First, the image processing unit 102 determines the tooth region including teeth and the gingival region including gums in the image data (S161). For example, the image processing unit 102 determines the tooth region and gingival region in the image data by using image analysis of feature quantities, etc.

[0111] Next, the image processing unit 102 determines whether the current photographing object is the maxilla or mandible (S162). For example, the intraoral camera 10 operates along the rows of teeth inside the mouth while being interfered with by the lips or cheeks. Therefore, when photographing the maxilla's teeth, the camera plane S is somewhat upward, and when photographing the mandible's teeth, the camera plane S is somewhat downward. Thus, the image processing unit 102 determines that the photographing object is the maxilla when the direction of the camera plane S (the direction of the optical axis LA) is upward compared to the horizontal direction, and determines that the photographing object is the mandible when the direction of the camera plane S (the direction of the optical axis LA) is downward compared to the horizontal direction.

[0112] Alternatively, instead of the image processing unit 102 determining whether the photographic object is the upper jaw or lower jaw in the direction of the photographic plane S (the direction of the optical axis LA), the user can input whether the photographic object is the upper jaw or lower jaw from the portable terminal 70. The part of the object that the user inputs on the portable terminal 70 is input to the image processing unit 102.

[0113] When the subject of the photograph is the upper jaw ("Yes" in S162), the image processing unit 102 rotates the image data so that the tooth area is below the gingival region (S163). On the other hand, when the subject of the photograph is the lower jaw ("No" in S162), the image processing unit 102 rotates the image data so that the tooth area is above the gingival region (S164). Thus, the image processing unit 102 can rotate the image data so that the vertical upper side is the upper side of the image.

[0114] Furthermore, rotating the image data in step S152 so that the vertical top side becomes the top side of the image is not limited to rotating the image data so that the vertical top side is completely aligned with the top side of the image; it may also include a predetermined deviation. Additionally, this process may include rotating the image data so that the vertical top side is closer to the top side of the image than the image data before rotation.

[0115] In this way, when the image processing unit 102 captures a picture of the teeth from the side, it rotates the image data so that the vertically upper side becomes the top of the image. This allows the user to confirm the vertical relationship in an image on the portable terminal 70, ensuring it matches the actual position of the teeth. Consequently, the user can intuitively grasp the state of the teeth, thus improving user convenience.

[0116] Use again Figure 5 Next, we will explain the case where the angle α is 45 degrees or more (No in S151). When the angle α is 45 degrees or more (No in S151), the image processing unit 102 determines that the user is taking a picture of the teeth from the crown side. The image processing unit 102 rotates the image data so that the front end of the intraoral camera 10 is at the top of the image (S153).

[0117] When taking a photograph from the crown side, the effect of tilting relative to the vertical direction is minimal, so the rotation based on tilting relative to the vertical direction, as in step S152, is not performed. On the other hand, the image data is displayed with the front end of the intraoral camera 10 positioned above the image, thus displaying an image similar to the crown side of the tooth viewed from outside the oral cavity. Therefore, the user can intuitively grasp the state of the teeth, thereby improving user convenience.

[0118] Furthermore, in step S153, rotating the image data in such a way that the front end of the intraoral camera 10 is aligned with the top of the image is not limited to rotating the image data in such a way that the front end of the intraoral camera 10 is completely aligned with the top of the image, but may also include a specified deviation.

[0119] After step S152 or S153, the image processing unit 102 rotates the image data according to the orientation of the display unit 103 (or the orientation of the portable terminal 70) (S154). Specifically, the image processing unit 102 rotates the image data so that the upper side of the displayed image is the upper side of the actual space, regardless of the orientation of the display unit 103 (or the portable terminal 70).

[0120] Figure 15 This is a diagram showing the portable terminal 70 tilted. (As shown) Figure 15 As shown, when the portable terminal 70 is tilted at an angle β relative to the vertically upward direction LS, the image processing unit 102 rotates the image data at the same angle β. Furthermore, Figure 15 The direction LC shown is the direction extending along the length of the portable terminal 70, which is the direction from the bottom to the top during normal use. For example, the angle β is the angle formed by the direction LS and the direction LC.

[0121] As described above, for example, when a user holds the portable terminal 70 with one hand and uses the intraoral camera 10 to photograph their teeth with the other, even if the portable terminal 70 is tilted, the user can still confirm the vertical relationship on the portable terminal 70 in an image that matches the actual situation. Therefore, the user can intuitively grasp the state of their teeth, thus improving user convenience.

[0122] The image processing unit 102 can flip the image data horizontally (S155). This allows the user to see their teeth in the same way as reflected in a mirror. Therefore, the user can intuitively grasp the state of their teeth, thus improving user convenience.

[0123] Furthermore, as described above, an example of determining the posture and camera orientation of the intraoral camera 10 and the portable terminal 70 using a three-axis accelerometer provided by position sensor 90 and position sensor 101 has been given. However, a three-axis gyroscope sensor can also be used to determine the posture and camera orientation of the intraoral camera 10 and the portable terminal 70. The three-axis gyroscope sensor, for example, outputs the change in angle caused by movement around the x-axis, the change in angle caused by movement around the y-axis, and the change in angle caused by movement around the z-axis, respectively. That is, with a three-axis gyroscope sensor, given an arbitrarily set initial state for the x-axis, y-axis, and z-axis, the changes in each axis are added together to determine the posture and camera orientation of the intraoral camera 10 and the portable terminal 70.

[0124] Alternatively, a combination of a three-axis accelerometer and a three-axis gyroscope can be used to determine the posture and shooting direction of the intraoral camera 10 and the portable terminal 70.

[0125] As described above, the intraoral camera system includes: a camera unit (e.g., intraoral camera 10) that manually captures images of the user's teeth inside their mouth and generates image data; a position sensor 90 that detects the posture of the camera unit (e.g., intraoral camera 10); an image processing unit 102 that rotates the image data based on the posture of the camera unit (e.g., intraoral camera 10) detected by the position sensor 90; and a display unit 103 that displays the rotated image data. Through these features, the intraoral camera system can appropriately display images of the captured teeth.

[0126] For example, the image processing unit 102 rotates the image data so that the vertical upper side in the actual space becomes the upper side of the image, based on the posture of the imaging unit (e.g., intraoral camera 10). Through this, for example, the user can confirm that the vertical relationship is the same as in reality, thus gaining a more intuitive understanding of the teeth's condition.

[0127] For example, when the first angle α formed by the imaging plane S of the imaging unit (e.g., intraoral camera 10) and the vertical axis LV is less than a predetermined second angle (e.g., 45 degrees), the image processing unit 102 rotates the image data so that the vertical upper side in the actual space becomes the upper side of the image, according to the posture of the imaging unit (e.g., intraoral camera 10).

[0128] For example, the imaging unit (e.g., intraoral camera 10) includes: a handle 10b held by a user, a head 10a including an image sensor that generates image data, and a neck 10c connecting the handle 10b and the head 10a. The image processing unit 102 rotates the image data such that the head 10a side of the imaging unit (e.g., intraoral camera 10) becomes the upper side of the image when the first angle α is a second angle or higher.

[0129] For example, the imaging unit (e.g., intraoral camera 10) includes: a handle 10b held by a user, a head 10a including an image sensor that generates image data, and a neck 10c connecting the handle 10b and the head 10a, and an image processing unit 102 that rotates the image data at a third angle θ, the third angle θ being the angle formed by a first direction LB from the handle 10b toward the head 10a and a second direction LV that is vertically upward.

[0130] For example Figure 14 As shown, the image processing unit 102 determines whether the image data includes an image of the maxilla or an image of the mandible based on the posture of the imaging unit (e.g., intraoral camera 10) (S162). If the image data includes an image of the maxilla, the image data is rotated so that the tooth region in the image data is below the gingival region (S163). If the image data includes an image of the mandible, the image data is rotated so that the tooth region in the image data is above the gingival region (S164).

[0131] For example, the image processing unit 102 further reverses the image data horizontally (S155), and the display unit 103 displays the rotated and reversed image data. Through this process, for example, a user can confirm their own teeth in the same state as reflected in a mirror, thus gaining a direct understanding of their teeth's condition.

[0132] For example, the image processing unit 102 further rotates the image data according to the posture of the display unit 103 (S154). Through the above, for example, the user can confirm that the upper and lower relationship is the same as the actual image, so that the user can intuitively grasp the state of the teeth.

[0133] The following describes variations of the above-described embodiments.

[0134] (Variation Example 1)

[0135] The display unit 103 can display the result of the judgment of the imaging direction of the teeth based on the posture of the intraoral camera 10 described above. Figure 16This is a flowchart of image processing by the image processing unit 102 in this case. Alternatively, the image processing unit 102 may only perform... Figure 16 The process shown can also be performed in the process described above (e.g.) Figure 5 Further processing is carried out on top of the process shown. Figure 16 The processing shown.

[0136] First, the image processing unit 102 determines whether the angle α between the vertical axis LV in the actual space and the imaging plane S is greater than or equal to 0 degrees and less than 45 degrees (S201). Here, the pose of the imaging plane S is calculated based on sensor data obtained from the intraoral camera 10. Further details of this processing are related to… Figure 5 The same as S151 shown.

[0137] When the angle α is less than 45 degrees ("Yes" in S201), the image processing unit 102 determines that the teeth are photographed from the side (cheek side or tongue side), and the display unit 103 displays that the image in the photograph (displayed) is an image of the side of the teeth photographed inside the user's mouth (S202). Figure 17 This is a diagram illustrating an example of this situation. For example... Figure 17 As shown, for example, display unit 103 displays images taken during photography, as well as the side view of the teeth being photographed.

[0138] On the other hand, when the angle α is 45 degrees or more (No in S201), the image processing unit 102 determines that the tooth is photographed from the crown side, and the display unit 103 displays that the image in the photograph (displayed) is an image of the tooth taken from the crown side inside the user's mouth (S203). Figure 18 This is a diagram illustrating an example of this situation. For example... Figure 18 As shown, for example, display unit 103 displays the image being photographed, and displays the crown side of the tooth being photographed.

[0139] Additionally, an example of using text (message) to indicate the photographic direction of a tooth is shown here, but text, illustrations, icons, and symbols can be used, or combinations of these can be used.

[0140] By displaying the imaging direction of the teeth, users can easily identify the imaging direction of the teeth in the current image, thus improving user convenience.

[0141] (Variation Example 2)

[0142] The above examples illustrate how the direction of a tooth's image can be determined based on whether the angle α is less than a predetermined angle (e.g., 45 degrees). However, the accuracy of the determination may decrease if the angle α is near the predetermined angle. For example, when photographing molars deep inside the oral cavity, the angle α may be near 45 degrees. Therefore, the image processing unit 102 can perform further determination processing when the angle α is near the predetermined angle.

[0143] Figure 19 This is a flowchart of the image processing performed by the image processing unit 102 in this situation. First, the image processing unit 102 determines whether the angle α between the vertical axis LV and the imaging plane S in actual space is near 45 degrees (S211). Furthermore, "near 45 degrees" can mean, for example, 40 to 50 degrees, or a narrower or wider range than that. In other words, if the difference between angle α and 45 degrees is less than a predetermined value, the image processing unit 102 determines that angle α is near 45 degrees.

[0144] If the angle α is not near 45 degrees ("No" in S211), the image processing unit 102 performs the operation with... Figure 5 The same process is applied (S218~S222). In other words, the image processing unit 102 determines whether the angle α is greater than or equal to 0 degrees and less than 45 degrees (S218).

[0145] When the angle α is less than 45 degrees ("Yes" in S218), the image processing unit 102 determines that the user is taking a picture of the teeth from the cheek side or tongue side, and rotates the image data so that the vertical upper side becomes the upper side of the image (S219). On the other hand, when the angle α is 45 degrees or more ("No" in S218), the image processing unit 102 determines that the user is taking a picture of the teeth from the crown side, and rotates the image data so that the front end side of the intraoral camera 10 becomes the upper side of the image (S220).

[0146] Next, the image processing unit 102 rotates the image data according to the orientation of the display unit 103 (the orientation of the portable terminal 70) (S221). Specifically, regardless of the orientation of the display unit 103 (portable terminal 70), the image processing unit 102 rotates the image data so that the upper side of the displayed image is aligned with the upper side of the actual space. Next, the image processing unit 102 flips the image data left and right (S222). Thus, the user can see their own teeth in the same way as when reflected in a mirror.

[0147] On the other hand, when the angle α is around 45 degrees ("Yes" in S211), the image processing unit 102 determines the tooth region including the teeth and the gingival region including the gums in the image data (S212). For example, the image processing unit 102 determines the tooth region and the gingival region in the image data by using image analysis of feature quantities, etc.

[0148] Next, the image processing unit 102 determines whether the gingival region is located on either side or on one side of the tooth region (S213). If the gingival region is located on either side of the tooth region ("Yes" in S213), the image processing unit 102 determines that the user is taking a picture of the teeth from the crown side, and rotates the image data so that the front end of the intraoral camera 10 is at the top of the image (S220).

[0149] Figure 20 This is an example image showing a tooth taken from the crown side. (See image below.) Figure 20 The image shown, taken from the crown side, reveals gingival regions on both sides of the tooth area (dental row).

[0150] On the other hand, if the gingival area is only on one side of the tooth area ("No" in S213), the image processing unit 102 determines that the user is taking a picture of the teeth from the cheek side or the tongue side. Figure 21 This is an example image showing the teeth of the lower jaw taken from the cheek side. (See image for reference.) Figure 21 In the image shown taken from the cheek side, the gingival region is present only on one side of the dental area (dental row).

[0151] Next, the image processing unit 102 calculates cosγ (S214). Figure 22 as well as Figure 23 This diagram illustrates an example of angle γ. Angle γ is the angle formed by the optical axis LA and the vertical upward direction LS, and it ranges from 0 to 180 degrees. Next, the image processing unit 102 determines whether the value of cosγ is positive or negative (S215). Furthermore, the determination of whether the value of cosγ is positive or negative here is equivalent to the determination of whether the dot product of a first vector with an arbitrary value along the optical axis LA from the imaging element 14 toward the subject and a second vector with an arbitrary value in the vertical upward direction LS is positive or negative.

[0152] When the value of cosγ is positive ("yes" in S215), in other words, when γ is between 0 and 90 degrees (e.g.) Figure 22The image processing unit 102 determines that it is capturing images of the upper teeth and rotates the image data in a manner that positions the tooth area below the gingival region (S216). On the other hand, if the value of cosγ is negative ("No" in S215), in other words, if γ is between 90 and 180 degrees (e.g.) Figure 23 The image processing unit 102 determines that it is capturing images of the lower jaw teeth, and rotates the image data so that the tooth area is above the gingival area (S217). For example, Figure 21 The image data is rotated so that the tooth region is positioned above the gum region.

[0153] After step S216 or S217, the image processing unit 102 rotates the image data according to the orientation of the display unit 103 (or the orientation of the portable terminal 70) (S221). Next, the image processing unit 102 flips the image data horizontally (S222).

[0154] Through the above, when the angle α is around 45 degrees, the image processing unit 102 determines the imaging direction (lateral or crown side) based on the relationship between the gingival region and the tooth region, and determines whether it is the maxilla or mandible based on cosγ. Therefore, the image processing unit 102 can improve the judgment accuracy when the angle α is around 45 degrees.

[0155] (Variation Example 3)

[0156] The judgment based on the posture of the intraoral camera 10 and the direction of the camera's view of the teeth is based on the assumption that the user is facing forward, either upright or sitting in a chair. However, when dentists or other professionals are photographing patients' teeth, the photograph is sometimes taken with the user (patient) lying down. In such cases, the relationship between the vertical axis and the teeth differs from when the user is facing forward, so the judgment may not be accurate. The following explains a method that allows for accurate judgment even in such situations.

[0157] Figure 24 This diagram illustrates the relationship of the projective planes for the user BD in a standing position. Here, the projective plane is a virtual plane with the user BD as the reference, consisting of three planes: the coronal plane 110, the sagittal plane 111, and the horizontal plane 112. The coronal plane 110 bisects the user BD's body from front to back and is perpendicular to the floor. The sagittal plane 111 bisects the user BD's body from left to right, passing through the front and back of the user's body, and is perpendicular to the floor. The horizontal plane 112 is parallel to the floor, bisects the user BD's body vertically, and is perpendicular to both the coronal plane 110 and the sagittal plane 111.

[0158] In addition, the axes of motion are divided into vertical axis, sagittal-horizontal axis, and coronal-horizontal axis. Figure 24 The X-axis shown is the "coronal-horizontal axis". The coronal-horizontal axis is the axis in the left-right direction, and it is the axis of rotation for flexion, extension, and other movements in the sagittal plane 111. Figure 24 The y-axis shown is the "sagittal-horizontal axis". The sagittal-horizontal axis is the axis in the anteroposterior direction, and it is the axis of rotation for lateral flexion, internal and external rotation, and other movements on the coronal plane 110. Figure 24 The z-axis shown is the "vertical axis". The vertical axis is an axis in the vertical direction, and it is the axis of rotation for movements such as rotation in the horizontal plane 112.

[0159] Figure 25 as well as Figure 26 This is a diagram illustrating an example of the posture of a user BD when using an intraoral camera 10.

[0160] like Figure 25 As shown, when user BD uses the intraoral camera 10 in an upright position or while sitting in a chair, it can be considered that the user is standing. At this time, the vertical axis Z0 (z-axis) of user BD's body is perpendicular to the floor surface, and the vertical axis Z0 of user BD's body is in the same direction as the gravitational acceleration.

[0161] on the other hand, Figure 26 As shown, for example, when user BD is lying on the dental treatment table and the dentist is using the intraoral camera 10, the coronal plane 110 of user BD's upper body is tilted along the back of the treatment table. That is, the coronal plane 110 of user BD is tilted, so that the vertical axis Z1 of the user in the tilted state along the back is tilted relative to the vertical axis Z0 of the user BD in the upright state.

[0162] Figure 27 This is a flowchart of image processing in the image processing unit 102 under the condition of changes in the user's (BD) posture. First, the image processing unit 102 obtains and maintains the initial posture of the intraoral camera 10 (S231). Specifically, based on the user's operation, the posture of the intraoral camera 10 in the state where the user's operation is being performed is obtained as the initial posture. For example, the initial posture is obtained based on the operation of the user on the portable terminal 70. Or, the initial posture is obtained by pressing a button set on the intraoral camera 10, etc. Figure 28 This is a diagram illustrating an example of an initial pose. For example... Figure 28 As shown, the attitude information of three axes with the vertical direction LV as the reference, obtained by the six-axis sensor, i.e., the position sensor 90, is used as the initial attitude. This initial attitude is maintained by the portable terminal 70 or the intraoral camera 10.

[0163] Figure 29 This is an example of a setup screen showing the initial posture of the portable terminal 70. Figure 29 As shown, for example, the posture of the intraoral camera 10 is obtained as an initial posture, where the relationship between the teeth and the intraoral camera 10 is a predefined relationship. Figure 29 In the example shown, the initial posture is one where the camera plane S of the intraoral camera 10 is parallel to the front of the anterior teeth, and the axial direction LB of the intraoral camera 10 in the planar view of the camera plane S is aligned with the height direction of the anterior teeth. However, the initial posture is not limited to this example and can be any posture based on any one or more teeth. For example, teeth other than the anterior teeth can be used. Furthermore, although it is specified here that "the axial direction LB of the intraoral camera 10 is aligned with the height (vertical) direction of the anterior teeth," it is also possible to use a posture where "the axial direction LB of the intraoral camera 10 is orthogonal to the height direction of the anterior teeth (the axial direction of the intraoral camera 10 is aligned with the width (horizontal) direction of the anterior teeth)."

[0164] Furthermore, the parallelism, consistency, and orthogonality described here do not need to be strictly defined; they can also be approximately parallel, approximately consistent, and approximately orthogonal. In other words, the portable terminal 70 can issue an instruction to the user to achieve the above-mentioned state, and the initial posture state is the posture of the intraoral camera 10 adopted by the user according to the instruction.

[0165] Figure 30 These are other examples of the setup screen showing the initial posture of the portable terminal 70. Figure 30 As shown, for example, as an initial pose, the pose of the intraoral camera 10 is obtained as a state in which the relationship between the user's pose and the pose of the intraoral camera 10 is a predefined relationship. Figure 30 In the example shown, the initial posture is that the coronal plane 110 of the user BD is parallel to the imaging plane S of the camera unit, and the vertical axis Z1 of the user BD in the planar view of the imaging plane S is consistent with the second direction LB.

[0166] Furthermore, the initial pose obtained is not limited to this example; it can also be any pose that allows the pose of the user BD to correspond with the pose of the intraoral camera 10. In addition, the pose of the user BD can be defined using one or more of the coronal plane 110, sagittal plane 111, horizontal plane 112, vertical axis, sagittal-horizontal axis, and coronal-horizontal axis. For example, although it is specified here that "the axial direction LB of the intraoral camera 10 is aligned with the vertical axis Z1," it is also possible to use "the axial direction LB of the intraoral camera 10 is orthogonal to the vertical axis Z1 (the axial direction LB is aligned with the coronal-horizontal axis)."

[0167] Next, the aforementioned dental imaging is performed. Specifically, the image processing unit 102 corrects the posture of the intraoral camera 10 obtained during the dental imaging using an initial posture (S232). In other words, the image processing unit 102 corrects the posture of the intraoral camera 10 using the initial posture, in a manner that the posture of the intraoral camera 10 is the same as the user's forward-facing posture.

[0168] Figure 31 This is a diagram illustrating an example of the initial posture. Figure 32 This diagram illustrates an example of posture correction. It also shows an example of correction based on the y-axis, but the same applies to corrections on other axes. Figure 31 As shown, when the angle δ between the vertical direction LV and the y-axis is obtained as the initial pose, the image processing unit 102, as Figure 32 As shown, the vertical LV is corrected to a vertical LV0. Furthermore, the corrected vertical LV0 is used instead of the vertical LV for tasks such as determining the shooting direction. For example... Figure 32 As shown, the angle between the corrected vertical direction LV0 and the camera plane S is calculated as angle α.

[0169] Furthermore, the image processing unit 102 can not only correct the vertical direction LV, but also the posture itself obtained by the position sensor 90, and the values ​​in the calculation (such as the angle used when making a judgment). In addition, part or all of this correction processing can be performed in the image processing unit 102 (portable terminal 70) or in the intraoral camera 10.

[0170] Finally, the image processing unit 102 performs image data rotation and other processing based on the corrected posture (S233). Specifically, the image processing unit 102 uses the corrected posture to perform... Figure 5 , Figure 14 , Figure 16 or Figure 19 The processing is shown.

[0171] As described above, the image processing unit 102 corrects the posture of the intraoral camera 10 according to the user's posture, thereby improving the accuracy of the judgment.

[0172] As mentioned above, Figure 1 , Figure 2 as well as Figure 4As shown, an intraoral camera system includes: a camera unit (e.g., intraoral camera 10) for capturing images of teeth inside the oral cavity and generating image data; the camera unit includes a handle 10b, a head 10a, and a neck 10c; the head includes an imaging element for generating image data; and the neck connects the handle 10b to the head 10a; a sensor 90 for detecting the posture of the camera unit (e.g., intraoral camera 10); an image processing unit 102 for processing the image data based on the posture of the camera unit (e.g., intraoral camera 10) detected by the sensor 90; and a display unit 103 for displaying the image data, such as... Figures 5 to 13C As shown, the image processing unit 102 rotates the image data by a third angle θ when the first angle α formed by the imaging plane S perpendicular to the optical axis LA of the imaging unit (e.g., intraoral camera 10) and the first direction LV (or LS) in the vertical upward direction along the vertical axis is less than a predetermined second angle (e.g., 45 degrees) ("Yes" in S151). This rotates the image data such that the upper vertical side of the vertical axis becomes the upper side of the image. The third angle θ is the angle formed by the second direction LB and the first direction LS from the handle portion 10b toward the head 10a (S152).

[0173] As described above, this intraoral camera system can accurately display images of the teeth. For example, users can confirm that the upper and lower teeth are in the same position as in the actual image, thus gaining a clear understanding of their condition.

[0174] For example Figures 5 to 13C As shown, when the first angle α is a second angle (e.g., 45 degrees or more), the image processing unit 102 rotates the image data so that the side of the image data corresponding to the head side becomes the top side of the image (S153).

[0175] For example Figures 16-18 As shown, when the first angle α is less than the second angle (e.g., 45 degrees) ("Yes" in S201), the image processing unit 102 displays on the display unit 103 an image of the side of the teeth taken by the camera unit (e.g., intraoral camera 10) inside the user's mouth (S202). When the first angle α is greater than or equal to the second angle (e.g., 45 degrees) ("No" in S201), the image processing unit 102 displays on the display unit 103 an image of the teeth taken by the camera unit (e.g., intraoral camera 10) inside the user's mouth from the crown side (S203).

[0176] As described above, this intraoral camera system displays the imaging direction of the teeth. This allows users to easily identify the imaging direction of the teeth in the current image, thus improving user convenience.

[0177] For example Figures 19-23 As shown, when the difference between the first angle α and the second angle (e.g., 45 degrees) is less than a predetermined value ("Yes" in S211), the image processing unit 102 detects the tooth region and the gingival region along the tooth region in the image data (S212). When the gingival region is detected on both the cheek side and the tongue side relative to the tooth region ("Yes" in S213), the image data is rotated in such a way that the side corresponding to the head 10a side in the image data becomes the upper side of the image (S220). The image processing unit 102, when detecting only the gingival region on either the cheek side or the tongue side relative to the tooth region ("No" in S213), calculates the cosine (cosγ) of the fourth angle γ formed by the first direction LS and the third direction, wherein the third direction is the direction from the camera unit toward the subject along the optical axis LA of the camera unit (S214). When the calculated cosine value is positive ("Yes" in S215), the image data is rotated in such a way that the tooth region is below the gingival region in the image data (S216). When the cosine value is negative ("No" in S215), the image data is rotated in such a way that the tooth region is above the gingival region in the image data (S217).

[0178] Through the above, this intraoral camera system, when the first angle α is near the second angle (e.g., 45 degrees), rotates the image data based on the relationship between the gingival region and the tooth region, and the cosine (cosγ) of the fourth angle γ. Therefore, this intraoral camera system can improve the judgment accuracy when the first angle α is near the second angle (e.g., 45 degrees).

[0179] For example Figure 5 As shown, the image processing unit 102 further reverses the image data horizontally, and the display unit 103 displays the rotated and reversed image data (S155). Through the above, for example, a user can confirm their teeth in the same state as reflected in a mirror, thus gaining a direct understanding of their teeth's condition.

[0180] For example Figure 5 As shown, the image processing unit 102 further rotates the image data according to the posture of the display unit 103 (S154). Through the above, for example, the user can confirm that the upper and lower relationship is the same as the actual image, so he can intuitively grasp the state of the teeth.

[0181] For example Figures 24-32 As shown, the prescribed posture of the camera unit is obtained as the initial posture (S231), and the first direction LV (or LS) is corrected using the initial posture (S232).

[0182] Through the above, the intraoral camera system corrects the posture of the imaging unit according to the user's posture, thereby improving the processing accuracy.

[0183] For example, the prescribed pose is the pose of the user BD and the pose of the camera department, which are in a pre-defined relationship.

[0184] For example, the prescribed posture is that the coronal plane 110 of the user BD is parallel to the imaging plane S of the camera unit, and the vertical axis Z1 of the user BD in the planar diagram of the imaging plane S is consistent with or orthogonal to the second direction LB.

[0185] For example, the prescribed posture is a state in which the pre-defined teeth (e.g., front teeth) are parallel to the imaging plane S of the camera unit and face each other, and the second direction LB in the plan view of the imaging plane S is consistent with or orthogonal to the pre-defined height direction of the teeth.

[0186] Through the above methods, users can easily obtain the initial posture. Furthermore, by improving the accuracy of the initial posture, the accuracy of the correction can be improved.

[0187] The oral cavity camera system according to the embodiments of the present disclosure has been described above, but the present disclosure is not limited to these embodiments.

[0188] For example, the above description illustrates an example using an intraoral camera 10 primarily for photographing teeth; however, the intraoral camera 10 could also be an intraoral cleaning device equipped with a camera. For instance, the intraoral camera 10 could be an intraoral cleaning machine equipped with a camera, etc.

[0189] Furthermore, the processing units included in the intraoral camera system described above are typically implemented as integrated circuits, i.e., LSIs. These can be individually monolithically integrated, or partially or entirely monolithically integrated.

[0190] Furthermore, integrated circuitry is not limited to LSIs; it can be implemented using dedicated circuits or general-purpose processors. Alternatively, FPGAs (Field-Programmable Gate Arrays) that are programmable after LSI manufacturing can be used, along with reconfigurable processors that connect and configure the internal circuitry of the reconfigurable LSI.

[0191] Furthermore, in each of the aforementioned embodiments, each component can be implemented by dedicated hardware or by executing software programs suitable for that component. Each component can be implemented by a program execution unit such as a CPU or processor reading and executing software programs recorded on a recording medium such as a hard disk or semiconductor memory.

[0192] Furthermore, this disclosure can be implemented as an image display method performed by an intraoral camera system. Additionally, this disclosure can be implemented as an intraoral camera, a portable terminal, or a cloud server included in an intraoral camera system.

[0193] Furthermore, the segmentation of functional blocks in a block diagram is one example. Multiple functional blocks can be implemented as a single functional block, or a single functional block can be divided into multiple functional blocks, or some functions can be transferred to other functional blocks. Additionally, the functions of multiple functional blocks with similar capabilities can be processed in parallel or time-sharing by a single piece of hardware or software.

[0194] Furthermore, the order in which the steps in the flowchart are executed is an example shown for the purpose of illustrating this disclosure, and may be in a different order. Additionally, some of the steps may be executed simultaneously (in parallel) with other steps.

[0195] The above description relates to one or more embodiments of the intraoral camera system based on implementation methods. However, the present disclosure is not limited to these embodiments. Various modifications conceivable to those skilled in the art, performed on these embodiments, and combinations of constituent elements from different embodiments are also included within the scope of one or more embodiments of the present disclosure, without departing from the spirit of the present disclosure.

[0196] This disclosure is applicable to intraoral camera systems.

[0197] Symbol Explanation

[0198] 10 Intraoral Cameras

[0199] 10a Head

[0200] 10b Handle

[0201] 10c Neck

[0202] 12. Photographic Optical System

[0203] 14. Camera components

[0204] 26A First LED

[0205] 26B 2nd LED

[0206] 26C 3rd LED

[0207] 26D 4thLED

[0208] 36, 40 Actuators

[0209] 50 Central Control Department

[0210] 52 Image Processing Department

[0211] 54 LED Control Department

[0212] 56 Lens Driver

[0213] 58 Wireless Communication Module

[0214] 60 Power Control Unit

[0215] 62 controllers

[0216] 64 Memory

[0217] 66 batteries

[0218] 68 coils

[0219] 69 Charger

[0220] 70 Portable Terminal

[0221] 72 Touchscreen

[0222] 80 cloud servers

[0223] 90 Position Sensor

[0224] 101 Position Sensor

[0225] 102 Image Processing Department

[0226] 103 Display Department

[0227] 110 Coronal plane

[0228] 111 Sagittal plane

[0229] 112 Horizontal plane

Claims

1. An intraoral camera system, comprising: A camera unit that captures images of teeth inside the mouth and generates image data. The camera unit includes a handle, a head, and a neck. The head includes a camera element that generates image data, and the neck connects the handle to the head. The sensor detects the posture of the camera unit; The image processing unit performs image processing on the image data based on the posture of the camera unit detected by the sensor. as well as The display unit displays the image data after the image processing. The image processing unit, When the first angle formed by the imaging plane perpendicular to the optical axis of the imaging unit and the first direction pointing vertically upwards along the vertical axis is less than a predetermined second angle, The image data is rotated at a third angle, such that the top of the vertical axis becomes the top of the image. The third angle is the angle formed by the second direction from the handle towards the head and the first direction. If the difference between the first angle and the second angle is less than a predetermined value, the tooth region and the gingival region along the tooth region are detected in the image data. When the gingival region is detected on both the cheek and tongue sides relative to the tooth region, the image data is rotated such that the side corresponding to the head side within the image data becomes the upper side of the image. If the gingival region is detected only on either the cheek side or the tongue side relative to the tooth region, the image data is rotated such that the tooth region is located below or above the gingival region in the image data.

2. The intraoral camera system as described in claim 1, The image processing unit, When the first angle is greater than or equal to the second angle, The image data is rotated so that the side of the image data corresponding to the head side becomes the top side of the image.

3. The intraoral camera system as described in claim 1 or 2, The image processing unit, When the first angle is smaller than the second angle, the display unit will display an image of the sides of the teeth taken by the camera unit inside the user's mouth. When the first angle is greater than or equal to the second angle, the display unit displays an image of the teeth taken by the camera unit from the crown side inside the user's mouth.

4. The intraoral camera system as described in claim 1 or 2, The image processing unit, If the gingival region is detected only on either the cheek side or the tongue side relative to the tooth region, Calculate the cosine of the fourth angle formed by the first direction and the third direction, where the third direction is the direction along the optical axis of the camera unit from the camera unit toward the subject. If the calculated cosine value is positive, the image data is rotated such that the tooth region is located below the gingival region in the image data. When the value of the cosine is negative, the image data is rotated so that the tooth region is located above the gingival region in the image data.

5. The intraoral camera system as described in claim 1 or 2, The image processing unit further reverses the image data horizontally. The display unit displays the rotated and inverted image data.

6. The intraoral camera system as described in claim 1 or 2, The image processing unit further rotates the image data according to the orientation of the display unit.

7. The intraoral camera system as described in claim 1 or 2, The prescribed posture of the camera unit is obtained as the initial posture. The first direction is corrected using the initial posture.

8. The intraoral camera system as described in claim 7, The prescribed posture is the posture of the camera unit in which the user's posture and the posture of the camera unit form a pre-defined relationship.

9. The intraoral camera system as described in claim 8, The prescribed posture is a state in which the user's coronal plane is parallel to the camera plane of the imaging unit, and the user's vertical axis in the planar view of the camera plane is consistent with or orthogonal to the second direction.

10. The intraoral camera system as described in claim 7, The prescribed posture is a state in which the teeth are parallel to and face each other on the camera surface of the camera unit, and the second direction in the plan view of the camera surface is consistent with or orthogonal to the height direction of the teeth.

11. An image display method, wherein in the image display method, The imaging unit captures images of the teeth inside the mouth and generates image data. The imaging unit includes a handle, a head, and a neck. The head includes a camera element that generates the image data, and the neck connects the handle to the head. The posture of the camera unit is detected. Based on the detected posture of the camera unit, image processing is performed on the image data. Display the image data after the image processing. In the image processing, When the first angle formed by the imaging plane perpendicular to the optical axis of the imaging unit and the first direction pointing vertically upwards along the vertical axis is less than a predetermined second angle, The image data is rotated at a third angle, such that the top of the vertical axis becomes the top of the image. The third angle is the angle formed by the second direction from the handle towards the head and the first direction. If the difference between the first angle and the second angle is less than a predetermined value, the tooth region and the gingival region along the tooth region are detected in the image data. When the gingival region is detected on both the cheek and tongue sides relative to the tooth region, the image data is rotated such that the side corresponding to the head side within the image data becomes the upper side of the image. If the gingival region is detected only on either the cheek side or the tongue side relative to the tooth region, the image data is rotated such that the tooth region is located below or above the gingival region in the image data.

Citation Information

Patent Citations

  • Oral cavity camera system and oral camera

    JP2019141582A

  • Oral imaging and display system

    CN103347436A

  • Method for displaying tooth image, tooth image display apparatus using the method, and recording medium used therefor

    JP2012143484A

  • Video camera fashioned as a handpiece for observing subjects in mouth of a patient

    US5661519A