Intraoral camera, lighting control device, and lighting control method

Abstract

An intraoral camera (11) comprises: an imaging unit (21) which generates image data by capturing an image of teeth in a user's mouth cavity; an illumination unit (23) which irradiates the teeth with light; and an illumination control unit (34) which controls the irradiation intensity and / or the color temperature of the illumination unit (23) such that the color temperature of light reflected from the teeth based on the image data is brought close to a target color temperature based on a second color temperature of the illumination unit (23).

Description

[Technical field]

[0001] The present disclosure relates to an intraoral camera, a lighting control device, and a lighting control method. [Background technology]

[0002] Patent document 1 discloses an intraoral observation device (intraoral camera) that includes a light source (illumination unit) that illuminates the oral cavity and a light receiving unit (imaging unit) that receives light reflected from the oral cavity irradiated by the light source. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2008-86554 A Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, it is desirable for an intraoral camera that captures images inside the oral cavity to accurately obtain information about the condition of the teeth, such as the amount of plaque present.

[0005] Therefore, the present disclosure provides an intraoral camera, a lighting control device, and a lighting control method that can accurately obtain the condition of teeth. [Means for solving the problem]

[0006] An intraoral camera according to one embodiment of the present disclosure includes an imaging unit that generates image data by imaging the teeth in a user's mouth, an illumination unit that irradiates the teeth with light, and an illumination control unit that controls at least one of the illumination intensity and color temperature of the illumination unit so that a first color temperature of reflected light from the teeth based on the image data approaches a target color temperature based on a second color temperature of the illumination unit.

[0007] A lighting control device according to one embodiment of the present disclosure is a lighting control device that controls the lighting unit in an intraoral camera that includes an imaging unit that generates image data by photographing the teeth in a user's oral cavity and an illumination unit that irradiates the teeth with light, and includes an acquisition unit that acquires the image data generated by the imaging unit, and a lighting control unit that controls at least one of the irradiation intensity and color temperature of the illumination unit so that a first color temperature of reflected light from the teeth based on the image data approaches a target color temperature based on a second color temperature of the illumination unit.

[0008] A lighting control method according to one aspect of the present disclosure generates image data by photographing teeth in a user's oral cavity, irradiates light onto the teeth, and controls at least one of the illumination intensity and color temperature of the lighting unit so that a first color temperature of light reflected from the teeth based on the image data approaches a target color temperature based on a second color temperature of the lighting unit. Effect of the Invention

[0009] The present disclosure can provide an intraoral camera, a lighting control device, and a lighting control method that can accurately obtain the condition of teeth. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a perspective view of an intraoral camera in the intraoral camera system according to the first embodiment. [Diagram 2] FIG. 2 is a schematic configuration diagram of the intraoral camera system according to the first embodiment. [Diagram 3] FIG. 3 is a diagram showing teeth in an oral cavity according to the first embodiment. [Figure 4] FIG. 4 is a diagram showing an example of an intraoral region according to the first embodiment. [Diagram 5] FIG. 5 is a flowchart showing the operation of the intraoral camera according to the first embodiment. [Figure 6] FIG. 6 is a diagram showing the relationship of the projection plane with respect to a user in a standing position according to a modification of the first embodiment. [Figure 7]FIG. 7 is a diagram showing an example of a posture of a user when using an intraoral camera according to a modification of the first embodiment. [Figure 8] FIG. 8 is a diagram showing an example of a posture of a user when using an intraoral camera according to a modification of the first embodiment. [Figure 9] FIG. 9 is a flowchart showing image processing according to a modification of the first embodiment. [Figure 10] FIG. 10 is a schematic configuration diagram of an intraoral camera system according to the second embodiment. [Figure 11] FIG. 11 is a flowchart showing the operation of the intraoral camera according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] An intraoral camera according to a first aspect of the present disclosure includes an imaging unit that generates image data by imaging the teeth in a user's mouth, an illumination unit that irradiates the teeth with light, and an illumination control unit that controls at least one of the illumination intensity and color temperature of the illumination unit so that a first color temperature of reflected light from the teeth based on the image data approaches a target color temperature based on a second color temperature of the illumination unit.

[0012] This allows image data with a color temperature close to the target color temperature to be captured regardless of the position of the tooth, thereby preventing the color temperature of the image data from differing due to the influence of external light, etc. For example, the intraoral camera can reduce the influence of external light by controlling the color temperature, making it easier to set the white balance gain to a substantially fixed value in accordance with the lighting unit (e.g., the light-emitting element of the lighting unit), thereby enabling plaque detection with less variation due to the environment. Thus, the intraoral camera according to one aspect of the present disclosure can accurately capture the state of the teeth even when there is the influence of external light, etc.

[0013] In addition, an intraoral camera according to a second aspect of the present disclosure is the intraoral camera according to the first aspect, and, for example, the lighting control unit may control at least one of the irradiation intensity and the color temperature of the lighting unit so that the first color temperature is within a predetermined range including the target color temperature.

[0014] This allows the lighting unit to be controlled so that the color temperature of the reflected light is within a specified range regardless of the position of the tooth, allowing the intraoral camera to obtain a more accurate image of the condition of the teeth.

[0015] In addition, an intraoral camera according to a third aspect of the present disclosure is the intraoral camera according to the first or second aspect, and further includes, for example, a determination unit that determines the position of the tooth to be photographed by the photographing unit based on first image data captured by the photographing unit, and the lighting control unit may further control at least one of the illumination intensity and color temperature of the lighting unit using the determination result of the determination unit.

[0016] This allows at least one of the illumination intensity and color temperature of the lighting unit to be controlled according to the position of the tooth, allowing the intraoral camera to obtain a more accurate image of the condition of the teeth.

[0017] In addition, an intraoral camera according to a fourth aspect of the present disclosure is the intraoral camera according to the third aspect, and, for example, the determination unit may determine the position of the tooth to be photographed by the photographing unit based on the first image data and second image data indicating a standard tooth shape.

[0018] This makes it possible to easily determine the position of the teeth using the second image showing the standard tooth shape.

[0019] In addition, an intraoral camera according to a fifth aspect of the present disclosure is the intraoral camera according to the third aspect, and further includes a memory unit that stores third image data of the oral cavity of a user using the intraoral camera, the third image data including the dentition, which has been captured in advance, and the determination unit may determine the position of the teeth to be captured by the capture unit based on the first image data and the third image data.

[0020] This allows the positions of the teeth to be determined from image data of the user's own teeth, improving the accuracy of determining the positions of the teeth.

[0021] In addition, an intraoral camera according to a sixth aspect of the present disclosure is the intraoral camera according to the third aspect, and further includes, for example, a communication unit that transmits notification information to a user using the intraoral camera to notify the user of an area to be photographed by the photographing unit among multiple areas of the oral cavity defined by dividing the dentition, and the determination unit may determine that an image captured by the photographing unit after the user is notified of the area indicated by the notification information is an image of the area.

[0022] This makes it possible to omit the process of determining the position of the tooth being photographed, leading to a reduction in the amount of processing required in the intraoral camera.

[0023] In addition, an intraoral camera according to a seventh aspect of the present disclosure is an intraoral camera according to any of the first to sixth aspects, and, for example, the target color temperature may be set based on the color temperature of the tooth photographed first after the intraoral camera is placed inside the oral cavity, and the lighting control unit may control at least one of the irradiation intensity and color temperature of the lighting unit so that the first color temperature approaches the set target color temperature throughout the entire area of ​​the oral cavity.

[0024] This allows the color temperature of the other teeth to approach the color temperature of the first tooth photographed.

[0025] In addition, an intraoral camera according to an eighth aspect of the present disclosure is an intraoral camera according to any one of the first to sixth aspects, and, for example, the lighting control unit may control at least one of the illumination intensity and color temperature of the lighting unit based on the color temperature of a glossy area that is strongly influenced by the light irradiated from the lighting unit among multiple areas in the oral cavity defined by dividing the dentition.

[0026] This allows the color temperature of the other areas to be closer to that of the glossy area.

[0027] A lighting control device according to a ninth aspect of the present disclosure is a lighting control device for controlling an illumination unit in an intraoral camera including an imaging unit that generates image data by imaging teeth in a user's oral cavity and an illumination unit that irradiates light onto the teeth, and includes an acquisition unit that acquires the image data generated by the imaging unit, and an illumination control unit that controls at least one of the illumination intensity and color temperature of the illumination unit so that a first color temperature of reflected light from the teeth based on the image data approaches a target color temperature based on a second color temperature of the illumination unit. A lighting control method according to a tenth aspect of the present disclosure generates image data by imaging teeth in a user's oral cavity, irradiates the teeth with light, and controls at least one of the illumination intensity and color temperature of the illumination unit so that a first color temperature of reflected light from the teeth based on the image data approaches a target color temperature based on a second color temperature of the illumination unit.

[0028] This provides the same effect as the intraoral camera described above.

[0029] In addition, an intraoral camera according to an eleventh aspect of the present disclosure may include, for example, an imaging unit that generates image data by photographing teeth in a user's oral cavity, an area detection unit that detects an area to be photographed by the imaging unit among multiple areas in the oral cavity defined by dividing the dentition, an illumination unit that irradiates light onto the detected area, and an illumination control unit that controls the illumination intensity of the illumination unit based on the detected area.

[0030] As a result, the illumination unit emits light with an illumination intensity that corresponds to the area to be photographed by the imaging unit, allowing the intraoral camera to appropriately control the illumination intensity of the illumination unit.

[0031] In addition, an intraoral camera according to a twelfth aspect of the present disclosure is the intraoral camera according to the eleventh aspect, wherein, for example, the multiple regions include a first region including front teeth and a second region further back than the first region, and the lighting control unit may cause the illumination intensity of the lighting unit to be different between the first region and the second region.

[0032] This allows the intraoral camera to vary the illumination intensity of the illumination unit between the first area and the second area, thereby making it possible to more appropriately control the illumination intensity of the illumination unit.

[0033] In addition, an intraoral camera according to a thirteenth aspect of the present disclosure is an intraoral camera according to the eleventh or twelfth aspect, and, for example, the lighting control unit may control the lighting unit so that the illumination intensity of the second area is higher than the illumination intensity of the first area.

[0034] This allows the brightness of an image captured of the first region to be closer to that of an image captured of the second region when external light is irradiated onto the first region. Note that external light refers to light other than the light irradiated by the lighting unit, and examples of this include illumination light and sunlight.

[0035] Furthermore, an intraoral camera according to a fourteenth aspect of the present disclosure is an intraoral camera according to any of the eleventh to thirteenth aspects, and, for example, the area detection unit may further detect whether the area to be photographed by the imaging unit is being photographed from the cheek side or the tongue side of the oral cavity, and the lighting control unit may cause the illumination intensity of the lighting unit to differ between when the imaging unit is photographing the area from the cheek side and when the imaging unit is photographing the area from the tongue side.

[0036] This allows the intraoral camera to vary the illumination intensity of the lighting unit depending on whether the imaging unit is capturing images from the cheek side or the tongue side (i.e., depending on the imaging direction of the imaging unit), thereby enabling even more appropriate control of the illumination intensity of the lighting unit.

[0037] Furthermore, an intraoral camera according to a fifteenth aspect of the present disclosure is the intraoral camera according to the thirteenth aspect, wherein, for example, the area detection unit further detects whether the area to be photographed by the photographing unit is photographed from the cheek side or the tongue side of the oral cavity, and the lighting control unit performs first control which is control of the lighting unit depending on whether the first area is photographed from the tongue side or the cheek side, and second control which is control of the lighting unit depending on whether the second area is photographed from the tongue side or the cheek side, and the first control and the second control may be different from each other.

[0038] Thereby, the intraoral camera controls the illumination intensity of the illumination unit differently between the first area and the second area, thereby enabling more appropriate control of the illumination intensity of the illumination unit.

[0039] In addition, an intraoral camera according to a sixteenth aspect of the present disclosure is the intraoral camera according to the fifteenth aspect, and, for example, the lighting control unit may control the lighting unit in the first control so that when the first area is photographed from the front side of the user, the illumination intensity is higher than when the first area is photographed from the cheek side, and may control the lighting unit in the second control so that when the second area is photographed from the tongue side, the illumination intensity is lower than when the second area is photographed from the cheek side.

[0040] This allows the intraoral camera to bring the brightness of an image of the first region captured from the front side of the user (an image that is easily affected by external light) closer to that of an image of the first region captured from the tongue side (an image that is less affected by external light). Also, the intraoral camera can bring the brightness of an image of the second region captured from the tongue side (an image that is easily affected by external light) closer to that of an image of the second region captured from the cheek side (an image that is less affected by external light). Thus, the intraoral camera can appropriately control the irradiation intensity of the illumination unit to prevent image data with different brightnesses for each region from being generated due to differences in the effects of external light.

[0041] Furthermore, an intraoral camera according to a seventeenth aspect of the present disclosure is an intraoral camera according to any of the eleventh to sixteenth aspects, and, for example, the multiple regions may include two or more regions included in the upper jaw region and two or more regions included in the lower jaw region.

[0042] This allows the intraoral camera to have finer control over illumination intensity.

[0043] In addition, an intraoral camera according to an 18th aspect of the present disclosure is an intraoral camera according to any of the 11th to 17th aspects, and may, for example, include an attitude detection unit that detects the attitude of the imaging unit based on the output of a multi-axis acceleration sensor, and the area detection unit may detect the area to be imaged by the imaging unit based on the detected attitude.

[0044] This allows the intraoral camera to detect the area to be photographed based on the orientation of the imaging unit.

[0045] In addition, an intraoral camera according to a 19th aspect of the present disclosure is an intraoral camera according to any of the 11th to 18th aspects, and, for example, the area detection unit may identify the type of tooth shown in the image data, and detect the area to be photographed by the imaging unit based on the identified type of tooth.

[0046] This allows the intraoral camera to detect the area of ​​the subject to be photographed using the image data photographed by the photographing unit. In other words, the intraoral camera does not need to have a dedicated configuration for detecting the area of ​​the subject to be photographed. Therefore, the intraoral camera can appropriately control the irradiation intensity of the lighting unit with a simple configuration.

[0047] In addition, an intraoral camera according to a 20th aspect of the present disclosure is the intraoral camera according to the 18th aspect, and may, for example, obtain an initial posture which is a predetermined posture of the imaging unit, and the area detection unit may correct the detected posture using the initial posture, and detect an area among the multiple areas to be imaged by the imaging unit based on the corrected posture.

[0048] This allows the intraoral camera to appropriately control the illumination intensity of the lighting unit regardless of the user's posture by correcting the posture of the imaging unit according to the user's posture.

[0049] In addition, a lighting control method according to a 21st aspect of the present disclosure generates image data by photographing teeth in a user's oral cavity, detects an area to be photographed by an imaging unit from among multiple areas in the oral cavity defined by dividing the dentition, and controls the illumination intensity of an illumination unit that irradiates light onto the detected area based on the detected area.

[0050] This provides the same effect as the intraoral camera system described above.

[0051] Furthermore, these comprehensive or specific aspects may be realized by a system, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable CD-ROM, or may be realized by any combination of the system, the method, the integrated circuit, the computer program, and the recording medium.

[0052] The embodiments described below are all comprehensive or specific examples. The numerical values, shapes, components, component arrangements and connection forms, steps, and order of steps shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Furthermore, among the components in the following embodiments, components that are not described in the independent claims are described as optional components.

[0053] In addition, each figure is a schematic diagram and is not necessarily illustrated precisely. Therefore, for example, the scales in each figure do not necessarily match. In addition, in each figure, substantially the same configurations are given the same reference numerals, and duplicated explanations are omitted or simplified.

[0054] In addition, in this specification, terms indicating the relationship between elements, such as parallel, coincident, and orthogonal, terms indicating the shape of an element, such as ring-shaped, as well as numerical values ​​and numerical ranges, are not expressions that only express a strict meaning, but are expressions that also include a substantially equivalent range, for example, a difference of about a few percent (or about 10%).

[0055] (Embodiment 1) Hereinafter, an intraoral camera and a lighting control method according to the present embodiment will be described with reference to FIGS. 1 to 5. FIG.

[0056] [1-1. Configuration of intraoral camera system] First, the configuration of an intraoral camera system including an intraoral camera according to the present embodiment will be described with reference to Figures 1 and 2. Figure 1 is a perspective view of the intraoral camera in the intraoral camera system according to the present embodiment.

[0057] As shown in FIG. 1, the intraoral camera 10 has a toothbrush-shaped housing that can be handled with one hand, and the housing has a head portion 10a that is placed in the user's oral cavity when photographing the dentition, a handle portion 10b that is held by the user, and a neck portion 10c that connects the head portion 10a and the handle portion 10b.

[0058] The photographing unit 21 is incorporated into the head portion 10a and the neck portion 10c. The photographing unit 21 has an image pickup element (not shown) and a lens (not shown) arranged on the optical axis LA.

[0059] The imaging element is a photographing device such as a CMOS (Complementary Metal Oxide Semiconductor) sensor or a CCD (Charge Coupled Device) element, and an image of the teeth is formed by the lens. The imaging element outputs a signal (image data) corresponding to the formed image to the outside.

[0060] The intraoral camera 10 is also equipped with a plurality of first to fourth light emitting diodes (LEDs) 23A to 23D as an illumination unit (illumination device) that irradiates light onto the teeth to be photographed during photography. The first to fourth LEDs 23A to 23D are, for example, white LEDs.

[0061] FIG. 2 is a schematic configuration diagram of the intraoral camera system according to the present embodiment.

[0062] 2, the intraoral camera system according to the present embodiment is generally configured to photograph the row of teeth by having the illumination unit irradiate light with an irradiation intensity according to the area of ​​the oral cavity to be photographed by the photographing unit 21. The area of ​​the oral cavity to be photographed by the photographing unit 21 (photographing area) is the area currently being photographed by the photographing unit 21 or the area to be photographed in the future.

[0063] As shown in Fig. 2, the intraoral camera system includes an intraoral camera 10 and a mobile terminal 50. In the intraoral camera system, when the intraoral camera 10 captures images of multiple regions in the oral cavity, the illumination intensity of the illumination unit 23 is controlled according to the region in the oral cavity captured by the imaging unit 21 in order to equalize the brightness of each captured image regardless of the degree of influence of external light. The external light is light other than the light emitted by the illumination unit 23, and examples thereof include illumination light and sunlight.

[0064] The mobile terminal 50 is, for example, a smartphone or a tablet terminal capable of wireless communication. The mobile terminal 50 includes, as an input device and an output device, a touch screen 52 capable of displaying, for example, a dentition image. The mobile terminal 50 functions as a user interface of the intraoral camera system.

[0065] The intraoral camera 10 includes a hardware unit 20, a signal processing unit 30, and a communication unit 40.

[0066] The hardware unit 20 is a physical element of the intraoral camera 10, and includes an imaging unit 21, a sensor unit 22, an illumination unit 23, and an operation unit 24.

[0067] The photographing unit 21 generates image data by photographing the teeth in the oral cavity of the user. The photographing unit 21 receives a control signal from the camera control unit 31, performs operations such as photographing in accordance with the received control signal, and outputs image data of a moving image or a still image obtained by photographing to the image processing unit 32. The photographing unit 21 has the above-mentioned image sensor and lens. The photographing unit 21 is an example of a photographing unit. The image data is a row of teeth image showing multiple teeth, but it is sufficient that the image shows at least one tooth.

[0068] The sensor unit 22 is a sensor that performs sensing to detect the attitude of the intraoral camera 10. The sensor unit 22 generates information (sensing data) such as acceleration and / or angular acceleration according to the attitude and / or movement of the imaging unit 21, and outputs the generated information to the area detection unit 33. The sensor unit 22 is, for example, a six-axis sensor having a three-axis acceleration sensor and a three-axis gyro sensor, but may be a multi-axis (for example, three axes of x, y, and z) acceleration sensor. For example, as shown in FIG. 1, the z axis coincides with the optical axis LA, the y axis is parallel to the imaging surface and extends in the longitudinal direction of the intraoral camera, and the x axis is parallel to the imaging surface and perpendicular to the y axis. The attitude of the imaging unit 21 is an attitude determined by the imaging direction of the imaging unit 21, and is, for example, a three-dimensional attitude of the imaging unit 21. The x axis, the y axis, and the z axis indicate, for example, the three axes of a three-dimensional orthogonal coordinate system.

[0069] A piezoresistance type, capacitance type, or heat detection type MEMS (Micro Electro Mechanical Systems) sensor may be used as the sensor unit 22. Although not shown in the figure, it is preferable to provide a correction circuit in the sensor unit 22 for correcting the balance of the sensitivity of the sensors for each axis, the temperature characteristics of the sensitivity, temperature drift, etc. Also, the sensor unit 22 may be provided with a band-pass filter (low-pass filter) for removing dynamic acceleration components, noise, etc. Also, the sensor unit 22 may reduce noise by smoothing the output waveform of the acceleration sensor.

[0070] The illumination unit 23 irradiates light onto the region to be photographed by the photographing unit 21, among the multiple regions in the oral cavity. The illumination unit 23 irradiates light onto the region detected by the region detection unit 33, for example. The illumination unit 23 has the above-mentioned multiple first to fourth LEDs 23A to 23D. The multiple first to fourth LEDs 23A to 23D irradiate light onto the photographing region, for example, from different directions from each other. This can prevent shadows from being generated in the photographing region.

[0071] Each of the first to fourth LEDs 23A to 23D is configured so that at least the dimming can be controlled. Each of the first to fourth LEDs 23A to 23D may be configured so that the dimming and color can be controlled. The first to fourth LEDs 23A to 23D are arranged to surround the imaging unit 21.

[0072] The illumination unit 23 has its illumination intensity (light emission intensity) controlled according to the photographing region. The illumination intensity of each of the first to fourth LEDs 23A to 23D may be controlled uniformly, or may be controlled to be different from one another. The number of LEDs included in the illumination unit 23 is not particularly limited, and may be one, or may be five or more. Furthermore, the illumination unit 23 is not limited to having an LED as a light source, and may have another light source.

[0073] The operation unit 24 receives operations from a user. The operation unit 24 is configured with, for example, push buttons, but may also be configured to receive operations by voice.

[0074] In addition, the hardware unit 20 may further include a battery (e.g., a secondary battery) that supplies power to each component of the intraoral camera 10, a coil for wireless charging by an external charger connected to a commercial power source, and an actuator necessary for at least one of composition adjustment and focus adjustment.

[0075] The signal processing unit 30 has functional components implemented by a CPU (Central Processing Unit) or MPU (Micro Processor Unit) that execute various processes described below, and a memory unit 35 such as a RAM or ROM that stores programs for causing the functional components to execute various processes. The signal processing unit 30 has a camera control unit 31, an image processing unit 32, an area detection unit 33, a lighting control unit 34, and the memory unit 35.

[0076] The camera control unit 31 is mounted on, for example, the handle unit 10b of the intraoral camera 10, and controls the photographing unit 21. The camera control unit 31 controls at least one of the aperture and the shutter speed of the photographing unit 21, for example, in response to at least one of the control signal from the image processing unit 32 and the detection result of the area detection unit 33. The detection result is the detection result of the photographing area of ​​the photographing unit 21. For example, when the photographing area is the front side of the oral cavity (for example, the area in front of the upper jaw and the lower jaw shown in FIG. 4), the camera control unit 31 may control the photographing unit 21 to narrow the aperture compared to when the photographing area is other than the front side (for example, the area in front of the upper jaw, the right upper jaw, the left lower jaw, and the right lower jaw shown in FIG. 4). In addition, the camera control unit 31 may control the photographing unit 21 so that the aperture setting value is different for each of the six areas of the upper jaw left, the front upper jaw, the right upper jaw, the left lower jaw, the front lower jaw, and the right lower jaw. Note that a table in which the areas are associated with the setting values ​​of the aperture and the shutter speed is set in advance and stored in the memory unit 35.

[0077] The image processing unit 32 is mounted, for example, on the handle unit 10b of the intraoral camera 10, and acquires the dentition image (image data) captured by the photographing unit 21 based on the detection result from the area detection unit 33, performs image processing on the acquired dentition image, and outputs the dentition image after the image processing to the camera control unit 31 and the area detection unit 33. The image processing unit 32 may also output the dentition image after the image processing to the memory unit 35, and store the dentition image after the image processing in the memory unit 35. The image processing unit 32 may function as an acquisition unit that acquires image data from the photographing unit 21.

[0078] The image processing unit 32 is composed of, for example, a circuit, and performs image processing such as noise removal, AWB (Automatic White Balance) processing, and contour enhancement processing on the row of teeth image. The image processing is performed, for example, to improve the accuracy in the area detection unit 33. For example, when the row of teeth image is image data with a brightness (pixel value) equal to or higher than a predetermined value, the image processing unit 32 may lower the brightness of the row of teeth image before performing contour enhancement processing. The brightness of the row of teeth image is, for example, the maximum value, average value, median value, etc. of the pixel value of each pixel, but is not limited to these.

[0079] The image processing unit 32 may change the contents of the image processing depending on the detection result of the area detection unit 33. The image processing unit 32 may change the contents of the image processing depending on which of the six areas, namely, the upper jaw left, the front of the upper jaw, the upper jaw right, the lower jaw left, the front of the lower jaw, and the lower jaw right, the photographed area is.

[0080] The dentition image output from the image processing unit 32 (the dentition image after image processing) may be transmitted to the mobile terminal 50 via the communication unit 40, and the transmitted dentition image may be displayed on the touch screen 52 of the mobile terminal 50. This makes it possible to present the dentition image to the user.

[0081] The area detection unit 33 detects an area to be photographed by the photographing unit 21 from among a plurality of areas in the oral cavity defined by dividing the row of teeth. The plurality of areas will be described later with reference to Figs. 3 and 4.

[0082] The area detection unit 33 detects (determines) an area to be photographed by the photographing unit 21 among the multiple areas, using at least one of the image data from the photographing unit 21 and the sensing data from the sensor unit 22. The area detection unit 33 may identify the type of tooth shown in the image data (see FIG. 3) and detect the area to be photographed by the photographing unit 21 based on the identified type of tooth. The area detection unit 33 may identify the type of tooth shown in the image data using a machine learning model trained to receive the image data and output the type of tooth shown in the image data, or may identify the type of tooth shown in the image data from the degree of agreement with image data of each tooth acquired in advance. The area detection unit 33 may also identify the type of tooth shown in the image data using a machine learning model trained to receive the image data and the sensing data and output the type of tooth shown in the image data. The method of identifying teeth from image data is not limited to the above, and any existing method may be used.

[0083] Furthermore, the area detection unit 33 may detect the attitude of the imaging unit 21 based on the sensing data, and detect the area imaged by the imaging unit 21 based on the detected attitude. The area detection unit 33 may function as an attitude detection unit that detects the attitude of the imaging unit 21. A method of detecting the attitude of the imaging unit 21 based on the sensing data will be described later.

[0084] The area detection unit 33 only needs to detect whether the area photographed by the photographing unit 21 is a first area including the front teeth (for example, the areas in front of the upper jaw and the lower jaw shown in FIG. 4) or a second area located further back in the oral cavity than the first area (for example, the areas of the left upper jaw, right upper jaw, left lower jaw and right lower jaw shown in FIG. 4). The first area and the second area are examples of multiple areas in the oral cavity defined by dividing the dentition. The front teeth include, for example, at least one of the central incisors and the lateral incisors.

[0085] The lighting control unit 34 is mounted on, for example, the handle unit 10b of the intraoral camera 10, and controls the light emission modes of the first to fourth LEDs 23A to 23D according to the detection result of the area detection unit 33. The lighting control unit 34 controls the irradiation intensity of the lighting unit 23 based on the shooting area detected by the area detection unit 33. The control of the irradiation intensity by the lighting control unit 34 will be described later. The control of the light emission mode includes control of turning on and off the lighting unit 23 and control of color adjustment. The lighting control unit 34 is composed of, for example, a circuit.

[0086] Furthermore, for example, when the user performs an operation to activate the intraoral camera 10 on the touch screen 52 of the mobile terminal 50, the illumination control unit 34 transmits a corresponding signal from the mobile terminal 50 to the signal processing unit 30 via the communication unit 40. The illumination control unit 34 of the signal processing unit 30 controls the light emission modes of the first to fourth LEDs 23A to 23D based on the received signal.

[0087] The memory unit 35 stores, in addition to the above programs, the dentition image (image data) captured by the imaging unit 21, various setting data, and the like. The setting data includes a table in which a plurality of regions are associated with the irradiation intensities of the respective regions. The memory unit 35 is realized by, for example, a semiconductor memory such as a RAM or a ROM, but is not limited thereto. The memory unit 35 is an example of a storage unit.

[0088] The signal processing unit 30 may further include a lens driver (not shown) mounted on the handle unit 10b of the intraoral camera 10 and controlling the actuator of the composition adjustment mechanism and the actuator of the focus adjustment mechanism, and a power supply control unit (not shown) distributing battery power. The lens driver and the power supply control unit are formed, for example, by circuits.

[0089] For example, when a user performs an operation related to composition adjustment or focus adjustment on the touch screen 52 of the mobile terminal 50, a corresponding signal is transmitted from the mobile terminal 50 to the signal processing unit 30 via the communication unit 40. The signal processing unit 30 transmits a control signal to the lens driver to perform composition adjustment or focus adjustment based on the received signal. Also, for example, the signal processing unit 30 may calculate an actuator control amount required for composition adjustment or focus adjustment based on the tooth row image from the image processing unit 32, and a control signal corresponding to the calculated control amount may be transmitted to the lens driver.

[0090] The communication unit 40 is a wireless communication module that performs wireless communication with the mobile terminal 50. The communication unit 40 is mounted, for example, on the handle portion 10b of the intraoral camera 10, and performs wireless communication with the mobile terminal 50 based on a control signal from the signal processing unit 30. The communication unit 40 executes wireless communication with the mobile terminal 50 that complies with existing communication standards such as WiFi (registered trademark) and Bluetooth (registered trademark). Via the communication unit 40, a dentition image showing teeth is transmitted from the intraoral camera 10 to the mobile terminal 50, and an operation signal is transmitted from the mobile terminal 50 to the intraoral camera 10.

[0091] Here, the multiple regions in the oral cavity will be described with reference to Fig. 3 and Fig. 4. Fig. 3 is a diagram showing teeth in the oral cavity. The types of teeth include, for example, central incisors, lateral incisors, canines, etc. shown in Fig. 3, and the positions of the teeth include the upper jaw, lower jaw, right side, left side, etc.

[0092] FIG. 4 is a diagram showing an example of an intraoral region according to the present embodiment. In FIG. 4, for example, a plurality of teeth in an oral cavity are divided into six regions, namely, upper jaw left, upper jaw front, upper jaw right, lower jaw left, lower jaw front, and lower jaw right. The six regions are an example of a plurality of intraoral regions defined by dividing a row of teeth. Here, an example in which the teeth are divided into six regions is shown, but the number of regions may be arbitrary. The teeth may be divided into two regions, the upper jaw and the lower jaw. Each region may be further divided according to the imaging direction. For example, as shown in FIG. 4, each region may be divided into two imaging directions, the cheek side and the tongue side. Here, an example in which each tooth does not belong to a plurality of regions in an overlapping manner is shown, but some teeth may belong to two or more regions. For example, a tooth near the boundary between two adjacent regions may belong to both the two regions. For example, the third canine tooth on the left end of the upper jaw front in FIG. 4 may belong to both the upper jaw front and the upper jaw left.

[0093] Also, as shown in Figures 3 and 4, the multiple regions within the oral cavity include two or more regions included in the upper jaw region (upper jaw left, upper jaw front, upper jaw right) and two or more regions included in the lower jaw region (mandibular jaw left, lower jaw front, mandibular jaw right).

[0094] According to such an intraoral camera 10, it is possible to control the irradiation intensity of the illumination unit 23 according to the area of ​​the oral cavity to be photographed by the photographing unit 21. For example, when the user moves the intraoral camera 10 to an arbitrary position in the oral cavity, the intraoral camera 10 can detect the area of ​​the oral cavity to be photographed by the photographing unit 21 at that position, and irradiate light with an irradiation intensity according to the detected area.

[0095] Hereinafter, a specific example of a method for determining the region and imaging direction from the sensing data of the acceleration sensor will be described. First, the region detection unit 33 determines whether it is the upper jaw or the lower jaw based on the output Az of the acceleration sensor in the z-axis direction. Here, when imaging the row of teeth of the upper jaw, the imaging surface faces upward to some extent, and when imaging the row of teeth of the lower jaw, the imaging surface faces downward to some extent. Therefore, when Az>0, the region detection unit 33 determines that the region corresponding to the image data is the lower jaw, and when Az≦0, the region corresponding to the image data is the upper jaw.

[0096] Next, a method for determining which region of the upper jaw it is when it is determined to be the upper jaw will be described. The region detection unit 33 determines whether it is a front tooth or not based on the output Ay of the acceleration sensor in the y-axis direction. Here, when photographing the front teeth, the intraoral camera 10 is relatively horizontal, but when photographing the molars, the intraoral camera 10 has to be oblique due to interference with the lips. Therefore, the region detection unit 33 determines that it is in front of the upper jaw when Ay≦threshold a. Horizontal and oblique are examples of postures.

[0097] Furthermore, when the region detection unit 33 determines that the region is the upper jaw front, it determines whether it is the cheek side or the tongue side based on the output Ax of the acceleration sensor in the x-axis direction. Here, the orientation of the imaging plane is reversed for the cheek side and the tongue side. Therefore, the region detection unit 33 determines that the region is the "upper jaw front cheek side" when Ax>0, and determines that the region is the "upper jaw front tongue side" when Ax≦0.

[0098] On the other hand, when the region detection unit 33 determines that the area is not in front of the upper jaw, it determines the orientation of the imaging plane based on the output Ax of the acceleration sensor in the x-axis direction. Specifically, when Ax>0, the region detection unit 33 determines that the area is "upper jaw right cheek side or upper jaw left tongue side," and when Ax≦0, it determines that the area is "upper jaw left cheek side or upper jaw right tongue side."

[0099] Further, the region detection unit 33 narrows down the region based on the region determined in the previous process. Specifically, when determining whether the region is the upper right cheek side or the upper left tongue side, if the previous region was any of "upper jaw anterior cheek side, upper jaw right cheek side, upper jaw right tongue side, lower jaw anterior cheek side, lower jaw right cheek side, lower jaw right tongue side", the region detection unit 33 estimates that the current region is "upper jaw right cheek side", and if the previous region was any of "upper jaw anterior tongue side, upper jaw left cheek side, upper jaw left tongue side, lower jaw anterior tongue side, lower jaw left cheek side, lower jaw left tongue side", the region detection unit 33 estimates that the current region is "upper jaw left tongue side".

[0100] Furthermore, when determining whether the area is the upper jaw left cheek side or the upper jaw right tongue side, if the previous area was any of "upper jaw anterior cheek side, upper jaw left cheek side, upper jaw left tongue side, lower jaw anterior cheek side, lower jaw left cheek side, lower jaw left tongue side", the area detection unit 33 estimates that the current area is "upper jaw left cheek side", and if the previous area was any of "upper jaw anterior tongue side, upper jaw right cheek side, upper jaw right tongue side, lower jaw anterior tongue side, lower jaw right cheek side, lower jaw right tongue side", the area detection unit 33 estimates that the current area is "upper jaw right tongue side". This utilizes the fact that there is a high probability that the imaging plane will be moved so as to minimize the amount of movement and change in direction of the imaging plane.

[0101] The same determination is also used for the lower jaw. Specifically, the region detection unit 33 determines whether or not it is a front tooth based on the output Ay of the acceleration sensor in the y-axis direction. Specifically, the region detection unit 33 determines that it is in front of the lower jaw when Ay≦threshold b.

[0102] If it is determined to be the front of the mandible, the region detection unit 33 determines whether it is the cheek side or the tongue side based on the output Ax of the acceleration sensor in the x-axis direction. Specifically, the region detection unit 33 determines the region as the "front of the mandible cheek side" when Ax<0, and determines the region as the "front of the mandible tongue side" when Ax≧0.

[0103] On the other hand, when the region detection unit 33 determines that the area is not in front of the mandible, it determines the orientation of the imaging plane based on the output Ax of the acceleration sensor in the x-axis direction. Specifically, when Ax>0, the region detection unit 33 determines that the area is "right cheek side or left tongue side of the mandible," and when Ax≦0, it determines that the area is "left cheek side or right tongue side of the mandible."

[0104] In addition, when determining whether the area detection unit 33 is the right cheek side of the mandible or the left tongue side of the mandible, if the previous area was any of "anterior cheek side of the mandible, right cheek side of the mandible, right tongue side of the mandible, anterior cheek side of the mandible, right cheek side of the maxilla, or right tongue side of the maxilla," it estimates that the current area is "right cheek side of the mandible," and if the previous area was any of "anterior tongue side of the mandible, left cheek side of the mandible, left tongue side of the mandible, anterior tongue side of the maxilla, left cheek side of the maxilla, or left tongue side of the maxilla," it estimates that the current area is "left tongue side of the mandible."

[0105] In addition, when determining whether the area is the left cheek side of the mandible or the right tongue side of the mandible, if the previous area was any of "anterior cheek side of the mandible, left cheek side of the mandible, left tongue side of the mandible, anterior cheek side of the maxilla, left cheek side of the maxilla, or left tongue side of the maxilla," the area detection unit 33 estimates that the current area is "left cheek side of the mandible," and if the previous area was any of "anterior tongue side of the mandible, right cheek side of the mandible, right tongue side of the mandible, anterior tongue side of the maxilla, right cheek side of the maxilla, or right tongue side of the maxilla," it estimates that the current area is "right tongue side of the mandible."

[0106] Through the above processing, the current area is identified as one of the following: "anterior cheek side of the maxilla," "anterior lingual side of the maxilla," "right cheek side of the maxilla," "left lingual side of the maxilla," "left cheek side of the maxilla," "right lingual side of the maxilla," "anterior cheek side of the mandible," "anterior lingual side of the mandible," "right cheek side of the mandible," "left lingual side of the mandible," "left cheek side of the mandible," or "right lingual side of the mandible."

[0107] The above-mentioned determination algorithm is merely an example, and any determination algorithm may be used as long as the region can be specified from the outputs Ax, Ay, and Az of the acceleration sensor. For example, instead of using the values ​​of Ax, Ay, and Az as they are as variables for the determination, a secondary variable obtained by appropriately combining Ax, Ay, and Az may be used for the determination. The secondary variable may be set arbitrarily, for example, Ay / Az, Ax·Ax+Ay·Ay, Az-Ax, etc. Alternatively, the region may be determined after converting the acceleration information Ax, Ay, and Az of each axis into angle information (attitude angle) α, β, and γ. For example, the angle of the x-axis relative to the direction of gravitational acceleration may be defined as the roll angle α, the angle of the y-axis relative to the direction of gravitational acceleration may be defined as the pitch angle β, and the angle of the z-axis relative to the direction of gravitational acceleration may be defined as the yaw angle γ. In addition, the threshold values ​​used for each determination may be determined from the results of clinical experiments, etc.

[0108] In the above description, two directions, the cheek side and the tongue side, are determined as the imaging direction, but three directions including the crown side may be determined. For example, when imaging the crown side, the imaging surface becomes more horizontal than when imaging the cheek side and tongue side, so that it can be determined that the imaging direction is the crown side.

[0109] In the above, an example has been described in which the area and the photographing direction of the photographing unit 21 are determined using a three-axis acceleration sensor of the sensor unit 22, but the area and the photographing direction of the photographing unit 21 may be determined using a three-axis gyro sensor. The three-axis gyro sensor outputs, for example, an amount of change in angle due to movement around the x-axis, an amount of change in angle due to movement around the y-axis, and an amount of change in angle due to movement around the z-axis. That is, in the case of a three-axis gyro sensor, the amount of change in each axis may be added with the initial states of the x-axis, y-axis, and z-axis arbitrarily set, to determine the area of ​​the photographing unit 21 and the orientation (photographing direction) of the imaging surface of the intraoral camera 10.

[0110] In addition, the area of ​​the photographing unit 21 and the orientation of the imaging surface of the intraoral camera 10 may be determined by combining both a three-axis acceleration sensor and a three-axis gyro sensor.

[0111] [1-2. Operation of intraoral camera] Next, the operation (illumination control method) of the intraoral camera 10 configured as above will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the operation of the intraoral camera 10 according to the present embodiment. In the following, an example in which the area detection unit 33 detects the area to be photographed by the photographing unit 21 using the sensing data will be described.

[0112] 5, a user uses the intraoral camera 10 to capture an image of the teeth and gums in his or her oral cavity, thereby generating image data (S10). The image data is output from the photographing unit 21 to the image processing unit 32. The image processing unit 32 performs image processing on the image data from the photographing unit 21, and outputs the image data after the image processing to the camera control unit 31 and the area detection unit 33. In step S10, for example, the illumination unit 23 may be controlled to irradiate light with an irradiation intensity registered as an initial setting.

[0113] Next, the area detection unit 33 detects the attitude of the image capturing unit 21 based on the sensing data of the sensor unit 22 acquired when the image was captured in step S10 (S20). For example, the sensing data may be acquired for each frame of the image data.

[0114] Next, the area detection unit 33 detects an area to be photographed by the photographing unit 21 among a plurality of areas in the oral cavity based on the posture of the photographing unit 21 (S30). The area detection unit 33 detects which of the six areas shown in FIG. 4 is photographed by the photographing unit 21, for example. The area detection unit 33 may further detect the photographing direction of the photographing unit 21. The area detection unit 33 may detect an area and an photographing direction, for example, whether the area in front of the upper jaw is photographed from the tongue side, or the area in front of the lower jaw is photographed from the front side of the user (from the outside of the oral cavity toward the inside of the oral cavity). The area detection unit 33 may detect whether the area to be photographed by the photographing unit 21 is the first area based on the posture of the photographing unit 21. The area detection unit 33 outputs information indicating the detected area (detection result) to the lighting control unit 34.

[0115] Next, the illumination control unit 34 controls the irradiation intensity of the illumination unit 23 according to the area detected by the area detection unit 33 (S40). This allows the illumination control unit 34 to cause the illumination unit 23 to emit light at a brightness according to the area to be photographed by the photographing unit 21. After the illumination intensity is controlled by the illumination control unit 34 in step S40, the photographing area (teeth) is photographed by the photographing unit 21, so that image data with a desired brightness can be obtained.

[0116] It is to be noted that step S10 does not necessarily have to be executed. Furthermore, the timing at which the processes of steps S20 to S40 are executed is not particularly limited, and the processes may be executed at predetermined time intervals, or may be executed each time at least one of the attitude and the position of the imaging unit 21 changes by a predetermined amount or more.

[0117] Here, a description will be given of an example of a combination of the areas detected by the area detection unit 33 and the control contents of the illumination control unit 34. First, a description will be given of a case where the multiple areas include a first area and a second area.

[0118] When the multiple regions include a first region and a second region, the illumination control unit 34 may control the illumination unit 23 so that the illumination intensity of the illumination unit 23 is different between the first region and the second region. The illumination control unit 34 may control the illumination unit 23 so that the illumination intensity of the second region is higher than the illumination intensity of the first region.

[0119] Next, a description will be given of a case where the irradiation intensity is varied depending on the photographing direction of the photographing unit 21. Specifically, a description will be given of a case where the irradiation intensity is varied depending on whether the photographing unit 21 photographs an area from the cheek side or the tongue side in the oral cavity.

[0120] In step S30, the area detection unit 33 detects whether the area to be photographed by the photographing unit 21 is to be photographed from the cheek side or the tongue side of the oral cavity, based on the image data photographed by the photographing unit 21 and at least one of the postures of the photographing unit 21. The area detection unit 33 outputs to the illumination control unit 34 the area to be photographed by the photographing unit 21 and whether the area is to be photographed from the cheek side or the tongue side (for example, the photographing direction).

[0121] The illumination control unit 34 determines the irradiation intensity according to the area photographed by the photographing unit 21 and the photographing direction based on a table in which the area and the photographing direction of the photographing unit 21 are associated with the irradiation intensity. The illumination control unit 34 controls the illumination unit 23 so that the irradiation intensity differs when the photographing unit 21 photographs the area from the cheek side and when the photographing unit 21 photographs the area from the tongue side. In other words, the illumination control unit 34 controls the illumination unit 23 so that the irradiation intensity differs when the photographing directions are different even for the same area. In this case, in the example of FIG. 4, there are 12 combinations of the area photographed by the photographing unit 21 and the photographing direction of the photographing unit 21, and a table in which the irradiation intensity is associated with each of the 12 combinations is created in advance.

[0122] For example, when the current area is the area in front of the upper jaw and the area in front of the lower jaw (first area) and is photographed from the tongue side, the illumination unit 23 is controlled so that the illumination intensity is higher than when the area is photographed from the front side of the user. This is an example of the first control. Also, when the current area is the area of ​​the upper right, the upper left, the lower right, and the lower left (second area) and is photographed from the tongue side, the illumination unit 23 is controlled so that the illumination intensity is lower than when the area is photographed from the cheek side. This is an example of the second control.

[0123] In this manner, the illumination control section 34 may control the illumination intensity (the relationship between high and low illumination intensity) of the illumination section 23 to be different between the first control and the second control.

[0124] The illumination control unit 34 may also control the illumination unit 23 so that the illumination intensity increases stepwise from the front of the upper jaw toward the upper right and left of the upper jaw, and from the front of the lower jaw toward the lower right and left of the lower jaw.

[0125] (Modification of the first embodiment) The above-mentioned determination of the tooth region and the photographing direction based on the posture of the intraoral camera 10 (generation of region information) is based on the assumption that the user is facing forward, such as standing upright or sitting in a chair. On the other hand, when a dentist photographs a patient's teeth, the photograph may be taken with the user (patient) lying on his / her back. In such a case, the relationship between the vertical axis and the teeth is different from that when the user is facing forward, and therefore it may not be possible to perform a correct determination. Below, a method for performing a correct determination even in such a case will be described.

[0126] 6 is a diagram showing the relationship of the projection planes with respect to the user BD in a standing state according to this modified example. Here, the projection planes are imaginary planes based on the user BD, and are composed of three planes: a frontal plane 110, a sagittal plane 111, and a horizontal plane 112. The frontal plane 110 is a plane that bisects the body of the user BD into front and back, and is perpendicular to the floor. The sagittal plane 111 is a plane that passes through the body of the user BD from front to back, bisects the body of the user BD into left and right, and is perpendicular to the floor. The horizontal plane 112 is a plane that is parallel to the floor, bisects the body of the user BD into top and bottom, and is perpendicular to both the frontal plane 110 and the sagittal plane 111.

[0127] The axes of movement are further divided into a vertical axis, a sagittal-horizontal axis, and a forehead-horizontal axis. The x-axis shown in FIG. 6 is the "forehead-horizontal axis". The sagittal-horizontal axis is an axis in the left-right direction, and is the axis of rotation for movements such as anterior-posterior bending, and flexion and extension in the sagittal plane 111. The y-axis shown in FIG. 6 is the "sagittal-horizontal axis". The sagittal-horizontal axis is an axis in the front-back direction, and is the axis of rotation for movements such as lateral bending, and abduction and abduction in the forehead plane 110. The z-axis shown in FIG. 6 is the "vertical axis". The vertical axis is an axis in the vertical direction, and is the axis of rotation for movements such as rotation in the horizontal plane 112.

[0128] 7 and 8 are diagrams showing examples of postures of the user BD when using the intraoral camera 10 according to this modification.

[0129] 7, when the user BD uses the intraoral camera 10 in an upright position or while sitting on a chair, the user can be considered to be standing. At this time, the vertical axis Z0 (z-axis) of the user BD's body is perpendicular to the floor surface, and the vertical axis Z0 of the user BD's body and the direction of gravitational acceleration coincide with each other.

[0130] 8, for example, when a dentist uses the intraoral camera 10 while a user BD is on a dental treatment table, the frontal plane 110 of the upper half of the body of the user BD is tilted along the backrest of the treatment table. In other words, as a result of the inclination of the frontal plane 110 of the user BD, the vertical axis Z1 of the user with the upper half of the body tilted along the backrest is inclined with respect to the vertical axis Z0 of the body when the user BD is standing upright.

[0131] FIG. 9 is a flowchart showing image processing according to this modified example. FIG. 9 is a flowchart showing area detection processing in the area detection unit 33 when the posture of the user BD changes as described above. First, the area detection unit 33 acquires and holds the initial posture of the intraoral camera 10 (S110). Specifically, based on the user's operation, the posture of the intraoral camera 10 in a state in which the user's operation is performed is acquired as the initial posture. For example, the initial posture is acquired based on the user's operation on the mobile terminal 50. Alternatively, the initial posture is acquired by pressing a button or the like provided on the intraoral camera 10. For example, three-axis posture information based on the vertical direction obtained by the sensor unit 22, which is a six-axis sensor, is acquired as the initial posture. This initial posture is held in the mobile terminal 50 or the intraoral camera 10.

[0132] The initial posture may be a state in which the imaging surface of the intraoral camera 10 is parallel to the front surface of the front teeth, and the axial direction of the intraoral camera 10 coincides with the height direction of the front teeth in a plan view of the imaging surface. Here, the axial direction is, for example, a direction passing through the center of the longitudinal direction of the intraoral camera 10 from the handle portion 10b to the head portion 10a in the intraoral camera 10. Also, the axial direction is, for example, a direction passing through the center of the vertical direction (column direction) of the imaging surface (image data).

[0133] The state in which the initial posture is acquired is not limited to this example, and may be any state based on one or more teeth. For example, teeth other than the front teeth may be used. Although an example in which the initial state is "a state in which the axial direction of the intraoral camera 10 coincides with the height (vertical) direction of the front teeth" has been described, the initial state may be "a state in which the axial direction of the intraoral camera 10 is perpendicular to the height direction of the front teeth (a state in which the axial direction of the intraoral camera 10 coincides with the width (horizontal) direction of the front teeth)." The mobile terminal 50 may instruct the user to take the above-mentioned state, and the state used for the initial posture may be the posture of the intraoral camera 10 taken by the user based on the instruction.

[0134] Also, as the initial posture, a posture of the intraoral camera 10 in a state where the relationship between the posture of the user and the posture of the intraoral camera 10 is a predetermined relationship may be acquired. The initial posture is a state where the frontal plane 110 of the user BD and the imaging plane of the imaging unit are parallel, and the vertical axis Z1 of the user BD coincides with the axial direction LB in a plan view on the imaging plane.

[0135] The state in which the initial posture is acquired is not limited to this example, and may be any posture that can associate the posture of the user BD with the posture of the intraoral camera 10. The posture of the user BD may be defined using one or more of the frontal plane 110, the sagittal plane 111, the horizontal plane 112, the vertical axis, the sagittal-horizontal axis, and the forehead-horizontal axis. For example, here, "a state in which the axial direction LB of the intraoral camera 10 coincides with the vertical axis Z1" is specified, but "a state in which the axial direction LB of the intraoral camera 10 is perpendicular to the vertical axis Z1 (a state in which the axial direction LB coincides with the forehead-horizontal axis)" may also be used.

[0136] Next, the above-mentioned teeth are photographed. Specifically, the area detection unit 33 corrects the attitude of the intraoral camera 10 obtained during the photographing of the teeth by using the initial attitude (S120). That is, the area detection unit 33 corrects the attitude of the intraoral camera 10 by using the initial attitude so that the attitude of the intraoral camera 10 becomes the same as the state in which the user faces forward.

[0137] Finally, the area detection unit 33 determines the tooth area, the imaging direction, and the like (generates area information) described above based on the corrected attitude (S130).

[0138] As described above, the area detection unit 33 can improve the accuracy of area detection by correcting the posture of the intraoral camera 10 according to the posture of the user. This allows the lighting control unit 34 to appropriately control the irradiation intensity of the lighting unit 23 regardless of the posture of the user.

[0139] (Embodiment 2) The intraoral camera according to the present embodiment will be described below with reference to Figures 10 and 11. Note that the following description will focus on differences from the first embodiment, and descriptions of contents that are the same as or similar to the first embodiment will be omitted or simplified.

[0140] [2-1. Configuration of intraoral camera system] First, the configuration of the intraoral camera system according to the present embodiment will be described with reference to FIG. 10. FIG. 10 is a schematic diagram of the intraoral camera system according to the present embodiment. The intraoral camera system according to the present embodiment differs from the intraoral camera system according to the first embodiment mainly in that the hardware unit 20a does not include a sensor (e.g., a three-axis acceleration sensor and a three-axis gyro sensor) for detecting the attitude of the intraoral camera 11, and the signal processing unit 30a controls the color temperature of the reflected light from the teeth. The reflected light from the teeth includes the direct reflected light (halation area) from the teeth. The reflected light may include the light from the illumination unit 23 reflected by the teeth and the light from the outside reflected by the teeth.

[0141] As shown in FIG. 10, the intraoral camera 11 includes a hardware unit 20a, a signal processing unit 30a, and a communication unit 40.

[0142] The hardware unit 20a has a configuration in which the sensor unit 22 (see FIG. 2) is removed from the hardware unit 20 according to embodiment 1. The hardware unit 20a may have a sensor other than the sensor for detecting the posture of the intraoral camera 11.

[0143] The photographing unit 21 is configured to generate color image data as image data. The photographing unit 21 includes, for example, a color camera. Note that, in the present embodiment, image data refers to color image data unless otherwise specified.

[0144] The illumination unit 23 is configured to be capable of controlling at least one of dimming and color adjustment. The illumination unit 23 may be configured to be capable of emitting white light of two different color temperatures, for example. The illumination unit 23 also emits illumination light for plaque detection.

[0145] The signal processing unit 30a has a determination unit 36 ​​instead of the area detection unit 33 of the signal processing unit 30 according to the first embodiment.

[0146] The determination unit 36 ​​determines the position of the teeth photographed by the photographing unit 21 (a position within the oral cavity or an area within the oral cavity (see, for example, Figures 3 and 4)) based on image data (an example of first image data) photographed by the photographing unit 21.

[0147] The determination unit 36 ​​may determine the position of the tooth currently being photographed by the photographing unit 21 from the shape of the tooth, for example. The determination unit 36 ​​may determine the position of the tooth currently being photographed by the photographing unit 21 based on the acquired image data and image data showing a standard tooth shape (an example of second image data), for example. The second image data is acquired in advance and stored in the memory unit 35.

[0148] The determination unit 36 ​​may determine the position of the tooth currently being photographed by the photographing unit 21 based on the acquired image data and image data (an example of third image data) of the oral cavity including the dentition of the user using the intraoral camera 11. The third image data is acquired by photographing the oral cavity of the user in advance and is stored in the memory unit 35 in advance. In this case, the intraoral camera 11 may have a registration mode for registering the third image data and a determination mode for determining the position of the tooth currently being photographed by the photographing unit 21 using the registered third image data. The memory unit 35 may store the color temperature (e.g., catalog value or actual measurement value) of the light-emitting element (e.g., LED) of the illumination unit 23.

[0149] Furthermore, the determination unit 36 ​​may determine that an image captured by the photographing unit 21 after the area indicated by the notification information has been notified to the user is an image of the area. When the determination unit 36 ​​receives information indicating at least one of the fact that the notification information has been received and that the area indicated by the notification information has been displayed on the touch screen 52 from the mobile terminal 50 via the communication unit 40, the determination unit 36 ​​may determine that an image captured by the photographing unit 21 after receiving the information is an image of the area.

[0150] The lighting control unit 34 controls the illumination light of the lighting unit 23 based on the image data so that the color temperature of the reflected light from the teeth (an example of a first color temperature) approaches a desired color temperature or is within a desired color temperature range, regardless of the position of the teeth in the oral cavity (i.e., regardless of the influence of external light). The lighting control unit 34 controls at least one of the irradiation intensity and color temperature of the lighting unit 23, for example, so as to maintain a set color temperature or color temperature range over the entire area in the oral cavity.

[0151] The desired color temperature and the desired color temperature range may be set based on the color temperature of white light emitted by the light-emitting elements (for example, the first to fourth LEDs 23A to 23D (see FIG. 1)) of the illumination unit 23. The desired color temperature and the desired color temperature range include a target color temperature that is set based on the color temperature of the illumination unit 23 (an example of the second color temperature). The target color temperature may be set, for example, based on the color temperature of the light-emitting elements of the illumination unit 23. The target color temperature is, for example, a color temperature according to the central wavelength of the light-emitting elements, but is not limited to this.

[0152] The desired color temperature is, for example, a target color temperature. The desired color temperature range is a color temperature based on the target color temperature, and may be within a range of ±300K or less from the target color temperature, more preferably within a range of ±200K or less, and even more preferably within a range of ±100K or less.

[0153] The illumination control unit 34 may control at least one of the irradiation intensity and the color temperature of the illumination unit 23 so that the first color temperature of the reflected light from the teeth based on the image data approaches the target color temperature. For example, the illumination control unit 34 may control at least one of the irradiation intensity and the color temperature of the illumination unit 23 so that the first color temperature falls within a predetermined range including the target color temperature.

[0154] The target color temperature may be set based on the color temperature (color temperature of reflected light) of the tooth photographed first after the intraoral camera 11 is placed in the oral cavity. Such a color temperature of the tooth photographed first is a color temperature according to the color temperature of the light emitted by the light emitting element, and is an example of a target color temperature based on the second color temperature of the illumination unit 23. The color temperature of the illumination light of the illumination unit 23 when the tooth is photographed first may be set to a preset color temperature. The tooth photographed first may be a front tooth or a back tooth. When the tooth photographed first is a front tooth, the illumination unit 23 is controlled so that the color temperature of the back tooth approaches the color temperature of the front tooth, and when the tooth photographed first is a back tooth, the illumination unit 23 is controlled so that the color temperature of the front tooth approaches the color temperature of the back tooth. The color temperature of the back tooth is the reflected light reflected by the back tooth, and means the color temperature of the reflected light received by the photographing unit 21. Other similar expressions have the same meaning.

[0155] Furthermore, the illumination control unit 34 may further use the determination result of the determination unit 36 ​​to control at least one of the irradiation intensity and the color temperature of the illumination unit 23. For example, the illumination control unit 34 may lower the irradiation intensity of the illumination light when photographing the back teeth side compared to when photographing the front teeth side.

[0156] Furthermore, the lighting control unit 34 may control the irradiation intensity of the lighting unit 23 based on the color temperature of a glossy area that is strongly influenced by the light irradiated from the lighting unit 23 among a plurality of areas in the oral cavity defined by dividing the dentition (see FIG. 4). The glossy area is an area in the image data (color image data) that is strongly influenced by reflection of the irradiated light. The glossy area is an area in which the pixel values ​​of the three sub-pixels of each of RGB in the image data (i.e., red pixel value (X), green pixel value (Y), and blue pixel value (Z)) are equal to or greater than a threshold value. The threshold value is, for example, 900 in a 10-bit representation, but is not limited to this. X, Y, and Z are colors that roughly correspond to R, G, and B, and are also called primary stimuli.

[0157] The communication unit 40 transmits notification information to the user's mobile terminal 50 to inform the user using the intraoral camera 11 which area of ​​the multiple areas of the oral cavity defined by dividing the dentition should be photographed by the photographing unit 21.

[0158] When the mobile terminal 50 receives the notification information, the mobile terminal 50 displays the area indicated by the notification information on the touch screen 52. The mobile terminal 50 may transmit, to the intraoral camera 11, information indicating at least one of the fact that the notification information has been received and the fact that the area indicated by the notification information has been displayed on the touch screen 52.

[0159] In the registration mode, for example, the positions (or areas) of the teeth to be photographed are displayed for the user on the touch screen 52, and image data of the teeth acquired after the display (for example, after receiving information indicating that the area has been displayed) may be stored in the memory unit 35 as image data of the teeth at the displayed positions. In the registration mode, image data is acquired for all of the user's teeth.

[0160] [2-2. Operation of intraoral camera] Next, the operation (illumination control method) of the intraoral camera 11 configured as above will be described with reference to Fig. 11. Fig. 11 is a flowchart showing the operation of the intraoral camera 11 according to this embodiment. Each operation shown in Fig. 11 is performed for each tooth or each tooth region. For example, control of at least one of the illumination intensity and color temperature of the illumination unit 23 is performed individually for each tooth or each tooth region.

[0161] 11, the photographing unit 21 receives light reflected by the teeth from the light irradiated by the illumination unit 23 (S210). The photographing unit 21 generates image data by receiving the reflected light, and outputs the image data to the image processing unit 32.

[0162] Next, the determination unit 36 ​​detects the color temperature of the reflected light based on the image data (S220). The determination unit 36 ​​detects the color temperature of the reflected light from the teeth from the image data. Specifically, the determination unit 36 ​​obtains the original stimuli (X, Y, Z) from the image data, and calculates the color temperature of the reflected light from the original stimuli (X, Y, Z).

[0163] The color temperature calculated in step S220 may be the average value of the color temperatures in one tooth, or may be the maximum value, minimum value, mode, median, or the like.

[0164] Next, the determination unit 36 ​​determines whether the color temperature detected in step S220 is within a predetermined range (for example, within a desired color temperature range) (S230). The determination unit 36 ​​may read out the predetermined range from the memory unit 35, or may calculate the predetermined range from the color temperature of the light-emitting element of the illumination unit 23 stored in the memory unit 35.

[0165] Next, if the judgment unit 36 ​​determines that the color temperature detected in step S220 is within the predetermined range (Yes in S230), the lighting control unit 34 does not change the irradiation intensity and color temperature of the lighting unit 23, and if the judgment unit 36 ​​determines that the color temperature detected in step S220 is not within the predetermined range (No in S230), the lighting control unit 34 controls at least one of the irradiation intensity and color temperature of the lighting unit 23 so that the color temperature of the reflected light from the teeth approaches the target color temperature (S240).

[0166] If the result of step S230 is No, the illumination control unit 34 may perform control to increase the proportion of the illumination light of the illumination unit 23 in the reflected light, for example, by increasing the irradiation intensity without changing the color temperature of the illumination unit 23. Furthermore, if the result of step S230 is No, the illumination control unit 34 may control the color temperature of the illumination light of the illumination unit 23 so that the color temperature of the reflected light approaches a target color temperature. The illumination control unit 34 may control the color temperature of the illumination light of the illumination unit 23 by controlling the amount of current supplied to two light-emitting elements having different color temperatures.

[0167] (Other embodiments) Although the intraoral camera system and the like according to the embodiment of the present disclosure have been described above, the present disclosure is not limited to this embodiment.

[0168] For example, although the above description has been given of an example in which an intraoral camera is used mainly for photographing teeth, the intraoral camera may be an oral care device equipped with a camera, such as an oral irrigator equipped with a camera.

[0169] Furthermore, the illumination unit according to each of the above-described embodiments may be realized by one light-emitting unit (for example, one LED). Furthermore, the illumination unit may be formed, for example, in a ring shape.

[0170] Furthermore, the signal processing unit shown in each of the above embodiments may be realized as a single device (lighting control device). For example, such a lighting control device is realized as a device for controlling a lighting unit in an intraoral camera that includes a photographing unit that generates image data by photographing teeth in a user's oral cavity and a lighting unit that irradiates light onto the teeth.

[0171] In addition, each processing unit included in the intraoral camera system according to each embodiment is typically realized as an LSI, which is an integrated circuit. These may be individually implemented as single chips, or may be integrated into a single chip so as to include some or all of them.

[0172] The integrated circuit is not limited to an LSI, but may be realized by a dedicated circuit or a general-purpose processor. A field programmable gate array (FPGA) that can be programmed after the LSI is manufactured, or a reconfigurable processor that can reconfigure the connections and settings of the circuit cells inside the LSI may also be used.

[0173] In addition, in each of the above embodiments, each component may be configured with dedicated hardware, or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

[0174] Furthermore, one aspect of the present disclosure may be realized as a lighting control method executed by an intraoral camera, etc. Furthermore, one aspect of the present disclosure may be a computer program that causes a computer to execute each characteristic step included in the lighting control method.

[0175] In addition, the intraoral camera according to each of the above embodiments may be realized as a single device or may be realized by multiple devices. When the intraoral camera is realized by multiple devices, each component of the intraoral camera may be distributed to the multiple devices in any way. For example, the operation unit may be included in a mobile terminal, and in this case, may be configured by a touch panel or the like. The communication unit receives a control signal corresponding to an operation accepted by the operation unit of the mobile terminal from the mobile terminal. Also, for example, at least one of the functional configurations of the signal processing unit of the intraoral camera may be realized by a mobile terminal or a server (e.g., a cloud server) capable of communicating with a mobile terminal. When the intraoral camera is realized by multiple devices, the communication method between the multiple devices is not particularly limited, and may be wireless communication or wired communication. Also, wireless communication and wired communication may be combined between the devices. Note that the cloud server is a server capable of communicating with the mobile terminal via the Internet or the like, and may provide the mobile terminal with an application for using the intraoral camera. For example, a user downloads an application from the cloud server and installs it on the mobile terminal. The cloud server may also acquire dentition images captured by an intraoral camera via a mobile terminal.

[0176] In addition, in the above-mentioned embodiments, examples have been described in which the multiple regions in the oral cavity include two or more teeth (see FIG. 4), but the number of teeth included in each of the multiple regions is not particularly limited and may be one. For example, each of the multiple teeth may constitute one region. In other words, there may be as many regions as there are teeth.

[0177] In addition, the table in which the multiple regions are associated with the respective irradiation intensities of the multiple regions in the above-mentioned embodiments may be stored in a multiple-type memory unit. For example, the table may be created for each use environment of the intraoral camera (e.g., indoors, outdoors, dentist, residence, type of external light, etc.), and may be appropriately selected by the user's operation on the operation unit, etc.

[0178] Furthermore, when the illuminance (illuminance of external light) of the space in which the intraoral camera is used is equal to or lower than a predetermined value, the illumination control unit according to the above-described embodiments does not need to control the irradiation intensity of the illumination unit according to the area photographed by the photographing unit 21. The illuminance of the space may be acquired, for example, from a mobile terminal.

[0179] As another example of detecting the attitude of the region detection unit according to each of the above-mentioned embodiments, outputs Ax, Ay, and Az of the x-axis, y-axis, and z-axis may be obtained from the acceleration sensor, and outputs Bx, By, and Bz of the x-axis, y-axis, and z-axis may be obtained from the gyro sensor. Ax is the output of the acceleration sensor in the x-axis direction (acceleration component in the x-axis direction), Ay is the output of the acceleration sensor in the y-axis direction (acceleration component in the y-axis direction), and Az is the output of the acceleration sensor in the z-axis direction (acceleration component in the z-axis direction). Bx is the output of the gyro sensor around the x-axis (angular velocity component around the x-axis), By is the output of the gyro sensor around the y-axis (angular velocity component around the y-axis), and Bz is the output of the gyro sensor around the z-axis (angular velocity component around the z-axis). When the magnitude of the resultant vector A (Ax, Ay, Az) is smaller than a predetermined threshold value equivalent to the gravitational acceleration, the area detection unit determines that the intraoral camera is stationary, and the outputs Ax, Ay, and Az of the acceleration sensor become an attitude vector that represents the three-dimensional attitude of the intraoral camera. When the magnitude of the resultant vector A (Ax, Ay, Az) is larger than the threshold value, the area detection unit determines that the intraoral camera is moving, and calculates the amount of change in angle of the intraoral camera around each of the x-axis, y-axis, and z-axis from the time when the intraoral camera was last determined to be stationary based on the outputs Bx, By, and Bz of the gyro sensor, and rotates the resultant vector A (Ax, Ay, Az) when the intraoral camera was last determined to be stationary by the calculated amount of change in angle to obtain the attitude vector. Such an attitude vector indicates the attitude of the imaging unit. Note that the method of detecting the attitude of the area detection unit is not limited to this, and any existing method may be used.

[0180] In addition, the division of functional blocks in the block diagram is an example, and multiple functional blocks may be realized as one functional block, one functional block may be divided into multiple blocks, or some functions may be transferred to another functional block. Furthermore, the functions of multiple functional blocks having similar functions may be processed in parallel or in a time-sharing manner by a single piece of hardware or software.

[0181] In addition, the order in which each step is performed in the flowchart is merely an example for specifically explaining the present disclosure, and an order other than the above may be used. In addition, some of the steps may be performed simultaneously (in parallel) with other steps.

[0182] Furthermore, one aspect of the present disclosure may be a computer program that causes a computer to execute each of the characteristic steps included in the lighting control method shown in any one of FIG. 5, FIG. 9, and FIG.

[0183] Also, for example, the program may be a program to be executed by a computer. Also, one aspect of the present disclosure may be a computer-readable non-transitory recording medium on which such a program is recorded. For example, such a program may be recorded on a recording medium and distributed or circulated. For example, the distributed program may be installed in a device having another processor, and the program may be executed by the processor, thereby making it possible to cause the device to perform each of the above processes.

[0184] The intraoral camera system according to one or more aspects has been described based on each embodiment, but the present disclosure is not limited to these embodiments. As long as it does not deviate from the gist of the present disclosure, various modifications conceived by a person skilled in the art to this embodiment and forms constructed by combining components in different embodiments may also be included within the scope of one or more aspects. [Industrial Applicability]

[0185] The present disclosure is applicable to intraoral camera systems. [Explanation of symbols]

[0186] 10, 11 Intraoral camera 10a Head section 10b Handle section 10c Neck 20, 20a Hard section 21 Photography Department 22 Sensor section 23 Lighting Department 23A 1st LED 23B Second LED 23C 3rd LED 23D 4th LED 24 Control section 30, 30a Signal processing unit 31 Camera control unit 32 Image processing section 33 Area detection unit (posture detection unit) 34 Lighting control section 35 Memory section (storage section) 36 Judgment section 40 Communications Department 50 Mobile Devices 52 Touchscreen 110 Frontal 111 sagittal plane 112 Horizontal plane

Claims

1. an imaging unit that captures images of teeth in a user's oral cavity to generate image data; an illumination unit that irradiates light onto the tooth; an illumination control unit that controls at least one of the irradiation intensity and the color temperature of the illumination unit so that a first color temperature of the reflected light from the tooth based on the image data approaches a target color temperature based on a second color temperature of the illumination unit. Intraoral camera.

2. The lighting control unit controls at least one of an irradiation intensity and a color temperature of the lighting unit so that the first color temperature falls within a predetermined range including the target color temperature. The intraoral camera of claim 1 .

3. a determination unit that determines a position of the tooth to be photographed by the photographing unit based on the first image data photographed by the photographing unit, The illumination control unit further controls at least one of the illumination intensity and the color temperature of the illumination unit using the determination result of the determination unit. The intraoral camera according to claim 1 or 2.

4. The determination unit determines the position of the tooth to be photographed by the photographing unit based on the first image data and second image data indicating a standard tooth shape. The intraoral camera of claim 3.

5. A storage unit that stores third image data of the oral cavity including the dentition of a user using the intraoral camera, the third image data being captured in advance, The determination unit determines the position of the tooth to be photographed by the photographing unit based on the first image data and the third image data. The intraoral camera of claim 3.

6. A communication unit that transmits notification information to a user using the intraoral camera to notify the user of an area to be photographed by the photographing unit among a plurality of areas in the oral cavity defined by dividing the dentition, The determination unit determines that an image captured by the image capturing unit after the area indicated by the notification information is notified to the user is an image of the area. The intraoral camera of claim 3.

7. The target color temperature is set based on a color temperature of a tooth photographed first after the intraoral camera is placed in the oral cavity; The lighting control unit controls at least one of the irradiation intensity and the color temperature of the lighting unit so that the first color temperature approaches the set target color temperature over the entire area of ​​the oral cavity. The intraoral camera according to claim 1 or 2.

8. The lighting control unit controls at least one of the irradiation intensity and the color temperature of the lighting unit based on the color temperature of a glossy area that is strongly influenced by the light irradiated from the lighting unit among a plurality of areas in the oral cavity defined by dividing the dentition. The intraoral camera according to claim 1 or 2.

9. A lighting control device for controlling an illumination unit in an intraoral camera including a photographing unit that generates image data by photographing teeth in a user's oral cavity and an illumination unit that irradiates light onto the teeth, an acquisition unit that acquires the image data generated by the imaging unit; a lighting control unit that controls at least one of the irradiation intensity and the color temperature of the lighting unit so that a first color temperature of the reflected light from the tooth based on the image data approaches a target color temperature based on a second color temperature of the lighting unit. Lighting control device.

10. Generate image data by photographing the teeth in the user's mouth, Irradiating the tooth with light; At least one of the irradiation intensity and the color temperature of the illumination unit is controlled so that a first color temperature of the reflected light from the tooth based on the image data approaches a target color temperature based on a second color temperature of the illumination unit. Lighting control methods.

Images