Method and system for evaluating tooth shade in an uncontrolled environment

Abstract

A method (300) for characterizing color information about teeth, the method (300) comprising: (i) projecting (320) at least one predetermined color pattern (400); (ii) acquiring (330) one or more images (90) using an imager (10), each image (90) comprising the projected first predetermined color pattern (400) and at least a portion of a user's mouth (500); (iii) automatically identifying (340) one or more teeth (510) in at least a portion of a user's mouth (500) from the acquired one or more images by a controller (30); (iv) comparing (350) the imaged predetermined color pattern with a corresponding projected predetermined color pattern; and (v) extracting (360) color information about the identified one or more teeth (510) by the controller based on the comparison result.

Description

Technical Field

[0001] The present disclosure generally relates to methods and systems for characterizing color information about a user's teeth. Background Art

[0002] Tooth discoloration is a concern for many people. Consumer aesthetic requirements for tooth discoloration treatments focus primarily on restoration of the natural color of teeth. In fact, tooth shade is one of the most important aesthetic components of adult dental care and is often addressed through whitening procedures or treatments. The assessment of tooth color or hue is most commonly performed by dental professionals using specialized tools. However, with the advent of many different smart and networked devices, consumers are increasingly turning to their own devices to perform tasks typically performed by professionals, including assessing tooth color or hue.

[0003] As with any color measurement, the determination of tooth color or tone is greatly affected by the environment. Many factors can affect the perception of the object color, including but not limited to lighting conditions and / or the reflectivity of the object. A common technique to overcome the challenge of tooth color determination is to utilize so-called calibration patterns, which are special objects including or showing one or more known colors. Although calibration patterns are effective under uniform illumination, they are relatively ineffective under challenging lighting environments (such as, those environments containing light gradients (e.g., shadows and / or multiple light sources)). In addition, although there are methods to assist consumers in determining tooth color or tone, these methods have brought great burdens to consumers, because they must first calibrate the system, and then utilize separate or dedicated imaging devices to capture and / or evaluate tooth color or tone. For consumers, this may be both time-consuming and expensive, which minimizes any benefit obtained by characterizing tooth color at home.

[0004] Some background information is provided in documents WO 2015 / 082300 and US 2013 / 244197.

[0005] Therefore, there continues to be a need in the art for simple yet effective methods and systems that allow users to accurately characterize the color or shade of their teeth. Summary of the invention

[0006] The present disclosure relates to inventive methods and systems for characterizing color information about a user's teeth. Various embodiments and implementations herein relate to a system configured to acquire and analyze images of a user's mouth. The system projects a predetermined color pattern on a screen and acquires one or more images each containing the predetermined color pattern and a portion of the user's mouth. The system uses the images to automatically identify one or more teeth in the imaged portion of the user's mouth. The system then compares the imaged color pattern to the projected predetermined color pattern and extracts color information about the one or more identified teeth based on the results of the comparison. The system may optionally transmit the color information to a dental professional.

[0007] In general, in one aspect, a method for characterizing color information about teeth is provided. The method includes: (i) projecting at least one predetermined color pattern; (ii) using an imager to acquire one or more images, each image including the projected predetermined color pattern and at least a portion of a user's mouth; (iii) automatically identifying, by a controller, one or more teeth in at least a portion of the user's mouth from the acquired one or more images; and (iv) comparing the imaged color pattern with the corresponding projected predetermined color pattern; and (v) extracting, by the controller, color information about the one or more identified teeth based on the result of the comparison.

[0008] According to an embodiment, the predetermined color pattern comprises a single color.

[0009] According to an embodiment, the method further comprises the step of transmitting the acquired one or more images to a remote server.

[0010] According to an embodiment, the method further comprises the step of transmitting the extracted color information to a dental professional.

[0011] According to an embodiment, the method further comprises the step of selecting a second predetermined color pattern to be projected based on a result of the comparison and / or the extracted color information.

[0012] According to an embodiment, the imager is a component of a smartphone.

[0013] According to an embodiment, projecting the predetermined color pattern comprises displaying the color pattern on a screen. According to an embodiment, projecting the predetermined color pattern comprises projecting the color pattern on a surface.

[0014] According to another aspect, a device for characterizing color information about teeth includes: a display or projector configured to display or project at least one predetermined color pattern; an imager configured to acquire one or more images, each image including a projected predetermined color pattern and at least a portion of a user's mouth; and a controller configured to: (i) identify one or more teeth in at least a portion of a user's mouth from the acquired one or more images; (ii) compare the imaged predetermined color pattern with a corresponding projected predetermined color pattern; and (iii) extract color information about the one or more identified teeth based on the comparison result.

[0015] According to an embodiment, the device further comprises a communication module configured to transmit the one or more images and / or the extracted color information regarding the one or more identified teeth.

[0016] According to another aspect, a system for characterizing color information about teeth. The system includes an imaging device, the imaging device including: (i) a display or projector configured to display or project at least one predetermined color pattern; and (ii) an imager configured to acquire one or more images, each image including the projected predetermined color pattern and at least a portion of a user's mouth; and further includes a controller configured to: (i) identify one or more teeth in at least a portion of the user's mouth from the acquired one or more images; (ii) compare the imaged predetermined color pattern with the corresponding projected predetermined color pattern; and (iii) extract color information about the one or more identified teeth based on the comparison result.

[0017] As used herein for the purposes of the present disclosure, the term "controller" is generally used to describe various devices related to the operation of an imaging device, system, or method. A controller can be implemented in a variety of ways (e.g., such as using dedicated hardware) to perform the various functions discussed herein. A "processor" is an example of a controller that employs one or more microprocessors that can be programmed using software (e.g., microcode) to perform the various functions discussed herein. A controller can be implemented with or without a processor, and can also be implemented as a combination of dedicated hardware that performs some functions and a processor (e.g., one or more programmed microprocessors and associated circuits) that performs other functions. Examples of controller components that can be employed in various embodiments of the present disclosure include, but are not limited to, conventional microprocessors, application specific integrated circuits (ASICs), and field programmable gate arrays (FPGAs).

[0018] As used herein, the term "user interface" refers to an interface between a human user or operator and one or more devices that enables communication between the user and the device(s). Examples of user interfaces that may be employed in various embodiments of the present disclosure include, but are not limited to, switches, potentiometers, buttons, dials, sliders, trackballs, display screens, various types of graphical user interfaces (GUIs), touch screens, microphones, and other types of sensors that may receive some form of human-generated stimulus and generate signals in response to the stimulus.

[0019] It should be understood that all combinations of the aforementioned concepts and the additional concepts discussed in more detail below (assuming that these concepts are not mutually inconsistent) are considered to be part of the inventive subject matter disclosed herein. In particular, all combinations of the claimed subject matter appearing at the end of this disclosure are considered to be part of the inventive subject matter disclosed herein.

[0020] These and other aspects of the invention will be apparent from and elucidated with reference to the embodiment(s) described hereinafter. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In the drawings, like reference numerals generally refer to the same parts throughout the different views. Also, the drawings are not necessarily to scale, emphasis instead generally being made upon illustrating the principles of the invention.

[0022] Figure 1 is a schematic representation of an imaging apparatus according to an embodiment.

[0023] Figure 2 is a schematic representation of an imaging system according to an embodiment.

[0024] Figure 3 is a flow chart of a method for characterizing color information about a user's teeth, according to an embodiment.

[0025] Figure 4 is a representation of a color pattern for display or projection according to an embodiment.

[0026] Figure 5 is a representation of an image of a user's teeth in accordance with an embodiment. DETAILED DESCRIPTION

[0027] The present disclosure describes various embodiments of methods and devices for dental imaging. More generally, the applicant has recognized and appreciated that it would be beneficial to provide an easy-to-use automated system to characterize color information about teeth based on acquired images. Therefore, the methods described herein or otherwise contemplated provide an imaging device or system, such as a smart phone, smart mirror, and / or other imaging device, that is configured to acquire one or more images of an individual's dental area. The imaging device or system simultaneously displays a predetermined color pattern on a screen and acquires one or more images that each contain the predetermined color pattern and a portion of the individual's dental area. The system uses the image to automatically identify one or more teeth in the imaged portion of the user's mouth. The system then compares the imaged color pattern with the projected predetermined color pattern, and extracts color information about one or more identified teeth based on the results of the comparison. The system can optionally transmit the color information to a dental professional, where it can be used for analysis by the dental professional.

[0028] Reference Figure 1 , in one embodiment, is an imaging device 100 configured to acquire one or more images of a dental region of an individual. The imaging device 100 may be any device having an imager capable of acquiring images of a dental region of an individual in a digital format. For example, the imaging device 100 may be a smart phone, a smart mirror, a wearable computing device, a digital camera, a laptop computer, and / or any other computing device or capture device capable of capturing images. The imaging device 100 may optionally include software, such as an application, that facilitates one or more aspects of an imaging system or method as described or otherwise contemplated herein.

[0029] The imaging device 100 includes an imager 10 configured to acquire an image of an individual's dental region. The imager 10 is, in particular, an image sensor such as a CCD or CMOS sensor. For example, the imager 10 may be a stand-alone digital camera, or may be a camera, a smart phone, a smart mirror, a wearable device, and / or any other computing or image capture device integrated into an oral care device. The imaging device 100 or the imager 10 may include or communicate with a light source 20, which is configured to illuminate one or more areas of the mouth. For example, the light source 20 may be a flash or other light source associated with the device or system. The light source 20 may be or include any light source, such as an LED light source, which emits light that can facilitate high-quality oral imaging. According to an embodiment, the light source includes light from two or more light sources. The imager 10 and / or the light source 20 may be configured to operate periodically, continuously, and / or in response to a stimulus. For example, the imager 10 and the light source 20 may acquire an image in response to a user taking an image or in response to a user positioning the imager on a portion of the oral cavity, as detected by the imager in real time.

[0030] The imaging device 100 further includes a controller 30 configured to receive one or more images acquired from the imager 10. The controller 30 may be formed of one or more modules and may be configured to operate the imager 10 in response to an input, such as an input acquired via a user interface. The controller 30 may include, for example, at least one processor 32. The processor 32 may take any suitable form, including but not limited to a microcontroller, a plurality of microcontrollers, a circuit, a single processor, or a plurality of processors. The controller 30 and / or the imaging device 100 may also include a memory 40. The memory 40 may take any suitable form, including non-volatile memory and / or RAM. The non-volatile memory may include a read-only memory (ROM), a hard disk drive (HDD), or a solid-state drive (SSD). The memory may store, in particular, an operating system. The RAM is used by the processor to temporarily store data. According to an embodiment, the operating system may include code that controls the operation of the hardware components of the imaging device 100 when executed by the controller 30.

[0031] The imaging device 100 further includes a communication module 50 configured to receive and / or transmit information via a wired and / or wireless communication network. The communication module 50 may be any module, device, or apparatus capable of transmitting a wired or wireless signal, including but not limited to Wi-Fi, Bluetooth, near field communication, and / or cellular modules. The communication module 50 may, for example, transmit one or more images acquired by the imager and / or color information about one or more teeth of the user.

[0032] According to an embodiment, the imaging device 100 includes a user interface 60, which is configured to provide information to a user and / or receive information from a user. The user interface 60 can take many different forms, but is configured to provide information to a user and / or receive information from a user. For example, information can be read, viewed, heard, felt and / or otherwise understood. Therefore, the user interface can be a display that provides information to the user, a tactile mechanism that provides tactile feedback to the user, a speaker that provides sound or text to the user, a simple LED light or LEDS array, or any of a variety of other user interface mechanisms. According to an embodiment, the user interface 60 provides feedback to the user when or after acquiring an image. The user interface 60 can also provide the user with instructions or guidelines about the image to be acquired or about improving the image, as well as many other types of information and guidelines.

[0033] The imaging device 100 further includes a display or projector 70. The display 70 can be a screen or other display configured to display one or more color patterns as described or otherwise contemplated herein. The projector 70 can be a projector or other image display configured to project a color pattern onto a surface as described or otherwise contemplated herein.

[0034] Reference Figure 2 , in one embodiment, is an imaging system 200 that is configured to acquire images of a dental region of a person. According to this embodiment, the imaging system 200 includes an imaging device 100 and a processing device 120. The imaging device 100 is configured to acquire one or more images of a user's mouth and transmit these images to the processing device 120, which can be located locally or remotely, or even part of the imaging device 100. For example, the imaging device 100 can be located at the same location as the user, while the processing device 120 can be located remote from the user, such as with a dental professional or with a cloud-based implementation. Many other configurations are possible. The processing device 120 is configured to receive and analyze one or more images received from the imaging device to extract color information about the user's teeth.

[0035] The imaging device 100 can be any device with an imager that can preferably acquire images of an individual's dental area in a digital format. For example, the imaging device 100 can be a smart phone, a smart mirror, a wearable computing device, a digital camera, a laptop computer, and / or any other computing device or capture device capable of capturing images. The imaging device 100 can optionally include software, such as an application, that contributes to one or more aspects of an imaging system or method as described herein or otherwise contemplated. The imaging device 100 particularly includes an imager 10 such as a CCD or CMOS sensor, which is configured to acquire images from a user's mouth. The imaging device 100 can be a stand-alone digital camera, or can be a camera, a smart phone, a smart mirror, a wearable device, and / or any other computing device integrated into an oral care device. The imaging device 100 can include a light source 20 that is configured to illuminate one or more areas of the mouth.

[0036] The imaging device 100 also includes a communication module 50a, which is configured to receive and / or transmit information via a wired and / or wireless communication network. The communication module 50a can be any module, device or device capable of transmitting wired or wireless signals, including but not limited to Wi-Fi, Bluetooth, near field communication and / or cellular modules. The communication module 50a can, for example, transmit one or more images acquired by the imager to the processing device 120.

[0037] According to an embodiment, the imaging device 100 also includes a user interface 60a, such as the user interface 60 previously described herein, which is configured to provide information to a user and / or receive information from a user. The user interface 60a can take many different forms and is configured to provide information to a user and / or receive information from a user. According to an embodiment, the user interface 60a provides feedback to the user while or after acquiring an image. The user interface 60a can also provide the user with instructions or guidance about images to be acquired or about improving imaging, as well as many other types of information and guidance.

[0038] The processing device 120 may be any device configured to receive images from the imaging device 100. For example, the processing device 120 may be a smart phone, a smart mirror, a computer, a laptop, a server, and / or any other computing device. The processing device 120 may optionally include software, such as an application, that facilitates one or more aspects of an imaging system or method as described or otherwise contemplated herein.

[0039] The processing device 120 includes a controller 30 configured to receive one or more images acquired from the imager. The controller 30 may be formed of one or more modules and may include, for example, a processor 32. The processor 32 may take any suitable form, including but not limited to a microcontroller, multiple microcontrollers, a circuit, a single processor, or multiple processors. The processing device 120 may include a memory 40, which may take any suitable form, including non-volatile memory and / or RAM. The memory 40 may be configured to store one or more received images or any other information or instructions.

[0040] The processing device further includes a communication module 50b configured to receive and / or transmit information via a wired and / or wireless communication network, including information transmitted from the communication module 50a of the imaging device 100. The communication module 50b may be any module, device or apparatus capable of transmitting wired or wireless signals, including but not limited to Wi-Fi, Bluetooth, near field communication and / or cellular modules.

[0041] According to an embodiment, the processing device 120 includes a user interface 60b that is configured to provide information to a user and / or receive information from a user. The user interface 60b can take many different forms and is configured to provide information to a user and / or receive information from a user. According to an embodiment, the user interface 60b provides feedback to the user while or after acquiring an image. The user interface 60b can also provide the user with instructions or guidance about images to be acquired or about improving imaging, as well as many other types of information and guidance.

[0042] Reference Figure 3 , in one embodiment, is a flow chart of a method 300 for characterizing color information about teeth. At step 310, a tooth color characterization device or system is provided. The tooth color characterization device or system can be any device or system described or otherwise contemplated herein. For example, the tooth color characterization device or system can be the device 100 or the system 200, as well as many other devices or systems. Generally, the tooth color characterization device or system will include: an imager 10 configured to acquire one or more images of a user's mouth; a controller 30 configured to receive and analyze the acquired one or more images; a communication module 50 configured to transmit and / or receive information via a wired and / or wireless communication system; and a user interface 60 for receiving information from a user and / or providing information to a user. Although the method 300 is described within the framework of the device 100 and the system 200, the method can be implemented using any other appropriately configured tooth color characterization device or system as described or otherwise contemplated herein.

[0043] At step 320 of the method, the device or system projects one or more predetermined color patterns 400. The color pattern can be projected or displayed using any mechanism for projection or display. According to an embodiment, the user is located in front of the mirror, and the predetermined color pattern is displayed on a screen of the device that is held up to be seen in the mirror, and / or the mirror itself displays the predetermined color pattern. According to another embodiment, the device 100 or system 200 includes a projector, and one or more color patterns 400 are projected onto a surface. The projected color pattern 400 includes a set of predetermined colors that are expected to describe achievable tooth shades. Additionally or alternatively, multiple versions of the predetermined color pattern 400 are generated to include different lighting gradient characteristics and angles.

[0044] According to an embodiment, the device 100 or the system 200 comprises a driver which ensures that, when obtaining a data stream such as Figure 5 One or more color patterns are projected simultaneously with an image 90 of at least a portion of the user's teeth as shown, and to ensure that the imager 10 has sufficient time to capture both the (multiple) projected pattern(s) 400 and the image 90 of at least a portion of the user's mouth, taking into account characteristics of the imager, including but not limited to shutter time, aperture, exposure, white / balance and other settings, characteristics and parameters.

[0045] Reference Figure 4 , in one embodiment, is representative of the predetermined color pattern 400. Although Figure 4 An example of a predetermined color pattern is shown in FIG, but this is merely an example and therefore many other patterns and formats are possible. Each of the color squares 410 includes a different color, which may have a specific or variable difference from adjacent squares, as long as the specific color of each square is known to the system. Figure 4 In addition to the color squares shown, the predetermined color pattern may also include circles, a spectrum from one wavelength to another, and / or many other shapes, sizes, patterns, and configurations.

[0046] At step 330 of the method, the imager 10 of the device 100 or system 200 acquires one or more images 90 (eg, Figure 5 ) and one or more predetermined color patterns 400 projected or displayed. In an embodiment, the user's mouth 500 is close to the one or more predetermined color patterns in the image. According to an embodiment, the imager is a 2D imaging sensor integrated into a smart connected medium such as a smart phone, laptop or other connected camera, which enables the capture of wavelengths in the visible part of the spectrum.

[0047] According to an embodiment, image capture includes capturing one or more images. For example, the system can acquire a series of images to allow the user to automatically select the best image accordingly, and / or allow the system or dental professional to select the most appropriate one or more images from the series of images for analysis.

[0048] The device or system may provide instructions or guidance to the user regarding image capture. The device or system may provide feedback to the user regarding the acquired image 90 to obtain the best possible image. For example, the user may be prompted to acquire the image at a specific angle or include certain teeth in the field of view, among many other possible prompts.

[0049] The image acquired by the user via the imager may be any part of the user's mouth, including but not limited to gums, teeth, tongue, or any other part of the oral cavity. The image may be analyzed immediately or may be stored in real time or near real time for batch processing. The image may be retained by the device for analysis, or may be transmitted to another device for downstream analysis, as described herein or otherwise contemplated. According to an embodiment, the image is transmitted to and / or received by the controller 30 for feature extraction and analysis.

[0050] At optional step 332 of the method, the device 100 or system 200 projects or displays different predetermined color patterns 400, and at step 330, the device or system captures additional one or more images 90 of the user's mouth 500 and the different predetermined color patterns projected or displayed. This allows the display and capture of multiple color patterns, each with multiple colors. Acquiring multiple color patterns can occur in response to user selection or stimulation or can occur automatically. For example, the device or system can be programmed or configured to acquire images of various color patterns, which can be performed in rapid succession and / or within a predetermined time between each color pattern.

[0051] At an optional step 334 of the method, the device or system transmits the acquired image 90. The image may be transmitted to another device located locally or remotely. For example, the image may be acquired by a smart phone or smart mirror, as well as many other imaging devices, and may be transmitted to a laptop, computer, or other device for analysis. Additionally or alternatively, the image may be transmitted to a cloud-based server or service and / or to a dental professional, or analyzed according to the methods described herein or otherwise contemplated.

[0052] At step 340 of the method, the device or system automatically identifies one or more teeth 500 from the user's mouth in the acquired image 90. This helps to extract color information about these identified teeth. According to an embodiment, the imaging device or system includes an identification module 34, which is configured to analyze one or more images 90 to identify teeth 510 from the user's mouth 500. The system can utilize a facial detection algorithm or classifier and / or a facial feature detection algorithm or classifier. The system can utilize three-dimensional information and shape matching and / or template matching to identify teeth from the user's mouth. According to an embodiment, the system can manually align the device 100 to superimpose its face with the camera image, among many other options.

[0053] According to an embodiment, the identification module 34 extracts one or more features from the acquired one or more images 90. Once extracted, the one or more features may be analyzed in real time or near real time or may be stored for later analysis. For example, the extracted one or more features may be stored in the memory 40, and the extracted features may be associated in the memory with the one or more images from which they were acquired.

[0054] According to an embodiment, the system is configured to determine what hardware is being used to display the color pattern and / or acquire the image. For example, the system may project a predetermined shape on the device screen and detect it with the aid of a machine learning algorithm (such as a trained classifier), project a specific sequence of light colors and / or intensities, or a variety of other methods including an algorithm configured to detect the shape of the device with the aid of a trained classifier or low-level features (such as a Hough transform). According to an embodiment, the system may be configured to detect the screen using the dimensional characteristics of the device and the orientation of the device. The system may be configured to track or otherwise record the determined hardware information and apply it to each subsequent loop in the process to limit the search space for these objects, thereby reducing the computational load on the system.

[0055] At step 350 of the method, the device or system compares the color pattern of the image 90 with the projected predetermined color pattern 400. This enables the device or system to detect the effects of the environment and / or imaging device or software on the projected predetermined color pattern 400, and enables the device or system to take those effects into account when calculating the color of the identified tooth 510. According to an embodiment, the device or system includes a comparison module 35 that is programmed or configured to analyze the image to identify the color difference between the projected predetermined color pattern and the image of the same projected predetermined color pattern acquired by the device or system. The comparison module 35 can compare a portion of the imaged and projected color patterns, or can compare all of the imaged and projected color patterns. The comparison module 35 can use an average value or use any other method to calculate (including but not limited to calculating pixel by pixel) the difference between at least a portion of the imaged and projected color patterns. The difference can be represented by a number, a color difference, an adjustment factor, or any other representation sufficient to be utilized by the device or system.

[0056] At step 360 of the method, the device or system uses the comparison results from step 350 of the method to extract color information about one or more identified teeth 510. According to an embodiment, the device or system includes an extraction module 36, which is programmed or configured to analyze the image and characterize the color information about one or more identified teeth using the comparison results of the imaged and projected color patterns. For example, the extraction module 36 can receive the comparison results of the imaged and projected color patterns from the comparison module 35. This can be an adjustment factor or any other representation of the comparison, which represents the impact of the environment and / or imager on the color of the teeth 510 as described herein. The extraction module uses the representation to extract and appropriately adjust the color features from the relevant detection area (i.e., the user's mouth or teeth) in the (multiple) images. In a preferred embodiment, color extraction is performed on the original image, which provides color information about the RGB (red, green, blue) color channels. In other embodiments, color extraction can be performed in YUV, LAB or HSV color space. Many other systems and methods may be used to extract color information about one or more identified teeth using one or more predetermined color patterns captured in the image(s).According to an embodiment, the device or system stores the extracted color features of each region of interest in a memory.

[0057] According to an embodiment, the device or system calculates the distance between the color features extracted from the relevant area (i.e., the user's mouth or teeth) and the device screen including one or more predetermined color patterns. For example, the distance can be calculated along each dimension of the color space used using the Euclidean distance.

[0058] According to an embodiment, at the optional step 352 of the method, the device or system modifies the sequence, selection and / or quantity of the projected color patterns 400 based on the determined color distance. In a practical embodiment, the system will favor the pattern that minimizes the previously calculated distance along at least one dimension of the color space rather than the next pattern available in the projection system. The minimization can be performed by a brute force search or by solving a minimization equation. According to an embodiment, the device or system modifies or otherwise adjusts the sequence, selection and / or quantity of the projected predetermined color patterns after comparing the imaged color pattern with the projected predetermined color pattern and / or after extracting color information about one or more identified teeth based on the comparison. For example, the system or device can adjust or select the next predetermined color pattern to be projected based on the determined color difference, which will inform the system or device about the environment affecting the color imaging. As another example, the system or device can adjust or select the next predetermined color pattern to be projected based on the color of the user's teeth extracted by the device or system. The system selects the next predetermined color pattern to be projected after determining that a specific predetermined color pattern can be used to better characterize the true color of the teeth based on the color extracted from the user's teeth.

[0059] According to an embodiment, once the system has traversed all available color patterns, or when the distance minimization criterion is met, all extracted color features of the screen are used to define a mapping between the real color space (i.e., the color features corresponding to the real values ​​of the projected pattern) and the perceived color space. In a preferred embodiment, the mapping is performed by assuming a linear or nonlinear transformation between the real space and the perceived space. For example, the system can define a transformation matrix that minimizes the projection error in all measurements.

[0060] According to an embodiment, once the mapping / transformation is calculated, the mouth color whose corresponding projection pattern exhibits the smallest distance is projected in the real color space to calculate the real color of the user's teeth 510. This information can be shared with the user (such as via a digital medium) and can be used for: (1) direct metric feedback; (2) comparison with previously measured shades to provide longitudinal feedback; (3) transmission to a third party system to support future or ongoing dental treatment.

[0061] At optional step 370 of the method, the system or device transmits the image(s) and / or the extracted color information to the dental professional. The images may be transmitted to the dental professional or other third party system or service via wired and / or wireless communications using the communication module 50 of the imaging device or system. The system may be configured or designed to transmit the image 90 to the dental professional or other third party system or service only if one or more predetermined criteria are met and / or only if the color information is successfully captured. The system may be configured or designed to transmit the image 90 to the dental professional or other third party system or service in response to a command from a user and / or in response to a request from the dental professional or other third party system or service.

[0062] As defined and used herein, all definitions should be understood to control over dictionary definitions, definitions in documents incorporated by reference, and / or ordinary meanings of the defined terms.

[0063] Unless explicitly indicated to the contrary, the indefinite articles "a" and "an" as used herein in the specification and claims should be understood to mean "at least one".

[0064] As used herein in the specification and claims, the phrase "and / or" should be understood to mean "either or both" of the elements so combined, i.e., elements that are present in combination in some cases and separately in other cases. Multiple elements listed with "and / or" should be interpreted in the same manner, i.e., "one or more" of the elements so combined. In addition to the elements specifically identified by the "and / or" clause, other elements may optionally be present, whether related or unrelated to those elements specifically identified.

[0065] As used herein in the specification and claims, "or" should be understood to have the same meaning as "and / or" defined above. For example, when separating items in a list, "or" or "and / or" should be interpreted as inclusive, that is, including at least one of a number of elements or listed elements, but also including more than one of them, and optionally including additional unlisted items. Only terms that clearly indicate the opposite meaning (such as "only one of" or "exactly one of", or when used in the claims, "consisting of...") will refer to including exactly one element of a number of elements or listed elements. Generally, the term "or" as used herein should be interpreted as indicating exclusive alternatives (i.e., "one or the other, but not both") only when it is preceded by an exclusive term (such as "any one of", "one of", "only one of" or "exactly one of").

[0066] As used herein in the specification and claims, the phrase "at least one" when referring to a list of one or more elements should be understood to mean at least one element selected from any one or more of the elements in the list of elements, but not necessarily including at least one of each element specifically listed in the list of elements, and not excluding any combination of elements in the list of elements. This definition also allows that in addition to the elements specifically identified within the list of elements to which the phrase "at least one" refers, other elements may optionally be present, whether related or unrelated to those elements specifically identified.

[0067] It should also be understood that in any method claimed herein that includes more than one step or action, the order of the steps or actions of the method is not necessarily limited to the order in which the steps or actions of the method are described unless explicitly indicated to the contrary.

[0068] In the claims and in the above description, all transitional phrases such as "comprising", "including", "carrying", "having", "containing", "involving", "holding", "consisting of", etc. should be understood as open-ended, that is, meaning including but not limited to. Only the transitional phrases "consisting of" and "consisting essentially of" should be closed or semi-closed transitional phrases, respectively.

[0069] Although several inventive embodiments have been described and illustrated herein, a person of ordinary skill in the art will readily conceive of various other devices and / or structures for performing functions and / or obtaining results and / or one or more advantages described herein, and each of these variations and / or modifications is considered to be within the scope of the inventive embodiments described herein. More generally, a person of ordinary skill in the art will readily appreciate that all parameters, dimensions, materials, and configurations described herein are exemplary, and that actual parameters, dimensions, materials, and / or configurations will depend on one or more specific applications for which the present invention is taught. A person of ordinary skill in the art will recognize or be able to determine many equivalents of the specific inventive embodiments described herein using only routine experiments. Therefore, it should be understood that the foregoing embodiments are presented only as examples, and within the scope of the appended claims and their equivalents, inventive embodiments may be practiced in a manner different from that specifically described and claimed. Inventive embodiments of the present disclosure relate to each individual feature, system, article, material, kit, and / or method described herein. In addition, any combination of two or more of such features, systems, articles, materials, kits, and / or methods is included within the scope of the invention disclosed herein if such features, systems, articles, materials, kits, and / or methods are not mutually contradictory.

Claims

1. A method (300) for characterizing color information about teeth, the method (300) comprising: projecting (320) at least one predetermined color pattern (400); acquiring (330) one or more images (90) using an imager (10), each of the images (90) comprising a projected predetermined color pattern and at least a portion of a user's mouth (500); automatically identifying (340), by a controller (30), from the acquired one or more images, one or more teeth (510) in the at least a portion of the user's mouth; comparing the imaged predetermined color pattern with a corresponding projected predetermined color pattern; as well as Based on the result of the comparison, color information about the identified one or more teeth (510) is extracted (360) by the controller. The method of claim 1 , wherein the predetermined color pattern comprises a single color.

3. The method according to claim 1, further comprising the steps of: The acquired one or more images are transmitted (334) to a remote server.

4. The method according to claim 1, further comprising the steps of: The extracted color information is transmitted (370) to a dental professional.

5. The method according to claim 1, further comprising the steps of: Based on a result of the comparison and / or based on the extracted color information, a second predetermined color pattern to be projected is selected (352). The method of claim 1 , wherein the imager is a component of a smartphone.

7. The method of claim 1, wherein projecting the predetermined color pattern comprises displaying the color pattern on a screen or on a surface.

8. The method according to claim 1, wherein: The user's mouth is close to the predetermined color pattern in the image.

9. A system (200) for characterizing color information about teeth, the system (200) comprising: An imaging device (100), the imaging device (100) comprising: (i) a display or projector (70), the display or projector (70) being configured to display or project at least one predetermined color pattern (400); and (ii) an imager (10), the imager (10) being configured to acquire one or more images (90), each of the images (90) containing the projected predetermined color pattern and at least a portion of a user's mouth (500); and A controller (30) is configured to: (i) identify one or more teeth (510) in the at least a portion of the user's mouth (500) from the acquired one or more images (90); (ii) compare the imaged predetermined color pattern with the corresponding projected predetermined color pattern; and (iii) extract color information about the identified one or more teeth (510) based on the result of the comparison.

10. The system of claim 9, wherein the imaging device is a smartphone.

11. The system of claim 9, further comprising a communication module (50) configured to transmit one or more images and / or extracted color information regarding the identified one or more teeth.

12. The system of claim 9, wherein the controller is further configured to select a second predetermined color pattern to be projected based on a result of the comparison and / or based on the extracted color information.

13. The system of claim 9, 11 or 12, wherein the controller (30) is part of the imaging device (100).

14. The system of claim 13, wherein the system is a smart phone.

Images