Method and system for visualizing tooth modifications in orthodontic treatment planning

Abstract

The present invention relates to an improved method of orthodontic treatment planning that allows modification of a person's teeth by direct manipulation of a 2D image (eg. photograph or video frame) that shows a portion of the person's dentition. Instead of applying manipulator tools, such as nudge buttons or 3D widgets, to a 3D digital representation, the invention may provide a user interface in which similar tools can be applied directly to a 2D image. The changes made on the 2D image are then referenced back to the underlying 3D model, causing corresponding changes to be made to the 3D model. The updated teeth configuration in the 3D model can then be "repainted" into the 2D image, allowing for real- time visualization of the modifications directly on the image.

Description

VMETHOD AND SYSTEM FOR VISUALIZING TOOTH MODIFICATIONS IN ORTHODONTIC TREATMENT PLANNINGFIELD OF THE INVENTION

[0001] The invention relates to computer-implemented tools that assist orthodontic treatment planning. In particular, the invention relates to computer-implemented methods and systems for manipulating images of a patient’s teeth to assist visualization of a proposed target dentition.BACKGROUND OF THE INVENTION

[0002] Orthodontic treatment planning is commonly carried out virtually using specialized software. A critical part of this planning process involves establishing a target dentition, which is the desired final configuration of a patient's teeth and jaws. Typically, a virtual 3D model of the patient's teeth and jaws is created based on intraoral scans or dental impressions. This 3D model allows for teeth to be repositioned into their final, intended positions. These adjustments may be performed manually by a technician, semi-automatically with software aids, or fully automatically using algorithms designed to achieve optimal occlusion and aesthetic alignment.

[0003] Once a proposed target dentition is established, additional modifications or refinements are often necessary. These modifications are usually applied manually to the 3D model to fine-tune the treatment plan based on the clinician’s preferences and patient-specific needs. Manual modifications are made using tools such as “nudge” buttons, which allow for incremental repositioning of individual teeth, or 3D widgets, which facilitate movement along various axes. However, these adjustments to the 3D model can be abstract, making it difficult to fully appreciate the aesthetic impact of the proposed changes, particularly in the context of the patient's overall facial appearance.

[0004] To address this issue, photographs of the patient, often showing the patient smiling, are sometimes used as part of the planning process. A version of the photograph may be created with the new target dentition “painted in” to illustrate the intended outcome in a realistic manner. This approach allows for a more comprehensive understanding of how the proposed changes will affect the patient’s smile, including lip coverage and facial balance.SUMMARY OF THE INVENTION

[0005] The present invention relates to an improved method of orthodontic treatment planning that allows modification of a person’s teeth by direct manipulation of a 2D image (e.g. photograph or video frame) that shows a portion of the person’s dentition. Instead of applying manipulator tools, such as nudge buttons or 3D widgets, to a 3D digital representation, the invention may provide a user interface in which similar tools can beapplied directly to a 2D image. The changes made on the 2D image are then referenced back to the underlying 3D model, causing corresponding changes to be made to the 3D model. The updated teeth configuration in the 3D model can then be “repainted” into the 2D image, allowing for real-time visualization of the modifications directly on the image.

[0006] According to the invention, there may therefore be provided computer-implemented method for orthodontic treatment planning, the method comprising: obtaining a digital model that provides a three-dimensional representation of a person’s dentition, wherein the digital model is segmented into components, and wherein the components include individual teeth and gum tissue; obtaining two-dimensional image data that shows a visible portion of the person’s dentition, wherein the image data is segmented into elements, and wherein the elements include individual teeth; co-registering the digital model and the visible portion of the person’s dentition in the two-dimensional image data; co-referencing the segmented elements of the two-dimensional image data with corresponding segmented components of the digital model; receiving, via user interface, a modification instruction to move a segmented element in the two-dimensional image; and translating the modification instruction into a corresponding modification of the digital model. By co-registering the digital model and image data and co-referencing the respective segmented components and segmented elements thereof, the invention enables adjustments to the image to be immediately reflected in the digital model.

[0007] The method may include determining an updated version of the visible portion of the person’s dentition from the modified digital model; and generating a revised image by applying the updated version of the visible portion of the person’s dentition to the two- dimensional image. The revised image may be displayed on the user interface to provide a real time visualization of the requested modification. The method may thus allow for realtime modification of the patient's dentition directly on their photograph, providing an intuitive and visually realistic representation of treatment outcomes. This allows for a more straightforward evaluation of the aesthetic impact of proposed changes.

[0008] By applying modifications directly to images, the clinician can better appreciate the visual impact of orthodontic changes in the context of the patient’s full face, including the smile, lips, and overall facial balance. This may represent an improvement over the more abstract adjustments made solely on a 3D model.

[0009] The two-dimensional image data may comprise a digital photograph or the like.

[0010] Advantageously, the two-dimensional image data may comprise a plurality of images, such as a plurality of frames from video footage. The plurality of images may show the person’s dentition from different angles. This allows for a more dynamic and comprehensive assessment of the proposed treatment plan. By using original photographs or videos, the system provides a more intuitive and realistic visualization of the aesthetic outcomes of the treatment, particularly in terms of facial aesthetics and how the changes will look in different expressions or poses.

[0011] The ability to apply modifications across multiple photographs taken from different angles or to video footage provides a comprehensive evaluation of how orthodontic changes will affect the patient’s appearance from all viewpoints, adding significant value to the planning process

[0012] The user interface may display a manipulator tool for a user to input the modification instruction. For example, the manipulator tool may comprise a nudge buttons or a 3D repositioning widget.

[0013] The modification instruction may relate to a single tooth or a plurality of teeth.

[0014] The user interface may comprise a chatbot configured to receive user input in text or spoken form, and translate the user input into the modification instruction. The chatbot may thus interpret the user input and passes the corresponding parameters to the modification system, facilitating a more natural and efficient interaction. The chatbot can also suggest refinements or validate the clinician’s requests to ensure that the treatment plan remains clinically appropriate. The incorporation of a chatbot interface allows the user (e.g. a clinician) to make modifications using natural language inputs, enhancing ease of use and allowing for a more conversational interaction. This reduces the need for complex manual operations and helps streamline the workflow.

[0015] The method may further allows for minor aesthetic refinements or corrections to be made directly on the photograph in real time. This enables clinicians to quickly and intuitively adjust individual teeth or groups of teeth, while immediately seeing the effect of these changes on the patient's overall appearance.

[0016] In one embodiment, the system may be linked to a refinement module that ensures that any modifications to targeted teeth are valid within the overall treatment plan. The method may therefore further comprise checking the corresponding modification of the digital model complies with a dentition specification indicating one or more clinical and aesthetic requirements and / or preferences. The term “dentition specification” is used to mean a collection of rules and preferences that govern how the target dentition is derived or selected. The dentition specification may reflect clinical norms (principles of good occlusion) and may define to clinical preferences, anatomical constraints, and patient-specific considerations, such as jaw shape and periodontal health. The dentition specification may be predefined or predetermined, e.g. through instructions communicated to a technician or automated treatment plan module, as is known.

[0017] The method may include automatically determining an additional change to the target dentition required as a consequence of implementing the corresponding modification in order to remain compliant with the dentition specification; and updating the corresponding modification to include the additional change. The additional change may comprises adjusting the position of teeth that are unrelated to the segmented element or reassigning interproximal reduction (IPR) to accommodate the corresponding modification. For instance, the refinement module may adjust non-targeted teeth or reassign interproximal reduction(IPR) to accommodate the clinician’s requested changes while maintaining a valid orthodontic solution. Requested changes may not be limited to the movement of specific teeth but could also include broader requests that need to be reinterpreted into particular multiple adjustments. For example, a request to make the smile broader could require decreased relative rotations from centrals through to canines and / or increased inclination.

[0018] Building in a checking function may ensure that any changes made directly on the two-dimensional image are reflected in the underlying digital model while maintaining the validity of a treatment plan.BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Embodiments of the invention are discussed in more detail below with reference to the accompanying drawings, in which:

[0020] Fig. 1 shows an example input original photograph and original model and resultant in-painted virtual photograph after modifying tooth positions;

[0021] Fig. 2 shows an example user interface that permits selection and adjustment of one or more teeth directly on a photograph that is co-registered and co-referenced with a corresponding 3D model;

[0022] Fig. 3 is a flow chart of a method for directly modifying tooth positions on a photograph, co-registered with and co-referencing a corresponding 3D model that is an embodiment of the invention;

[0023] Fig. 4 is a flow chart of a method for directly modifying tooth positions on a photograph, co-registered with and co-referencing a corresponding 3D model, wherein several photos reflect the modifications;

[0024] Fig. 5 is a flow chart of a method for directly modifying tooth positions on a frame of a video, co-registered with and co-referencing a corresponding 3D model, wherein several frames of a video reflect the modifications;

[0025] Fig. 6 is a flow chart of a method for requesting modification of tooth positions via a chatbot, while referencing a photograph, co-registered with and co-referencing a corresponding 3D model.DETAILED DESCRIPTION OF THE INVENTION

[0026] The present invention relates to a system and method for orthodontic treatment planning that allows for the direct modification of a patient’s dentition using original photographs or video footage, while simultaneously referencing and updating an underlying 3D digital model of the patient’s teeth. The invention enables real-time visualization of orthodontic changes within a photograph, providing both clinicians and patients with a more intuitive and aesthetically accurate representation of proposed treatment outcomes.

[0027] Fig. 1 illustrates the effect of an embodiment of the invention. The technique of the invention starts with receiving input information relating to a patient’s current dentition. For example, the input information may comprise a visual image (e.g. a photograph 101) and a digital model 102 of the current dentition.

[0028] The photograph 101 may be of a patient’s face or mouth, which can be obtained through any suitable imaging technology, such as digital cameras or video recordings. The digital model 102 (also referred to herein as a 3D model or scan) may be obtained from a 3D scan of the patient's dentition and surrounding anatomy, e.g., collected from intraoral scanners, dental impressions, CBCT scans, or other 3D imaging techniques.

[0029] In another example, the visual image part of the input information may comprise a plurality of photographs of the patient, for example from varying angles or in various poses. These plurality of photographs may be displayed and updated simultaneously, i.e., a modification in one photograph will be replicated where relevant in the other photographs.

[0030] In yet another example, the visual image part of the input information may comprise a video or a subset of frames from a video of the patient, e.g., obtained by panning, zooming, or rotating around the patient in one or more poses.

[0031] As discussed in more detail below, the digital model 102 may be segmented into distinct components, such as individual teeth, and gum tissue and other oral structures. The segmentation creates separate representations for these components. This allows each individual tooth to be independently manipulated while preserving or adapting the surrounding gum tissue to reflect changes in tooth position.

[0032] The visual image part of the of the input information may be pre-processed in a similar way to identify and segment portions of the dentition that are visible in the image(s).

[0033] The pre-processing steps facilitate the creation of a data structure 103 in which the dentition in the visual image (e.g., photograph 101) is co-registered and co-referenced with the digital model 102. Once the inputs are co-registered and co-referenced, the system allows for selection and direct modification of teeth to generate a modified photograph 105, with those modifications being reflected in an updated digital model 104, and vice versa.

[0034] Fig. 2 shows an example user interface that permits selection and adjustment of one or more teeth directly on a photograph that is co-registered and co-referenced with a corresponding digital model. For example, the user interface may include a panel that displays the photograph to permit user selection of a visible tooth. The selected tooth 201 may be highlighted or otherwise indicated relative to the other teeth. The user interface may then display a movement tool, e.g. graphical arrow symbol 202, that indicates options for movement to the user. The movement tool may indicate translational or rotational movement options. Following movement, the user interface may display a modified photograph with the moved tooth 203 in its new position. The highlight or indication may be removed in this view.

[0035] In one embodiment, the user interface may comprises a chatbot interface 204 configured to allow a user (e.g., clinician or technician) to input modifications either through text or spoken commands. The chatbot interprets these inputs and translates them into specific parameters or actions for the 3D model. For example, a clinician might request, “broaden the smile,” and the chatbot could interpret this as a command to adjust the inclination and rotation of several teeth. The system would then carry out the requested modification, updating the 3D model and the co-registered photograph in real time.

[0036] Fig. 3 is a flow chart of a method 300 for directly modifying tooth positions on a photograph, co-registered with and co-referencing a corresponding 3D model that is an embodiment of the invention.

[0037] The method 300 begins with a step of obtaining the input information, for example steps 301A, 301B respectively for obtaining the digital model and visual image (a photograph in this embodiment).

[0038] The method 300 continues with steps 302A, 302B of preprocessing the digital model and photograph as discussed above. For example, a 3D model pre-processing module may perform segmentation of teeth, gums and other oral structures from the digital model to create separate representations of these, allowing each tooth to be individually manipulated while preserving or adapting the surrounding gum tissue to reflect changes in tooth position. This would typically comprise identifying and / or separating teeth in the model from gums and / or other objects present in the model and identifying the type of / labelling each tooth (e.g. identifying a particular tooth as being the upper left canine). The result may comprise a series of separate surface meshes, each corresponding to one tooth crown, and additional surface meshes corresponding to the gum (gingiva) in each jaw. Model preparation may be fully automatic, partly automated (involving some user interaction) or fully manual (e.g. requiring the user to label each tooth).

[0039] Similarly, a photograph pre-processing module may perform identification of the mouth within the photograph, identifying the portion of the dentition visible in the photograph — most commonly the anterior teeth and gums, and segmenting these regions. This may be achieved by detecting facial landmarks, isolating the mouth region of the photograph, and using pre-trained Al-based or semi-manual segmentation tools, to identify and label each visible tooth region. Where the input visual image comprises multiple photographs or video frames (Figs. 4 and 5), this pre-processing module can be run on all of the images, or only on a subset thereof.

[0040] The method 300 continues with a step 303 of co-registering the digital model with the photograph. The effect of the co-registering is to align the spatial orientation of the maxilla and mandible, including all teeth and gums, within the digital model with their respective positions in the 2D photograph. The alignment process can be achieved through various means and may leverage landmarks, contours or segmented visible areas of teeth and gums within the photograph to determine the optimal spatial relationship between the 3D modeland the photograph. Co-registration may be accomplished using a variety of algorithms, including but not limited to 3D-to-2D projection matching, heuristic or pre-trained machine learning based optimisation approaches to coordinate dental features, or manual alignment assisted by software tools.

[0041] In some cases, where the patient’s dental occlusion is open in the photograph, or otherwise does not match the occlusion of the 3D model, the system may determine the relative positions of both the maxilla and mandible independently, using six degrees of freedom for each, accounting for the possible separation between the upper and lower jaws. Alternatively, one jaw may be deemed a secondary jaw and registered with restricted degrees of freedom - so as to reflect typical jaw actuation, subsequently to, and with reference to, the primary jaw e.g. in the case where one jaw has a small portion of visible teeth in the photograph, this may be deemed a secondary jaw.

[0042] The method 300 continues with a step 304 of co-referencing of objects between the photograph and 3D model. In this step, the portion of each tooth visible on the photograph, pixels and coordinates associated with it, are identified as belonging to that particular tooth e.g. a central incisor, and any action applied to any portion of that tooth would then apply to the corresponding tooth in 3D model. Vice versa any action applied to any surface triangle in the 3D model identified as belonging to a particular tooth, could, if visible, apply to the corresponding tooth in the photograph. This may be achieved by various means, for example creating and storing “masks” whereby pixels in the photograph are grouped and labelled as belonging to an individual tooth. These masks can be stored in an array with corresponding identification numbers linking them to tooth objects in the 3D model.

[0043] In the case of using multiple photographs, co-registration and co-referencing can be carried out on all or a subset of the photographs.

[0044] In the case of using a video, co-registration and co-referencing can be carried out on all frames or a subset of frames of the video.

[0045] The method 300 continues with a step 305 of presenting a user interface that permits selection of individual teeth or groups of teeth within the photograph for modification. Selection can be performed using a variety of input methods, such as clicking on a tooth using a mouse, selecting a tooth via touch input on a tablet, or using a voice-command-based interface through an Al-driven chatbot with reference to the photograph displayed on screen. Once a tooth is selected, it may be highlighted in the photograph, for example by rendering a contour around the tooth or shading its visible area, to indicate that it has been selected for modification. The corresponding tooth in the 3D model is also automatically flagged or highlighted if the 3D model is also visible, or is otherwise referenced in the background if only the photograph is visible.

[0046] After a tooth or a group of teeth are selected, the method 300 continues with a step 306 of receiving, from the user interface, one or more requested modifications to the selected tooth or teeth on the photograph. A modification may include, but is not limited to, a changein position, inclination, rotation, or translation. These modifications can be requested by the clinician through a graphical user interface (GUI) using tools such as sliders, nudge buttons, and 2D or 3D manipulation widgets. For instance, a clinician may adjust the inclination of a tooth by 5 degrees or move a tooth bucco-lingually by a specified distance. Alternatively, more abstract requests, such as broadening the patient’s smile, may be interpreted by the system as a set of changes to multiple teeth, including rotations and inclination adjustments.

[0047] Once a modification is requested, the method 300 continues with a step 307 of applying the change to the co-referenced digital model, updating the dentition’s configuration. The method 300 may then continue with a step 308 of using the modified digital model is then used to generate an updated virtual photograph in which the selected teeth in the original photograph are in-painted with their new positions, reflecting the proposed changes. This process ensures that the visible teeth in the photograph are replaced with their new configuration, providing a realistic and immediate preview of how the patient’s smile or facial appearance would change as a result of the treatment.

[0048] The invention allows for the simultaneous application of modifications across multiple photographs taken from different angles, or even to video footage of the patient. In such cases, the 3D model is co-registered with each photograph or video frame, ensuring that modifications to the 3D model are accurately reflected across all views. This feature provides a comprehensive, multi-angle representation of the proposed changes, allowing both clinicians and patients to assess how orthodontic adjustments will impact the patient’s appearance from various perspectives.

[0049] Real-time updates are made possible by employing inpainting and rendering techniques to blend the modified 3D model into each co-registered photograph or video frame. The system may use any suitable rendering method to ensure the modified teeth appear naturally in the photograph, including but not limited to ray-tracing, texture mapping, or deep learning-based image synthesis techniques. These updates are performed dynamically, allowing clinicians to immediately visualize the aesthetic outcome of any changes made to the 3D model.

[0050] The invention’s ability to handle real-time visualization of orthodontic changes across multiple photographs or video frames represents a significant improvement over conventional orthodontic planning tools. By allowing direct manipulation of teeth within original patient images, clinicians can more accurately predict the aesthetic and clinical outcomes of their treatment plans, leading to more informed decision-making and enhanced patient communication.

[0051] Fig. 4 is a flow chart of a method 400 for directly modifying tooth positions on a set of input photographs. The steps 401A, 401B of obtaining the input information, the steps 402A, 402B of pre-processing the input information, the steps 403, 404 of co-registering and co-referencing, the step 405 of receiving a selection, the steps 406, 407 of receiving and applying a modification, and the step 408 of generating updated virtual photographs are thesame as the corresponding steps discussed above with respect to Fig. 3, except that the visual input is a plurality of photographs.

[0052] Fig. 5 is a flow chart of a method 500 for directly modifying tooth positions on a set of input photographs. The steps 501A, 501B of obtaining the input information, the steps 502A, 502B of pre-processing the input information, the steps 503, 504 of co-registering and co-referencing, the step 505 of receiving a selection, the steps 506, 507 of receiving and applying a modification, and the step 508 of generating updated virtual photographs are the same as the corresponding steps discussed above with respect to Fig. 3, except that the visual input is a video of the patient.

[0053] Each of the embodiments discussed above, may further include a step of checking the validity of the requested modification. For example, as shown in Fig. 3, the method 300 may include an optional step 309 of inputting the requested modification to a refinement module, which ensures that any modifications to the teeth are valid within the context of a complete and clinically acceptable orthodontic treatment plan. For example, if a clinician requests a modification that could cause the upper and lower teeth to clash or interfere with normal occlusion, the refinement module identifies this issue and may automatically adjust nontargeted teeth or propose interproximal reduction (IPR) to accommodate the requested change, for example by providing one or more consequential modifications to be implemented at the step 307 of applying the requested modification.

[0054] The refinement module may also apply additional rules or constraints, such as maintaining good occlusion, adhering to clinical norms, or ensuring the patient’s periodontal health is not compromised by excessive tooth movement. When necessary, the module can flag potential issues and provide feedback to the clinician, either through a GUI or via the AI- driven chatbot, offering alternative solutions or suggestions for refinement.

[0055] Fig. 6 is a flow chart of a method 700 for requesting modification of tooth positions via a chatbot, while referencing a photograph, co-registered with and co-referencing a corresponding 3D model. The steps 701A, 701B of obtaining the input information, the steps 702A, 702B of pre-processing the input information, and the steps 703, 704 of co-registering and co-referencing are the same as the corresponding steps discussed above with respect to Fig. 3.

[0056] In the method 700, rather than manually select and directly modify a tooth or teeth, the method includes a step 705 of requesting a modification either through text or spoken commands provided to a chatbot interface. The chatbot interprets these inputs and translates them into specific parameters or actions for the 3D model. For example, a clinician might request, “broaden the smile,” and the chatbot could interpret this as a command to adjust the inclination and rotation of several teeth.

[0057] As discussed above, the method 700 may include an optional step 706 of inputting the requested modification to a refinement module, which ensures that any modifications to the teeth are valid within the context of a complete and clinically acceptable orthodontictreatment plan. In step 707, the refinement module may automatically determine consequential adjustments that are needed non-targeted teeth or propose interproximal reduction (IPR) to accommodate the requested change, for example by providing one or more consequential modifications to be implemented at a step 708 of applying the modification determined by the chatbot.

[0058] The chatbot interface also serves as an assistant, providing real-time validation of the clinician’s requests. If a requested modification is likely to result in an invalid treatment outcome, the chatbot can suggest alternative adjustments or highlight potential problems for the clinician to review.

[0059] The method 700 may continue with a steps 709 of generating an updated virtual photograph, similar to step 308 discussed above.

[0060] Aspects of the disclosure above are summarised in the following clauses, which form part of the description.

[0061] 1. A method for orthodontic treatment planning comprising: obtaining an original photograph of a patient showing at least one tooth or portion of a tooth; selecting one or more teeth in the photograph for modification; requesting modifications to the selected teeth; referencing requested modifications of in-photograph teeth back to an underlying 3D model of the patient's dentition; updating the 3D model based on the requested modifications; and repainting a virtual updated teeth configuration within the photograph based on the updated 3D model to provide real-time visualization of the requested modifications.

[0062] 2. The method of clause 1, further comprising applying the process to multiple photographs taken from different angles or to video footage of the patient.

[0063] 3. The method of clause 1, wherein the manipulator tools include nudge buttons and 3D widgets for repositioning individual teeth or groups of teeth.

[0064] 4. The method of clause 1, further comprising linking the system to a refinement module that ensures modifications made to targeted teeth are valid within an overall treatment plan.

[0065] 5. The method of clause 4, wherein the refinement module automatically adjusts nontargeted teeth or reassigns interproximal reduction (IPR) to accommodate modifications to the targeted teeth.

[0066] 6. The method of clause 1, further comprising integrating an Al-driven chatbot interface for receiving clinician inputs in text or spoken form to facilitate modification of the photograph and underlying 3D model.

[0067] 7. The method of clause 6, wherein the chatbot interface interprets clinician inputs and passes corresponding parameters to the modification system.

[0068] 8. The method of clause 1, wherein the modifications are made in real time to provide immediate visualization of the aesthetic impact of the proposed changes.

[0069] The modification technique disclosed herein represents a significant advancement in orthodontic treatment planning by allowing for direct modifications to be made on originalphotographs of the patient. This approach provides a more intuitive and realistic assessment of the aesthetic outcomes of treatment, making the planning process more effective and patient-friendly. The integration with a refinement module and a chatbot interface further enhances the usability and robustness of the system, ensuring that treatment plans remain valid and are easily adjustable based on clinician input.

Claims

CLAIMS1. A computer-implemented method for orthodontic treatment planning, the method comprising: obtaining a digital model that provides a three-dimensional representation of a person’s dentition, wherein the digital model is segmented into components, and wherein the components include individual teeth and gum tissue; obtaining two-dimensional image data that shows a visible portion of the person’s dentition, wherein the image data is segmented into elements, and wherein the elements include individual teeth; co-registering the digital model and the visible portion of the person’s dentition in the two-dimensional image data; co-referencing the segmented elements of the two-dimensional image data with corresponding segmented components of the digital model; receiving, via user interface, a modification instruction to move a segmented element in the two-dimensional image; and translating the modification instruction into a corresponding modification of the digital model.

2. The computer-implemented method of claim 1 further comprising: determining an updated version of the visible portion of the person’s dentition from the modified digital model; and generating a revised image by applying the updated version of the visible portion of the person’s dentition to the two-dimensional image.

3. The computer-implemented method of claim 2 further comprising displaying the revised image on the user interface to provide a real time visualization of the requested modification.

4. The computer-implemented method of any one of claims 1 to 3, wherein the two-dimensional image data comprises a digital photograph.

5. The computer-implemented method of any one of claims 1 to 3, wherein the two-dimensional image data comprises a plurality of images, wherein the plurality of images show the person’s dentition from different angles.

6. The computer-implemented method of any one of claims 1 to 3, wherein the two-dimensional image data comprises a plurality of frames from video footage of the person.

7. The computer-implemented method of any one of claims 1 to 6, wherein the user interface display a manipulator tool for a user to input the modification instruction.

8. The computer-implemented method of claim 7, wherein the manipulator tool comprises a nudge buttons or a 3D repositioning widget.

9. The computer-implemented method of any one of claims 1 to 8, wherein the modification instruction relates to a plurality of teeth.

10. The computer-implemented method of any one of claims 1 to 9, wherein the user interface comprises a chatbot configured to receive user input in text or spoken form, and translate the user input into the modification instruction.

11. The computer-implemented method of any one of claims 1 to 10 further comprising checking the corresponding modification of the digital model complies with a dentition specification indicating one or more clinical and aesthetic requirements and / or preferences.

12. The computer-implemented method of claim 11 further comprising: automatically determining an additional change to the target dentition required as a consequence of implementing the corresponding modification in order to remain compliant with the dentition specification; and updating the corresponding modification to include the additional change.

13. The computer-implemented method of claim 12, wherein the additional change comprises adjusting the position of teeth that are unrelated to the segmented element or reassigning interproximal reduction (IPR) to accommodate the corresponding modification.

Images