The present application provides a method for operating a dental appliance, the method comprising providing a dental appliance including at least one motion sensor that provides motion data, the motion sensor being one of an orientation sensor, an acceleration sensor, and an inertial sensor. Additionally, providing at least one camera associated with the dental appliance that provides image data, and using a first
machine learning neural network to segment the image data received from the camera to segment
surface conditions, thereby generating a surface condition segmentation. Using a second
machine learning
neural network classifier, classifying the motion data received from the motion sensor and the image data received from the camera to classify the motion and position of the dental appliance relative to the surface of the user's anatomical structure, thereby generating a surface position that includes at least one of a
relative motion classification or a relative position classification. Finally, based on the
surface conditions and the surface position, generating a user treatment progress status and position, and transmitting the treatment progress status and position to the user.