Intelligent agent monitoring system and method for oral health and appliance usage

Abstract

The invention discloses an intelligent agent monitoring system for oral health and appliance use. The intelligent agent monitoring system comprises an image acquisition module which is used for guiding a user to shoot a first image when the user wears an appliance in the oral cavity and a second image when the user takes down the appliance through a specific application program of a terminal; the data transmission module is used for transmitting the first image and the second image to a cloud server in a wireless communication mode; the mode recognition and analysis module is used for carrying out feature extraction on the preprocessed first image and second image based on a model in the cloud server, and analyzing the extracted oral cavity structure features to obtain the progress situation and potential problems of correction treatment; the personalized evaluation module is used for generating a treatment evaluation result through the language model, the progress condition and the potential problem, and generating a diagnosis report according to the evaluation result; the interactive feedback and adjustment module is used for pushing a diagnosis report to a user through a specific application program; a user is supported to carry out interactive consultation on the diagnosis report through the terminal and the cloud server, and instant response is obtained.

Description

Technical Field

[0001] The present invention relates to the field of oral health, and in particular to, but not limited to, an intelligent agent monitoring system and method for oral health and appliance use. Background Art

[0002] With the improvement of oral health awareness and the popularization of invisible orthodontic technology, more and more patients are choosing digital invisible orthodontic treatment. According to incomplete statistics, a certain brand's global chain has an audience of more than 10 million, and a domestic mainstream brand also has a patient group of about 7 million. How to provide effective treatment for a large number of invisible orthodontic patients has become an urgent need.

[0003] In related technologies, doctors are used as the main observers to examine users' oral health and the therapeutic effects of braces, and to provide feedback on diagnostic opinions to users. However, this method is inefficient and, to a certain extent, difficult to provide accurate examinations and feedback.

[0004] Therefore, how to quickly, accurately and effectively check the user's oral health and improve the treatment effect has become an urgent problem to be solved. Summary of the Invention

[0005] In view of this, an embodiment of the present invention provides an oral health and appliance usage intelligent agent monitoring system, which at least solves the problem that related technologies cannot quickly, accurately and effectively check the user's oral health and improve the treatment effect.

[0006] According to a first aspect of an embodiment of the present invention, there is provided an oral health and appliance usage intelligent agent monitoring system, comprising: An image acquisition module, configured to guide a user, through a specific application of a terminal, to capture a first image of the oral cavity wearing the braces and a second image after the braces are removed; A data transmission module, configured to transmit the first image and the second image to a cloud server via wireless communication; a pattern recognition and analysis module, configured to extract features from the preprocessed first and second images based on the pattern recognition and analysis model in the cloud server, and analyze the extracted oral structure features to obtain the progress of orthodontic treatment and potential problems; a personalized assessment module, configured to generate a treatment assessment result based on the constructed language model, the progress status, and the potential problems, and to generate a diagnosis report based on the assessment result; the diagnosis report includes a description of the problem, a severity score, and recommended measures; The interactive feedback and adjustment module is used to push the diagnostic report to the user through the specific application; and supports the user to conduct interactive consultation with the cloud server regarding the diagnostic report through the terminal to obtain real-time feedback and guidance.

[0007] According to a second aspect of an embodiment of the present invention, there is provided a method for monitoring oral health and appliance use using an intelligent agent, comprising: Guide the user to take a first image of the oral cavity wearing the braces and a second image after removing the braces through a specific application of the terminal; transmitting the first image and the second image to a cloud server via wireless communication; Extracting features from the pre-processed first and second images based on the pattern recognition and analysis model in the cloud server, and analyzing the extracted oral structure features to obtain the progress of the orthodontic treatment and potential problems; generating a treatment evaluation result based on the constructed language model, the progress and the potential problem, and generating a diagnosis report based on the evaluation result; the diagnosis report includes a description of the problem, a severity score and recommended measures; The diagnostic report is pushed to the user through the specific application; the user is supported to interact with the cloud server through the terminal regarding the diagnostic report to obtain real-time feedback and guidance.

[0008] According to the solution provided by an embodiment of the present invention, the image acquisition module is used to guide the user to capture a first image of the appliance worn in the oral cavity and a second image after the appliance is removed through a specific application of the terminal; A data transmission module is used to transmit the first image and the second image to a cloud server via wireless communication; a pattern recognition and analysis module is used to extract features of the preprocessed first image and the second image based on the pattern recognition and analysis model in the cloud server, and analyze the extracted oral structure features to obtain the progress of corrective treatment and potential problems; a personalized assessment module is used to generate a treatment assessment result based on the constructed language model, the progress and the potential problems, and generate a diagnosis report based on the assessment result; the diagnosis report includes a problem description, a severity score and recommended measures; an interactive feedback and adjustment module is used to push the diagnosis report to the user through the specific application; and supports users to conduct interactive consultation with the cloud server regarding the diagnosis report through the terminal to obtain real-time feedback and guidance. In this system, a specific application on the terminal device guides the user to follow the standard process to take the first image of the oral cavity when wearing the braces and the second image after removing the braces, to ensure image quality and acquisition specifications; then, the image data is securely transmitted to the cloud server via wireless communication for storage and processing; on the cloud server, the image is pre-processed, feature extracted and compared based on the deep learning pattern recognition and analysis model to accurately identify the movement status of teeth, occlusal changes, attachment position and possible abnormalities, so as to evaluate the progress and potential risks of corrective treatment; then, the system combines the personalized language model to generate a structured diagnostic report based on the analysis results, including a specific problem description, severity score and targeted recommended measures, to achieve highly personalized assessment services; finally, through the interactive feedback and adjustment module, users can receive diagnostic reports in real time through the application, and conduct online consultation and interactive communication with the cloud server or doctor to obtain immediate professional feedback and adjustment treatment suggestions. The entire system realizes closed-loop management of the entire process from image acquisition, intelligent analysis to personalized feedback. The degree of intelligence and automation is improved, the efficiency and convenience of diagnosis and treatment are improved, user participation and compliance, security and privacy are also improved, and real-time monitoring and personalized services are realized. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. Those skilled in the art can also derive other drawings based on these drawings without inventive work, among which: Figure 1 A schematic diagram of an intelligent agent monitoring system for oral health and appliance use provided by an embodiment of the present invention; Figure 2A schematic diagram of an intelligent agent monitoring method for oral health and appliance use provided by an embodiment of the present invention; Figure 3 A schematic structural diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0010] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all the embodiments. The following embodiments are used to illustrate the present invention, but are not used to limit the scope of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0011] In the following description, reference is made to “some embodiments”, which describes a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0012] It should be pointed out that the terms "first\second\third" involved in the embodiments of the present invention are only used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that "first\second\third" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present invention described here can be implemented in an order other than that illustrated or described here.

[0013] Those skilled in the art will understand that, unless otherwise defined, all terms used herein (including technical and scientific terms) have the same meaning as commonly understood by those skilled in the art in the art to which the embodiments of the present invention pertain. It should also be understood that terms such as those defined in common dictionaries should be understood to have meanings consistent with their meanings in the context of the prior art and, unless specifically defined as herein, should not be interpreted in an idealized or overly formal sense.

[0014] The embodiments of the present application will be further described below with reference to the accompanying drawings.

[0015] The embodiments of the present application provide an oral health and appliance usage intelligent agent monitoring system and method.

[0016] The technical solution of the present application is introduced below, and first the system embodiment of the present application is introduced.

[0017] Please refer to Figure 1 , which shows a schematic diagram of an oral health and appliance use intelligent agent monitoring system provided by an embodiment of the present application, such as Figure 1 As shown, the oral health and orthodontic appliance usage intelligent agent monitoring system includes an image acquisition module 101 , a data transmission module 102 , a pattern recognition and analysis module 103 , a personalized evaluation module 104 and an interactive feedback and adjustment module 105 . Among them, the image acquisition module 101 is used to guide the user to take a first image of the braces worn in the mouth and a second image after the braces are removed through a specific application of the terminal; the data transmission module 102 is used to transmit the first image and the second image to the cloud server through wireless communication; the pattern recognition and analysis module 103 is used to extract features of the pre-processed first image and the second image based on the pattern recognition and analysis model in the cloud server, and analyze the extracted oral structure features to obtain the progress of the corrective treatment and potential problems; the personalized evaluation module 104 is used to generate a treatment evaluation result through the established language model, the progress and the potential problems, and generate a diagnosis report based on the evaluation result; the diagnosis report includes a problem description, a severity score and recommended measures; the interactive feedback and adjustment module 105 is used to push the diagnosis report to the user through the specific application; and supports the user to interactively consult with the cloud server on the diagnosis report through the terminal to obtain real-time feedback and guidance.

[0018] The second image is an image taken when the user removes the braces to view the treatment results during the brace treatment process. This specific application is a customized program that includes a user registration interface, a data collection interface, an analysis and feedback interface, and an interactive interface. The user enters personal information to register and log in on the user registration interface, and takes the first image and the second image on the data collection interface. The data collection interface can display the camera position and angle to guide the user to perform standardized collection. The analysis and feedback interface can accept the diagnosis report analyzed by the cloud server based on the collected first and second images. The interactive interface allows the user to interact with the intelligent agent deployed by the cloud server for information consultation.

[0019] Extracted oral structural features include the color, shape, and position of teeth and accessories. Orthodontic treatment progress includes tooth movement (whether it moves as planned, how fast or slow it moves, and whether there are delays or pauses), accessory status changes (whether brackets or accessory pieces have fallen off or shifted, and whether they need rebonding), brace fit and derailment (whether the braces still fit well and whether the archwire has dislodged), and oral health feedback (whether complications such as gingivitis, caries, and enamel demineralization occur). These oral structural features also characterize user behavior patterns and habits, providing a foundation for subsequent diagnostic reports and improving user engagement and compliance. Potential issues refer to various obstacles or complications that may be encountered during treatment. If not addressed promptly, these issues may affect treatment effectiveness or even lead to treatment failure. The diagnostic report can be presented to users in intuitive charts and statistical graphs to help them better understand and analyze their health status. When the diagnostic report is sent, if the user's teeth are seriously damaged or any abnormalities occur during the orthodontic treatment, timely reminders and warnings will be issued to the user, guiding them to take appropriate treatment measures.

[0020] When the first image and the second image are transmitted from the terminal to the cloud server, encryption technology and privacy protection measures are used to ensure the security of the user's oral health data and personal privacy.

[0021] Among them, the various modules 102 to 105 mentioned above can be integrated to perform system testing and debugging to ensure the stability and reliability of the entire system.

[0022] Among them, the image acquisition module belongs to the terminal, the data transmission module belongs to the collaboration between the terminal and the cloud server, the pattern recognition and analysis module and the personalized evaluation module belong to the cloud server, and the interactive feedback and adjustment module belongs to the collaboration between the terminal and the cloud server.

[0023] It can be understood that in the embodiments of the present application, a specific application on the terminal device is used to guide the user to take a first image of the oral cavity when wearing the braces and a second image after removing the braces in accordance with a standard process to ensure image quality and acquisition specifications; then, the image data is securely transmitted to the cloud server via wireless communication for storage and processing; the cloud server uses a deep learning-based pattern recognition and analysis model to pre-process, extract features, and perform comparison analysis on the image to accurately identify tooth movement status, occlusal changes, attachment positions, and possible abnormalities, thereby evaluating the progress and potential risks of orthodontic treatment; then, the system combines a personalized language model to generate a structured diagnostic report based on the analysis results, which includes a specific problem description, severity score, and targeted recommended measures to achieve a highly personalized assessment service; finally, through the interactive feedback and adjustment module, the user can receive a diagnostic report in real time through the application, and conduct online consultation and interactive communication with the cloud system or doctor to obtain immediate professional feedback and adjustment treatment suggestions. The entire system realizes closed-loop management of the entire process from image acquisition, intelligent analysis to personalized feedback. The degree of intelligence and automation is improved, the efficiency and convenience of diagnosis and treatment are enhanced, user participation and compliance, security and privacy are also improved, and real-time monitoring and personalized services are realized.

[0024] In an embodiment of the present application, the oral health and orthodontic appliance usage intelligent agent monitoring system also includes a preprocessing module, which is used to automatically correct the brightness, contrast and cropping of the first image and the second image through a pattern recognition and analysis model, remove invalid, erroneous or abnormal data, etc., to obtain a preprocessed first image and a preprocessed second image, and then standardize the preprocessed first image and the preprocessed second image to ensure the comparability of data from different shooting tools and different time points.

[0025] In an embodiment of the present application, the oral health and appliance usage intelligent agent monitoring system also includes a data storage module, which can save all data during the user's treatment process and track the progress of treatment based on the saved data.

[0026] In this embodiment of the present application, the oral health and appliance usage intelligent agent monitoring system also includes a remote monitoring module. This module allows users to authorize doctors to access diagnostic reports through the platform. Doctors review the user's oral condition and diagnostic reports to provide treatment recommendations or arrange for offline follow-up visits. This expansion of interaction across multiple platforms or devices allows users to interact seamlessly in different environments.

[0027] Among them, after obtaining the diagnosis report, the user can interact with the cloud server regarding the diagnosis report, or after obtaining the diagnosis report, the user and the doctor log in to the oral health and orthodontic appliance use intelligent agent monitoring system through their respective corresponding platforms. The user authorizes the doctor to access the diagnosis report. At the same time, the doctor can also communicate with the user face-to-face through the video conferencing submodule in the remote monitoring module, intuitively observe the user's oral health and orthodontic status, and provide treatment recommendations or arrange offline follow-up visits based on the diagnosis report. Or after the user obtains the diagnosis report and the doctor reviews the diagnosis report and gives the final treatment recommendation, the user can interact with the cloud server regarding the diagnosis report and treatment recommendation.

[0028] In an embodiment of the present application, the pattern recognition and analysis model in the pattern recognition and analysis module needs to be trained before use. The specific training process is: obtain a first image sample of the oral appliance worn and a second image sample after the appliance is removed, and perform model training through the first image sample and the second image sample to obtain a pattern recognition and analysis model; the first image sample and the second image sample contain feature annotations, and the annotation content includes but is not limited to caries, tartar, plaque, demineralization, gingivitis, and the position of the appliance accessories, degree of wear, fit, and expression rate.

[0029] In an embodiment of the present application, the interactive feedback and adjustment module includes a voice interaction submodule, which is used to support users to issue voice commands through the terminal to interactively consult with the cloud server regarding the diagnostic report and obtain real-time feedback and guidance.

[0030] After receiving the diagnostic report, the user can interact with the intelligent agent deployed on the cloud server through voice commands.

[0031] In an embodiment of the present application, the oral health and braces use intelligent agent monitoring system also includes a virtual demonstration module, which includes multiple submodules, namely a simulation demonstration module, a wearing guidance module, a progress review module and an effect confirmation module. The virtual demonstration module is used to display the movement of teeth during the correction process through virtual reality technology, so that users can intuitively understand the changes in the entire course of treatment. The wearing guidance module is used for braces. Virtual reality technology can simulate the correct way to wear and take off the appliance to help patients quickly master the skills. The progress review module is used to use virtual reality technology to review the treatment progress from the last follow-up visit to the present during the follow-up visit, and compare the actual and expected differences. The effect confirmation module is used to use virtual reality technology to show the comparison before and after treatment again to enhance patient satisfaction.

[0032] In an embodiment of the present invention, Figure 2 A schematic diagram of an intelligent agent monitoring method for oral health and appliance use provided in an embodiment of the present invention includes the following steps: S201, guiding the user through a specific application of the terminal to take a first image of the user wearing the braces in the mouth and a second image after the braces are removed; S202: Transmit the first image and the second image to a cloud server via wireless communication.

[0033] S203. Extract features from the pre-processed first and second images based on the pattern recognition and analysis model in the cloud server, and analyze the extracted oral structure features to obtain the progress of the orthodontic treatment and potential problems.

[0034] S204. Generate treatment evaluation results based on the constructed language model, progress and potential problems, and generate a diagnostic report based on the evaluation results; the diagnostic report includes a description of the problem, a severity score and recommended measures.

[0035] S205. Push the diagnostic report to the user through a specific application; support the user to interact with the cloud server through the terminal regarding the diagnostic report and obtain real-time feedback and guidance.

[0036] In an embodiment of the present invention, a user logs into a customized specific application in a terminal, is guided to take a first image of an oral appliance that meets the requirements and a second image after the appliance is removed, and transmits the first image and the second image to a cloud server in real time via wireless communication. The first image and the second image are preprocessed by a pattern recognition and analysis model in the cloud server, and features are extracted from the preprocessed first image and the preprocessed second image. The extracted oral structure features are analyzed to obtain the progress of the corrective treatment and potential problems. The progress and potential problems are processed based on the constructed language model to obtain the evaluation results of the treatment, and a diagnostic report such as a chart containing a description of the problem, a severity score, and recommended measures is generated based on the evaluation results. Finally, the cloud server sends the diagnostic report to the terminal for the user to view. After viewing the diagnostic report, the user can interact with the cloud server.

[0037] Reference Figure 3 , shows a schematic structural diagram of an electronic device according to an embodiment of the present invention. The specific embodiment of the present invention does not limit the specific implementation of the electronic device.

[0038] like Figure 3 As shown, the electronic device may include: a processor (processor) 502 , a communication interface (Communications Interface) 504 , a memory (memory) 506 , and a communication bus 508 .

[0039] in: The processor 502 , the communication interface 504 , and the memory 506 communicate with each other via a communication bus 508 .

[0040] The communication interface 504 is used to communicate with other electronic devices or servers.

[0041] The processor 502 is configured to execute the program 510 , and specifically may execute the relevant steps in the above method embodiment.

[0042] Specifically, the program 510 may include program codes, which include computer operation instructions.

[0043] Processor 502 may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention. The one or more processors included in a smart device may be of the same type, such as one or more CPUs, or different types, such as one or more CPUs and one or more ASICs.

[0044] The memory 506 is used to store the program 510. The memory 506 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk storage.

[0045] The program 510 may be specifically configured to enable the processor 502 to execute operations corresponding to the methods described in the above method embodiments.

[0046] The specific implementation of each step in program 510 can be found in the corresponding descriptions of the corresponding steps and units in the above-mentioned method embodiments, and will not be repeated here. Those skilled in the art will clearly understand that for the convenience and brevity of description, the specific working processes of the above-mentioned devices and modules can refer to the corresponding process descriptions in the above-mentioned method embodiments, and will not be repeated here.

[0047] It should be pointed out that, according to the needs of implementation, the various components / steps described in the embodiments of the present invention can be split into more components / steps, or two or more components / steps or partial operations of components / steps can be combined into new components / steps to achieve the purpose of the embodiments of the present invention.

[0048] The methods according to the embodiments of the present invention described above can be implemented in hardware, firmware, or as software or computer code that can be stored on a recording medium (such as a CD ROM, RAM, floppy disk, hard disk, or magneto-optical disk), or as computer code originally stored on a remote recording medium or non-transitory machine-readable medium downloaded over a network and then stored on a local recording medium. Thus, the methods described herein can be processed by such software stored on a recording medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware (such as an ASIC or FPGA). It will be understood that a computer, processor, microprocessor controller, or programmable hardware includes a storage component (e.g., RAM, ROM, flash memory, etc.) that can store or receive software or computer code. When the software or computer code is accessed and executed by the computer, processor, or hardware, the methods described herein are implemented. Furthermore, when a general-purpose computer accesses the code for implementing the methods described herein, the execution of the code transforms the general-purpose computer into a dedicated computer for performing the methods described herein.

[0049] Those skilled in the art will appreciate that the units and method steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the embodiments of the present invention.

[0050] The above implementation methods are only used to illustrate the embodiments of the present invention, and are not intended to limit the embodiments of the present invention. Ordinary technicians in the relevant technical field may make various changes and modifications without departing from the spirit and scope of the embodiments of the present invention. Therefore, all equivalent technical solutions also fall within the scope of the embodiments of the present invention, and the scope of patent protection of the embodiments of the present invention should be defined by the claims.

Claims

1. An intelligent agent monitoring system for oral health and appliance use, characterized in that: include: An image acquisition module, configured to guide a user, through a specific application of a terminal, to capture a first image of the oral cavity wearing the braces and a second image after the braces are removed; A data transmission module, configured to transmit the first image and the second image to a cloud server via wireless communication; a pattern recognition and analysis module, configured to extract features from the preprocessed first and second images based on the pattern recognition and analysis model in the cloud server, and analyze the extracted oral structure features to obtain the progress of orthodontic treatment and potential problems; a personalized assessment module, configured to generate a treatment assessment result based on the constructed language model, the progress status, and the potential problems, and to generate a diagnosis report based on the assessment result; the diagnosis report includes a description of the problem, a severity score, and recommended measures; The interactive feedback and adjustment module is used to push the diagnostic report to the user through the specific application; and supports the user to conduct interactive consultation with the cloud server regarding the diagnostic report through the terminal to obtain real-time feedback and guidance.

2. The system according to claim 1, wherein: The system also includes a remote monitoring module, which is used to allow the user to authorize the doctor to access the diagnosis report through the platform. The doctor provides treatment suggestions or arranges offline follow-up visits by viewing the user's oral condition and the diagnosis report.

3. The system according to claim 1, wherein: The pattern recognition and analysis model is trained as follows: A first image sample of an oral appliance worn and a second image sample after the appliance is removed are obtained, and a model is trained using the first image sample and the second image sample to obtain the pattern recognition and analysis model; the first image sample and the second image sample contain feature annotations, and the annotation content includes caries, tartar, plaque, demineralization, gingivitis, and the attachment position, wear degree, fit, and expression rate of the appliance.

4. The system according to claim 2, wherein: The remote monitoring module further includes a video conferencing submodule, which is used for face-to-face communication between doctors and users.

5. The system according to claim 1, wherein: The interactive feedback and adjustment module also includes a voice interaction submodule, which is used to support users to interact with the cloud server through voice commands.

6. An intelligent agent monitoring method for oral health and appliance use, characterized in that: include: Guide the user to take a first image of the oral cavity wearing the braces and a second image after removing the braces through a specific application of the terminal; transmitting the first image and the second image to a cloud server via wireless communication; Extracting features from the pre-processed first and second images based on the pattern recognition and analysis model in the cloud server, and analyzing the extracted oral structure features to obtain the progress of the orthodontic treatment and potential problems; generating a treatment evaluation result based on the constructed language model, the progress and the potential problem, and generating a diagnosis report based on the evaluation result; the diagnosis report includes a description of the problem, a severity score and recommended measures; Pushing the diagnostic report to the user through the specific application; The user is supported to conduct interactive consultation with the cloud server regarding the diagnostic report through the terminal to obtain real-time feedback and guidance.

Images