System
The system optimizes tooth brushing by analyzing individual tooth shapes and identifying hard-to-reach areas, using an automatic toothbrushing device and AI feedback to enhance oral hygiene.
Patent Information
- Application Number
- JP2024116328
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-19
- Publication Date
- 2026-01-29
AI Technical Summary
Conventional tooth brushing methods often fail to thoroughly clean hard-to-reach areas such as back teeth and between teeth, leading to increased risks of cavities and periodontal disease, and are not optimized for individual tooth shapes and brushing styles.
A system that uses a terminal to acquire tooth shape data, which is analyzed by a server to identify difficult-to-brush areas, controls an automatic toothbrushing device, detects unbrushed areas, and generates an improvement plan based on AI analysis to optimize brushing for each user.
The system ensures thorough tooth brushing, minimizes missed areas, and reduces the risk of cavities and periodontal disease by providing personalized brushing instructions.
Smart Images

Figure 2026014854000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] There is a problem in that it is easy to leave some areas unbrushed when brushing teeth. With conventional manual or partially automated tooth brushing methods, it is often the case that hard-to-reach areas, such as back teeth and between teeth, are not brushed thoroughly, which increases the risk of cavities and periodontal disease. In addition, it is difficult to achieve efficient and effective tooth brushing because it is not possible to take an approach that is optimal for each user's tooth shape and brushing style. [Means for solving the problem]
[0005] To solve this problem, we provide the following system. The user acquires tooth shape data using a terminal, which then sends the data to a server, which saves and analyzes the received data. The server identifies areas that are difficult to brush based on the analysis results, and the terminal controls the automatic tooth brushing device based on the server's analysis results. Furthermore, the terminal detects areas that have not been brushed after brushing and sends this information back to the server. The server generates an improvement plan for the next brushing session based on the data on areas that have not been brushed, and sends this improvement plan to the terminal as feedback to the user. This series of processing steps enables optimal tooth brushing tailored to each individual user, minimizing areas that have not been brushed.
[0006] A "user" is an entity that uses the tooth brushing system, scans and registers their own tooth shape on a terminal, and gives instructions on how to brush their teeth.
[0007] A "terminal" is an electronic device used by a user to acquire tooth shape data, send data to a server, receive tooth brushing patterns, control an automatic tooth brushing device, and detect areas that have not been brushed.
[0008] The "server" is a centralized computer system that works in conjunction with terminals via a network to store and analyze tooth shape data, analyze data on areas that have not been brushed, and generate a plan to improve tooth brushing for the next visit.
[0009] "Tooth shape data" is digital data that indicates the shape information of the user's teeth obtained by scanning.
[0010] The "AI analysis module" is a software module installed on the server that contains an artificial intelligence algorithm for analyzing tooth shape data and data on areas that have not been brushed.
[0011] An "automatic toothbrushing device" is a mechanical device that operates in response to instructions from a terminal and automatically brushes the user's teeth.
[0012] The "unbrushed area" is the area that remains unbrushed after brushing the teeth, and is an area that is detected by the device's sensor.
[0013] The "improvement plan" is generated by the server based on data on areas that have not been brushed, and is a specific proposal for the user to brush their teeth more effectively the next time they brush their teeth. [Brief explanation of the drawings]
[0014] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0015] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0016] First, the terms used in the following description will be explained.
[0017] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0018] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0019] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0020] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0022] [First embodiment]
[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0024] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0027] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0030] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0031] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0032] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0034] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0035] The present invention relates to an automatic tooth brushing system that thoroughly brushes the user's teeth according to their shape and memorizes areas that are prone to cavities (are likely to be left unbrushed) through AI learning. Specific embodiments for realizing this system are described below.
[0036] 1. Acquisition of tooth profile data
[0037] The user activates the device's scanning function and opens their mouth to capture their teeth. The device has a built-in high-precision 3D scanner that scans the user's teeth in just a few seconds.
[0038] The device temporarily stores the scanned data in its internal memory and prepares it for subsequent transmission to the server.
[0039] 2. Sending and saving tooth profile data
[0040] The terminal encrypts the scanned tooth profile data and implements security measures to prevent data leakage.
[0041] The terminal transmits the encrypted tooth profile data to a server via the Internet.
[0042] The server receives and securely stores the tooth profile data sent to it, which is then stored in a separate database, allowing easy access to each user's data.
[0043] 3. Analyzing tooth profile data and identifying areas that are difficult to polish
[0044] The server retrieves the stored tooth profile data and inputs it into the AI analysis module.
[0045] The AI analysis module analyzes the tooth shape data to identify irregularities and areas that are difficult to brush, and then lists areas that require special attention.
[0046] Based on the analysis results, the server generates a list of areas that are difficult to polish and stores it in a database.
[0047] 4. Automatic tooth brushing
[0048] The user selects the tooth brushing mode on the terminal and presses the start button.
[0049] The device sends the user ID and a request to start brushing teeth to the server.
[0050] The server generates an optimal tooth brushing pattern based on the user's tooth shape data and analysis results and sends it to the terminal.
[0051] The terminal controls the automatic toothbrushing device according to the received toothbrushing pattern, and the automatic toothbrushing device performs the specified operations to effectively brush the user's teeth.
[0052] 5. Detecting and sending unpolished areas
[0053] After brushing, the device activates its built-in sensor to scan the user's teeth and detect any areas that have not been brushed.
[0054] The device encrypts the detected unpolished area data and sends it to the server.
[0055] 6. Analyzing data on remaining areas and providing feedback
[0056] The server inputs the received data on areas that have not been polished into the AI analysis module.
[0057] The AI analysis module analyzes the data and learns patterns that are likely to result in areas not being polished.
[0058] The server generates a tooth brushing improvement plan for the next time based on the learning results and sends the plan to the terminal.
[0059] The terminal displays the improvement plan received from the server to the user and provides specific advice on how to reduce areas that remain unbrushed.
[0060] Specific examples
[0061] When using the device for the first time, the user presses the scan button on the device to scan their teeth. The device then sends the scanned data to the server, which analyzes the data, identifies areas that are difficult to brush, and saves them.
[0062] During use, the user selects a toothbrushing mode, the device executes the optimal toothbrushing pattern, and the sensor detects areas that have not been brushed and sends the data to the server, which then generates an improvement plan and provides feedback to the user.
[0063] The system allows users to brush their teeth in an individually optimized way, minimizing missed spots, thereby reducing the risk of cavities and periodontal disease and improving the user's oral hygiene.
[0064] The processing flow will be explained below.
[0065] Step 1:
[0066] The user activates the device's scanning function, opens their mouth, and captures their teeth. The device is equipped with a high-precision 3D scanner that generates the user's teeth profile data in a few seconds. The data captured by the device is temporarily stored in its internal memory.
[0067] Step 2:
[0068] The device encrypts the stored tooth profile data. To ensure security, the device protects the data using a sophisticated encryption algorithm. The device then transmits the encrypted data to a server via the Internet.
[0069] Step 3:
[0070] The server receives the tooth profile data sent from the terminal. The server saves the data in a database and stores it in an organized format for each user. This allows for quick access to each user's individual data.
[0071] Step 4:
[0072] The server sends the saved tooth profile data to the AI analysis module, which then analyzes the data in detail to identify irregularities and areas that are difficult to brush. It then generates a list of the identified areas and sends it to the server.
[0073] Step 5:
[0074] Based on the analysis results, the server saves a list of difficult-to-brush areas in a database. It also generates an optimal tooth brushing pattern based on the analysis results. The generated tooth brushing pattern is unique to each user and is saved in a dedicated format.
[0075] Step 6:
[0076] The user selects the tooth brushing mode on the device and presses the start button. The device sends a tooth brushing start request including the user ID to the server.
[0077] Step 7:
[0078] The server retrieves the relevant tooth shape data and a list of difficult-to-brush areas based on the user ID, generates an optimal tooth brushing pattern, and sends the pattern to the device.
[0079] Step 8:
[0080] The terminal controls the automatic toothbrushing device according to the received toothbrushing pattern, so that the automatic toothbrushing device operates according to the settings and effectively brushes the user's teeth.
[0081] Step 9:
[0082] After brushing, the device activates its built-in sensor and scans the user's teeth again to detect any areas that have not been brushed. The device generates the detection data, encrypts it, and sends it to the server.
[0083] Step 10:
[0084] The server inputs the received missed brushing data into the AI analysis module, which analyzes the data and learns patterns that tend to cause missed brushing. Based on the analysis results, it generates an improvement plan for the next brushing.
[0085] Step 11:
[0086] The server sends the improvement plan to the user's device, which then displays the feedback and provides specific advice to the user. Based on this, the user can improve their next brushing routine to minimize missed spots.
[0087] Example 1
[0088] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0089] Conventional tooth brushing systems require a lot of manual operation by the user, which means that areas are likely to be left unbrushed. It is also difficult to identify areas that have been left unbrushed and provide solutions, making it difficult to improve overall oral hygiene. Furthermore, data security has not been sufficiently considered, raising concerns about the leakage of personal information.
[0090] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0091] In this invention, the server includes a means for storing tooth shape data in a database and inputting it into an AI analysis module for analysis, a means for identifying areas that are difficult to brush based on the analysis results, and a means for generating an improvement plan for the next tooth brushing session and sending it to the terminal as feedback to the user. This enables individually optimized tooth brushing, reduces missed spots, improves overall oral hygiene, and ensures the security of personal information.
[0092] "User" refers to an individual who uses the system to capture tooth profile data and automatically brush their teeth.
[0093] A "terminal" is a device used by a user, and refers to a device that acquires and transmits tooth shape data, executes tooth brushing patterns, and detects data on areas that have not been brushed.
[0094] "Tooth shape data" refers to 3D scan data that accurately shows the shape and position of the user's teeth.
[0095] "Server" refers to a central management system that stores and analyzes the received tooth profile data, generates various plans based on the analysis results, and sends them to the terminal.
[0096] "Encryption" refers to a technology that uses a specific algorithm to convert data such as tooth shape data and unbrushed area data, making it unreadable, in order to ensure its security.
[0097] The "AI analysis module" refers to a part of the system that uses artificial intelligence technology to analyze tooth shape data and data on areas that have not been brushed, and identifies areas that are difficult to brush.
[0098] "Difficult-to-brush areas" refer to areas of the teeth that, due to their shape and position, are likely to be left unbrushed when using manual or automatic toothbrushes.
[0099] The "tooth brushing pattern" refers to an optimal operation sequence to be executed by the automatic tooth brushing device, which is generated based on the user's tooth shape data and the analysis results.
[0100] "Automatic tooth brushing device" refers to a device that is controlled by a terminal and effectively brushes a user's teeth automatically.
[0101] "Missed area data" refers to data containing information about missed areas detected after brushing teeth.
[0102] A "toothbrushing improvement plan" refers to a plan that includes specific instructions and a schedule for brushing your teeth more effectively the next time, based on data on areas that have not been brushed.
[0103] "Feedback" refers to specific advice and information provided to users based on analysis results and improvement plans.
[0104] The present invention relates to an automatic tooth brushing system that thoroughly brushes the user's teeth according to their shape and memorizes areas that are prone to cavities (are likely to be left unbrushed) through AI learning. Specific embodiments for realizing this system are described below.
[0105] 1. Acquisition of tooth profile data
[0106] The user activates the device's scanning function, opens their mouth, and scans their teeth with a 3D scanner. The device is equipped with a highly accurate 3D scanner that captures teeth impressions in a few seconds. The scanned data is temporarily stored in the device's internal memory. For example, when the user taps the "scan button," the 3D scanner begins scanning the teeth impressions and saves them in the device's internal memory.
[0107] 2. Sending and saving tooth profile data
[0108] The terminal encrypts the scanned tooth profile data and protects it using a secure encryption method such as AES-256. The encrypted data is then sent over the Internet to a server, which securely stores the received data in a database and efficiently manages each user's data.
[0109] 3. Analyzing tooth profile data and identifying areas that are difficult to polish
[0110] The server inputs the saved tooth profile data into the AI analysis module. The AI analysis module uses deep learning technology to analyze the tooth profile data and identify irregularities and areas that are difficult to brush. As a result of the analysis, a list of areas that are difficult to brush is generated and stored in a database. The AI analysis module processes the data in the background and sends a notification to the server that the analysis is complete.
[0111] 4. Automatic tooth brushing
[0112] When a user selects tooth brushing mode on the device and presses the "Start" button, the device sends a request to start brushing along with the user ID to the server. The server generates an optimal tooth brushing pattern based on the user's tooth shape data and analysis results, and sends it to the device. The device controls the automatic tooth brushing device according to the received pattern. The automatic tooth brushing device performs the specified operations, for example, using rotation and vibration to effectively brush the user's teeth.
[0113] 5. Detecting and sending unpolished areas
[0114] After brushing is complete, the device activates its built-in sensor and scans the user's teeth again. This scan detects any missed areas. The device then encrypts the missed area data again and sends it to the server. For example, the "Start missed area detection" button is automatically pressed, and the missed area data is sent to the server.
[0115] 6. Analyzing data on remaining areas and providing feedback
[0116] The server inputs the received missed brushing data into the AI analysis module for analysis. Based on the analysis results, it generates an improvement plan for the next tooth brushing session and sends it to the terminal. The terminal displays the received plan to the user and provides specific advice on how to reduce missed brushing sessions next time. For example, the server executes the "improvement plan generation" process and sends the improvement plan to the terminal.
[0117] Specific examples
[0118] First time use:
[0119] The user presses the scan button on the device, and the scanner scans the teeth profile. The device then encrypts the scanned data and sends it to a server, where the server analyzes the data to identify areas that are difficult to brush and stores them.
[0120] Currently in use:
[0121] The user selects a toothbrushing mode, and the device receives the optimal toothbrushing pattern from the server. The device controls the automatic toothbrushing device and brushes the teeth according to the specified movements. After finishing, the sensor detects any areas that have not been brushed and sends the data to the server. The server analyzes the data on areas that have not been brushed, generates an improvement plan for the next time, and provides feedback.
[0122] Prompt Sentence Examples
[0123] "Please explain this automated tooth brushing system. Please explain in detail the process in which the user scans their teeth and the server analyzes the data to detect areas that have not been brushed and provides feedback."
[0124] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0125] Step 1:
[0126] The user activates the device's scanning function to capture their own dental profile data. When the user taps the scan button, the device's built-in high-precision 3D scanner starts operating and captures the user's dental profile data within a few seconds. The input is the user's mouth open, and the output is dental profile data obtained by 3D scanning. The device temporarily stores the captured dental profile data in its internal memory.
[0127] Step 2:
[0128] The terminal encrypts the scanned tooth profile data. The encryption method used is AES-256 or similar. The input is the acquired tooth profile data, and the output is the encrypted tooth profile data. The terminal sends the encrypted data to a server via the Internet. The server receives the data.
[0129] Step 3:
[0130] The server stores the received tooth profile data in a database. The input is encrypted tooth profile data, and the output is the data stored in the database. The data stored in the database is managed so that it can be easily accessed.
[0131] Step 4:
[0132] The server inputs the saved tooth profile data into an AI analysis module. The AI analysis module analyzes the data and identifies irregularities in the teeth and areas that are difficult to brush. The input is the saved tooth profile data, and the output is a list of areas that are difficult to brush. Based on the analysis results, the list of areas that are difficult to brush is saved in a database.
[0133] Step 5:
[0134] The user selects a tooth brushing mode on the device and presses the "Start" button. The input is the user's mode selection, and the output is a request to start brushing. The device sends the request to the server along with the user ID.
[0135] Step 6:
[0136] The server generates a tooth brushing pattern based on the user's tooth shape data and the analysis results. The input is the user's tooth shape data and the analysis results, and the output is the optimal tooth brushing pattern. The server sends the tooth brushing pattern to the terminal.
[0137] Step 7:
[0138] The terminal controls the automatic toothbrushing device according to the received toothbrushing pattern. The automatic toothbrushing device performs the specified operations to effectively brush the user's teeth. The input is the transmitted toothbrushing pattern, and the output is the control of the automatic toothbrushing device. Specifically, it performs operations such as vibration and rotation to brush specific teeth or areas with priority.
[0139] Step 8:
[0140] After brushing, the device activates its built-in sensor and scans the user's teeth again to detect any missed areas. The input is the state of the user's teeth after brushing, and the output is data on any missed areas. The device again encrypts the detected missed areas and sends them to the server.
[0141] Step 9:
[0142] The server inputs the received missed brushing data into the AI analysis module and analyzes the data. The input is missed brushing data, and the output is a tooth brushing improvement plan for the next time. The server generates an improvement plan based on the learning results and sends it to the device.
[0143] Step 10:
[0144] The device displays the received improvement plan to the user and provides specific advice on how to reduce missed spots next time. The input is the improvement plan from the server, and the output is feedback information to the user. Specifically, the device displays detailed instructions to the user, such as which areas they should focus on brushing.
[0145] (Application example 1)
[0146] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0147] Conventional tooth brushing methods tend to leave some areas unbrushed, which in the long term can lead to oral health problems such as cavities and periodontal disease. It is also difficult to provide optimal tooth brushing methods tailored to individual users, and in many cases, users brush their teeth without understanding the correct method. Furthermore, dental clinics face the challenge of not having a way to efficiently monitor and instruct patients on their dental condition.
[0148] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0149] In this invention, the server includes: means for a user to acquire tooth shape data using a terminal; means for transmitting the acquired tooth shape data to the server; means for the server to store and analyze the received tooth shape data; means for the server to identify areas that are difficult to brush based on the analysis results; means for the server to make the analysis results available to dentists in brick-and-mortar stores; means for the terminal to control an automatic tooth brushing device based on the analysis results of the server; means for the terminal to detect areas that have not been brushed after brushing and transmit them to the server; means for the server to generate an improvement plan for the next tooth brushing based on the data on areas that have not been brushed; means for the server to transmit the generated improvement plan to the terminal and provide feedback to the user; and means for the terminal to generate prompt sentences to input into the generative AI model. This allows users to share data scanned at home with a dental clinic and receive individually optimized tooth brushing instructions, reducing areas that have not been brushed and reducing the risk of cavities and periodontal disease.
[0150] A "user" is a person who uses this system to acquire tooth shape data and perform automatic tooth brushing and oral care.
[0151] A "terminal" is a device that allows a user to acquire tooth profile data and send it to a server, and includes mobile information terminals such as smartphones and tablets.
[0152] "Tooth shape data" is data that captures the shape and arrangement of the user's teeth with high precision.
[0153] The "server" is a central processing unit that receives, stores, and analyzes tooth profile data sent from the terminal.
[0154] "Analysis" refers to data processing that identifies areas that are difficult to brush or areas that have not been brushed based on the tooth shape data received by the server.
[0155] "Hard to brush areas" refers to areas of the teeth that are difficult for a user to effectively brush with a regular toothbrush.
[0156] A "physical dentist" is a medical professional at a dental clinic who refers to the data on the server and provides direct oral care and guidance to users.
[0157] An "automatic toothbrushing device" is a device that automatically and effectively brushes a user's teeth based on the analysis results of the server.
[0158] "Missed spots" refer to areas of the teeth that still have dirt or plaque remaining after brushing.
[0159] "Data on areas that have not been brushed" is data for identifying areas that have not been brushed, and is used to generate the next tooth brushing improvement plan.
[0160] The "next tooth brushing improvement plan" is a suggestion about the optimal tooth brushing method and procedure that the user should follow next time, generated by the server based on the results of analysis and learning.
[0161] A "generative AI model" is an artificial intelligence algorithm that suggests effective tooth brushing methods to users based on tooth shape data and data on areas that have not been brushed.
[0162] A "prompt sentence" is a sentence input to a generative AI model that contains instructions and guidelines to encourage users to take proper oral care.
[0163] The present invention relates to a system that combines the provision of individually optimized automatic tooth brushing based on a user's tooth shape with direct oral care support from a dentist in a brick-and-mortar store. A specific description will be given of an embodiment of the present invention.
[0164] First, the user uses a device to capture their own dental profile data. The device is equipped with a high-precision 3D scanner, and users can capture dental profile data in just a few seconds by opening their mouth and pressing the scan button. The captured dental profile data is encrypted to prevent data leaks, and the encrypted data is then sent to a server via the Internet.
[0165] The server stores the received tooth profile data and inputs it into the AI analysis module for analysis. The AI analysis module analyzes the tooth profile data and identifies areas that are difficult to brush or have many irregularities. This results in a list of areas that require special attention.
[0166] The server converts the analysis results into a format that can be referenced by dentists at brick-and-mortar clinics, who can then use this data to provide optimal oral care and guidance to patients, allowing users to receive detailed advice at dental clinics.
[0167] The terminal then controls the automatic toothbrushing device based on the server's analysis results. When the user selects a toothbrushing mode and presses the start button, the terminal generates an optimal toothbrushing pattern and sends commands to the automatic toothbrushing device. The automatic toothbrushing device then performs the instructed actions to effectively brush the user's teeth.
[0168] After brushing is complete, the device activates a sensor to detect missed areas and scans the user's teeth again. After identifying missed areas, the device re-encrypts the data and sends it to the server. The server then inputs the received missed areas data into the AI analysis module again, learning patterns that tend to result in missed areas. The server then generates a toothbrushing improvement plan for the next brushing session based on the learning results and sends this plan to the device.
[0169] The device also displays the improvement plan received from the server to the user and provides specific advice for effective tooth brushing. Furthermore, the device generates prompt sentences to input into the generative AI model, providing instructions and guidelines for promoting proper oral care. Examples of prompt sentences are as follows:
[0170] Example prompt sentence:
[0171] "You can 3D scan your teeth at home and send the data through the app. Your dentist will review the results and provide you with tailored advice at your next appointment."
[0172] This system allows users to efficiently manage their oral health and, in conjunction with dental consultations, allows them to receive comprehensive oral care, reducing the risk of tooth decay and periodontal disease by reducing missed spots when brushing.
[0173] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0174] Step 1:
[0175] The user uses the device to acquire dental profile data. The user presses the scan button on the device, opens their mouth, and acquires dental profile data. The device has a built-in high-precision 3D scanner that captures dental profile data in a few seconds. The acquired data is temporarily stored in the device's internal memory.
[0176] Input: Intraoral image data
[0177] Output: 3D tooth profile data
[0178] Step 2:
[0179] The terminal encrypts the acquired tooth profile data and then sends it to the server. To prevent data leakage, the terminal encrypts the data using an encryption library. The encrypted data is then sent to the server via the Internet.
[0180] Input: 3D tooth profile data
[0181] Output: Encrypted 3D tooth profile data
[0182] Step 3:
[0183] The server stores and analyzes the received tooth profile data. The server decrypts the encrypted data and stores it securely. The stored data is input into an AI analysis system and analyzed to identify tooth shape, irregularities, and areas that are difficult to brush.
[0184] Input: Encrypted 3D tooth profile data
[0185] Output: Analysis result data (list of areas that are difficult to polish)
[0186] Step 4:
[0187] The server converts the analysis results into a format that can be viewed by the dentist in the brick-and-mortar clinic, and provides it to the dentist, who can then provide detailed advice and treatment suggestions to the patient.
[0188] Input: Analysis result data
[0189] Output: Information provided to dentist (report of analysis results)
[0190] Step 5:
[0191] The terminal controls the automatic toothbrushing device based on the analysis results from the server. The terminal sends the received toothbrushing pattern to the automatic toothbrushing device, and when the user presses the start button, the device performs the specified operation.
[0192] Input: Analysis result data
[0193] Output: Control commands for the automatic toothbrushing device
[0194] Step 6:
[0195] After brushing, the device detects any missed areas and sends the data to the server.The device then uses a 3D scanner to scan the missed areas again, encrypting the data and sending it to the server.
[0196] Input: Tooth shape data after brushing
[0197] Output: Data on areas that remain unpolished
[0198] Step 7:
[0199] The server generates a tooth brushing improvement plan for the next time based on the data on missed brushing areas. The server uses an AI analysis system to learn the missed brushing area data and creates an improvement plan to suggest the best brushing method for the next time.
[0200] Input: Data on areas to be polished
[0201] Output: Improvement plan data
[0202] Step 8:
[0203] The server sends the generated improvement plan to the terminal and provides feedback to the user. The terminal displays the received improvement plan to the user and provides specific advice that will be useful for the next tooth brushing.
[0204] Input: Improvement Plan Data
[0205] Output: Feedback information for the user
[0206] Step 9:
[0207] The device generates prompts to input into the generative AI model, providing instructions and guidelines to encourage proper oral care to the user.
[0208] An example of a specific prompt might be, "3D scan your teeth at home and send the data through the app. Your dentist will review the results and provide you with tailored advice at your next appointment."
[0209] Input: Improvement Plan Data
[0210] Output: prompt statement
[0211] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0212] The present invention relates to a system that automatically brushes teeth according to the user's tooth shape, uses AI to learn and memorize areas that have not been brushed, and further combines it with an emotion engine that recognizes the user's emotions and provides feedback. Specific embodiments for realizing this system are described below.
[0213] 1. Acquisition of tooth profile data
[0214] The user activates the device's scanning function, opens their mouth, and captures their teeth. The device is equipped with a highly accurate 3D scanner, which generates the user's teeth profile data in a few seconds. The data captured by the device is temporarily stored in its internal memory.
[0215] 2. Sending and saving tooth profile data
[0216] The device encrypts the stored tooth profile data. To ensure security, the device protects the data using a sophisticated encryption algorithm. The device then transmits the encrypted data to a server via the Internet.
[0217] The server receives the tooth profile data sent from the device and stores it securely in a database. The saved data is stored in a format organized for each user.
[0218] 3. Analyzing tooth profile data and identifying areas that are difficult to polish
[0219] The server sends the saved tooth profile data to the AI analysis module, which then analyzes the data in detail to identify irregularities and areas that are difficult to brush. It then generates a list of the identified areas and sends it to the server.
[0220] Based on the analysis results, the server saves a list of difficult-to-brush areas in a database. Based on the analysis results, an optimal tooth brushing pattern is generated. The generated tooth brushing pattern is unique to each user and is saved in a dedicated format.
[0221] 4. Automatic tooth brushing
[0222] The user selects the tooth brushing mode on the device and presses the start button. The device sends a tooth brushing start request including the user ID to the server.
[0223] The server retrieves the relevant tooth shape data and a list of difficult-to-brush areas based on the user ID, generates an optimal tooth brushing pattern, and sends the pattern to the device.
[0224] The terminal controls the automatic toothbrushing device according to the received toothbrushing pattern, so that the automatic toothbrushing device operates according to the settings and effectively brushes the user's teeth.
[0225] 5. Detecting and sending unpolished areas
[0226] After the user has finished brushing, the device activates its built-in sensor and scans the user's teeth again to detect any areas that have not been brushed. The device generates the detection data, encrypts it, and sends it to the server.
[0227] 6. Analyzing data on remaining areas and providing feedback
[0228] The server inputs the received missed brushing data into the AI analysis module, which analyzes the data and learns patterns that tend to cause missed brushing. Based on the analysis results, it generates an improvement plan for the next brushing.
[0229] The server sends the improvement plan to the user's device, which then displays the feedback and provides specific advice to the user. Based on this, the user can improve their next brushing routine to minimize missed spots.
[0230] Incorporating an emotion engine
[0231] 7. Emotional Engine Activation
[0232] The device's built-in emotion engine analyzes the user's facial expressions and tone of voice in real time to recognize the user's emotional state. The emotion engine uses the camera and microphone to obtain emotional information from the user's subtle changes in facial expressions and voice.
[0233] The emotion engine sends the recognized emotion data to the server, which then adjusts the feedback to the user based on the emotion data.
[0234] 8. Providing Emotional Feedback
[0235] The server analyzes the received emotional data and determines the emotional state the user is in. For example, if the user is feeling stressed, it can provide relaxation advice or play calming music.
[0236] The device receives feedback from the server and displays it to the user, which is customized according to the user's emotional state, providing an effective and comfortable brushing experience.
[0237] Specific examples
[0238] When using the device for the first time, the user presses the scan button on the device to scan their teeth. The device then sends the scanned data to the server, which analyzes the data, identifies areas that are difficult to brush, and saves them.
[0239] While brushing their teeth, the user's emotions are analyzed by the emotion engine, and the device displays encouraging or relaxing comments according to the user's emotions, providing a more comfortable brushing experience.
[0240] After use, the user selects a toothbrushing mode, the device executes the optimal toothbrushing pattern, and the sensor detects areas that have not been brushed and sends the data to the server, which then generates an improvement plan and provides feedback to the user.
[0241] This system allows users to brush their teeth in a way that is optimized for them and provides feedback based on their emotional state, helping them brush their teeth comfortably while minimizing missed spots, thereby reducing the risk of cavities and periodontal disease and improving their oral hygiene.
[0242] The processing flow will be explained below.
[0243] Step 1:
[0244] The user activates the device's scanning function, opens their mouth, and captures their teeth profile. The device's high-precision 3D scanner generates the user's teeth profile data within a few seconds, and the device temporarily stores the data in its internal memory.
[0245] Step 2:
[0246] The device encrypts the stored tooth profile data, protects the data using a sophisticated encryption algorithm, and then transmits the encrypted data to a server over the Internet.
[0247] Step 3:
[0248] The server receives the tooth profile data sent from the terminal and stores it in a database. The server organizes and manages the data for each individual user.
[0249] Step 4:
[0250] The server sends the saved tooth profile data to an AI analysis module, which then analyzes the data in detail to identify irregularities and areas that are difficult to brush. A list of the identified areas is generated and sent back to the server.
[0251] Step 5:
[0252] The server then creates a list of areas that are difficult to brush based on the analysis results and saves it in a database. Based on this, the server then generates an optimal brushing pattern for each user and saves this information in the database as well.
[0253] Step 6:
[0254] The user operates the device to select the tooth brushing mode and presses the start button. The device then sends this information to the server.
[0255] Step 7:
[0256] The server retrieves the relevant tooth shape data and analysis results based on the user ID, and then sends the optimal tooth brushing pattern to the device.
[0257] Step 8:
[0258] The terminal controls the automatic toothbrushing device based on the received toothbrushing pattern, and the automatic toothbrushing device starts to effectively brush the user's teeth.
[0259] Step 9:
[0260] After the user has finished brushing, the device activates its built-in sensor and scans the user's teeth again to detect any areas that have not been brushed. The device generates the detection data, encrypts it, and sends it to the server.
[0261] Step 10:
[0262] The server inputs the received missed brushing data into the AI analysis module, which learns the pattern of missed brushing and generates an improvement plan for the next brushing.
[0263] Step 11:
[0264] The server sends the improvement plan to the user's device, which displays this feedback to the user and provides specific advice so that the user can improve their next brushing routine.
[0265] Incorporating an emotion engine
[0266] Step 12:
[0267] The device's built-in emotion engine analyzes the user's facial expressions and tone of voice in real time to recognize their emotional state. The emotion engine uses the camera and microphone to obtain emotional information from the user's subtle changes in facial expressions and voice.
[0268] Step 13:
[0269] The emotion engine encrypts the emotion data it recognizes and sends it to the server, which receives and stores the emotion data.
[0270] Step 14:
[0271] The server analyzes the emotional data and generates feedback based on the user's emotional state. For example, if the user is feeling stressed, it generates advice to relax or an instruction to play calming music.
[0272] Step 15:
[0273] The device displays the feedback received from the server to the user, providing a comfortable tooth brushing experience by displaying customized comments and advice according to the user's emotional state.
[0274] Specific examples
[0275] When using the device for the first time, the user presses the scan button on the device to scan their teeth. The scanned data is sent to a server, which analyzes the data, identifies areas that are difficult to brush, and saves them.
[0276] While brushing, the emotion engine works to recognize the user's emotional state by analyzing their facial expressions and tone of voice. If the user feels stressed, the device will play relaxing comments or music received from the server, providing a comfortable brushing experience.
[0277] After brushing, the device detects any areas that have been missed and sends the data to the server. The server generates an improvement plan and provides feedback to the user, who can then use the feedback to improve their next brushing session and minimize missed areas.
[0278] Example 2
[0279] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0280] Conventional automatic toothbrushing devices have poor adaptability to the shape of each user's mouth and areas that need brushing, and are unable to provide feedback based on the user's emotional state, making it difficult to provide effective cleaning and improve the user experience.In addition, they do not provide real-time feedback on the detection of areas that need brushing and how to improve them, which makes it difficult to take prompt action for the next cleaning.
[0281] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0282] In this invention, the server includes a means for storing and analyzing intraoral scan data, a means for identifying areas that are difficult to clean, and a means for generating an optimal cleaning pattern. This allows for optimal management of the automatic cleaning device based on the user's intraoral shape. Furthermore, by using a terminal with a built-in emotion analysis engine, feedback can be provided according to the user's emotional state, and missed areas can be detected and an improvement plan can be generated in real time, allowing for rapid response.
[0283] definition statement
[0284] "Intraoral scan data" is data that captures the shape of the user's oral cavity using a 3D scanner or similar device.
[0285] A "terminal" is a device used by a user that has built-in scanning functions, control functions for an automatic cleaning device, an emotion analysis engine, and the like.
[0286] A "server" is a computer system that receives, stores, and analyzes data sent from a terminal.
[0287] The "AI Analysis Module" is a software module that uses machine learning algorithms to analyze intraoral scan data and identify areas that are difficult to clean.
[0288] "Difficult-to-clean areas" refer to areas that are difficult for an automatic cleaning device to access due to the shape or structure of the mouth.
[0289] An "automatic cleaning device" is a device that automatically cleans the inside of a user's mouth based on a pre-set cleaning pattern.
[0290] "Remaining dirty areas" refers to areas that were not polished after cleaning by the automatic cleaning device.
[0291] An "emotion analysis engine" is a software module that analyzes a user's facial expressions and tone of voice to recognize their emotional state in real time.
[0292] "Feedback" refers to advice and information based on the user's emotional state and cleaning results that is provided to the user from the server via the terminal.
[0293] An "improvement plan" refers to a plan generated by the server to make the next cleaning more effective based on areas that need to be cleaned and cleaning patterns.
[0294] MODE FOR CARRYING OUT THE INVENTION
[0295] The present invention is an automatic teeth brushing system that optimally adapts to the shape of the user's oral cavity and provides feedback according to the user's emotional state. Specific embodiments for realizing the present invention are described below.
[0296] 1. User-initiated intraoral scan
[0297] The user activates the intraoral scan function using the device. The device has a built-in high-precision 3D scanner (e.g., high-precision 3D scanner), which generates intraoral scan data by having the user open their mouth and wait a few seconds. This data is temporarily stored in the device's internal memory.
[0298] 2. Data Encryption and Transmission
[0299] The device encrypts the intraoral scan data stored in its internal memory using the AES-256 algorithm and sends the data over the Internet to a server, which receives the data and stores it in a database (e.g., a cloud database).
[0300] 3. AI-based data analysis
[0301] The server sends the stored intraoral scan data to an AI analysis module (e.g., machine learning algorithm) for detailed analysis. This analysis identifies areas that are difficult to clean and generates an optimal cleaning pattern. The list of identified areas and cleaning patterns are stored in a database.
[0302] 4. Automatic cleaning
[0303] The user selects a cleaning mode on the device and presses the start button. The device sends a cleaning start request along with the user ID to the server. The server retrieves the relevant scan data and a list of difficult-to-clean areas based on the user ID, and sends the optimal cleaning pattern to the device. The device then controls an automatic cleaning device (e.g., an electric toothbrush) according to this pattern and brushes the user's teeth.
[0304] 5. Detecting and sending unpolished areas
[0305] After the device has finished cleaning, it activates its built-in sensor and scans the mouth again to detect any missed areas. The device generates missed area data, encrypts it, and sends it to the server. The server inputs the received data into an AI analysis module and learns patterns that are likely to result in missed areas. This generates an improvement plan that will be reflected in the next cleaning.
[0306] 6. Use of sentiment analysis engines
[0307] The device's built-in emotion analysis engine analyzes the user's facial expressions and tone of voice in real time, recognizing the user's emotional state and sending the resulting emotional data to the server. The server then adjusts the feedback based on the emotional data and provides it to the user.
[0308] 7. Providing Feedback
[0309] The server generates an improvement plan and sends feedback based on sentiment analysis to the device, which then displays it to the user, offering advice on how to improve the next cleaning or comments to help the user relax.
[0310] Specific examples
[0311] On first use, the user presses the scan button on the device to scan their teeth. The device then sends the scanned data to the server, which analyzes the data, identifies and saves areas that are difficult to brush. While brushing, the user's emotions are analyzed, and the device displays encouraging or relaxing comments based on the user's emotions, providing a more comfortable brushing experience. After use, the user selects a brushing mode, and the device executes the optimal brushing pattern, using the built-in sensor to detect areas that have not been brushed, and sends the data to the server. The server then generates an improvement plan and provides feedback to the user.
[0312] Prompt Sentence Examples
[0313] "Please start dental scan."
[0314] "I found some areas that were difficult to polish. Next time I will change the settings to make it easier to polish."
[0315] "You seem tired today. I'll play some recommended music to help you relax."
[0316] The present invention allows users to receive cleaning that is optimized for their oral cavity shape and emotional state, achieving comfortable oral care while minimizing missed areas.
[0317] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0318] Program processing flow
[0319] ---
[0320] Step 1: Acquire tooth profile data
[0321] input:
[0322] The user presses the scan button on the device.
[0323] Operation:
[0324] The user opens their mouth as instructed.
[0325] The device activates its built-in high-precision 3D scanner and scans the inside of the user's mouth for a few seconds.
[0326] Data processing:
[0327] The device generates scan data.
[0328] output:
[0329] The scanned data is temporarily saved in the device's internal memory.
[0330] Specific behavior:
[0331] The message "Start scanning" will appear on the device screen.
[0332] A 3D scanner captures the shape of the inside of your mouth and generates scan data.
[0333] The device will display "Scan complete" and the data will be saved.
[0334] ---
[0335] Step 2: Encrypt and send data
[0336] input:
[0337] Scan data (output of step 1)
[0338] Operation:
[0339] The device encrypts the scanned data.
[0340] The device sends the encrypted data to a server over the Internet.
[0341] Data processing:
[0342] Encrypts data using the AES-256 algorithm.
[0343] output:
[0344] The encrypted scan data is sent to the server.
[0345] Specific behavior:
[0346] The message "Encrypting data" appears on the device screen.
[0347] After encryption is complete, "Sending data" will be displayed and the progress bar will progress.
[0348] The server receives the data and notifies the terminal that "the data has been saved."
[0349] ---
[0350] Step 3: Data analysis using AI
[0351] input:
[0352] Encrypted scan data (output of step 2)
[0353] Operation:
[0354] The server decrypts the encrypted data and stores it in a database.
[0355] The server sends the scan data to the AI analysis module.
[0356] Data processing:
[0357] Use AI analysis modules (e.g., machine learning algorithms) to identify hard-to-clean areas.
[0358] output:
[0359] A list of difficult-to-clean areas and optimal cleaning patterns are generated and stored in a database.
[0360] Specific behavior:
[0361] The server displays the message "Data is being analyzed."
[0362] The AI analysis module analyzes the data and returns the results in JSON format.
[0363] "Analysis complete" will be displayed and the list and patterns will be saved.
[0364] ---
[0365] Step 4: Run Auto Cleaning
[0366] input:
[0367] User ID, list of difficult-to-clean areas, and optimal cleaning pattern (output of step 3)
[0368] Operation:
[0369] The user selects the cleaning mode on the terminal and presses the start button.
[0370] The device sends a request to the server.
[0371] The server sends relevant information to the terminal based on the user ID.
[0372] Data processing:
[0373] The automatic cleaning device is controlled based on an optimal cleaning pattern.
[0374] output:
[0375] The device executes a cleaning pattern and brushes the user's teeth.
[0376] Specific behavior:
[0377] The device screen will display "Select a cleaning mode."
[0378] When the user presses the start button, the message "Cleaning begins" is displayed.
[0379] The automatic cleaning device will operate and the cleaning progress will be displayed on the terminal.
[0380] ---
[0381] Step 5: Detect and send unpolished areas
[0382] input:
[0383] Cleaning completed (result of step 4)
[0384] Operation:
[0385] The device will activate its built-in sensor and scan the inside of your mouth again.
[0386] Any remaining dirt is detected, and data is generated and encrypted.
[0387] The device sends the encrypted data to the server.
[0388] Data processing:
[0389] Generate and encrypt data on areas that remain unpolished.
[0390] output:
[0391] The encrypted unpolished area data is sent to the server.
[0392] Specific behavior:
[0393] After brushing your teeth, the device screen will display "Scanning for remaining areas."
[0394] The sensor scans again and displays the message "Unpolished areas detected."
[0395] When sending data, the message "Sending data" is displayed.
[0396] ---
[0397] Step 6: Analyze remaining polishing data and provide feedback
[0398] input:
[0399] Encrypted unpolished data (output of step 5)
[0400] Operation:
[0401] The server decrypts the data and inputs it into an AI analysis module.
[0402] The server generates the next cleaning improvement plan based on the data analysis results.
[0403] Data processing:
[0404] The AI analysis module analyzes the data and generates an improvement plan.
[0405] output:
[0406] An improvement plan is generated and transmitted from the server to the terminal.
[0407] The feedback is displayed to the user.
[0408] Specific behavior:
[0409] The message "Analyzing remaining polishing data" is displayed on the server side.
[0410] Once the analysis is complete, you will be notified that an improvement plan has been generated.
[0411] The device will display "Feedback on how to clean next time."
[0412] ---
[0413] Step 7: Use a sentiment analysis engine
[0414] input:
[0415] User's facial expressions and voice (real-time data)
[0416] Operation:
[0417] The device's built-in emotion analysis engine analyzes the user's emotions.
[0418] The acquired emotion data is sent to the server.
[0419] Data processing:
[0420] Emotional data is generated from facial expressions and tone of voice.
[0421] output:
[0422] The emotion data is sent to the server.
[0423] Specific behavior:
[0424] The emotion engine will start and the message "Analyzing emotions" will be displayed.
[0425] The user's facial expressions and voice are captured and the message "Sending emotion data" is displayed.
[0426] ---
[0427] Step 8: Provide emotional feedback
[0428] input:
[0429] Emotion data (output of step 7)
[0430] Operation:
[0431] The server analyzes the emotional data and generates feedback according to the user's emotional state.
[0432] The server sends the feedback to the device.
[0433] Data processing:
[0434] Generate feedback based on the user's emotional state.
[0435] output:
[0436] The feedback is sent to the terminal and displayed to the user.
[0437] Specific behavior:
[0438] The device screen will display the message, "You have received emotion-based advice."
[0439] Specific feedback might include, "You seem to be feeling stressed today. We'll play some music to help you relax."
[0440] The above is the specific flow of processing and details of each step of this system. This system allows users to brush their teeth in an optimized way, and furthermore, by providing feedback according to their emotional state, users can brush their teeth comfortably while minimizing missed spots.
[0441] (Application example 2)
[0442] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0443] Current factory cleaning and equipment inspections require time and effort, and are prone to inappropriate cleaning and inspection. Therefore, a system is needed to improve cleaning efficiency and minimize areas left uncleaned. It is also necessary to improve the working environment by understanding the emotional state of factory workers in real time and providing appropriate feedback.
[0444] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0445] In this invention, the server includes means for a user to acquire object data using a terminal, means for transmitting the acquired object data to the server, means for the server to store and analyze the received object data, means for the server to identify areas that are difficult to clean based on the analysis results, means for the terminal to control the automatic cleaning device based on the analysis results of the server, means for the terminal to detect areas that remain uncleaned after cleaning and transmit the detected areas to the server, means for the server to generate a next cleaning improvement plan based on the uncleaned area data, means for the server to transmit the generated improvement plan to the terminal and provide feedback to the user, means for acquiring and analyzing user emotion data, and means for transmitting the emotion data to the server and providing feedback. This makes it possible to improve the efficiency of cleaning work in factories and minimize areas that remain uncleaned, and further improve the working environment through feedback according to the worker's emotional state.
[0446] Key Word Definitions
[0447] A "user" is a plant supervisor or operator who utilizes the automated cleaning system.
[0448] A "terminal" is a portable or stationary electronic device for acquiring, transmitting, analyzing, and providing feedback on data of an object.
[0449] "Object data" refers to scan data relating to the surface of the equipment or facility to be cleaned or inspected.
[0450] A "server" is a central processing unit that receives, stores, analyzes data sent from a terminal, and returns the results.
[0451] The "analysis means" is a program that identifies areas that are difficult to clean based on the object data received by the server and generates a cleaning improvement plan for the next time.
[0452] "Hard-to-clean areas" are areas on or inside an object that tend to accumulate dirt and dust and are difficult to clean.
[0453] An "automatic cleaning device" is a robot or device that automatically cleans an object according to instructions from a terminal or server.
[0454] The "uncleaned area" is an area where dirt or dust remains after cleaning.
[0455] An "improvement plan" is a plan generated by the server that indicates efficient and effective cleaning patterns and procedures for the next cleaning.
[0456] "Emotion data" refers to data relating to the emotional state of the user obtained from facial expressions and voice.
[0457] "Feedback" refers to analysis results, improvement plans, and advice and information based on the user's emotions that are sent from the server to the device.
[0458] MODE FOR CARRYING OUT THE INVENTION
[0459] This invention relates to a system that automatically cleans machinery and equipment in a factory and uses AI to learn and memorize areas that need cleaning. Furthermore, this system also incorporates an emotion engine that recognizes the user's emotions and provides feedback. A specific embodiment for realizing this system is described below.
[0460] System Program Overview
[0461] Hardware and software:
[0462] Hardware: cleaning robot with high-precision 3D scanner (e.g., robot with LIDAR sensor), camera feed (e.g., Logitech C920 camera)
[0463] Software: Python, OpenCV library, EmotionRecognizer library, HTTP request library (requests)
[0464] Procedure:
[0465] 1. Scan the object:
[0466] The user activates the cleaning robot's scanning function and scans the surface of the equipment or facility to be cleaned. The surface data is acquired using a high-precision 3D scanner and temporarily stored in local memory.
[0467] 2. Data transmission:
[0468] Scan data stored in local memory is encrypted and sent to a central server via the internet, using advanced encryption algorithms to ensure security.
[0469] 3. Data storage and analysis:
[0470] The server securely stores the received scan data in a database. The stored data is then input into an AI analysis module to identify areas that are difficult to clean. The AI analysis module then analyzes the data in detail and lists areas that need cleaning.
[0471] 4. Cleaning pattern generation:
[0472] The server generates an optimal cleaning pattern based on the analysis results. The generated cleaning pattern is unique to each user and is saved in a dedicated format. This pattern is then sent to the device.
[0473] 5. Cleaning execution:
[0474] The user selects the cleaning mode on the device and presses the start button, and the robot begins cleaning. The robot follows the cleaning pattern sent to it and cleans effectively.
[0475] 6. Detecting missing areas:
[0476] After cleaning, the robot uses its built-in sensors to scan the object again to detect any areas that remain uncleaned, generating detection data that is encrypted and sent to a server.
[0477] 7. Improvement plan generation and feedback:
[0478] The server analyzes the received data on remaining cleaning areas and generates a cleaning improvement plan for the next cleaning. The generated improvement plan is sent to the terminal and feedback is provided to the user.
[0479] 8. Use of Emotion Engine:
[0480] The device's built-in emotion engine analyzes the user's facial expressions and tone of voice in real time to recognize their emotional state. The device uses a camera and microphone to capture emotion data from subtle changes in the user's facial expressions and voice, and sends it to a server.
[0481] 9. Emotion-based feedback:
[0482] The server analyzes the emotional data and provides feedback based on the user's emotional state. For example, if the user is feeling stressed, it will provide relaxation advice or play calming music.
[0483] Examples:
[0484] First time use: The user presses the scan button on the device to scan the object to be cleaned. The device sends the scanned data to the server, which analyzes the data to identify and store areas that are difficult to clean.
[0485] During cleaning: The user's emotions are analyzed by the emotion engine. Depending on the user's emotions, the device displays encouraging and relaxing comments, providing a comfortable cleaning experience.
[0486] After use: The user selects a cleaning mode, and the device performs the optimal cleaning pattern. The sensor detects any remaining cleaning areas and sends the data to the server. The server generates an improvement plan and provides feedback to the user.
[0487] Example prompts to be input to the generative AI model:
[0488] Please start the scanning service.
[0489] "We conduct sentiment analysis of employees."
[0490] "We are currently obtaining cleaning patterns for the equipment."
[0491] The robot is cleaning.
[0492] "We received your feedback and our work environment has improved."
[0493] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0494] System program processing steps
[0495] Step 1:
[0496] Scanning an object
[0497] The user activates the cleaning robot's scan function.
[0498] Input: Start scan command
[0499] Data processing: A unique 3D scanner scans the surface of the object and obtains highly accurate 3D data.
[0500] Output: Scanned 3D data
[0501] Step 2:
[0502] Sending data
[0503] The scanned data acquired by the terminal is encrypted and sent to the server.
[0504] Input: scanned 3D data
[0505] Data processing: Applying advanced encryption algorithms to protect your data.
[0506] Output: Sends the encrypted data to the server
[0507] Step 3:
[0508] Data storage and analysis
[0509] The server stores the received scan data in a database and inputs it into the AI analysis module.
[0510] Input: Encrypted 3D data
[0511] Data processing: The received data is decrypted, stored in a secure database, and analyzed in detail using an AI analysis module.
[0512] Output: Analyzed result data
[0513] Step 4:
[0514] Identifying hard-to-clean areas
[0515] The server uses an AI analysis module to identify areas that are difficult to clean.
[0516] Input: Parsed result data
[0517] Data processing: AI uses data to create a list of areas that are difficult to clean.
[0518] Output: List of hard-to-clean areas
[0519] Step 5:
[0520] Cleaning pattern generation
[0521] The server generates the optimal cleaning pattern based on the analysis results and sends it to the terminal.
[0522] Input: List of hard-to-clean areas
[0523] Data processing: Run the cleaning pattern generation algorithm to generate individual cleaning instructions.
[0524] Output: Sends cleaning pattern to terminal
[0525] Step 6:
[0526] Cleaning execution
[0527] The user selects a cleaning mode on the terminal, and the cleaning robot starts cleaning according to the transmitted cleaning pattern.
[0528] Input: cleaning pattern and start cleaning command
[0529] Data processing: The terminal controls the cleaning robot's operation and cleans the equipment according to the transmitted pattern.
[0530] Output: Cleaned equipment
[0531] Step 7:
[0532] Detecting areas that need cleaning
[0533] After cleaning, the robot uses its built-in sensors to re-scan the object to detect any areas that remain uncleaned.
[0534] Input: Post-cleaning scan command
[0535] Data Processing: Built-in sensors identify missed cleaning areas and assemble the data.
[0536] Output: Data on areas that remain uncleaned
[0537] Step 8:
[0538] Improvement plan generation and feedback
[0539] The server analyzes the remaining cleaning data received and generates a cleaning improvement plan for the next cleaning.
[0540] Input: Data on remaining areas to be cleaned
[0541] Data processing: AI uses data to optimize the next cleaning pattern.
[0542] Output: Send the improvement plan to the device and provide feedback to the user
[0543] Step 9:
[0544] Using the Emotion Engine
[0545] The device's built-in emotion engine analyzes the user's facial expressions and voice to recognize their emotional state.
[0546] Input: facial expression and speech data
[0547] Data processing: Emotion recognition algorithms analyze the data and determine emotions.
[0548] Output: Send emotion data to the server
[0549] Step 10:
[0550] Emotion-based feedback
[0551] The server analyzes the emotional data and provides appropriate feedback to the user.
[0552] Input: Emotion data
[0553] Data processing: Based on the analysis results, feedback tailored to the user's emotions is generated.
[0554] Output: Emotional feedback displayed on the device
[0555] The above are the specific processing steps for carrying out the present invention.
[0556] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0557] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0558] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0559] [Second embodiment]
[0560] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0561] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0562] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0563] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0564] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0565] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0566] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0567] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0568] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0569] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0570] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0571] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0572] The present invention relates to an automatic tooth brushing system that thoroughly brushes the user's teeth according to their shape and memorizes areas that are prone to cavities (are likely to be left unbrushed) through AI learning. Specific embodiments for realizing this system are described below.
[0573] 1. Acquisition of tooth profile data
[0574] The user activates the device's scanning function and opens their mouth to capture their teeth. The device has a built-in high-precision 3D scanner that scans the user's teeth in just a few seconds.
[0575] The device temporarily stores the scanned data in its internal memory and prepares it for subsequent transmission to the server.
[0576] 2. Sending and saving tooth profile data
[0577] The terminal encrypts the scanned tooth profile data and implements security measures to prevent data leakage.
[0578] The terminal transmits the encrypted tooth profile data to a server via the Internet.
[0579] The server receives and securely stores the tooth profile data sent to it, which is then stored in a separate database, allowing easy access to each user's data.
[0580] 3. Analyzing tooth profile data and identifying areas that are difficult to polish
[0581] The server retrieves the stored tooth profile data and inputs it into the AI analysis module.
[0582] The AI analysis module analyzes the tooth shape data to identify irregularities and areas that are difficult to brush, and then lists areas that require special attention.
[0583] Based on the analysis results, the server generates a list of areas that are difficult to polish and stores it in a database.
[0584] 4. Automatic tooth brushing
[0585] The user selects the tooth brushing mode on the terminal and presses the start button.
[0586] The device sends the user ID and a request to start brushing teeth to the server.
[0587] The server generates an optimal tooth brushing pattern based on the user's tooth shape data and analysis results and sends it to the terminal.
[0588] The terminal controls the automatic toothbrushing device according to the received toothbrushing pattern, and the automatic toothbrushing device performs the specified operations to effectively brush the user's teeth.
[0589] 5. Detecting and sending unpolished areas
[0590] After brushing, the device activates its built-in sensor to scan the user's teeth and detect any areas that have not been brushed.
[0591] The device encrypts the detected unpolished area data and sends it to the server.
[0592] 6. Analyzing data on remaining areas and providing feedback
[0593] The server inputs the received data on areas that have not been polished into the AI analysis module.
[0594] The AI analysis module analyzes the data and learns patterns that are likely to result in areas not being polished.
[0595] The server generates a tooth brushing improvement plan for the next time based on the learning results and sends the plan to the terminal.
[0596] The terminal displays the improvement plan received from the server to the user and provides specific advice on how to reduce areas that remain unbrushed.
[0597] Specific examples
[0598] When using the device for the first time, the user presses the scan button on the device to scan their teeth. The device then sends the scanned data to the server, which analyzes the data, identifies areas that are difficult to brush, and saves them.
[0599] During use, the user selects a toothbrushing mode, the device executes the optimal toothbrushing pattern, and the sensor detects areas that have not been brushed and sends the data to the server, which then generates an improvement plan and provides feedback to the user.
[0600] The system allows users to brush their teeth in an individually optimized way, minimizing missed spots, thereby reducing the risk of cavities and periodontal disease and improving the user's oral hygiene.
[0601] The processing flow will be explained below.
[0602] Step 1:
[0603] The user activates the device's scanning function, opens their mouth, and captures their teeth. The device is equipped with a high-precision 3D scanner that generates the user's teeth profile data in a few seconds. The data captured by the device is temporarily stored in its internal memory.
[0604] Step 2:
[0605] The device encrypts the stored tooth profile data. To ensure security, the device protects the data using a sophisticated encryption algorithm. The device then transmits the encrypted data to a server via the Internet.
[0606] Step 3:
[0607] The server receives the tooth profile data sent from the terminal. The server saves the data in a database and stores it in an organized format for each user. This allows for quick access to each user's individual data.
[0608] Step 4:
[0609] The server sends the saved tooth profile data to the AI analysis module, which then analyzes the data in detail to identify irregularities and areas that are difficult to brush. It then generates a list of the identified areas and sends it to the server.
[0610] Step 5:
[0611] Based on the analysis results, the server saves a list of difficult-to-brush areas in a database. It also generates an optimal tooth brushing pattern based on the analysis results. The generated tooth brushing pattern is unique to each user and is saved in a dedicated format.
[0612] Step 6:
[0613] The user selects the tooth brushing mode on the device and presses the start button. The device sends a tooth brushing start request including the user ID to the server.
[0614] Step 7:
[0615] The server retrieves the relevant tooth shape data and a list of difficult-to-brush areas based on the user ID, generates an optimal tooth brushing pattern, and sends the pattern to the device.
[0616] Step 8:
[0617] The terminal controls the automatic toothbrushing device according to the received toothbrushing pattern, so that the automatic toothbrushing device operates according to the settings and effectively brushes the user's teeth.
[0618] Step 9:
[0619] After brushing, the device activates its built-in sensor and scans the user's teeth again to detect any areas that have not been brushed. The device generates the detection data, encrypts it, and sends it to the server.
[0620] Step 10:
[0621] The server inputs the received missed brushing data into the AI analysis module, which analyzes the data and learns patterns that tend to cause missed brushing. Based on the analysis results, it generates an improvement plan for the next brushing.
[0622] Step 11:
[0623] The server sends the improvement plan to the user's device, which then displays the feedback and provides specific advice to the user. Based on this, the user can improve their next brushing routine to minimize missed spots.
[0624] Example 1
[0625] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0626] Conventional tooth brushing systems require a lot of manual operation by the user, which means that areas are likely to be left unbrushed. It is also difficult to identify areas that have been left unbrushed and provide solutions, making it difficult to improve overall oral hygiene. Furthermore, data security has not been sufficiently considered, raising concerns about the leakage of personal information.
[0627] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0628] In this invention, the server includes a means for storing tooth shape data in a database and inputting it into an AI analysis module for analysis, a means for identifying areas that are difficult to brush based on the analysis results, and a means for generating an improvement plan for the next tooth brushing session and sending it to the terminal as feedback to the user. This enables individually optimized tooth brushing, reduces missed spots, improves overall oral hygiene, and ensures the security of personal information.
[0629] "User" refers to an individual who uses the system to capture tooth profile data and automatically brush their teeth.
[0630] A "terminal" is a device used by a user, and refers to a device that acquires and transmits tooth shape data, executes tooth brushing patterns, and detects data on areas that have not been brushed.
[0631] "Tooth shape data" refers to 3D scan data that accurately shows the shape and position of the user's teeth.
[0632] "Server" refers to a central management system that stores and analyzes the received tooth profile data, generates various plans based on the analysis results, and sends them to the terminal.
[0633] "Encryption" refers to a technology that uses a specific algorithm to convert data such as tooth shape data and remaining tooth brushing data, making it unreadable, in order to ensure its security.
[0634] The "AI analysis module" refers to a part of the system that uses artificial intelligence technology to analyze tooth shape data and data on areas that have not been brushed, and identifies areas that are difficult to brush.
[0635] "Difficult-to-brush areas" refer to areas of the teeth that, due to their shape and position, are likely to be left unbrushed when using manual or automatic toothbrushes.
[0636] The "tooth brushing pattern" refers to an optimal operation sequence to be executed by the automatic tooth brushing device, which is generated based on the user's tooth shape data and the analysis results.
[0637] "Automatic tooth brushing device" refers to a device that is controlled by a terminal and effectively brushes a user's teeth automatically.
[0638] "Missed area data" refers to data containing information about missed areas detected after brushing teeth.
[0639] A "toothbrushing improvement plan" refers to a plan that includes specific instructions and a schedule for brushing your teeth more effectively the next time, based on data on areas that have not been brushed.
[0640] "Feedback" refers to specific advice and information provided to users based on analysis results and improvement plans.
[0641] The present invention relates to an automatic tooth brushing system that thoroughly brushes the user's teeth according to their shape and memorizes areas that are prone to cavities (are likely to be left unbrushed) through AI learning. Specific embodiments for realizing this system are described below.
[0642] 1. Acquisition of tooth profile data
[0643] The user activates the device's scanning function, opens their mouth, and scans their teeth with a 3D scanner. The device is equipped with a highly accurate 3D scanner that captures teeth impressions in a few seconds. The scanned data is temporarily stored in the device's internal memory. For example, when the user taps the "scan button," the 3D scanner begins scanning the teeth impressions and saves them in the device's internal memory.
[0644] 2. Sending and saving tooth profile data
[0645] The terminal encrypts the scanned tooth profile data and protects it using a secure encryption method such as AES-256. The encrypted data is then sent over the Internet to a server, which securely stores the received data in a database and efficiently manages each user's data.
[0646] 3. Analyzing tooth profile data and identifying areas that are difficult to polish
[0647] The server inputs the saved tooth profile data into the AI analysis module. The AI analysis module uses deep learning technology to analyze the tooth profile data and identify irregularities and areas that are difficult to brush. As a result of the analysis, a list of areas that are difficult to brush is generated and stored in a database. The AI analysis module processes the data in the background and sends a notification to the server that the analysis is complete.
[0648] 4. Automatic tooth brushing
[0649] When a user selects tooth brushing mode on the device and presses the "Start" button, the device sends a request to start brushing along with the user ID to the server. The server generates an optimal tooth brushing pattern based on the user's tooth shape data and analysis results, and sends it to the device. The device controls the automatic tooth brushing device according to the received pattern. The automatic tooth brushing device performs the specified operations, for example, using rotation and vibration to effectively brush the user's teeth.
[0650] 5. Detecting and sending unpolished areas
[0651] After brushing is complete, the device activates its built-in sensor and scans the user's teeth again. This scan detects any missed areas. The device then encrypts the missed area data again and sends it to the server. For example, the "Start missed area detection" button is automatically pressed, and the missed area data is sent to the server.
[0652] 6. Analyzing data on remaining areas and providing feedback
[0653] The server inputs the received missed brushing data into the AI analysis module for analysis. Based on the analysis results, it generates an improvement plan for the next tooth brushing session and sends it to the terminal. The terminal displays the received plan to the user and provides specific advice on how to reduce missed brushing sessions next time. For example, the server executes the "improvement plan generation" process and sends the improvement plan to the terminal.
[0654] Specific examples
[0655] First time use:
[0656] The user presses the scan button on the device, and the scanner scans the teeth profile. The device then encrypts the scanned data and sends it to a server, which analyzes it to identify areas that are difficult to brush and stores them.
[0657] Currently in use:
[0658] The user selects a toothbrushing mode, and the device receives the optimal toothbrushing pattern from the server. The device controls the automatic toothbrushing device and brushes the teeth according to the specified movements. After finishing, the sensor detects any areas that have not been brushed and sends the data to the server. The server analyzes the data on areas that have not been brushed, generates an improvement plan for the next time, and provides feedback.
[0659] Prompt Sentence Examples
[0660] "Please explain this automated tooth brushing system. Please explain in detail the process in which the user scans their teeth and the server analyzes the data to detect areas that have not been brushed and provides feedback."
[0661] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0662] Step 1:
[0663] The user activates the device's scanning function to capture their own dental profile data. When the user taps the scan button, the device's built-in high-precision 3D scanner starts operating and captures the user's dental profile data within a few seconds. The input is the user's mouth open, and the output is dental profile data obtained by 3D scanning. The device temporarily stores the captured dental profile data in its internal memory.
[0664] Step 2:
[0665] The terminal encrypts the scanned tooth profile data. The encryption method used is AES-256 or similar. The input is the acquired tooth profile data, and the output is the encrypted tooth profile data. The terminal sends the encrypted data to a server via the Internet. The server receives the data.
[0666] Step 3:
[0667] The server stores the received tooth profile data in a database. The input is encrypted tooth profile data, and the output is the data stored in the database. The data stored in the database is managed so that it can be easily accessed.
[0668] Step 4:
[0669] The server inputs the saved tooth profile data into an AI analysis module. The AI analysis module analyzes the data and identifies irregularities in the teeth and areas that are difficult to brush. The input is the saved tooth profile data, and the output is a list of areas that are difficult to brush. Based on the analysis results, the list of areas that are difficult to brush is saved in a database.
[0670] Step 5:
[0671] The user selects a tooth brushing mode on the device and presses the "Start" button. The input is the user's mode selection, and the output is a request to start brushing. The device sends the request to the server along with the user ID.
[0672] Step 6:
[0673] The server generates a tooth brushing pattern based on the user's tooth shape data and the analysis results. The input is the user's tooth shape data and the analysis results, and the output is the optimal tooth brushing pattern. The server sends the tooth brushing pattern to the terminal.
[0674] Step 7:
[0675] The terminal controls the automatic toothbrushing device according to the received toothbrushing pattern. The automatic toothbrushing device performs the specified operations to effectively brush the user's teeth. The input is the transmitted toothbrushing pattern, and the output is the control of the automatic toothbrushing device. Specifically, it performs operations such as vibration and rotation to brush specific teeth or areas with priority.
[0676] Step 8:
[0677] After brushing, the device activates its built-in sensor and scans the user's teeth again to detect any missed areas. The input is the state of the user's teeth after brushing, and the output is data on any missed areas. The device again encrypts the detected missed areas and sends them to the server.
[0678] Step 9:
[0679] The server inputs the received missed brushing data into the AI analysis module and analyzes the data. The input is missed brushing data, and the output is a tooth brushing improvement plan for the next time. The server generates an improvement plan based on the learning results and sends it to the device.
[0680] Step 10:
[0681] The device displays the received improvement plan to the user and provides specific advice on how to reduce missed spots next time. The input is the improvement plan from the server, and the output is feedback information to the user. Specifically, the device displays detailed instructions to the user, such as which areas they should focus on brushing.
[0682] (Application example 1)
[0683] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0684] Conventional tooth brushing methods tend to leave some areas unbrushed, which in the long term can lead to oral health problems such as cavities and periodontal disease. It is also difficult to provide optimal tooth brushing methods tailored to individual users, and in many cases, users brush their teeth without understanding the correct method. Furthermore, dental clinics face the challenge of not having a way to efficiently monitor and instruct patients on their dental condition.
[0685] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0686] In this invention, the server includes: means for a user to acquire tooth shape data using a terminal; means for transmitting the acquired tooth shape data to the server; means for the server to store and analyze the received tooth shape data; means for the server to identify areas that are difficult to brush based on the analysis results; means for the server to make the analysis results available to dentists in brick-and-mortar stores; means for the terminal to control an automatic tooth brushing device based on the analysis results of the server; means for the terminal to detect areas that have not been brushed after brushing and transmit them to the server; means for the server to generate an improvement plan for the next tooth brushing based on the data on areas that have not been brushed; means for the server to transmit the generated improvement plan to the terminal and provide feedback to the user; and means for the terminal to generate prompt sentences to input into the generative AI model. This allows users to share data scanned at home with a dental clinic and receive individually optimized tooth brushing instructions, reducing areas that have not been brushed and reducing the risk of cavities and periodontal disease.
[0687] A "user" is a person who uses this system to acquire tooth shape data and perform automatic tooth brushing and oral care.
[0688] A "terminal" is a device that allows a user to acquire tooth profile data and send it to a server, and includes mobile information terminals such as smartphones and tablets.
[0689] "Tooth shape data" is data that captures the shape and arrangement of the user's teeth with high accuracy.
[0690] The "server" is a central processing unit that receives, stores, and analyzes tooth profile data sent from the terminal.
[0691] "Analysis" refers to data processing that identifies areas that are difficult to brush or areas that have not been brushed based on the tooth shape data received by the server.
[0692] "Hard to brush areas" refers to areas of the teeth that are difficult for a user to effectively brush with a regular toothbrush.
[0693] A "physical dentist" is a medical professional at a dental clinic who refers to the data on the server and provides direct oral care and guidance to users.
[0694] An "automatic toothbrushing device" is a device that automatically and effectively brushes a user's teeth based on the analysis results of the server.
[0695] "Missed spots" refer to areas of the teeth that still have dirt or plaque remaining after brushing.
[0696] "Data on areas that have not been brushed" is data for identifying areas that have not been brushed, and is used to generate the next tooth brushing improvement plan.
[0697] The "next tooth brushing improvement plan" is a suggestion about the optimal tooth brushing method and procedure that the user should follow next time, generated by the server based on the results of analysis and learning.
[0698] A "generative AI model" is an artificial intelligence algorithm that suggests effective tooth brushing methods to users based on tooth shape data and data on areas that have not been brushed.
[0699] A "prompt sentence" is a sentence input to a generative AI model that contains instructions and guidelines to encourage users to take proper oral care.
[0700] The present invention relates to a system that combines the provision of individually optimized automatic tooth brushing based on a user's tooth shape with direct oral care support from a dentist in a brick-and-mortar store. A specific description will be given of an embodiment of the present invention.
[0701] First, the user uses a device to capture their own dental profile data. The device is equipped with a high-precision 3D scanner, and users can capture dental profile data in just a few seconds by opening their mouth and pressing the scan button. The captured dental profile data is encrypted to prevent data leaks, and the encrypted data is then sent to a server via the Internet.
[0702] The server stores the received tooth profile data and inputs it into the AI analysis module for analysis. The AI analysis module analyzes the tooth profile data and identifies areas that are difficult to brush or have many irregularities. This results in a list of areas that require special attention.
[0703] The server converts the analysis results into a format that can be referenced by dentists at brick-and-mortar clinics, who can then use this data to provide optimal oral care and guidance to patients, allowing users to receive detailed advice at dental clinics.
[0704] The terminal then controls the automatic toothbrushing device based on the server's analysis results. When the user selects a toothbrushing mode and presses the start button, the terminal generates an optimal toothbrushing pattern and sends commands to the automatic toothbrushing device. The automatic toothbrushing device then performs the instructed actions to effectively brush the user's teeth.
[0705] After brushing is complete, the device activates a sensor to detect missed areas and scans the user's teeth again. After identifying missed areas, the device re-encrypts the data and sends it to the server. The server then inputs the received missed areas data into the AI analysis module again, learning patterns that tend to result in missed areas. The server then generates a toothbrushing improvement plan for the next brushing session based on the learning results and sends this plan to the device.
[0706] The device also displays the improvement plan received from the server to the user and provides specific advice for effective tooth brushing. Furthermore, the device generates prompt sentences to input into the generative AI model, providing instructions and guidelines for promoting proper oral care. Examples of prompt sentences are as follows:
[0707] Example prompt sentence:
[0708] "You can 3D scan your teeth at home and send the data through the app. Your dentist will review the results and provide you with tailored advice at your next appointment."
[0709] This system allows users to efficiently manage their oral health and, in conjunction with dental consultations, allows them to receive comprehensive oral care, reducing the risk of tooth decay and periodontal disease by reducing missed spots when brushing.
[0710] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0711] Step 1:
[0712] The user uses the device to acquire tooth profile data. The user presses the scan button on the device, opens their mouth, and acquires tooth profile data. The device has a built-in high-precision 3D scanner that captures tooth profile data in a few seconds. The acquired data is temporarily stored in the device's internal memory.
[0713] Input: Intraoral image data
[0714] Output: 3D tooth profile data
[0715] Step 2:
[0716] The terminal encrypts the acquired tooth profile data and then sends it to the server. To prevent data leakage, the terminal encrypts the data using an encryption library. The encrypted data is then sent to the server via the Internet.
[0717] Input: 3D tooth profile data
[0718] Output: Encrypted 3D tooth profile data
[0719] Step 3:
[0720] The server stores and analyzes the received tooth profile data. The server decrypts the encrypted data and stores it securely. The stored data is input into an AI analysis system and analyzed to identify tooth shape, irregularities, and areas that are difficult to brush.
[0721] Input: Encrypted 3D tooth profile data
[0722] Output: Analysis result data (list of areas that are difficult to polish)
[0723] Step 4:
[0724] The server converts the analysis results into a format that can be viewed by the dentist in the brick-and-mortar clinic, and provides it to the dentist, who can then provide detailed advice and treatment suggestions to the patient.
[0725] Input: Analysis result data
[0726] Output: Information provided to dentist (report of analysis results)
[0727] Step 5:
[0728] The terminal controls the automatic toothbrushing device based on the analysis results from the server. The terminal sends the received toothbrushing pattern to the automatic toothbrushing device, and when the user presses the start button, the device performs the specified operation.
[0729] Input: Analysis result data
[0730] Output: Control commands for the automatic toothbrushing device
[0731] Step 6:
[0732] After brushing, the device detects any missed areas and sends the data to the server.The device then uses a 3D scanner to scan the missed areas again, encrypting the data and sending it to the server.
[0733] Input: Tooth shape data after brushing
[0734] Output: Data on areas that remain unpolished
[0735] Step 7:
[0736] The server generates a tooth brushing improvement plan for the next time based on the missed brushing area data. The server uses an AI analysis system to learn the missed brushing area data and creates an improvement plan to suggest the best tooth brushing method for the next time.
[0737] Input: Data on areas to be polished
[0738] Output: Improvement plan data
[0739] Step 8:
[0740] The server sends the generated improvement plan to the terminal and provides feedback to the user. The terminal displays the received improvement plan to the user and provides specific advice that will be useful for the next tooth brushing.
[0741] Input: Improvement Plan Data
[0742] Output: Feedback information for the user
[0743] Step 9:
[0744] The device generates prompts to input into the generative AI model, providing instructions and guidelines to encourage proper oral care to the user.
[0745] An example of a specific prompt might be, "3D scan your teeth at home and send the data through the app. Your dentist will review the results and provide you with tailored advice at your next appointment."
[0746] Input: Improvement Plan Data
[0747] Output: prompt statement
[0748] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0749] The present invention relates to a system that automatically brushes teeth according to the user's tooth shape, uses AI to learn and memorize areas that have not been brushed, and further combines it with an emotion engine that recognizes the user's emotions and provides feedback. Specific embodiments for realizing this system are described below.
[0750] 1. Acquisition of tooth profile data
[0751] The user activates the device's scanning function, opens their mouth, and captures their teeth. The device is equipped with a highly accurate 3D scanner, which generates the user's teeth profile data in a few seconds. The data captured by the device is temporarily stored in its internal memory.
[0752] 2. Sending and saving tooth profile data
[0753] The device encrypts the stored tooth profile data. To ensure security, the device protects the data using a sophisticated encryption algorithm. The device then transmits the encrypted data to a server via the Internet.
[0754] The server receives the tooth profile data sent from the device and stores it securely in a database. The saved data is stored in a format organized for each user.
[0755] 3. Analyzing tooth profile data and identifying areas that are difficult to polish
[0756] The server sends the saved tooth profile data to the AI analysis module, which then analyzes the data in detail to identify irregularities and areas that are difficult to brush. It then generates a list of the identified areas and sends it to the server.
[0757] Based on the analysis results, the server saves a list of difficult-to-brush areas in a database. Based on the analysis results, an optimal tooth brushing pattern is generated. The generated tooth brushing pattern is unique to each user and is saved in a dedicated format.
[0758] 4. Automatic tooth brushing
[0759] The user selects the tooth brushing mode on the device and presses the start button. The device sends a tooth brushing start request including the user ID to the server.
[0760] The server retrieves the relevant tooth shape data and a list of difficult-to-brush areas based on the user ID, generates an optimal tooth brushing pattern, and sends the pattern to the device.
[0761] The terminal controls the automatic toothbrushing device according to the received toothbrushing pattern, so that the automatic toothbrushing device operates according to the settings and effectively brushes the user's teeth.
[0762] 5. Detecting and sending unpolished areas
[0763] After the user has finished brushing, the device activates its built-in sensor and scans the user's teeth again to detect any areas that have not been brushed. The device generates the detection data, encrypts it, and sends it to the server.
[0764] 6. Analyzing data on remaining areas and providing feedback
[0765] The server inputs the received missed brushing data into the AI analysis module, which analyzes the data and learns patterns that tend to cause missed brushing. Based on the analysis results, it generates an improvement plan for the next brushing.
[0766] The server sends the improvement plan to the user's device, which then displays the feedback and provides specific advice to the user. Based on this, the user can improve their next brushing routine to minimize missed spots.
[0767] Incorporating an emotion engine
[0768] 7. Emotional Engine Activation
[0769] The device's built-in emotion engine analyzes the user's facial expressions and tone of voice in real time to recognize the user's emotional state. The emotion engine uses the camera and microphone to obtain emotional information from the user's subtle changes in facial expressions and voice.
[0770] The emotion engine sends the recognized emotion data to the server, which then adjusts the feedback to the user based on the emotion data.
[0771] 8. Providing Emotional Feedback
[0772] The server analyzes the received emotional data and determines the emotional state the user is in. For example, if the user is feeling stressed, it can provide relaxation advice or play calming music.
[0773] The device receives feedback from the server and displays it to the user, which is customized according to the user's emotional state, providing an effective and comfortable brushing experience.
[0774] Specific examples
[0775] When using the device for the first time, the user presses the scan button on the device to scan their teeth. The device then sends the scanned data to the server, which analyzes the data, identifies areas that are difficult to brush, and saves them.
[0776] While brushing their teeth, the user's emotions are analyzed by the emotion engine, and the device displays encouraging or relaxing comments according to the user's emotions, providing a more comfortable brushing experience.
[0777] After use, the user selects a toothbrushing mode, the device executes the optimal toothbrushing pattern, and the sensor detects areas that have not been brushed and sends the data to the server, which then generates an improvement plan and provides feedback to the user.
[0778] This system allows users to brush their teeth in a way that is optimized for them and provides feedback based on their emotional state, helping them brush their teeth comfortably while minimizing missed spots, thereby reducing the risk of cavities and periodontal disease and improving their oral hygiene.
[0779] The processing flow will be explained below.
[0780] Step 1:
[0781] The user activates the device's scanning function, opens their mouth, and captures their teeth profile. The device's high-precision 3D scanner generates the user's teeth profile data within a few seconds, and the device temporarily stores the data in its internal memory.
[0782] Step 2:
[0783] The device encrypts the stored tooth profile data, protects the data using a sophisticated encryption algorithm, and then transmits the encrypted data to a server over the Internet.
[0784] Step 3:
[0785] The server receives the tooth profile data sent from the terminal and stores it in a database. The server organizes and manages the data for each individual user.
[0786] Step 4:
[0787] The server sends the saved tooth profile data to an AI analysis module, which then analyzes the data in detail to identify irregularities and areas that are difficult to brush. A list of the identified areas is generated and sent back to the server.
[0788] Step 5:
[0789] The server then creates a list of areas that are difficult to brush based on the analysis results and saves it in a database. Based on this, the server then generates an optimal tooth brushing pattern for each user and saves this information in the database as well.
[0790] Step 6:
[0791] The user operates the device to select the tooth brushing mode and presses the start button. The device then sends this information to the server.
[0792] Step 7:
[0793] The server retrieves the relevant tooth shape data and analysis results based on the user ID, and then sends the optimal tooth brushing pattern to the device.
[0794] Step 8:
[0795] The terminal controls the automatic toothbrushing device based on the received toothbrushing pattern, and the automatic toothbrushing device starts to effectively brush the user's teeth.
[0796] Step 9:
[0797] After the user has finished brushing, the device activates its built-in sensor and scans the user's teeth again to detect any areas that have not been brushed. The device generates the detection data, encrypts it, and sends it to the server.
[0798] Step 10:
[0799] The server inputs the received missed brushing data into the AI analysis module, which learns the pattern of missed brushing and generates an improvement plan for the next brushing.
[0800] Step 11:
[0801] The server sends the improvement plan to the user's device, which displays this feedback to the user and provides specific advice so that the user can improve their next brushing routine.
[0802] Incorporating an emotion engine
[0803] Step 12:
[0804] The device's built-in emotion engine analyzes the user's facial expressions and tone of voice in real time to recognize their emotional state. The emotion engine uses the camera and microphone to obtain emotional information from the user's subtle changes in facial expressions and voice.
[0805] Step 13:
[0806] The emotion engine encrypts the emotion data it recognizes and sends it to the server, which receives and stores the emotion data.
[0807] Step 14:
[0808] The server analyzes the emotional data and generates feedback based on the user's emotional state. For example, if the user is feeling stressed, it generates advice to relax or an instruction to play calming music.
[0809] Step 15:
[0810] The device displays the feedback received from the server to the user, providing a comfortable tooth brushing experience by displaying customized comments and advice according to the user's emotional state.
[0811] Specific examples
[0812] When using the device for the first time, the user presses the scan button on the device to scan their teeth. The scanned data is sent to a server, which analyzes the data, identifies areas that are difficult to brush, and saves them.
[0813] While brushing, the emotion engine works to recognize the user's emotional state by analyzing their facial expressions and tone of voice. If the user feels stressed, the device will play relaxing comments or music received from the server, providing a comfortable brushing experience.
[0814] After brushing, the device detects any areas that have been missed and sends the data to the server. The server generates an improvement plan and provides feedback to the user, who can then use the feedback to improve their next brushing and minimize missed spots.
[0815] Example 2
[0816] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0817] Conventional automatic toothbrushing devices have poor adaptability to the shape of each user's mouth and areas that need brushing, and are unable to provide feedback based on the user's emotional state, making it difficult to provide effective cleaning and improve the user experience.In addition, they do not provide real-time feedback on the detection of areas that need brushing and how to improve them, which makes it difficult to take prompt action for the next cleaning.
[0818] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0819] In this invention, the server includes a means for storing and analyzing intraoral scan data, a means for identifying areas that are difficult to clean, and a means for generating an optimal cleaning pattern. This allows for optimal management of the automatic cleaning device based on the user's intraoral shape. Furthermore, by using a terminal with a built-in emotion analysis engine, feedback can be provided according to the user's emotional state, and missed areas can be detected and an improvement plan can be generated in real time, allowing for rapid response.
[0820] definition statement
[0821] "Intraoral scan data" is data that captures the shape of the user's oral cavity using a 3D scanner or similar device.
[0822] A "terminal" is a device used by a user that has built-in scanning functions, control functions for an automatic cleaning device, an emotion analysis engine, and the like.
[0823] A "server" is a computer system that receives, stores, and analyzes data sent from a terminal.
[0824] The "AI Analysis Module" is a software module that uses machine learning algorithms to analyze intraoral scan data and identify areas that are difficult to clean.
[0825] "Difficult-to-clean areas" refer to areas that are difficult for an automatic cleaning device to access due to the shape or structure of the mouth.
[0826] An "automatic cleaning device" is a device that automatically cleans the inside of a user's mouth based on a pre-set cleaning pattern.
[0827] "Remaining dirty areas" refers to areas that were not polished after cleaning by the automatic cleaning device.
[0828] An "emotion analysis engine" is a software module that analyzes a user's facial expressions and tone of voice to recognize their emotional state in real time.
[0829] "Feedback" refers to advice and information based on the user's emotional state and cleaning results that is provided to the user from the server via the terminal.
[0830] An "improvement plan" refers to a plan generated by the server to make the next cleaning more effective based on areas that need to be cleaned and cleaning patterns.
[0831] MODE FOR CARRYING OUT THE INVENTION
[0832] The present invention is an automatic teeth brushing system that optimally adapts to the shape of the user's oral cavity and provides feedback according to the user's emotional state. Specific embodiments for realizing the present invention are described below.
[0833] 1. User-initiated intraoral scan
[0834] The user activates the intraoral scan function using the device. The device has a built-in high-precision 3D scanner (e.g., high-precision 3D scanner), which generates intraoral scan data by having the user open their mouth and wait a few seconds. This data is temporarily stored in the device's internal memory.
[0835] 2. Data Encryption and Transmission
[0836] The device encrypts the intraoral scan data stored in its internal memory using the AES-256 algorithm and sends the data over the Internet to a server, which receives the data and stores it in a database (e.g., a cloud database).
[0837] 3. AI-based data analysis
[0838] The server sends the stored intraoral scan data to an AI analysis module (e.g., machine learning algorithm) for detailed analysis. This analysis identifies areas that are difficult to clean and generates an optimal cleaning pattern. The list of identified areas and cleaning patterns are stored in a database.
[0839] 4. Automatic cleaning
[0840] The user selects a cleaning mode on the device and presses the start button. The device sends a cleaning start request along with the user ID to the server. The server retrieves the relevant scan data and a list of difficult-to-clean areas based on the user ID, and sends the optimal cleaning pattern to the device. The device then controls an automatic cleaning device (e.g., an electric toothbrush) according to this pattern and brushes the user's teeth.
[0841] 5. Detecting and sending unpolished areas
[0842] After the device has finished cleaning, it activates its built-in sensor and scans the mouth again to detect any missed areas. The device generates missed area data, encrypts it, and sends it to the server. The server inputs the received data into an AI analysis module and learns patterns that are likely to result in missed areas. This generates an improvement plan that will be reflected in the next cleaning.
[0843] 6. Use of sentiment analysis engines
[0844] The device's built-in emotion analysis engine analyzes the user's facial expressions and tone of voice in real time, recognizing the user's emotional state and sending the resulting emotional data to the server. The server then adjusts the feedback based on the emotional data and provides it to the user.
[0845] 7. Providing Feedback
[0846] The server generates an improvement plan and sends feedback based on sentiment analysis to the device, which then displays it to the user, offering advice on how to improve the next cleaning or comments to help the user relax.
[0847] Specific examples
[0848] On first use, the user presses the scan button on the device to scan their teeth. The device then sends the scanned data to the server, which analyzes the data, identifies and saves areas that are difficult to brush. While brushing, the user's emotions are analyzed, and the device displays encouraging or relaxing comments based on the user's emotions, providing a more comfortable brushing experience. After use, the user selects the brushing mode, and the device executes the optimal brushing pattern, using the built-in sensor to detect areas that have not been brushed, and sends the data to the server. The server then generates an improvement plan and provides feedback to the user.
[0849] Prompt Sentence Examples
[0850] "Please start dental scan."
[0851] "I found some areas that were difficult to polish. Next time I will change the settings to make it easier to polish."
[0852] "You seem tired today. I'll play some recommended music to help you relax."
[0853] The present invention allows users to receive cleaning that is optimized for their oral cavity shape and emotional state, achieving comfortable oral care while minimizing missed areas.
[0854] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0855] Program processing flow
[0856] ---
[0857] Step 1: Acquire tooth profile data
[0858] input:
[0859] The user presses the scan button on the device.
[0860] Operation:
[0861] The user opens their mouth as instructed.
[0862] The device activates its built-in high-precision 3D scanner and scans the inside of the user's mouth for a few seconds.
[0863] Data processing:
[0864] The device generates scan data.
[0865] output:
[0866] The scanned data is temporarily saved in the device's internal memory.
[0867] Specific behavior:
[0868] The message "Start scanning" will appear on the device screen.
[0869] A 3D scanner captures the shape of the inside of your mouth and generates scan data.
[0870] The device will display "Scan complete" and the data will be saved.
[0871] ---
[0872] Step 2: Encrypt and send data
[0873] input:
[0874] Scan data (output of step 1)
[0875] Operation:
[0876] The device encrypts the scanned data.
[0877] The device sends the encrypted data to a server over the Internet.
[0878] Data processing:
[0879] Encrypts data using the AES-256 algorithm.
[0880] output:
[0881] The encrypted scan data is sent to the server.
[0882] Specific behavior:
[0883] The message "Encrypting data" appears on the device screen.
[0884] After encryption is complete, "Sending data" will be displayed and the progress bar will progress.
[0885] The server receives the data and notifies the terminal that "the data has been saved."
[0886] ---
[0887] Step 3: Data analysis using AI
[0888] input:
[0889] Encrypted scan data (output of step 2)
[0890] Operation:
[0891] The server decrypts the encrypted data and stores it in a database.
[0892] The server sends the scan data to the AI analysis module.
[0893] Data processing:
[0894] Use AI analysis modules (e.g., machine learning algorithms) to identify hard-to-clean areas.
[0895] output:
[0896] A list of difficult-to-clean areas and optimal cleaning patterns are generated and stored in a database.
[0897] Specific behavior:
[0898] The server displays the message "Data is being analyzed."
[0899] The AI analysis module analyzes the data and returns the results in JSON format.
[0900] "Analysis complete" will be displayed and the list and patterns will be saved.
[0901] ---
[0902] Step 4: Run Auto Cleaning
[0903] input:
[0904] User ID, list of difficult-to-clean areas, and optimal cleaning pattern (output of step 3)
[0905] Operation:
[0906] The user selects the cleaning mode on the terminal and presses the start button.
[0907] The device sends a request to the server.
[0908] The server sends relevant information to the terminal based on the user ID.
[0909] Data processing:
[0910] The automatic cleaning device is controlled based on an optimal cleaning pattern.
[0911] output:
[0912] The device executes a cleaning pattern and brushes the user's teeth.
[0913] Specific behavior:
[0914] The device screen will display "Select a cleaning mode."
[0915] When the user presses the start button, the message "Cleaning begins" is displayed.
[0916] The automatic cleaning device will operate and the cleaning progress will be displayed on the terminal.
[0917] ---
[0918] Step 5: Detect and send unpolished areas
[0919] input:
[0920] Cleaning completed (result of step 4)
[0921] Operation:
[0922] The device will activate its built-in sensor and scan the inside of your mouth again.
[0923] Any remaining dirt is detected, and data is generated and encrypted.
[0924] The device sends the encrypted data to the server.
[0925] Data processing:
[0926] Generate and encrypt data on areas that remain unpolished.
[0927] output:
[0928] The encrypted unpolished area data is sent to the server.
[0929] Specific behavior:
[0930] After brushing your teeth, the device screen will display "Scanning for remaining areas."
[0931] The sensor scans again and displays the message "Unpolished areas detected."
[0932] When sending data, the message "Sending data" is displayed.
[0933] ---
[0934] Step 6: Analyze remaining polishing data and provide feedback
[0935] input:
[0936] Encrypted unpolished data (output of step 5)
[0937] Operation:
[0938] The server decrypts the data and inputs it into an AI analysis module.
[0939] The server generates the next cleaning improvement plan based on the data analysis results.
[0940] Data processing:
[0941] The AI analysis module analyzes the data and generates an improvement plan.
[0942] output:
[0943] An improvement plan is generated and transmitted from the server to the terminal.
[0944] The feedback is displayed to the user.
[0945] Specific behavior:
[0946] The message "Analyzing remaining polishing data" is displayed on the server side.
[0947] Once the analysis is complete, you will be notified that an improvement plan has been generated.
[0948] The device will display "Feedback on how to clean next time."
[0949] ---
[0950] Step 7: Use a sentiment analysis engine
[0951] input:
[0952] User's facial expressions and voice (real-time data)
[0953] Operation:
[0954] The device's built-in emotion analysis engine analyzes the user's emotions.
[0955] The acquired emotion data is sent to the server.
[0956] Data processing:
[0957] Emotional data is generated from facial expressions and tone of voice.
[0958] output:
[0959] The emotion data is sent to the server.
[0960] Specific behavior:
[0961] The emotion engine will start and the message "Analyzing emotions" will be displayed.
[0962] The user's facial expressions and voice are captured and the message "Sending emotion data" is displayed.
[0963] ---
[0964] Step 8: Provide emotional feedback
[0965] input:
[0966] Emotion data (output of step 7)
[0967] Operation:
[0968] The server analyzes the emotional data and generates feedback according to the user's emotional state.
[0969] The server sends the feedback to the device.
[0970] Data processing:
[0971] Generate feedback based on the user's emotional state.
[0972] output:
[0973] The feedback is sent to the terminal and displayed to the user.
[0974] Specific behavior:
[0975] The device screen will display the message, "You have received emotion-based advice."
[0976] Specific feedback might include, "You seem to be feeling stressed today. We'll play some music to help you relax."
[0977] The above is the specific flow of processing and details of each step of this system. This system allows users to brush their teeth in an optimized way, and furthermore, by providing feedback according to their emotional state, users can brush their teeth comfortably while minimizing missed spots.
[0978] (Application example 2)
[0979] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0980] Current factory cleaning and equipment inspections require time and effort, and are prone to inappropriate cleaning and inspection. Therefore, a system is needed to improve cleaning efficiency and minimize areas left uncleaned. It is also necessary to improve the working environment by understanding the emotional state of factory workers in real time and providing appropriate feedback.
[0981] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0982] In this invention, the server includes means for a user to acquire object data using a terminal, means for transmitting the acquired object data to the server, means for the server to store and analyze the received object data, means for the server to identify areas that are difficult to clean based on the analysis results, means for the terminal to control the automatic cleaning device based on the analysis results of the server, means for the terminal to detect areas that remain uncleaned after cleaning and transmit the detected areas to the server, means for the server to generate a next cleaning improvement plan based on the uncleaned area data, means for the server to transmit the generated improvement plan to the terminal and provide feedback to the user, means for acquiring and analyzing user emotion data, and means for transmitting the emotion data to the server and providing feedback. This makes it possible to improve the efficiency of cleaning work in factories and minimize areas that remain uncleaned, and further improve the working environment through feedback according to the worker's emotional state.
[0983] Key Word Definitions
[0984] A "user" is a plant supervisor or operator who utilizes the automated cleaning system.
[0985] A "terminal" is a portable or stationary electronic device for acquiring, transmitting, analyzing, and providing feedback on data of an object.
[0986] "Object data" refers to scan data relating to the surface of the equipment or facility to be cleaned or inspected.
[0987] A "server" is a central processing unit that receives, stores, analyzes data sent from a terminal, and returns the results.
[0988] The "analysis means" is a program that identifies areas that are difficult to clean based on the object data received by the server and generates a cleaning improvement plan for the next time.
[0989] "Hard-to-clean areas" are areas on or inside an object that tend to accumulate dirt and dust and are difficult to clean.
[0990] An "automatic cleaning device" is a robot or device that automatically cleans an object according to instructions from a terminal or server.
[0991] The "uncleaned area" is an area where dirt or dust remains after cleaning.
[0992] An "improvement plan" is a plan generated by the server that indicates efficient and effective cleaning patterns and procedures for the next cleaning.
[0993] "Emotion data" refers to data relating to the emotional state of the user obtained from facial expressions and voice.
[0994] "Feedback" refers to analysis results, improvement plans, and advice and information based on the user's emotions that are sent from the server to the device.
[0995] MODE FOR CARRYING OUT THE INVENTION
[0996] This invention relates to a system that automatically cleans machinery and equipment in a factory and uses AI to learn and memorize areas that need to be cleaned. Furthermore, this system also incorporates an emotion engine that recognizes the user's emotions and provides feedback. A specific embodiment for realizing this system is described below.
[0997] System Program Overview
[0998] Hardware and software:
[0999] Hardware: cleaning robot with high-precision 3D scanner (e.g., robot with LIDAR sensor), camera feed (e.g., Logitech C920 camera)
[1000] Software: Python, OpenCV library, EmotionRecognizer library, HTTP request library (requests)
[1001] Procedure:
[1002] 1. Scan the object:
[1003] The user activates the cleaning robot's scanning function and scans the surface of the equipment or facility to be cleaned. The surface data is acquired using a high-precision 3D scanner and temporarily stored in local memory.
[1004] 2. Data transmission:
[1005] Scan data stored in local memory is encrypted and sent to a central server via the internet, using advanced encryption algorithms to ensure security.
[1006] 3. Data storage and analysis:
[1007] The server securely stores the received scan data in a database. The stored data is then input into an AI analysis module to identify areas that are difficult to clean. The AI analysis module then analyzes the data in detail and lists areas that need cleaning.
[1008] 4. Cleaning pattern generation:
[1009] The server generates an optimal cleaning pattern based on the analysis results. The generated cleaning pattern is unique to each user and is saved in a dedicated format. This pattern is then sent to the device.
[1010] 5. Cleaning execution:
[1011] The user selects the cleaning mode on the device and presses the start button, and the robot begins cleaning. The robot follows the cleaning pattern sent to it and cleans effectively.
[1012] 6. Detecting missing areas:
[1013] After cleaning, the robot uses its built-in sensors to scan the object again to detect any areas that remain uncleaned, generating detection data that is encrypted and sent to a server.
[1014] 7. Improvement plan generation and feedback:
[1015] The server analyzes the received remaining cleaning data and generates a cleaning improvement plan for the next cleaning. The generated improvement plan is sent to the terminal and feedback is provided to the user.
[1016] 8. Use of Emotion Engine:
[1017] The device's built-in emotion engine analyzes the user's facial expressions and tone of voice in real time to recognize their emotional state. The device uses a camera and microphone to capture emotion data from subtle changes in the user's facial expressions and voice, and sends it to a server.
[1018] 9. Emotion-based feedback:
[1019] The server analyzes the emotional data and provides feedback based on the user's emotional state. For example, if the user is feeling stressed, it will provide relaxation advice or play calming music.
[1020] Examples:
[1021] First time use: The user presses the scan button on the device to scan the object to be cleaned. The device sends the scanned data to the server, which analyzes the data to identify and store areas that are difficult to clean.
[1022] During cleaning: The user's emotions are analyzed by the emotion engine. Depending on the user's emotions, the device displays encouraging and relaxing comments, providing a comfortable cleaning experience.
[1023] After use: The user selects a cleaning mode, and the device performs the optimal cleaning pattern. The sensor detects any remaining cleaning areas and sends the data to the server. The server generates an improvement plan and provides feedback to the user.
[1024] Example prompts to be input to the generative AI model:
[1025] Please start the scanning service.
[1026] "We conduct sentiment analysis of employees."
[1027] "We are currently obtaining cleaning patterns for the equipment."
[1028] The robot is cleaning.
[1029] "We received your feedback and our work environment has improved."
[1030] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1031] System program processing steps
[1032] Step 1:
[1033] Scanning an object
[1034] The user activates the cleaning robot's scan function.
[1035] Input: Start scan command
[1036] Data processing: A unique 3D scanner scans the surface of the object and obtains highly accurate 3D data.
[1037] Output: Scanned 3D data
[1038] Step 2:
[1039] Sending data
[1040] The scanned data acquired by the terminal is encrypted and sent to the server.
[1041] Input: scanned 3D data
[1042] Data processing: Applying advanced encryption algorithms to protect your data.
[1043] Output: Sends the encrypted data to the server
[1044] Step 3:
[1045] Data storage and analysis
[1046] The server stores the received scan data in a database and inputs it into the AI analysis module.
[1047] Input: Encrypted 3D data
[1048] Data processing: The received data is decrypted, stored in a secure database, and analyzed in detail using an AI analysis module.
[1049] Output: Analyzed result data
[1050] Step 4:
[1051] Identifying hard-to-clean areas
[1052] The server uses an AI analysis module to identify areas that are difficult to clean.
[1053] Input: Parsed result data
[1054] Data processing: AI uses data to create a list of areas that are difficult to clean.
[1055] Output: List of hard-to-clean areas
[1056] Step 5:
[1057] Cleaning pattern generation
[1058] The server generates the optimal cleaning pattern based on the analysis results and sends it to the terminal.
[1059] Input: List of hard-to-clean areas
[1060] Data processing: Run the cleaning pattern generation algorithm to generate individual cleaning instructions.
[1061] Output: Sends cleaning pattern to terminal
[1062] Step 6:
[1063] Cleaning execution
[1064] The user selects a cleaning mode on the terminal, and the cleaning robot starts cleaning according to the transmitted cleaning pattern.
[1065] Input: cleaning pattern and start cleaning command
[1066] Data processing: The terminal controls the cleaning robot's operation and cleans the equipment according to the transmitted pattern.
[1067] Output: Cleaned equipment
[1068] Step 7:
[1069] Detecting areas that need cleaning
[1070] After cleaning, the robot uses its built-in sensors to re-scan the object to detect any areas that remain uncleaned.
[1071] Input: Post-cleaning scan command
[1072] Data Processing: Built-in sensors identify missed cleaning areas and assemble the data.
[1073] Output: Data on areas that remain uncleaned
[1074] Step 8:
[1075] Improvement plan generation and feedback
[1076] The server analyzes the remaining cleaning data received and generates a cleaning improvement plan for the next cleaning.
[1077] Input: Data on remaining areas to be cleaned
[1078] Data processing: AI uses data to optimize the next cleaning pattern.
[1079] Output: Send the improvement plan to the device and provide feedback to the user
[1080] Step 9:
[1081] Using the Emotion Engine
[1082] The device's built-in emotion engine analyzes the user's facial expressions and voice to recognize their emotional state.
[1083] Input: facial expression and speech data
[1084] Data processing: Emotion recognition algorithms analyze the data and determine emotions.
[1085] Output: Send emotion data to the server
[1086] Step 10:
[1087] Emotion-Based Feedback
[1088] The server analyzes the emotional data and provides appropriate feedback to the user.
[1089] Input: Emotion data
[1090] Data processing: Based on the analysis results, feedback tailored to the user's emotions is generated.
[1091] Output: Emotional feedback displayed on the device
[1092] The above are the specific processing steps for carrying out the present invention.
[1093] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1094] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1095] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1096] [Third embodiment]
[1097] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1098] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[1099] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1100] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1101] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1102] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1103] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1104] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1105] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1106] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1107] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1108] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[1109] The present invention relates to an automatic tooth brushing system that thoroughly brushes the user's teeth according to their shape and memorizes areas that are prone to cavities (are likely to be left unbrushed) through AI learning. Specific embodiments for realizing this system are described below.
[1110] 1. Acquisition of tooth profile data
[1111] The user activates the device's scanning function and opens their mouth to capture their teeth. The device has a built-in high-precision 3D scanner that scans the user's teeth in just a few seconds.
[1112] The device temporarily stores the scanned data in its internal memory and prepares it for subsequent transmission to the server.
[1113] 2. Sending and saving tooth profile data
[1114] The terminal encrypts the scanned tooth profile data and implements security measures to prevent data leakage.
[1115] The terminal transmits the encrypted tooth profile data to a server via the Internet.
[1116] The server receives and securely stores the tooth profile data sent to it, which is then stored in a separate database, allowing easy access to each user's data.
[1117] 3. Analyzing tooth profile data and identifying areas that are difficult to polish
[1118] The server retrieves the stored tooth profile data and inputs it into the AI analysis module.
[1119] The AI analysis module analyzes the tooth shape data to identify irregularities and areas that are difficult to brush, and then lists areas that require special attention.
[1120] Based on the analysis results, the server generates a list of areas that are difficult to polish and stores it in a database.
[1121] 4. Automatic tooth brushing
[1122] The user selects the tooth brushing mode on the terminal and presses the start button.
[1123] The device sends the user ID and a request to start brushing teeth to the server.
[1124] The server generates an optimal tooth brushing pattern based on the user's tooth shape data and analysis results and sends it to the terminal.
[1125] The terminal controls the automatic toothbrushing device according to the received toothbrushing pattern, and the automatic toothbrushing device performs the specified operations to effectively brush the user's teeth.
[1126] 5. Detecting and sending unpolished areas
[1127] After brushing, the device activates its built-in sensor to scan the user's teeth and detect any areas that have not been brushed.
[1128] The device encrypts the detected unpolished area data and sends it to the server.
[1129] 6. Analyzing data on remaining areas and providing feedback
[1130] The server inputs the received data on areas that have not been polished into the AI analysis module.
[1131] The AI analysis module analyzes the data and learns patterns that are likely to result in areas not being polished.
[1132] The server generates a tooth brushing improvement plan for the next time based on the learning results and sends the plan to the terminal.
[1133] The terminal displays the improvement plan received from the server to the user and provides specific advice on how to reduce areas that remain unbrushed.
[1134] Specific examples
[1135] When using the device for the first time, the user presses the scan button on the device to scan their teeth. The device then sends the scanned data to the server, which analyzes the data, identifies areas that are difficult to brush, and saves them.
[1136] During use, the user selects a toothbrushing mode, the device executes the optimal toothbrushing pattern, and the sensor detects areas that have not been brushed and sends the data to the server, which then generates an improvement plan and provides feedback to the user.
[1137] The system allows users to brush their teeth in an individually optimized way, minimizing missed spots, thereby reducing the risk of cavities and periodontal disease and improving the user's oral hygiene.
[1138] The processing flow will be explained below.
[1139] Step 1:
[1140] The user activates the device's scanning function, opens their mouth, and captures their teeth. The device is equipped with a high-precision 3D scanner that generates the user's teeth profile data in a few seconds. The data captured by the device is temporarily stored in its internal memory.
[1141] Step 2:
[1142] The device encrypts the stored tooth profile data. To ensure security, the device protects the data using a sophisticated encryption algorithm. The device then transmits the encrypted data to a server via the Internet.
[1143] Step 3:
[1144] The server receives the tooth profile data sent from the terminal. The server saves the data in a database and stores it in an organized format for each user. This allows for quick access to each user's individual data.
[1145] Step 4:
[1146] The server sends the saved tooth profile data to the AI analysis module, which then analyzes the data in detail to identify irregularities and areas that are difficult to brush. It then generates a list of the identified areas and sends it to the server.
[1147] Step 5:
[1148] Based on the analysis results, the server saves a list of difficult-to-brush areas in a database. It also generates an optimal tooth brushing pattern based on the analysis results. The generated tooth brushing pattern is unique to each user and is saved in a dedicated format.
[1149] Step 6:
[1150] The user selects the tooth brushing mode on the device and presses the start button. The device sends a tooth brushing start request including the user ID to the server.
[1151] Step 7:
[1152] The server retrieves the relevant tooth shape data and a list of difficult-to-brush areas based on the user ID, generates an optimal tooth brushing pattern, and sends the pattern to the device.
[1153] Step 8:
[1154] The terminal controls the automatic toothbrushing device according to the received toothbrushing pattern, so that the automatic toothbrushing device operates according to the settings and effectively brushes the user's teeth.
[1155] Step 9:
[1156] After brushing, the device activates its built-in sensor and scans the user's teeth again to detect any areas that have not been brushed. The device generates the detection data, encrypts it, and sends it to the server.
[1157] Step 10:
[1158] The server inputs the received missed brushing data into the AI analysis module, which analyzes the data and learns patterns that tend to cause missed brushing. Based on the analysis results, it generates an improvement plan for the next brushing.
[1159] Step 11:
[1160] The server sends the improvement plan to the user's device, which then displays the feedback and provides specific advice to the user. Based on this, the user can improve their next brushing routine to minimize missed spots.
[1161] Example 1
[1162] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1163] Conventional tooth brushing systems require a lot of manual operation by the user, which means that areas are likely to be left unbrushed. It is also difficult to identify areas that have been left unbrushed and provide solutions, making it difficult to improve overall oral hygiene. Furthermore, data security has not been sufficiently considered, raising concerns about the leakage of personal information.
[1164] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1165] In this invention, the server includes a means for storing tooth shape data in a database and inputting it into an AI analysis module for analysis, a means for identifying areas that are difficult to brush based on the analysis results, and a means for generating an improvement plan for the next tooth brushing session and sending it to the terminal as feedback to the user. This enables individually optimized tooth brushing, reduces missed spots, improves overall oral hygiene, and ensures the security of personal information.
[1166] "User" refers to an individual who uses the system to capture tooth profile data and automatically brush their teeth.
[1167] A "terminal" is a device used by a user, and refers to a device that acquires and transmits tooth shape data, executes tooth brushing patterns, and detects data on areas that have not been brushed.
[1168] "Tooth shape data" refers to 3D scan data that accurately shows the shape and position of the user's teeth.
[1169] "Server" refers to a central management system that stores and analyzes the received tooth profile data, generates various plans based on the analysis results, and sends them to the terminal.
[1170] "Encryption" refers to a technology that uses a specific algorithm to convert data such as tooth shape data and remaining tooth brushing data, making it unreadable, in order to ensure its security.
[1171] The "AI analysis module" refers to a part of the system that uses artificial intelligence technology to analyze tooth shape data and data on areas that have not been brushed, and identifies areas that are difficult to brush.
[1172] "Difficult-to-brush areas" refer to areas of the teeth that, due to their shape and position, are likely to be left unbrushed when using manual or automatic toothbrushes.
[1173] The "tooth brushing pattern" refers to an optimal operation sequence to be executed by the automatic tooth brushing device, which is generated based on the user's tooth shape data and the analysis results.
[1174] "Automatic tooth brushing device" refers to a device that is controlled by a terminal and effectively brushes a user's teeth automatically.
[1175] "Missed area data" refers to data containing information about missed areas detected after brushing teeth.
[1176] A "toothbrushing improvement plan" refers to a plan that includes specific instructions and a schedule for brushing your teeth more effectively the next time, based on data on areas that have not been brushed.
[1177] "Feedback" refers to specific advice and information provided to users based on analysis results and improvement plans.
[1178] The present invention relates to an automatic tooth brushing system that thoroughly brushes the user's teeth according to their shape and memorizes areas that are prone to cavities (are likely to be left unbrushed) through AI learning. Specific embodiments for realizing this system are described below.
[1179] 1. Acquisition of tooth profile data
[1180] The user activates the device's scanning function, opens their mouth, and scans their teeth with a 3D scanner. The device is equipped with a highly accurate 3D scanner that captures teeth impressions in a few seconds. The scanned data is temporarily stored in the device's internal memory. For example, when the user taps the "scan button," the 3D scanner begins scanning the teeth impressions and saves them in the device's internal memory.
[1181] 2. Sending and saving tooth profile data
[1182] The terminal encrypts the scanned tooth profile data and protects it using a secure encryption method such as AES-256. The encrypted data is then sent over the Internet to a server, which securely stores the received data in a database and efficiently manages each user's data.
[1183] 3. Analyzing tooth profile data and identifying areas that are difficult to polish
[1184] The server inputs the saved tooth profile data into the AI analysis module. The AI analysis module uses deep learning technology to analyze the tooth profile data and identify irregularities and areas that are difficult to brush. As a result of the analysis, a list of areas that are difficult to brush is generated and stored in a database. The AI analysis module processes the data in the background and sends a notification to the server that the analysis is complete.
[1185] 4. Automatic tooth brushing
[1186] When a user selects tooth brushing mode on the device and presses the "Start" button, the device sends a request to start brushing along with the user ID to the server. The server generates an optimal tooth brushing pattern based on the user's tooth shape data and analysis results, and sends it to the device. The device controls the automatic tooth brushing device according to the received pattern. The automatic tooth brushing device performs the specified operations, for example, using rotation and vibration to effectively brush the user's teeth.
[1187] 5. Detecting and sending unpolished areas
[1188] After brushing is complete, the device activates its built-in sensor and scans the user's teeth again. This scan detects any missed areas. The device then encrypts the missed area data again and sends it to the server. For example, the "Start missed area detection" button is automatically pressed, and the missed area data is sent to the server.
[1189] 6. Analyzing data on remaining areas and providing feedback
[1190] The server inputs the received missed brushing data into the AI analysis module for analysis. Based on the analysis results, it generates an improvement plan for the next tooth brushing session and sends it to the terminal. The terminal displays the received plan to the user and provides specific advice on how to reduce missed brushing sessions next time. For example, the server executes the "improvement plan generation" process and sends the improvement plan to the terminal.
[1191] Specific examples
[1192] First time use:
[1193] The user presses the scan button on the device, and the scanner scans the teeth profile. The device then encrypts the scanned data and sends it to a server, which analyzes it to identify areas that are difficult to brush and stores them.
[1194] Currently in use:
[1195] The user selects a toothbrushing mode, and the device receives the optimal toothbrushing pattern from the server. The device controls the automatic toothbrushing device and brushes the teeth according to the specified movements. After finishing, the sensor detects any areas that have not been brushed and sends the data to the server. The server analyzes the data on areas that have not been brushed, generates an improvement plan for the next time, and provides feedback.
[1196] Prompt Sentence Examples
[1197] "Please explain this automated tooth brushing system. Please explain in detail the process in which the user scans their teeth and the server analyzes the data to detect areas that have not been brushed and provides feedback."
[1198] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1199] Step 1:
[1200] The user activates the device's scanning function to capture their own dental profile data. When the user taps the scan button, the device's built-in high-precision 3D scanner starts operating and captures the user's dental profile data within a few seconds. The input is the user's mouth open, and the output is dental profile data obtained by 3D scanning. The device temporarily stores the captured dental profile data in its internal memory.
[1201] Step 2:
[1202] The terminal encrypts the scanned tooth profile data. The encryption method used is AES-256 or similar. The input is the acquired tooth profile data, and the output is the encrypted tooth profile data. The terminal sends the encrypted data to a server via the Internet. The server receives the data.
[1203] Step 3:
[1204] The server stores the received tooth profile data in a database. The input is encrypted tooth profile data, and the output is the data stored in the database. The data stored in the database is managed so that it can be easily accessed.
[1205] Step 4:
[1206] The server inputs the saved tooth profile data into an AI analysis module. The AI analysis module analyzes the data and identifies irregularities in the teeth and areas that are difficult to brush. The input is the saved tooth profile data, and the output is a list of areas that are difficult to brush. Based on the analysis results, the list of areas that are difficult to brush is saved in a database.
[1207] Step 5:
[1208] The user selects a tooth brushing mode on the device and presses the "Start" button. The input is the user's mode selection, and the output is a request to start brushing. The device sends the request to the server along with the user ID.
[1209] Step 6:
[1210] The server generates a tooth brushing pattern based on the user's tooth shape data and the analysis results. The input is the user's tooth shape data and the analysis results, and the output is the optimal tooth brushing pattern. The server sends the tooth brushing pattern to the terminal.
[1211] Step 7:
[1212] The terminal controls the automatic toothbrushing device according to the received toothbrushing pattern. The automatic toothbrushing device performs the specified operations to effectively brush the user's teeth. The input is the transmitted toothbrushing pattern, and the output is the control of the automatic toothbrushing device. Specifically, it performs operations such as vibration and rotation to brush specific teeth or areas with priority.
[1213] Step 8:
[1214] After brushing, the device activates its built-in sensor and scans the user's teeth again to detect any missed areas. The input is the state of the user's teeth after brushing, and the output is data on any missed areas. The device again encrypts the detected missed areas and sends them to the server.
[1215] Step 9:
[1216] The server inputs the received missed brushing data into the AI analysis module and analyzes the data. The input is missed brushing data, and the output is a tooth brushing improvement plan for the next time. The server generates an improvement plan based on the learning results and sends it to the device.
[1217] Step 10:
[1218] The device displays the received improvement plan to the user and provides specific advice on how to reduce missed spots next time. The input is the improvement plan from the server, and the output is feedback information to the user. Specifically, the device displays detailed instructions to the user, such as which areas they should focus on brushing.
[1219] (Application example 1)
[1220] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1221] Conventional tooth brushing methods tend to leave some areas unbrushed, which in the long term can lead to oral health problems such as cavities and periodontal disease. It is also difficult to provide optimal tooth brushing methods tailored to individual users, and in many cases, users brush their teeth without understanding the correct method. Furthermore, dental clinics face the challenge of not having a way to efficiently monitor and instruct patients on their dental condition.
[1222] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1223] In this invention, the server includes: means for a user to acquire tooth shape data using a terminal; means for transmitting the acquired tooth shape data to the server; means for the server to store and analyze the received tooth shape data; means for the server to identify areas that are difficult to brush based on the analysis results; means for the server to make the analysis results available to dentists in brick-and-mortar stores; means for the terminal to control an automatic tooth brushing device based on the analysis results of the server; means for the terminal to detect areas that have not been brushed after brushing and transmit them to the server; means for the server to generate an improvement plan for the next tooth brushing based on the data on areas that have not been brushed; means for the server to transmit the generated improvement plan to the terminal and provide feedback to the user; and means for the terminal to generate prompt sentences to input into the generative AI model. This allows users to share data scanned at home with a dental clinic and receive individually optimized tooth brushing instructions, reducing areas that have not been brushed and reducing the risk of cavities and periodontal disease.
[1224] A "user" is a person who uses this system to acquire tooth shape data and perform automatic tooth brushing and oral care.
[1225] A "terminal" is a device that allows a user to acquire tooth profile data and send it to a server, and includes mobile information terminals such as smartphones and tablets.
[1226] "Tooth shape data" is data that captures the shape and arrangement of the user's teeth with high accuracy.
[1227] The "server" is a central processing unit that receives, stores, and analyzes tooth profile data sent from the terminal.
[1228] "Analysis" refers to data processing that identifies areas that are difficult to brush or areas that have not been brushed based on the tooth shape data received by the server.
[1229] "Hard to brush areas" refers to areas of the teeth that are difficult for a user to effectively brush with a regular toothbrush.
[1230] A "physical dentist" is a medical professional at a dental clinic who refers to the data on the server and provides direct oral care and guidance to users.
[1231] An "automatic toothbrushing device" is a device that automatically and effectively brushes a user's teeth based on the analysis results of the server.
[1232] "Missed spots" refer to areas of the teeth that still have dirt or plaque remaining after brushing.
[1233] "Data on areas that have not been brushed" is data for identifying areas that have not been brushed, and is used to generate the next tooth brushing improvement plan.
[1234] The "next tooth brushing improvement plan" is a suggestion about the optimal tooth brushing method and procedure that the user should follow next time, generated by the server based on the results of analysis and learning.
[1235] A "generative AI model" is an artificial intelligence algorithm that suggests effective tooth brushing methods to users based on tooth shape data and data on areas that have not been brushed.
[1236] A "prompt sentence" is a sentence input to a generative AI model that contains instructions and guidelines to encourage users to take proper oral care.
[1237] The present invention relates to a system that combines the provision of individually optimized automatic tooth brushing based on a user's tooth shape with direct oral care support from a dentist in a brick-and-mortar store. A specific description will be given of an embodiment of the present invention.
[1238] First, the user uses a device to capture their own dental profile data. The device is equipped with a high-precision 3D scanner, and users can capture dental profile data in just a few seconds by opening their mouth and pressing the scan button. The captured dental profile data is encrypted to prevent data leaks, and the encrypted data is then sent to a server via the Internet.
[1239] The server stores the received tooth profile data and inputs it into the AI analysis module for analysis. The AI analysis module analyzes the tooth profile data and identifies areas that are difficult to brush or have many irregularities. This results in a list of areas that require special attention.
[1240] The server converts the analysis results into a format that can be referenced by dentists at brick-and-mortar clinics, who can then use this data to provide optimal oral care and guidance to patients, allowing users to receive detailed advice at dental clinics.
[1241] The terminal then controls the automatic toothbrushing device based on the server's analysis results. When the user selects a toothbrushing mode and presses the start button, the terminal generates an optimal toothbrushing pattern and sends commands to the automatic toothbrushing device. The automatic toothbrushing device then performs the instructed actions to effectively brush the user's teeth.
[1242] After brushing is complete, the device activates a sensor to detect missed areas and scans the user's teeth again. After identifying missed areas, the device re-encrypts the data and sends it to the server. The server then inputs the received missed areas data into the AI analysis module again, learning patterns that tend to result in missed areas. The server then generates a toothbrushing improvement plan for the next brushing session based on the learning results and sends this plan to the device.
[1243] The device also displays the improvement plan received from the server to the user and provides specific advice for effective tooth brushing. Furthermore, the device generates prompt sentences to input into the generative AI model, providing instructions and guidelines for promoting proper oral care. Examples of prompt sentences are as follows:
[1244] Example prompt sentence:
[1245] "You can 3D scan your teeth at home and send the data through the app. Your dentist will review the results and provide you with tailored advice at your next appointment."
[1246] This system allows users to efficiently manage their oral health and, in conjunction with dental consultations, allows them to receive comprehensive oral care, reducing the risk of tooth decay and periodontal disease by reducing missed spots when brushing.
[1247] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1248] Step 1:
[1249] The user uses the device to acquire tooth profile data. The user presses the scan button on the device, opens their mouth, and acquires tooth profile data. The device has a built-in high-precision 3D scanner that captures tooth profile data in a few seconds. The acquired data is temporarily stored in the device's internal memory.
[1250] Input: Intraoral image data
[1251] Output: 3D tooth profile data
[1252] Step 2:
[1253] The terminal encrypts the acquired tooth profile data and then sends it to the server. To prevent data leakage, the terminal encrypts the data using an encryption library. The encrypted data is then sent to the server via the Internet.
[1254] Input: 3D tooth profile data
[1255] Output: Encrypted 3D tooth profile data
[1256] Step 3:
[1257] The server stores and analyzes the received tooth profile data. The server decrypts the encrypted data and stores it securely. The stored data is input into an AI analysis system and analyzed to identify tooth shape, irregularities, and areas that are difficult to brush.
[1258] Input: Encrypted 3D tooth profile data
[1259] Output: Analysis result data (list of areas that are difficult to polish)
[1260] Step 4:
[1261] The server converts the analysis results into a format that can be viewed by the dentist in the brick-and-mortar clinic, and provides it to the dentist, who can then provide detailed advice and treatment suggestions to the patient.
[1262] Input: Analysis result data
[1263] Output: Information provided to dentist (report of analysis results)
[1264] Step 5:
[1265] The terminal controls the automatic toothbrushing device based on the analysis results from the server. The terminal sends the received toothbrushing pattern to the automatic toothbrushing device, and when the user presses the start button, the device performs the specified operation.
[1266] Input: Analysis result data
[1267] Output: Control commands for the automatic toothbrushing device
[1268] Step 6:
[1269] After brushing, the device detects any missed areas and sends the data to the server.The device then uses a 3D scanner to scan the missed areas again, encrypting the data and sending it to the server.
[1270] Input: Tooth shape data after brushing
[1271] Output: Data on areas that remain unpolished
[1272] Step 7:
[1273] The server generates a tooth brushing improvement plan for the next time based on the missed brushing area data. The server uses an AI analysis system to learn the missed brushing area data and creates an improvement plan to suggest the best tooth brushing method for the next time.
[1274] Input: Data on areas to be polished
[1275] Output: Improvement plan data
[1276] Step 8:
[1277] The server sends the generated improvement plan to the terminal and provides feedback to the user. The terminal displays the received improvement plan to the user and provides specific advice that will be useful for the next tooth brushing.
[1278] Input: Improvement Plan Data
[1279] Output: Feedback information for the user
[1280] Step 9:
[1281] The device generates prompts to input into the generative AI model, providing instructions and guidelines to encourage proper oral care to the user.
[1282] An example of a specific prompt might be, "3D scan your teeth at home and send the data through the app. Your dentist will review the results and provide you with tailored advice at your next appointment."
[1283] Input: Improvement Plan Data
[1284] Output: prompt statement
[1285] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1286] The present invention relates to a system that automatically brushes teeth according to the user's tooth shape, uses AI to learn and memorize areas that have not been brushed, and further combines it with an emotion engine that recognizes the user's emotions and provides feedback. Specific embodiments for realizing this system are described below.
[1287] 1. Acquisition of tooth profile data
[1288] The user activates the device's scanning function, opens their mouth, and captures their teeth. The device is equipped with a highly accurate 3D scanner, which generates the user's teeth profile data in a few seconds. The data captured by the device is temporarily stored in its internal memory.
[1289] 2. Sending and saving tooth profile data
[1290] The device encrypts the stored tooth profile data. To ensure security, the device protects the data using a sophisticated encryption algorithm. The device then transmits the encrypted data to a server via the Internet.
[1291] The server receives the tooth profile data sent from the device and stores it securely in a database. The saved data is stored in a format organized for each user.
[1292] 3. Analyzing tooth profile data and identifying areas that are difficult to polish
[1293] The server sends the saved tooth profile data to the AI analysis module, which then analyzes the data in detail to identify irregularities and areas that are difficult to brush. It then generates a list of the identified areas and sends it to the server.
[1294] Based on the analysis results, the server saves a list of difficult-to-brush areas in a database. Based on the analysis results, an optimal tooth brushing pattern is generated. The generated tooth brushing pattern is unique to each user and is saved in a dedicated format.
[1295] 4. Automatic tooth brushing
[1296] The user selects the tooth brushing mode on the device and presses the start button. The device sends a tooth brushing start request including the user ID to the server.
[1297] The server retrieves the relevant tooth shape data and a list of difficult-to-brush areas based on the user ID, generates an optimal tooth brushing pattern, and sends the pattern to the device.
[1298] The terminal controls the automatic toothbrushing device according to the received toothbrushing pattern, so that the automatic toothbrushing device operates according to the settings and effectively brushes the user's teeth.
[1299] 5. Detecting and sending unpolished areas
[1300] After the user has finished brushing, the device activates its built-in sensor and scans the user's teeth again to detect any areas that have not been brushed. The device generates the detection data, encrypts it, and sends it to the server.
[1301] 6. Analyzing data on remaining areas and providing feedback
[1302] The server inputs the received missed brushing data into the AI analysis module, which analyzes the data and learns patterns that tend to cause missed brushing. Based on the analysis results, it generates an improvement plan for the next brushing.
[1303] The server sends the improvement plan to the user's device, which then displays the feedback and provides specific advice to the user. Based on this, the user can improve their next brushing routine to minimize missed spots.
[1304] Incorporating an emotion engine
[1305] 7. Emotional Engine Activation
[1306] The device's built-in emotion engine analyzes the user's facial expressions and tone of voice in real time to recognize the user's emotional state. The emotion engine uses the camera and microphone to obtain emotional information from the user's subtle changes in facial expressions and voice.
[1307] The emotion engine sends the recognized emotion data to the server, which then adjusts the feedback to the user based on the emotion data.
[1308] 8. Providing Emotional Feedback
[1309] The server analyzes the received emotional data and determines the emotional state the user is in. For example, if the user is feeling stressed, it can provide relaxation advice or play calming music.
[1310] The device receives feedback from the server and displays it to the user, which is customized according to the user's emotional state, providing an effective and comfortable brushing experience.
[1311] Specific examples
[1312] When using the device for the first time, the user presses the scan button on the device to scan their teeth. The device then sends the scanned data to the server, which analyzes the data, identifies areas that are difficult to brush, and saves them.
[1313] While brushing their teeth, the user's emotions are analyzed by the emotion engine, and the device displays encouraging or relaxing comments according to the user's emotions, providing a more comfortable brushing experience.
[1314] After use, the user selects a toothbrushing mode, the device executes the optimal toothbrushing pattern, and the sensor detects areas that have not been brushed and sends the data to the server, which then generates an improvement plan and provides feedback to the user.
[1315] This system allows users to brush their teeth in a way that is optimized for them and provides feedback based on their emotional state, helping them brush their teeth comfortably while minimizing missed spots, thereby reducing the risk of cavities and periodontal disease and improving their oral hygiene.
[1316] The processing flow will be explained below.
[1317] Step 1:
[1318] The user activates the device's scanning function, opens their mouth, and captures their teeth profile. The device's high-precision 3D scanner generates the user's teeth profile data within a few seconds, and the device temporarily stores the data in its internal memory.
[1319] Step 2:
[1320] The device encrypts the stored tooth profile data, protects the data using a sophisticated encryption algorithm, and then transmits the encrypted data to a server over the Internet.
[1321] Step 3:
[1322] The server receives the tooth profile data sent from the terminal and stores it in a database. The server organizes and manages the data for each individual user.
[1323] Step 4:
[1324] The server sends the saved tooth profile data to an AI analysis module, which then analyzes the data in detail to identify irregularities and areas that are difficult to brush. A list of the identified areas is generated and sent back to the server.
[1325] Step 5:
[1326] The server then creates a list of areas that are difficult to brush based on the analysis results and saves it in a database. Based on this, the server then generates an optimal tooth brushing pattern for each user and saves this information in the database as well.
[1327] Step 6:
[1328] The user operates the device to select the tooth brushing mode and presses the start button. The device then sends this information to the server.
[1329] Step 7:
[1330] The server retrieves the relevant tooth shape data and analysis results based on the user ID, and then sends the optimal tooth brushing pattern to the device.
[1331] Step 8:
[1332] The terminal controls the automatic toothbrushing device based on the received toothbrushing pattern, and the automatic toothbrushing device starts to effectively brush the user's teeth.
[1333] Step 9:
[1334] After the user has finished brushing, the device activates its built-in sensor and scans the user's teeth again to detect any areas that have not been brushed. The device generates the detection data, encrypts it, and sends it to the server.
[1335] Step 10:
[1336] The server inputs the received missed brushing data into the AI analysis module, which learns the pattern of missed brushing and generates an improvement plan for the next brushing.
[1337] Step 11:
[1338] The server sends the improvement plan to the user's device, which displays this feedback to the user and provides specific advice so that the user can improve their next brushing routine.
[1339] Incorporating an emotion engine
[1340] Step 12:
[1341] The device's built-in emotion engine analyzes the user's facial expressions and tone of voice in real time to recognize their emotional state. The emotion engine uses the camera and microphone to obtain emotional information from the user's subtle changes in facial expressions and voice.
[1342] Step 13:
[1343] The emotion engine encrypts the emotion data it recognizes and sends it to the server, which receives and stores the emotion data.
[1344] Step 14:
[1345] The server analyzes the emotional data and generates feedback based on the user's emotional state. For example, if the user is feeling stressed, it generates advice to relax or an instruction to play calming music.
[1346] Step 15:
[1347] The device displays the feedback received from the server to the user, providing a comfortable tooth brushing experience by displaying customized comments and advice according to the user's emotional state.
[1348] Specific examples
[1349] When using the device for the first time, the user presses the scan button on the device to scan their teeth. The scanned data is sent to a server, which analyzes the data, identifies areas that are difficult to brush, and saves them.
[1350] While brushing, the emotion engine works to recognize the user's emotional state by analyzing their facial expressions and tone of voice. If the user feels stressed, the device will play relaxing comments or music received from the server, providing a comfortable brushing experience.
[1351] After brushing, the device detects any areas that have been missed and sends the data to the server. The server generates an improvement plan and provides feedback to the user, who can then use the feedback to improve their next brushing and minimize missed spots.
[1352] Example 2
[1353] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1354] Conventional automatic toothbrushing devices have poor adaptability to the shape of each user's mouth and areas that need brushing, and are unable to provide feedback based on the user's emotional state, making it difficult to provide effective cleaning and improve the user experience.In addition, they do not provide real-time feedback on the detection of areas that need brushing and how to improve them, which makes it difficult to take prompt action for the next cleaning.
[1355] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1356] In this invention, the server includes a means for storing and analyzing intraoral scan data, a means for identifying areas that are difficult to clean, and a means for generating an optimal cleaning pattern. This allows for optimal management of the automatic cleaning device based on the user's intraoral shape. Furthermore, by using a terminal with a built-in emotion analysis engine, feedback can be provided according to the user's emotional state, and missed areas can be detected and an improvement plan can be generated in real time, allowing for rapid response.
[1357] definition statement
[1358] "Intraoral scan data" is data that captures the shape of the user's oral cavity using a 3D scanner or similar device.
[1359] A "terminal" is a device used by a user that has built-in scanning functions, control functions for an automatic cleaning device, an emotion analysis engine, and the like.
[1360] A "server" is a computer system that receives, stores, and analyzes data sent from a terminal.
[1361] The "AI Analysis Module" is a software module that uses machine learning algorithms to analyze intraoral scan data and identify areas that are difficult to clean.
[1362] "Difficult-to-clean areas" refer to areas that are difficult for an automatic cleaning device to access due to the shape or structure of the mouth.
[1363] An "automatic cleaning device" is a device that automatically cleans the inside of a user's mouth based on a pre-set cleaning pattern.
[1364] "Remaining dirty areas" refers to areas that were not polished after cleaning by the automatic cleaning device.
[1365] An "emotion analysis engine" is a software module that analyzes a user's facial expressions and tone of voice to recognize their emotional state in real time.
[1366] "Feedback" refers to advice and information based on the user's emotional state and cleaning results that is provided to the user from the server via the terminal.
[1367] An "improvement plan" refers to a plan generated by the server to make the next cleaning more effective based on areas that need to be cleaned and cleaning patterns.
[1368] MODE FOR CARRYING OUT THE INVENTION
[1369] The present invention is an automatic teeth brushing system that optimally adapts to the shape of the user's oral cavity and provides feedback according to the user's emotional state. Specific embodiments for realizing the present invention are described below.
[1370] 1. User-initiated intraoral scan
[1371] The user activates the intraoral scan function using the device. The device has a built-in high-precision 3D scanner (e.g., high-precision 3D scanner), which generates intraoral scan data by having the user open their mouth and wait a few seconds. This data is temporarily stored in the device's internal memory.
[1372] 2. Data Encryption and Transmission
[1373] The device encrypts the intraoral scan data stored in its internal memory using the AES-256 algorithm and sends the data over the Internet to a server, which receives the data and stores it in a database (e.g., a cloud database).
[1374] 3. AI-based data analysis
[1375] The server sends the stored intraoral scan data to an AI analysis module (e.g., machine learning algorithm) for detailed analysis. This analysis identifies areas that are difficult to clean and generates an optimal cleaning pattern. The list of identified areas and cleaning patterns are stored in a database.
[1376] 4. Automatic cleaning
[1377] The user selects a cleaning mode on the device and presses the start button. The device sends a cleaning start request along with the user ID to the server. The server retrieves the relevant scan data and a list of difficult-to-clean areas based on the user ID, and sends the optimal cleaning pattern to the device. The device then controls an automatic cleaning device (e.g., an electric toothbrush) according to this pattern and brushes the user's teeth.
[1378] 5. Detecting and sending unpolished areas
[1379] After the device has finished cleaning, it activates its built-in sensor and scans the mouth again to detect any missed areas. The device generates missed area data, encrypts it, and sends it to the server. The server inputs the received data into an AI analysis module and learns patterns that are likely to result in missed areas. This generates an improvement plan that will be reflected in the next cleaning.
[1380] 6. Use of sentiment analysis engines
[1381] The device's built-in emotion analysis engine analyzes the user's facial expressions and tone of voice in real time, recognizing the user's emotional state and sending the resulting emotional data to the server. The server then adjusts the feedback based on the emotional data and provides it to the user.
[1382] 7. Providing Feedback
[1383] The server generates an improvement plan and sends feedback based on sentiment analysis to the device, which then displays it to the user, offering advice on how to improve the next cleaning or comments to help the user relax.
[1384] Specific examples
[1385] On first use, the user presses the scan button on the device to scan their teeth. The device then sends the scanned data to the server, which analyzes the data, identifies and saves areas that are difficult to brush. While brushing, the user's emotions are analyzed, and the device displays encouraging or relaxing comments based on the user's emotions, providing a more comfortable brushing experience. After use, the user selects the brushing mode, and the device executes the optimal brushing pattern, using the built-in sensor to detect areas that have not been brushed, and sends the data to the server. The server then generates an improvement plan and provides feedback to the user.
[1386] Prompt Sentence Examples
[1387] "Please start dental scan."
[1388] "I found some areas that were difficult to polish. Next time I will change the settings to make it easier to polish."
[1389] "You seem tired today. I'll play some recommended music to help you relax."
[1390] The present invention allows users to receive cleaning that is optimized for their oral cavity shape and emotional state, achieving comfortable oral care while minimizing missed areas.
[1391] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1392] Program processing flow
[1393] ---
[1394] Step 1: Acquire tooth profile data
[1395] input:
[1396] The user presses the scan button on the device.
[1397] Operation:
[1398] The user opens their mouth as instructed.
[1399] The device activates its built-in high-precision 3D scanner and scans the inside of the user's mouth for a few seconds.
[1400] Data processing:
[1401] The device generates scan data.
[1402] output:
[1403] The scanned data is temporarily saved in the device's internal memory.
[1404] Specific behavior:
[1405] The message "Start scanning" will appear on the device screen.
[1406] A 3D scanner captures the shape of the inside of your mouth and generates scan data.
[1407] The device will display "Scan complete" and the data will be saved.
[1408] ---
[1409] Step 2: Encrypt and send data
[1410] input:
[1411] Scan data (output of step 1)
[1412] Operation:
[1413] The device encrypts the scanned data.
[1414] The device sends the encrypted data to a server over the Internet.
[1415] Data processing:
[1416] Encrypts data using the AES-256 algorithm.
[1417] output:
[1418] The encrypted scan data is sent to the server.
[1419] Specific behavior:
[1420] The message "Encrypting data" appears on the device screen.
[1421] After encryption is complete, "Sending data" will be displayed and the progress bar will progress.
[1422] The server receives the data and notifies the terminal that "the data has been saved."
[1423] ---
[1424] Step 3: Data analysis using AI
[1425] input:
[1426] Encrypted scan data (output of step 2)
[1427] Operation:
[1428] The server decrypts the encrypted data and stores it in a database.
[1429] The server sends the scan data to the AI analysis module.
[1430] Data processing:
[1431] Use AI analysis modules (e.g., machine learning algorithms) to identify hard-to-clean areas.
[1432] output:
[1433] A list of difficult-to-clean areas and optimal cleaning patterns are generated and stored in a database.
[1434] Specific behavior:
[1435] The server displays the message "Data is being analyzed."
[1436] The AI analysis module analyzes the data and returns the results in JSON format.
[1437] "Analysis complete" will be displayed and the list and patterns will be saved.
[1438] ---
[1439] Step 4: Run Auto Cleaning
[1440] input:
[1441] User ID, list of difficult-to-clean areas, and optimal cleaning pattern (output of step 3)
[1442] Operation:
[1443] The user selects the cleaning mode on the terminal and presses the start button.
[1444] The device sends a request to the server.
[1445] The server sends relevant information to the terminal based on the user ID.
[1446] Data processing:
[1447] The automatic cleaning device is controlled based on an optimal cleaning pattern.
[1448] output:
[1449] The device executes a cleaning pattern and brushes the user's teeth.
[1450] Specific behavior:
[1451] The device screen will display "Select a cleaning mode."
[1452] When the user presses the start button, the message "Cleaning begins" is displayed.
[1453] The automatic cleaning device will operate and the cleaning progress will be displayed on the terminal.
[1454] ---
[1455] Step 5: Detect and send unpolished areas
[1456] input:
[1457] Cleaning completed (result of step 4)
[1458] Operation:
[1459] The device will activate its built-in sensor and scan the inside of your mouth again.
[1460] Any remaining dirt is detected, and data is generated and encrypted.
[1461] The device sends the encrypted data to the server.
[1462] Data processing:
[1463] Generate and encrypt data on areas that remain unpolished.
[1464] output:
[1465] The encrypted unpolished area data is sent to the server.
[1466] Specific behavior:
[1467] After brushing your teeth, the device screen will display "Scanning for remaining areas."
[1468] The sensor scans again and displays the message "Unpolished areas detected."
[1469] When sending data, the message "Sending data" is displayed.
[1470] ---
[1471] Step 6: Analyze remaining polishing data and provide feedback
[1472] input:
[1473] Encrypted unpolished data (output of step 5)
[1474] Operation:
[1475] The server decrypts the data and inputs it into an AI analysis module.
[1476] The server generates the next cleaning improvement plan based on the data analysis results.
[1477] Data processing:
[1478] The AI analysis module analyzes the data and generates an improvement plan.
[1479] output:
[1480] An improvement plan is generated and transmitted from the server to the terminal.
[1481] The feedback is displayed to the user.
[1482] Specific behavior:
[1483] The message "Analyzing remaining polishing data" is displayed on the server side.
[1484] Once the analysis is complete, you will be notified that an improvement plan has been generated.
[1485] The device will display "Feedback on how to clean next time."
[1486] ---
[1487] Step 7: Use a sentiment analysis engine
[1488] input:
[1489] User's facial expressions and voice (real-time data)
[1490] Operation:
[1491] The device's built-in emotion analysis engine analyzes the user's emotions.
[1492] The acquired emotion data is sent to the server.
[1493] Data processing:
[1494] Emotional data is generated from facial expressions and tone of voice.
[1495] output:
[1496] The emotion data is sent to the server.
[1497] Specific behavior:
[1498] The emotion engine will start and the message "Analyzing emotions" will be displayed.
[1499] The user's facial expressions and voice are captured and the message "Sending emotion data" is displayed.
[1500] ---
[1501] Step 8: Provide emotional feedback
[1502] input:
[1503] Emotion data (output of step 7)
[1504] Operation:
[1505] The server analyzes the emotional data and generates feedback according to the user's emotional state.
[1506] The server sends the feedback to the device.
[1507] Data processing:
[1508] Generate feedback based on the user's emotional state.
[1509] output:
[1510] The feedback is sent to the terminal and displayed to the user.
[1511] Specific behavior:
[1512] The device screen will display the message, "You have received emotion-based advice."
[1513] Specific feedback might include, "You seem to be feeling stressed today. We'll play some music to help you relax."
[1514] The above is the specific flow of processing and details of each step of this system. This system allows users to brush their teeth in an optimized way, and furthermore, by providing feedback according to their emotional state, users can brush their teeth comfortably while minimizing missed spots.
[1515] (Application example 2)
[1516] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1517] Current factory cleaning and equipment inspections require time and effort, and are prone to inappropriate cleaning and inspection. Therefore, a system is needed to improve cleaning efficiency and minimize areas left uncleaned. It is also necessary to improve the working environment by understanding the emotional state of factory workers in real time and providing appropriate feedback.
[1518] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1519] In this invention, the server includes means for a user to acquire object data using a terminal, means for transmitting the acquired object data to the server, means for the server to store and analyze the received object data, means for the server to identify areas that are difficult to clean based on the analysis results, means for the terminal to control the automatic cleaning device based on the analysis results of the server, means for the terminal to detect areas that remain uncleaned after cleaning and transmit the detected areas to the server, means for the server to generate a next cleaning improvement plan based on the uncleaned area data, means for the server to transmit the generated improvement plan to the terminal and provide feedback to the user, means for acquiring and analyzing user emotion data, and means for transmitting the emotion data to the server and providing feedback. This makes it possible to improve the efficiency of cleaning work in factories and minimize areas that remain uncleaned, and further improve the working environment through feedback according to the worker's emotional state.
[1520] Key Word Definitions
[1521] A "user" is a plant supervisor or operator who utilizes the automated cleaning system.
[1522] A "terminal" is a portable or stationary electronic device for acquiring, transmitting, analyzing, and providing feedback on data of an object.
[1523] "Object data" refers to scan data relating to the surface of the equipment or facility to be cleaned or inspected.
[1524] A "server" is a central processing unit that receives, stores, analyzes data sent from a terminal, and returns the results.
[1525] The "analysis means" is a program that identifies areas that are difficult to clean based on the object data received by the server and generates a cleaning improvement plan for the next time.
[1526] "Hard-to-clean areas" are areas on or inside an object that tend to accumulate dirt and dust and are difficult to clean.
[1527] An "automatic cleaning device" is a robot or device that automatically cleans an object according to instructions from a terminal or server.
[1528] The "uncleaned area" is an area where dirt or dust remains after cleaning.
[1529] An "improvement plan" is a plan generated by the server that indicates efficient and effective cleaning patterns and procedures for the next cleaning.
[1530] "Emotion data" refers to data relating to the emotional state of the user obtained from facial expressions and voice.
[1531] "Feedback" refers to analysis results, improvement plans, and advice and information based on the user's emotions that are sent from the server to the device.
[1532] MODE FOR CARRYING OUT THE INVENTION
[1533] This invention relates to a system that automatically cleans machinery and equipment in a factory and uses AI to learn and memorize areas that need to be cleaned. Furthermore, this system also incorporates an emotion engine that recognizes the user's emotions and provides feedback. A specific embodiment for realizing this system is described below.
[1534] System Program Overview
[1535] Hardware and software:
[1536] Hardware: cleaning robot with high-precision 3D scanner (e.g., robot with LIDAR sensor), camera feed (e.g., Logitech C920 camera)
[1537] Software: Python, OpenCV library, EmotionRecognizer library, HTTP request library (requests)
[1538] Procedure:
[1539] 1. Scan the object:
[1540] The user activates the cleaning robot's scanning function and scans the surface of the equipment or facility to be cleaned. The surface data is acquired using a high-precision 3D scanner and temporarily stored in local memory.
[1541] 2. Data transmission:
[1542] Scan data stored in local memory is encrypted and sent to a central server via the internet, using advanced encryption algorithms to ensure security.
[1543] 3. Data storage and analysis:
[1544] The server securely stores the received scan data in a database. The stored data is then input into an AI analysis module to identify areas that are difficult to clean. The AI analysis module then analyzes the data in detail and lists areas that need cleaning.
[1545] 4. Cleaning pattern generation:
[1546] The server generates an optimal cleaning pattern based on the analysis results. The generated cleaning pattern is unique to each user and is saved in a dedicated format. This pattern is then sent to the device.
[1547] 5. Cleaning execution:
[1548] The user selects the cleaning mode on the device and presses the start button, and the robot begins cleaning. The robot follows the cleaning pattern sent to it and cleans effectively.
[1549] 6. Detecting missing areas:
[1550] After cleaning, the robot uses its built-in sensors to scan the object again to detect any areas that remain uncleaned, generating detection data that is encrypted and sent to a server.
[1551] 7. Improvement plan generation and feedback:
[1552] The server analyzes the received remaining cleaning data and generates a cleaning improvement plan for the next cleaning. The generated improvement plan is sent to the terminal and feedback is provided to the user.
[1553] 8. Use of Emotion Engine:
[1554] The device's built-in emotion engine analyzes the user's facial expressions and tone of voice in real time to recognize their emotional state. The device uses a camera and microphone to capture emotion data from subtle changes in the user's facial expressions and voice, and sends it to a server.
[1555] 9. Emotion-based feedback:
[1556] The server analyzes the emotional data and provides feedback based on the user's emotional state. For example, if the user is feeling stressed, it will provide relaxation advice or play calming music.
[1557] Examples:
[1558] First time use: The user presses the scan button on the device to scan the object to be cleaned. The device sends the scanned data to the server, which analyzes the data to identify and store areas that are difficult to clean.
[1559] During cleaning: The user's emotions are analyzed by the emotion engine. Depending on the user's emotions, the device displays encouraging and relaxing comments, providing a comfortable cleaning experience.
[1560] After use: The user selects a cleaning mode, and the device performs the optimal cleaning pattern. The sensor detects any remaining cleaning areas and sends the data to the server. The server generates an improvement plan and provides feedback to the user.
[1561] Example prompts to be input to the generative AI model:
[1562] Please start the scanning service.
[1563] "We conduct sentiment analysis of employees."
[1564] "We are currently obtaining cleaning patterns for the equipment."
[1565] The robot is cleaning.
[1566] "We received your feedback and our work environment has improved."
[1567] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1568] System program processing steps
[1569] Step 1:
[1570] Scanning an object
[1571] The user activates the cleaning robot's scan function.
[1572] Input: Start scan command
[1573] Data processing: A unique 3D scanner scans the surface of the object and obtains highly accurate 3D data.
[1574] Output: Scanned 3D data
[1575] Step 2:
[1576] Sending data
[1577] The scanned data acquired by the terminal is encrypted and sent to the server.
[1578] Input: scanned 3D data
[1579] Data processing: Applying advanced encryption algorithms to protect your data.
[1580] Output: Sends the encrypted data to the server
[1581] Step 3:
[1582] Data storage and analysis
[1583] The server stores the received scan data in a database and inputs it into the AI analysis module.
[1584] Input: Encrypted 3D data
[1585] Data processing: The received data is decrypted, stored in a secure database, and analyzed in detail using an AI analysis module.
[1586] Output: Analyzed result data
[1587] Step 4:
[1588] Identifying hard-to-clean areas
[1589] The server uses an AI analysis module to identify areas that are difficult to clean.
[1590] Input: Parsed result data
[1591] Data processing: AI uses data to create a list of areas that are difficult to clean.
[1592] Output: List of hard-to-clean areas
[1593] Step 5:
[1594] Cleaning pattern generation
[1595] The server generates the optimal cleaning pattern based on the analysis results and sends it to the terminal.
[1596] Input: List of hard-to-clean areas
[1597] Data processing: Run the cleaning pattern generation algorithm to generate individual cleaning instructions.
[1598] Output: Sends cleaning pattern to terminal
[1599] Step 6:
[1600] Cleaning execution
[1601] The user selects a cleaning mode on the terminal, and the cleaning robot starts cleaning according to the transmitted cleaning pattern.
[1602] Input: cleaning pattern and start cleaning command
[1603] Data processing: The terminal controls the cleaning robot's operation and cleans the equipment according to the transmitted pattern.
[1604] Output: Cleaned equipment
[1605] Step 7:
[1606] Detecting areas that need cleaning
[1607] After cleaning, the robot uses its built-in sensors to re-scan the object to detect any areas that remain uncleaned.
[1608] Input: Post-cleaning scan command
[1609] Data Processing: Built-in sensors identify missed cleaning areas and assemble the data.
[1610] Output: Data on areas that remain uncleaned
[1611] Step 8:
[1612] Improvement plan generation and feedback
[1613] The server analyzes the remaining cleaning data received and generates a cleaning improvement plan for the next time.
[1614] Input: Data on remaining areas to be cleaned
[1615] Data processing: AI uses data to optimize the next cleaning pattern.
[1616] Output: Send improvement plan to device and provide feedback to user
[1617] Step 9:
[1618] Using the Emotion Engine
[1619] The device's built-in emotion engine analyzes the user's facial expressions and voice to recognize their emotional state.
[1620] Input: facial expression and speech data
[1621] Data processing: Emotion recognition algorithms analyze the data and determine emotions.
[1622] Output: Send emotion data to the server
[1623] Step 10:
[1624] Emotion-based feedback
[1625] The server analyzes the emotional data and provides appropriate feedback to the user.
[1626] Input: Emotion data
[1627] Data processing: Based on the analysis results, feedback tailored to the user's emotions is generated.
[1628] Output: Emotional feedback displayed on the device
[1629] The above are the specific processing steps for carrying out the present invention.
[1630] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1631] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1632] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1633] [Fourth embodiment]
[1634] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1635] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1636] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1637] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1638] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1639] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1640] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1641] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1642] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1643] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1644] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1645] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1646] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1647] The present invention relates to an automatic tooth brushing system that thoroughly brushes the user's teeth according to their shape and memorizes areas that are prone to cavities (are likely to be left unbrushed) through AI learning. Specific embodiments for realizing this system are described below.
[1648] 1. Acquisition of tooth profile data
[1649] The user activates the device's scanning function and opens their mouth to capture their teeth. The device has a built-in high-precision 3D scanner that scans the user's teeth in just a few seconds.
[1650] The device temporarily stores the scanned data in its internal memory and prepares it for subsequent transmission to the server.
[1651] 2. Sending and saving tooth profile data
[1652] The terminal encrypts the scanned tooth profile data and implements security measures to prevent data leakage.
[1653] The terminal transmits the encrypted tooth profile data to a server via the Internet.
[1654] The server receives and securely stores the tooth profile data sent to it, which is then stored in a separate database, allowing easy access to each user's data.
[1655] 3. Analyzing tooth profile data and identifying areas that are difficult to polish
[1656] The server retrieves the stored tooth profile data and inputs it into the AI analysis module.
[1657] The AI analysis module analyzes the tooth shape data to identify irregularities and areas that are difficult to brush, and then lists areas that require special attention.
[1658] Based on the analysis results, the server generates a list of areas that are difficult to polish and stores it in a database.
[1659] 4. Automatic tooth brushing
[1660] The user selects the tooth brushing mode on the terminal and presses the start button.
[1661] The device sends the user ID and a request to start brushing teeth to the server.
[1662] The server generates an optimal tooth brushing pattern based on the user's tooth shape data and analysis results and sends it to the terminal.
[1663] The terminal controls the automatic toothbrushing device according to the received toothbrushing pattern, and the automatic toothbrushing device performs the specified operations to effectively brush the user's teeth.
[1664] 5. Detecting and sending unpolished areas
[1665] After brushing, the device activates its built-in sensor to scan the user's teeth and detect any areas that have not been brushed.
[1666] The device encrypts the detected unpolished area data and sends it to the server.
[1667] 6. Analyzing data on remaining areas and providing feedback
[1668] The server inputs the received data on areas that have not been polished into the AI analysis module.
[1669] The AI analysis module analyzes the data and learns patterns that are likely to result in areas not being polished.
[1670] The server generates a tooth brushing improvement plan for the next time based on the learning results and sends the plan to the terminal.
[1671] The terminal displays the improvement plan received from the server to the user and provides specific advice on how to reduce areas that remain unbrushed.
[1672] Specific examples
[1673] When using the device for the first time, the user presses the scan button on the device to scan their teeth. The device then sends the scanned data to the server, which analyzes the data, identifies areas that are difficult to brush, and saves them.
[1674] During use, the user selects a toothbrushing mode, the device executes the optimal toothbrushing pattern, and the sensor detects areas that have not been brushed and sends the data to the server, which then generates an improvement plan and provides feedback to the user.
[1675] The system allows users to brush their teeth in an individually optimized way, minimizing missed spots, thereby reducing the risk of cavities and periodontal disease and improving the user's oral hygiene.
[1676] The processing flow will be explained below.
[1677] Step 1:
[1678] The user activates the device's scanning function, opens their mouth, and captures their teeth. The device is equipped with a high-precision 3D scanner that generates the user's teeth profile data in a few seconds. The data captured by the device is temporarily stored in its internal memory.
[1679] Step 2:
[1680] The device encrypts the stored tooth profile data. To ensure security, the device protects the data using a sophisticated encryption algorithm. The device then transmits the encrypted data to a server via the Internet.
[1681] Step 3:
[1682] The server receives the tooth profile data sent from the terminal. The server saves the data in a database and stores it in an organized format for each user. This allows for quick access to each user's individual data.
[1683] Step 4:
[1684] The server sends the saved tooth profile data to the AI analysis module, which then analyzes the data in detail to identify irregularities and areas that are difficult to brush. It then generates a list of the identified areas and sends it to the server.
[1685] Step 5:
[1686] Based on the analysis results, the server saves a list of difficult-to-brush areas in a database. It also generates an optimal tooth brushing pattern based on the analysis results. The generated tooth brushing pattern is unique to each user and is saved in a dedicated format.
[1687] Step 6:
[1688] The user selects the tooth brushing mode on the device and presses the start button. The device sends a tooth brushing start request including the user ID to the server.
[1689] Step 7:
[1690] The server retrieves the relevant tooth shape data and a list of difficult-to-brush areas based on the user ID, generates an optimal tooth brushing pattern, and sends the pattern to the device.
[1691] Step 8:
[1692] The terminal controls the automatic toothbrushing device according to the received toothbrushing pattern, so that the automatic toothbrushing device operates according to the settings and effectively brushes the user's teeth.
[1693] Step 9:
[1694] After brushing, the device activates its built-in sensor and scans the user's teeth again to detect any areas that have not been brushed. The device generates the detection data, encrypts it, and sends it to the server.
[1695] Step 10:
[1696] The server inputs the received missed brushing data into the AI analysis module, which analyzes the data and learns patterns that tend to cause missed brushing. Based on the analysis results, it generates an improvement plan for the next brushing.
[1697] Step 11:
[1698] The server sends the improvement plan to the user's device, which then displays the feedback and provides specific advice to the user. Based on this, the user can improve their next brushing routine to minimize missed spots.
[1699] Example 1
[1700] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1701] Conventional tooth brushing systems require a lot of manual operation by the user, which means that areas are likely to be left unbrushed. It is also difficult to identify areas that have been left unbrushed and provide solutions, making it difficult to improve overall oral hygiene. Furthermore, data security has not been sufficiently considered, raising concerns about the leakage of personal information.
[1702] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1703] In this invention, the server includes a means for storing tooth shape data in a database and inputting it into an AI analysis module for analysis, a means for identifying areas that are difficult to brush based on the analysis results, and a means for generating an improvement plan for the next tooth brushing session and sending it to the terminal as feedback to the user. This enables individually optimized tooth brushing, reduces missed spots, improves overall oral hygiene, and ensures the security of personal information.
[1704] "User" refers to an individual who uses the system to capture tooth profile data and automatically brush their teeth.
[1705] A "terminal" is a device used by a user, and refers to a device that acquires and transmits tooth shape data, executes tooth brushing patterns, and detects data on areas that have not been brushed.
[1706] "Tooth shape data" refers to 3D scan data that accurately shows the shape and position of the user's teeth.
[1707] "Server" refers to a central management system that stores and analyzes the received tooth profile data, generates various plans based on the analysis results, and sends them to the terminal.
[1708] "Encryption" refers to a technology that uses a specific algorithm to convert data such as tooth shape data and remaining tooth brushing data, making it unreadable, in order to ensure its security.
[1709] The "AI analysis module" refers to a part of the system that uses artificial intelligence technology to analyze tooth shape data and data on areas that have not been brushed, and identifies areas that are difficult to brush.
[1710] "Difficult-to-brush areas" refer to areas of the teeth that, due to their shape and position, are likely to be left unbrushed when using manual or automatic toothbrushes.
[1711] The "tooth brushing pattern" refers to an optimal operation sequence to be executed by the automatic tooth brushing device, which is generated based on the user's tooth shape data and the analysis results.
[1712] "Automatic tooth brushing device" refers to a device that is controlled by a terminal and effectively brushes a user's teeth automatically.
[1713] "Missed area data" refers to data containing information about missed areas detected after brushing teeth.
[1714] A "toothbrushing improvement plan" refers to a plan that includes specific instructions and a schedule for brushing your teeth more effectively the next time, based on data on areas that have not been brushed.
[1715] "Feedback" refers to specific advice and information provided to users based on analysis results and improvement plans.
[1716] The present invention relates to an automatic tooth brushing system that thoroughly brushes the user's teeth according to their shape and memorizes areas that are prone to cavities (are likely to be left unbrushed) through AI learning. Specific embodiments for realizing this system are described below.
[1717] 1. Acquisition of tooth profile data
[1718] The user activates the device's scanning function, opens their mouth, and scans their teeth with a 3D scanner. The device is equipped with a highly accurate 3D scanner that captures teeth impressions in a few seconds. The scanned data is temporarily stored in the device's internal memory. For example, when the user taps the "scan button," the 3D scanner begins scanning the teeth impressions and saves them in the device's internal memory.
[1719] 2. Sending and saving tooth profile data
[1720] The terminal encrypts the scanned tooth profile data and protects it using a secure encryption method such as AES-256. The encrypted data is then sent over the Internet to a server, which securely stores the received data in a database and efficiently manages each user's data.
[1721] 3. Analyzing tooth profile data and identifying areas that are difficult to polish
[1722] The server inputs the saved tooth profile data into the AI analysis module. The AI analysis module uses deep learning technology to analyze the tooth profile data and identify irregularities and areas that are difficult to brush. As a result of the analysis, a list of areas that are difficult to brush is generated and stored in a database. The AI analysis module processes the data in the background and sends a notification to the server that the analysis is complete.
[1723] 4. Automatic tooth brushing
[1724] When a user selects tooth brushing mode on the device and presses the "Start" button, the device sends a request to start brushing along with the user ID to the server. The server generates an optimal tooth brushing pattern based on the user's tooth shape data and analysis results, and sends it to the device. The device controls the automatic tooth brushing device according to the received pattern. The automatic tooth brushing device performs the specified operations, for example, using rotation and vibration to effectively brush the user's teeth.
[1725] 5. Detecting and sending unpolished areas
[1726] After brushing is complete, the device activates its built-in sensor and scans the user's teeth again. This scan detects any missed areas. The device then encrypts the missed area data again and sends it to the server. For example, the "Start missed area detection" button is automatically pressed, and the missed area data is sent to the server.
[1727] 6. Analyzing data on remaining areas and providing feedback
[1728] The server inputs the received missed brushing data into the AI analysis module for analysis. Based on the analysis results, it generates an improvement plan for the next tooth brushing session and sends it to the terminal. The terminal displays the received plan to the user and provides specific advice on how to reduce missed brushing sessions next time. For example, the server executes the "improvement plan generation" process and sends the improvement plan to the terminal.
[1729] Specific examples
[1730] First time use:
[1731] The user presses the scan button on the device, and the scanner scans the teeth profile. The device then encrypts the scanned data and sends it to a server, which analyzes it to identify areas that are difficult to brush and stores them.
[1732] Currently in use:
[1733] The user selects a toothbrushing mode, and the device receives the optimal toothbrushing pattern from the server. The device controls the automatic toothbrushing device and brushes the teeth according to the specified movements. After finishing, the sensor detects any areas that have not been brushed and sends the data to the server. The server analyzes the data on areas that have not been brushed, generates an improvement plan for the next time, and provides feedback.
[1734] Prompt Sentence Examples
[1735] "Please explain this automated tooth brushing system. Please explain in detail the process in which the user scans their teeth and the server analyzes the data to detect areas that have not been brushed and provides feedback."
[1736] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1737] Step 1:
[1738] The user activates the device's scanning function to capture their own dental profile data. When the user taps the scan button, the device's built-in high-precision 3D scanner starts operating and captures the user's dental profile data within a few seconds. The input is the user's mouth open, and the output is dental profile data obtained by 3D scanning. The device temporarily stores the captured dental profile data in its internal memory.
[1739] Step 2:
[1740] The terminal encrypts the scanned tooth profile data. The encryption method used is AES-256 or similar. The input is the acquired tooth profile data, and the output is the encrypted tooth profile data. The terminal sends the encrypted data to a server via the Internet. The server receives the data.
[1741] Step 3:
[1742] The server stores the received tooth profile data in a database. The input is encrypted tooth profile data, and the output is the data stored in the database. The data stored in the database is managed so that it can be easily accessed.
[1743] Step 4:
[1744] The server inputs the saved tooth profile data into an AI analysis module. The AI analysis module analyzes the data and identifies irregularities in the teeth and areas that are difficult to brush. The input is the saved tooth profile data, and the output is a list of areas that are difficult to brush. Based on the analysis results, the list of areas that are difficult to brush is saved in a database.
[1745] Step 5:
[1746] The user selects a tooth brushing mode on the device and presses the "Start" button. The input is the user's mode selection, and the output is a request to start brushing. The device sends the request to the server along with the user ID.
[1747] Step 6:
[1748] The server generates a tooth brushing pattern based on the user's tooth shape data and the analysis results. The input is the user's tooth shape data and the analysis results, and the output is the optimal tooth brushing pattern. The server sends the tooth brushing pattern to the terminal.
[1749] Step 7:
[1750] The terminal controls the automatic toothbrushing device according to the received toothbrushing pattern. The automatic toothbrushing device performs the specified operations to effectively brush the user's teeth. The input is the transmitted toothbrushing pattern, and the output is the control of the automatic toothbrushing device. Specifically, it performs operations such as vibration and rotation to brush specific teeth or areas with priority.
[1751] Step 8:
[1752] After brushing, the device activates its built-in sensor and scans the user's teeth again to detect any missed areas. The input is the state of the user's teeth after brushing, and the output is data on any missed areas. The device again encrypts the detected missed areas and sends them to the server.
[1753] Step 9:
[1754] The server inputs the received missed brushing data into the AI analysis module and analyzes the data. The input is missed brushing data, and the output is a tooth brushing improvement plan for the next time. The server generates an improvement plan based on the learning results and sends it to the device.
[1755] Step 10:
[1756] The device displays the received improvement plan to the user and provides specific advice on how to reduce missed spots next time. The input is the improvement plan from the server, and the output is feedback information to the user. Specifically, the device displays detailed instructions to the user, such as which areas they should focus on brushing.
[1757] (Application example 1)
[1758] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1759] Conventional tooth brushing methods tend to leave some areas unbrushed, which in the long term can lead to oral health problems such as cavities and periodontal disease. It is also difficult to provide optimal tooth brushing methods tailored to individual users, and in many cases, users brush their teeth without understanding the correct method. Furthermore, dental clinics face the challenge of not having a way to efficiently monitor and instruct patients on their dental condition.
[1760] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1761] In this invention, the server includes: means for a user to acquire tooth shape data using a terminal; means for transmitting the acquired tooth shape data to the server; means for the server to store and analyze the received tooth shape data; means for the server to identify areas that are difficult to brush based on the analysis results; means for the server to make the analysis results available to dentists in brick-and-mortar stores; means for the terminal to control an automatic tooth brushing device based on the analysis results of the server; means for the terminal to detect areas that have not been brushed after brushing and transmit them to the server; means for the server to generate an improvement plan for the next tooth brushing based on the data on areas that have not been brushed; means for the server to transmit the generated improvement plan to the terminal and provide feedback to the user; and means for the terminal to generate prompt sentences to input into the generative AI model. This allows users to share data scanned at home with a dental clinic and receive individually optimized tooth brushing instructions, reducing areas that have not been brushed and reducing the risk of cavities and periodontal disease.
[1762] A "user" is a person who uses this system to acquire tooth shape data and perform automatic tooth brushing and oral care.
[1763] A "terminal" is a device that allows a user to acquire tooth profile data and send it to a server, and includes mobile information terminals such as smartphones and tablets.
[1764] "Tooth shape data" is data that captures the shape and arrangement of the user's teeth with high accuracy.
[1765] The "server" is a central processing unit that receives, stores, and analyzes tooth profile data sent from the terminal.
[1766] "Analysis" refers to data processing that identifies areas that are difficult to brush or areas that have not been brushed based on the tooth shape data received by the server.
[1767] "Hard to brush areas" refers to areas of the teeth that are difficult for a user to effectively brush with a regular toothbrush.
[1768] A "physical dentist" is a medical professional at a dental clinic who refers to the data on the server and provides direct oral care and guidance to users.
[1769] An "automatic toothbrushing device" is a device that automatically and effectively brushes a user's teeth based on the analysis results of the server.
[1770] "Missed spots" refer to areas of the teeth that still have dirt or plaque remaining after brushing.
[1771] "Data on areas that have not been brushed" is data for identifying areas that have not been brushed, and is used to generate the next tooth brushing improvement plan.
[1772] The "next tooth brushing improvement plan" is a suggestion about the optimal tooth brushing method and procedure that the user should follow next time, generated by the server based on the results of analysis and learning.
[1773] A "generative AI model" is an artificial intelligence algorithm that suggests effective tooth brushing methods to users based on tooth shape data and data on areas that have not been brushed.
[1774] A "prompt sentence" is a sentence input to a generative AI model that contains instructions and guidelines to encourage users to take proper oral care.
[1775] The present invention relates to a system that combines the provision of individually optimized automatic tooth brushing based on a user's tooth shape with direct oral care support from a dentist in a brick-and-mortar store. A specific description will be given of an embodiment of the present invention.
[1776] First, the user uses a device to capture their own dental profile data. The device is equipped with a high-precision 3D scanner, and users can capture dental profile data in just a few seconds by opening their mouth and pressing the scan button. The captured dental profile data is encrypted to prevent data leaks, and the encrypted data is then sent to a server via the Internet.
[1777] The server stores the received tooth profile data and inputs it into the AI analysis module for analysis. The AI analysis module analyzes the tooth profile data and identifies areas that are difficult to brush or have many irregularities. This results in a list of areas that require special attention.
[1778] The server converts the analysis results into a format that can be referenced by dentists at brick-and-mortar clinics, who can then use this data to provide optimal oral care and guidance to patients, allowing users to receive detailed advice at dental clinics.
[1779] The terminal then controls the automatic toothbrushing device based on the server's analysis results. When the user selects a toothbrushing mode and presses the start button, the terminal generates an optimal toothbrushing pattern and sends commands to the automatic toothbrushing device. The automatic toothbrushing device then performs the instructed actions to effectively brush the user's teeth.
[1780] After brushing is complete, the device activates a sensor to detect missed areas and scans the user's teeth again. After identifying missed areas, the device re-encrypts the data and sends it to the server. The server then inputs the received missed areas data into the AI analysis module again, learning patterns that tend to result in missed areas. The server then generates a toothbrushing improvement plan for the next brushing session based on the learning results and sends this plan to the device.
[1781] The device also displays the improvement plan received from the server to the user and provides specific advice for effective tooth brushing. Furthermore, the device generates prompt sentences to input into the generative AI model, providing instructions and guidelines for promoting proper oral care. Examples of prompt sentences are as follows:
[1782] Example prompt sentence:
[1783] "You can 3D scan your teeth at home and send the data through the app. Your dentist will review the results and provide you with tailored advice at your next appointment."
[1784] This system allows users to efficiently manage their oral health and, in conjunction with dental consultations, allows them to receive comprehensive oral care, reducing the risk of tooth decay and periodontal disease by reducing missed spots when brushing.
[1785] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1786] Step 1:
[1787] The user uses the device to acquire tooth profile data. The user presses the scan button on the device, opens their mouth, and acquires tooth profile data. The device has a built-in high-precision 3D scanner that captures tooth profile data in a few seconds. The acquired data is temporarily stored in the device's internal memory.
[1788] Input: Intraoral image data
[1789] Output: 3D tooth profile data
[1790] Step 2:
[1791] The terminal encrypts the acquired tooth profile data and then sends it to the server. To prevent data leakage, the terminal encrypts the data using an encryption library. The encrypted data is then sent to the server via the Internet.
[1792] Input: 3D tooth profile data
[1793] Output: Encrypted 3D tooth profile data
[1794] Step 3:
[1795] The server stores and analyzes the received tooth profile data. The server decrypts the encrypted data and stores it securely. The stored data is input into an AI analysis system and analyzed to identify tooth shape, irregularities, and areas that are difficult to brush.
[1796] Input: Encrypted 3D tooth profile data
[1797] Output: Analysis result data (list of areas that are difficult to polish)
[1798] Step 4:
[1799] The server converts the analysis results into a format that can be viewed by the dentist in the brick-and-mortar clinic, and provides it to the dentist, who can then provide detailed advice and treatment suggestions to the patient.
[1800] Input: Analysis result data
[1801] Output: Information provided to dentist (report of analysis results)
[1802] Step 5:
[1803] The terminal controls the automatic toothbrushing device based on the analysis results from the server. The terminal sends the received toothbrushing pattern to the automatic toothbrushing device, and when the user presses the start button, the device performs the specified operation.
[1804] Input: Analysis result data
[1805] Output: Control commands for the automatic toothbrushing device
[1806] Step 6:
[1807] After brushing, the device detects any missed areas and sends the data to the server.The device then uses a 3D scanner to scan the missed areas again, encrypting the data and sending it to the server.
[1808] Input: Tooth shape data after brushing
[1809] Output: Data on areas that remain unpolished
[1810] Step 7:
[1811] The server generates a tooth brushing improvement plan for the next time based on the missed brushing area data. The server uses an AI analysis system to learn the missed brushing area data and creates an improvement plan to suggest the best tooth brushing method for the next time.
[1812] Input: Data on areas to be polished
[1813] Output: Improvement plan data
[1814] Step 8:
[1815] The server sends the generated improvement plan to the terminal and provides feedback to the user. The terminal displays the received improvement plan to the user and provides specific advice that will be useful for the next tooth brushing.
[1816] Input: Improvement Plan Data
[1817] Output: Feedback information for the user
[1818] Step 9:
[1819] The device generates prompts to input into the generative AI model, providing instructions and guidelines to encourage proper oral care to the user.
[1820] An example of a specific prompt might be, "3D scan your teeth at home and send the data through the app. Your dentist will review the results and provide you with tailored advice at your next appointment."
[1821] Input: Improvement Plan Data
[1822] Output: prompt statement
[1823] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1824] The present invention relates to a system that automatically brushes teeth according to the user's tooth shape, uses AI to learn and memorize areas that have not been brushed, and further combines it with an emotion engine that recognizes the user's emotions and provides feedback. Specific embodiments for realizing this system are described below.
[1825] 1. Acquisition of tooth profile data
[1826] The user activates the device's scanning function, opens their mouth, and captures their teeth. The device is equipped with a highly accurate 3D scanner, which generates the user's teeth profile data in a few seconds. The data captured by the device is temporarily stored in its internal memory.
[1827] 2. Sending and saving tooth profile data
[1828] The device encrypts the stored tooth profile data. To ensure security, the device protects the data using a sophisticated encryption algorithm. The device then transmits the encrypted data to a server via the Internet.
[1829] The server receives the tooth profile data sent from the device and stores it securely in a database. The saved data is stored in a format organized for each user.
[1830] 3. Analyzing tooth profile data and identifying areas that are difficult to polish
[1831] The server sends the saved tooth profile data to the AI analysis module, which then analyzes the data in detail to identify irregularities and areas that are difficult to brush. It then generates a list of the identified areas and sends it to the server.
[1832] Based on the analysis results, the server saves a list of difficult-to-brush areas in a database. Based on the analysis results, an optimal tooth brushing pattern is generated. The generated tooth brushing pattern is unique to each user and is saved in a dedicated format.
[1833] 4. Automatic tooth brushing
[1834] The user selects the tooth brushing mode on the device and presses the start button. The device sends a tooth brushing start request including the user ID to the server.
[1835] The server retrieves the relevant tooth shape data and a list of difficult-to-brush areas based on the user ID, generates an optimal tooth brushing pattern, and sends the pattern to the device.
[1836] The terminal controls the automatic toothbrushing device according to the received toothbrushing pattern, so that the automatic toothbrushing device operates according to the settings and effectively brushes the user's teeth.
[1837] 5. Detecting and sending unpolished areas
[1838] After the user has finished brushing, the device activates its built-in sensor and scans the user's teeth again to detect any areas that have not been brushed. The device generates the detection data, encrypts it, and sends it to the server.
[1839] 6. Analyzing data on remaining areas and providing feedback
[1840] The server inputs the received missed brushing data into the AI analysis module, which analyzes the data and learns patterns that tend to cause missed brushing. Based on the analysis results, it generates an improvement plan for the next brushing.
[1841] The server sends the improvement plan to the user's device, which then displays the feedback and provides specific advice to the user. Based on this, the user can improve their next brushing routine to minimize missed spots.
[1842] Incorporating an emotion engine
[1843] 7. Emotional Engine Activation
[1844] The device's built-in emotion engine analyzes the user's facial expressions and tone of voice in real time to recognize the user's emotional state. The emotion engine uses the camera and microphone to obtain emotional information from the user's subtle changes in facial expressions and voice.
[1845] The emotion engine sends the recognized emotion data to the server, which then adjusts the feedback to the user based on the emotion data.
[1846] 8. Providing Emotional Feedback
[1847] The server analyzes the received emotional data and determines the emotional state the user is in. For example, if the user is feeling stressed, it can provide relaxation advice or play calming music.
[1848] The device receives feedback from the server and displays it to the user, which is customized according to the user's emotional state, providing an effective and comfortable brushing experience.
[1849] Specific examples
[1850] When using the device for the first time, the user presses the scan button on the device to scan their teeth. The device then sends the scanned data to the server, which analyzes the data, identifies areas that are difficult to brush, and saves them.
[1851] While brushing their teeth, the user's emotions are analyzed by the emotion engine, and the device displays encouraging or relaxing comments according to the user's emotions, providing a more comfortable brushing experience.
[1852] After use, the user selects a toothbrushing mode, the device executes the optimal toothbrushing pattern, and the sensor detects areas that have not been brushed and sends the data to the server, which then generates an improvement plan and provides feedback to the user.
[1853] This system allows users to brush their teeth in a way that is optimized for them and provides feedback based on their emotional state, helping them brush their teeth comfortably while minimizing missed spots, thereby reducing the risk of cavities and periodontal disease and improving their oral hygiene.
[1854] The processing flow will be explained below.
[1855] Step 1:
[1856] The user activates the device's scanning function, opens their mouth, and captures their teeth profile. The device's high-precision 3D scanner generates the user's teeth profile data within a few seconds, and the device temporarily stores the data in its internal memory.
[1857] Step 2:
[1858] The device encrypts the stored tooth profile data, protects the data using a sophisticated encryption algorithm, and then transmits the encrypted data to a server over the Internet.
[1859] Step 3:
[1860] The server receives the tooth profile data sent from the terminal and stores it in a database. The server organizes and manages the data for each individual user.
[1861] Step 4:
[1862] The server sends the saved tooth profile data to an AI analysis module, which then analyzes the data in detail to identify irregularities and areas that are difficult to brush. A list of the identified areas is generated and sent back to the server.
[1863] Step 5:
[1864] The server then creates a list of areas that are difficult to brush based on the analysis results and saves it in a database. Based on this, the server then generates an optimal tooth brushing pattern for each user and saves this information in the database as well.
[1865] Step 6:
[1866] The user operates the device to select the tooth brushing mode and presses the start button. The device then sends this information to the server.
[1867] Step 7:
[1868] The server retrieves the relevant tooth shape data and analysis results based on the user ID, and then sends the optimal tooth brushing pattern to the device.
[1869] Step 8:
[1870] The terminal controls the automatic toothbrushing device based on the received toothbrushing pattern, and the automatic toothbrushing device starts to effectively brush the user's teeth.
[1871] Step 9:
[1872] After the user has finished brushing, the device activates its built-in sensor and scans the user's teeth again to detect any areas that have not been brushed. The device generates the detection data, encrypts it, and sends it to the server.
[1873] Step 10:
[1874] The server inputs the received missed brushing data into the AI analysis module, which learns the pattern of missed brushing and generates an improvement plan for the next brushing.
[1875] Step 11:
[1876] The server sends the improvement plan to the user's device, which displays this feedback to the user and provides specific advice so that the user can improve their next brushing routine.
[1877] Incorporating an emotion engine
[1878] Step 12:
[1879] The device's built-in emotion engine analyzes the user's facial expressions and tone of voice in real time to recognize their emotional state. The emotion engine uses the camera and microphone to obtain emotional information from the user's subtle changes in facial expressions and voice.
[1880] Step 13:
[1881] The emotion engine encrypts the emotion data it recognizes and sends it to the server, which receives and stores the emotion data.
[1882] Step 14:
[1883] The server analyzes the emotional data and generates feedback based on the user's emotional state. For example, if the user is feeling stressed, it generates advice to relax or an instruction to play calming music.
[1884] Step 15:
[1885] The device displays the feedback received from the server to the user, providing a comfortable tooth brushing experience by displaying customized comments and advice according to the user's emotional state.
[1886] Specific examples
[1887] When using the device for the first time, the user presses the scan button on the device to scan their teeth. The scanned data is sent to a server, which analyzes the data, identifies areas that are difficult to brush, and saves them.
[1888] While brushing, the emotion engine works to recognize the user's emotional state by analyzing their facial expressions and tone of voice. If the user feels stressed, the device will play relaxing comments or music received from the server, providing a comfortable brushing experience.
[1889] After brushing, the device detects any areas that have been missed and sends the data to the server. The server generates an improvement plan and provides feedback to the user, who can then use the feedback to improve their next brushing and minimize missed spots.
[1890] Example 2
[1891] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1892] Conventional automatic toothbrushing devices have poor adaptability to the shape of each user's mouth and areas that need brushing, and are unable to provide feedback based on the user's emotional state, making it difficult to provide effective cleaning and improve the user experience.In addition, they do not provide real-time feedback on the detection of areas that need brushing and how to improve them, which makes it difficult to take prompt action for the next cleaning.
[1893] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1894] In this invention, the server includes a means for storing and analyzing intraoral scan data, a means for identifying areas that are difficult to clean, and a means for generating an optimal cleaning pattern. This allows for optimal management of the automatic cleaning device based on the user's intraoral shape. Furthermore, by using a terminal with a built-in emotion analysis engine, feedback can be provided according to the user's emotional state, and missed areas can be detected and an improvement plan can be generated in real time, allowing for rapid response.
[1895] definition statement
[1896] "Intraoral scan data" is data that captures the shape of the user's oral cavity using a 3D scanner or similar device.
[1897] A "terminal" is a device used by a user that has built-in scanning functions, control functions for an automatic cleaning device, an emotion analysis engine, and the like.
[1898] A "server" is a computer system that receives, stores, and analyzes data sent from a terminal.
[1899] The "AI Analysis Module" is a software module that uses machine learning algorithms to analyze intraoral scan data and identify areas that are difficult to clean.
[1900] "Difficult-to-clean areas" refer to areas that are difficult for an automatic cleaning device to access due to the shape or structure of the mouth.
[1901] An "automatic cleaning device" is a device that automatically cleans the inside of a user's mouth based on a pre-set cleaning pattern.
[1902] "Remaining dirty areas" refers to areas that were not polished after cleaning by the automatic cleaning device.
[1903] An "emotion analysis engine" is a software module that analyzes a user's facial expressions and tone of voice to recognize their emotional state in real time.
[1904] "Feedback" refers to advice and information based on the user's emotional state and cleaning results that is provided to the user from the server via the terminal.
[1905] An "improvement plan" refers to a plan generated by the server to make the next cleaning more effective based on areas that need to be cleaned and cleaning patterns.
[1906] MODE FOR CARRYING OUT THE INVENTION
[1907] The present invention is an automatic teeth brushing system that optimally adapts to the shape of the user's oral cavity and provides feedback according to the user's emotional state. Specific embodiments for realizing the present invention are described below.
[1908] 1. User-initiated intraoral scan
[1909] The user activates the intraoral scan function using the device. The device has a built-in high-precision 3D scanner (e.g., high-precision 3D scanner), which generates intraoral scan data by having the user open their mouth and wait a few seconds. This data is temporarily stored in the device's internal memory.
[1910] 2. Data Encryption and Transmission
[1911] The device encrypts the intraoral scan data stored in its internal memory using the AES-256 algorithm and sends the data over the Internet to a server, which receives the data and stores it in a database (e.g., a cloud database).
[1912] 3. AI-based data analysis
[1913] The server sends the stored intraoral scan data to an AI analysis module (e.g., machine learning algorithm) for detailed analysis. This analysis identifies areas that are difficult to clean and generates an optimal cleaning pattern. The list of identified areas and cleaning patterns are stored in a database.
[1914] 4. Automatic cleaning
[1915] The user selects a cleaning mode on the device and presses the start button. The device sends a cleaning start request along with the user ID to the server. The server retrieves the relevant scan data and a list of difficult-to-clean areas based on the user ID, and sends the optimal cleaning pattern to the device. The device then controls an automatic cleaning device (e.g., an electric toothbrush) according to this pattern and brushes the user's teeth.
[1916] 5. Detecting and sending unpolished areas
[1917] After the device has finished cleaning, it activates its built-in sensor and scans the mouth again to detect any missed areas. The device generates missed area data, encrypts it, and sends it to the server. The server inputs the received data into an AI analysis module and learns patterns that are likely to result in missed areas. This generates an improvement plan that will be reflected in the next cleaning.
[1918] 6. Use of sentiment analysis engines
[1919] The device's built-in emotion analysis engine analyzes the user's facial expressions and tone of voice in real time, recognizing the user's emotional state and sending the resulting emotional data to the server. The server then adjusts the feedback based on the emotional data and provides it to the user.
[1920] 7. Providing Feedback
[1921] The server generates an improvement plan and sends feedback based on sentiment analysis to the device, which then displays it to the user, offering advice on how to improve the next cleaning or comments to help the user relax.
[1922] Specific examples
[1923] On first use, the user presses the scan button on the device to scan their teeth. The device then sends the scanned data to the server, which analyzes the data, identifies and saves areas that are difficult to brush. While brushing, the user's emotions are analyzed, and the device displays encouraging or relaxing comments based on the user's emotions, providing a more comfortable brushing experience. After use, the user selects the brushing mode, and the device executes the optimal brushing pattern, using the built-in sensor to detect areas that have not been brushed, and sends the data to the server. The server then generates an improvement plan and provides feedback to the user.
[1924] Prompt Sentence Examples
[1925] "Please start dental scan."
[1926] "I found some areas that were difficult to polish. Next time I will change the settings to make it easier to polish."
[1927] "You seem tired today. I'll play some recommended music to help you relax."
[1928] The present invention allows users to receive cleaning that is optimized for their oral cavity shape and emotional state, achieving comfortable oral care while minimizing missed areas.
[1929] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1930] Program processing flow
[1931] ---
[1932] Step 1: Acquire tooth profile data
[1933] input:
[1934] The user presses the scan button on the device.
[1935] Operation:
[1936] The user opens their mouth as instructed.
[1937] The device activates its built-in high-precision 3D scanner and scans the inside of the user's mouth for a few seconds.
[1938] Data processing:
[1939] The device generates scan data.
[1940] output:
[1941] The scanned data is temporarily saved in the device's internal memory.
[1942] Specific behavior:
[1943] The message "Start scanning" will appear on the device screen.
[1944] A 3D scanner captures the shape of the inside of your mouth and generates scan data.
[1945] The device will display "Scan complete" and the data will be saved.
[1946] ---
[1947] Step 2: Encrypt and send data
[1948] input:
[1949] Scan data (output of step 1)
[1950] Operation:
[1951] The device encrypts the scanned data.
[1952] The device sends the encrypted data to a server over the Internet.
[1953] Data processing:
[1954] Encrypts data using the AES-256 algorithm.
[1955] output:
[1956] The encrypted scan data is sent to the server.
[1957] Specific behavior:
[1958] The message "Encrypting data" appears on the device screen.
[1959] After encryption is complete, "Sending data" will be displayed and the progress bar will progress.
[1960] The server receives the data and notifies the terminal that "the data has been saved."
[1961] ---
[1962] Step 3: Data analysis using AI
[1963] input:
[1964] Encrypted scan data (output of step 2)
[1965] Operation:
[1966] The server decrypts the encrypted data and stores it in a database.
[1967] The server sends the scan data to the AI analysis module.
[1968] Data processing:
[1969] Use AI analysis modules (e.g., machine learning algorithms) to identify hard-to-clean areas.
[1970] output:
[1971] A list of difficult-to-clean areas and optimal cleaning patterns are generated and stored in a database.
[1972] Specific behavior:
[1973] The server displays the message "Data is being analyzed."
[1974] The AI analysis module analyzes the data and returns the results in JSON format.
[1975] "Analysis complete" will be displayed and the list and patterns will be saved.
[1976] ---
[1977] Step 4: Run Auto Cleaning
[1978] input:
[1979] User ID, list of difficult-to-clean areas, and optimal cleaning pattern (output of step 3)
[1980] Operation:
[1981] The user selects the cleaning mode on the terminal and presses the start button.
[1982] The device sends a request to the server.
[1983] The server sends relevant information to the terminal based on the user ID.
[1984] Data processing:
[1985] The automatic cleaning device is controlled based on an optimal cleaning pattern.
[1986] output:
[1987] The device executes a cleaning pattern and brushes the user's teeth.
[1988] Specific behavior:
[1989] The device screen will display "Select a cleaning mode."
[1990] When the user presses the start button, the message "Cleaning begins" is displayed.
[1991] The automatic cleaning device will operate and the cleaning progress will be displayed on the terminal.
[1992] ---
[1993] Step 5: Detect and send unpolished areas
[1994] input:
[1995] Cleaning completed (result of step 4)
[1996] Operation:
[1997] The device will activate its built-in sensor and scan the inside of your mouth again.
[1998] Any remaining dirt is detected, and data is generated and encrypted.
[1999] The device sends the encrypted data to the server.
[2000] Data processing:
[2001] Generate and encrypt data on areas that remain unpolished.
[2002] output:
[2003] The encrypted unpolished area data is sent to the server.
[2004] Specific behavior:
[2005] After brushing your teeth, the device screen will display "Scanning for remaining areas."
[2006] The sensor scans again and displays the message "Unpolished areas detected."
[2007] When sending data, the message "Sending data" is displayed.
[2008] ---
[2009] Step 6: Analyze remaining polishing data and provide feedback
[2010] input:
[2011] Encrypted unpolished data (output of step 5)
[2012] Operation:
[2013] The server decrypts the data and inputs it into an AI analysis module.
[2014] The server generates the next cleaning improvement plan based on the data analysis results.
[2015] Data processing:
[2016] The AI analysis module analyzes the data and generates an improvement plan.
[2017] output:
[2018] An improvement plan is generated and transmitted from the server to the terminal.
[2019] The feedback is displayed to the user.
[2020] Specific behavior:
[2021] The message "Analyzing remaining polishing data" is displayed on the server side.
[2022] Once the analysis is complete, you will be notified that an improvement plan has been generated.
[2023] The device will display "Feedback on how to clean next time."
[2024] ---
[2025] Step 7: Use a sentiment analysis engine
[2026] input:
[2027] User's facial expressions and voice (real-time data)
[2028] Operation:
[2029] The device's built-in emotion analysis engine analyzes the user's emotions.
[2030] The acquired emotion data is sent to the server.
[2031] Data processing:
[2032] Emotional data is generated from facial expressions and tone of voice.
[2033] output:
[2034] The emotion data is sent to the server.
[2035] Specific behavior:
[2036] The emotion engine will start and the message "Analyzing emotions" will be displayed.
[2037] The user's facial expressions and voice are captured and the message "Sending emotion data" is displayed.
[2038] ---
[2039] Step 8: Provide emotional feedback
[2040] input:
[2041] Emotion data (output of step 7)
[2042] Operation:
[2043] The server analyzes the emotional data and generates feedback according to the user's emotional state.
[2044] The server sends the feedback to the device.
[2045] Data processing:
[2046] Generate feedback based on the user's emotional state.
[2047] output:
[2048] The feedback is sent to the terminal and displayed to the user.
[2049] Specific behavior:
[2050] The device screen will display the message, "You have received emotion-based advice."
[2051] Specific feedback might include, "You seem to be feeling stressed today. We'll play some music to help you relax."
[2052] The above is the specific flow of processing and details of each step of this system. This system allows users to brush their teeth in an optimized way, and furthermore, by providing feedback according to their emotional state, users can brush their teeth comfortably while minimizing missed spots.
[2053] (Application example 2)
[2054] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2055] Current factory cleaning and equipment inspections require time and effort, and are prone to inappropriate cleaning and inspection. Therefore, a system is needed to improve cleaning efficiency and minimize areas left uncleaned. It is also necessary to improve the working environment by understanding the emotional state of factory workers in real time and providing appropriate feedback.
[2056] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[2057] In this invention, the server includes means for a user to acquire object data using a terminal, means for transmitting the acquired object data to the server, means for the server to store and analyze the received object data, means for the server to identify areas that are difficult to clean based on the analysis results, means for the terminal to control the automatic cleaning device based on the analysis results of the server, means for the terminal to detect areas that remain uncleaned after cleaning and transmit the detected areas to the server, means for the server to generate a next cleaning improvement plan based on the uncleaned area data, means for the server to transmit the generated improvement plan to the terminal and provide feedback to the user, means for acquiring and analyzing user emotion data, and means for transmitting the emotion data to the server and providing feedback. This makes it possible to improve the efficiency of cleaning work in factories and minimize areas that remain uncleaned, and further improve the working environment through feedback according to the worker's emotional state.
[2058] Key Word Definitions
[2059] A "user" is a plant supervisor or operator who utilizes the automated cleaning system.
[2060] A "terminal" is a portable or stationary electronic device for acquiring, transmitting, analyzing, and providing feedback on data of an object.
[2061] "Object data" refers to scan data relating to the surface of the equipment or facility to be cleaned or inspected.
[2062] A "server" is a central processing unit that receives, stores, analyzes data sent from a terminal, and returns the results.
[2063] The "analysis means" is a program that identifies areas that are difficult to clean based on the object data received by the server and generates a cleaning improvement plan for the next time.
[2064] "Hard-to-clean areas" are areas on or inside an object that tend to accumulate dirt and dust and are difficult to clean.
[2065] An "automatic cleaning device" is a robot or device that automatically cleans an object according to instructions from a terminal or server.
[2066] The "uncleaned area" is an area where dirt or dust remains after cleaning.
[2067] An "improvement plan" is a plan generated by the server that indicates efficient and effective cleaning patterns and procedures for the next cleaning.
[2068] "Emotion data" refers to data relating to the emotional state of the user obtained from facial expressions and voice.
[2069] "Feedback" refers to analysis results, improvement plans, and advice and information based on the user's emotions that are sent from the server to the device.
[2070] MODE FOR CARRYING OUT THE INVENTION
[2071] This invention relates to a system that automatically cleans machinery and equipment in a factory and uses AI to learn and memorize areas that need to be cleaned. Furthermore, this system also incorporates an emotion engine that recognizes the user's emotions and provides feedback. A specific embodiment for realizing this system is described below.
[2072] System Program Overview
[2073] Hardware and software:
[2074] Hardware: cleaning robot with high-precision 3D scanner (e.g., robot with LIDAR sensor), camera feed (e.g., Logitech C920 camera)
[2075] Software: Python, OpenCV library, EmotionRecognizer library, HTTP request library (requests)
[2076] Procedure:
[2077] 1. Scan the object:
[2078] The user activates the cleaning robot's scanning function and scans the surface of the equipment or facility to be cleaned. The surface data is acquired using a high-precision 3D scanner and temporarily stored in local memory.
[2079] 2. Data transmission:
[2080] Scan data stored in local memory is encrypted and sent to a central server via the internet, using advanced encryption algorithms to ensure security.
[2081] 3. Data storage and analysis:
[2082] The server securely stores the received scan data in a database. The stored data is then input into an AI analysis module to identify areas that are difficult to clean. The AI analysis module then analyzes the data in detail and lists areas that need cleaning.
[2083] 4. Cleaning pattern generation:
[2084] The server generates an optimal cleaning pattern based on the analysis results. The generated cleaning pattern is unique to each user and is saved in a dedicated format. This pattern is then sent to the device.
[2085] 5. Cleaning execution:
[2086] The user selects the cleaning mode on the device and presses the start button, and the robot begins cleaning. The robot follows the cleaning pattern sent to it and cleans effectively.
[2087] 6. Detecting missing areas:
[2088] After cleaning, the robot uses its built-in sensors to scan the object again to detect any areas that remain uncleaned, generating detection data that is encrypted and sent to a server.
[2089] 7. Improvement plan generation and feedback:
[2090] The server analyzes the received remaining cleaning data and generates a cleaning improvement plan for the next cleaning. The generated improvement plan is sent to the terminal and feedback is provided to the user.
[2091] 8. Use of Emotion Engine:
[2092] The device's built-in emotion engine analyzes the user's facial expressions and tone of voice in real time to recognize their emotional state. The device uses a camera and microphone to capture emotion data from subtle changes in the user's facial expressions and voice, and sends it to a server.
[2093] 9. Emotion-based feedback:
[2094] The server analyzes the emotional data and provides feedback based on the user's emotional state. For example, if the user is feeling stressed, it will provide relaxation advice or play calming music.
[2095] Examples:
[2096] First time use: The user presses the scan button on the device to scan the object to be cleaned. The device sends the scanned data to the server, which analyzes the data to identify and store areas that are difficult to clean.
[2097] During cleaning: The user's emotions are analyzed by the emotion engine. Depending on the user's emotions, the device displays encouraging and relaxing comments, providing a comfortable cleaning experience.
[2098] After use: The user selects a cleaning mode, and the device performs the optimal cleaning pattern. The sensor detects any remaining cleaning areas and sends the data to the server. The server generates an improvement plan and provides feedback to the user.
[2099] Example prompts to be input to the generative AI model:
[2100] Please start the scanning service.
[2101] "We conduct sentiment analysis of employees."
[2102] "We are currently obtaining cleaning patterns for the equipment."
[2103] The robot is cleaning.
[2104] "We received your feedback and our work environment has improved."
[2105] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[2106] System program processing steps
[2107] Step 1:
[2108] Scanning an object
[2109] The user activates the cleaning robot's scan function.
[2110] Input: Start scan command
[2111] Data processing: A unique 3D scanner scans the surface of the object and obtains highly accurate 3D data.
[2112] Output: Scanned 3D data
[2113] Step 2:
[2114] Sending data
[2115] The scanned data acquired by the terminal is encrypted and sent to the server.
[2116] Input: scanned 3D data
[2117] Data processing: Applying advanced encryption algorithms to protect your data.
[2118] Output: Sends the encrypted data to the server
[2119] Step 3:
[2120] Data storage and analysis
[2121] The server stores the received scan data in a database and inputs it into the AI analysis module.
[2122] Input: Encrypted 3D data
[2123] Data processing: The received data is decrypted, stored in a secure database, and analyzed in detail using an AI analysis module.
[2124] Output: Analyzed result data
[2125] Step 4:
[2126] Identifying hard-to-clean areas
[2127] The server uses an AI analysis module to identify areas that are difficult to clean.
[2128] Input: Parsed result data
[2129] Data processing: AI uses data to create a list of areas that are difficult to clean.
[2130] Output: List of hard-to-clean areas
[2131] Step 5:
[2132] Cleaning pattern generation
[2133] The server generates the optimal cleaning pattern based on the analysis results and sends it to the terminal.
[2134] Input: List of hard-to-clean areas
[2135] Data processing: Run the cleaning pattern generation algorithm to generate individual cleaning instructions.
[2136] Output: Sends cleaning pattern to terminal
[2137] Step 6:
[2138] Cleaning execution
[2139] The user selects a cleaning mode on the terminal, and t...
Claims
1. A means for a user to acquire tooth profile data using a terminal; A means for transmitting the tooth profile data acquired by the terminal to a server; A means for storing and analyzing the tooth profile data received by the server; The server uses the analysis results to identify areas that are difficult to polish, A means for the terminal to control the automatic tooth brushing device based on the analysis results of the server; A means for the terminal to detect areas that have not been brushed after brushing the teeth and transmit the results to a server; A means for the server to generate a next tooth brushing improvement plan based on the data on areas not brushed; a means for transmitting the improvement plan generated by the server to the terminal and providing feedback to the user; A system including:
2. 2. The system according to claim 1, further comprising means for encrypting the tooth profile data acquired by the terminal and transmitting the encrypted data to the server.
3. 2. The system according to claim 1, wherein the server includes means for inputting tooth profile data into an AI analysis module for analysis.
4. The system according to claim 1, wherein the terminal includes means for detecting any areas that have not been brushed using a sensor after finishing brushing the teeth.
5. The system of claim 1 , wherein the server includes means for analyzing the unpolished area data using an AI analysis module and generating an improvement plan.
6. The system according to claim 1, further comprising means for the server to generate an optimal tooth brushing pattern based on the analysis results and transmit the generated pattern to the terminal.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A