Treatment inspection system

The system addresses the need for safe and efficient cosmetic medical treatment evaluation by using sensors, AI, and AR to monitor and audit procedures, reducing errors and enhancing compliance and training.

JP2025017601APending Publication Date: 2025-02-06SBC MEDICAL GROUP CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2023120750
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-07-25
Publication Date
2025-02-06

AI Technical Summary

Technical Problem

Existing cosmetic medical treatments lack efficient, accurate, and safe evaluation methods to ensure compliance with treatment protocols, leading to potential medical errors and reduced patient safety.

Method used

A system utilizing sensors, AI, and AR technology to monitor and audit medical procedures in real-time, providing alerts and feedback to ensure adherence to treatment manuals, and integrating robotic assistance for precise procedures.

Benefits of technology

Enhances treatment safety and efficiency by reducing human errors, improving compliance with treatment protocols, and providing training materials for continuous improvement.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

To inspect whether beauty treatment is performed properly.SOLUTION: There is provided a medical treatment inspection system for analyzing an image capturing treatment using a plurality of models, and inspecting whether treatment is performed according to procedures. The inspection system makes it possible to accurately inspect whether the treatment in a beauty clinic is performed according to the procedures, and provide feedback in real time accompanying the progress of the treatment, thereby improving quality of the treatment and reducing a risk of a medical accident substantially. The inspection system, which uses image analysis, makes it possible to eliminate human subjective view and oversight, and perform objective and consistent evaluation. Furthermore, the inspection system supports a quick response when a problem arises since the system has a function to automatically issue an alarm when an abnormality occurs.SELECTED DRAWING: None
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a treatment audit system. [Background technology]

[0002] In recent years, the need for aesthetic medical treatment has increased, and various hospitals and clinics are offering a wide variety of aesthetic medical treatments. In response to this growing need, it is becoming increasingly important to provide aesthetic medical treatment more efficiently, accurately, and safely. [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] Japan Society of Aesthetic Plastic Surgery, "Japan Society of Aesthetic Plastic Surgery Newsletter Aesthetic Medical Practice Guidelines (Revised Edition for 2021)," published on October 10, 2022 Summary of the Invention [Problem to be solved by the invention]

[0004] The present invention provides a method for evaluating whether cosmetic medical treatment is being performed appropriately in order to meet the need for performing cosmetic medical treatment more efficiently, more accurately, and more safely. [Means for solving the problem]

[0005] According to the present invention, there are provided an evaluation method, evaluation device, evaluation system, evaluation program, analysis method, analysis device, analysis system, analysis program, medical accident prevention method, medical accident prevention device, medical accident prevention system, medical accident prevention program, medical safety assurance method, medical safety assurance device, medical safety assurance system, and medical safety assurance program. Effect of the Invention

[0006] According to the present invention, it is possible to improve the safety and efficiency of treatment, and to ensure support and safety of treatment by using a terminal. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] Embodiments of the present invention can be utilized as an evaluation method, evaluation device, evaluation system, evaluation program, analysis method, analysis device, analysis system, analysis program, medical accident prevention method, medical accident prevention device, medical accident prevention system, medical accident prevention program, medical safety assurance method, medical safety assurance device, medical safety assurance system, and medical safety assurance program, as to whether cosmetic medical care is being performed more efficiently, more accurately, and safely.

[0008] [Technology 1] This invention is a system for monitoring compliance with manuals for procedures at beauty clinics. Specifically, it captures information on the actions of medical staff during procedures and the tools they use in real time, and uses AI to determine whether the procedures are being performed according to the manual. If proper procedures are not performed, the system immediately issues an alert. This improves patient safety and reduces the possibility of medical errors.

[0009] Specifically, the present invention is a system for monitoring compliance with a manual for treatment actions in a beauty clinic. The problem that the present invention aims to solve is the deterioration of patient safety due to human error during surgery or examination or deviation from the manual. Specifically, in treatment at a beauty clinic where compliance with procedures is required, human error and non-compliance with routines are serious problems. The specific content of the present invention is a system that captures information such as the movements of medical personnel and the tools they use in real time and uses artificial intelligence (AI) to determine whether those actions conform to the manual. If appropriate actions are not taken, an alert is issued immediately, allowing appropriate responses. As an effect of the present invention, first of all, patient safety is significantly improved. By detecting deviations from the manual in real time, it is possible to prevent medical errors. In addition, the reaction of medical personnel to the generated alert and their subsequent actions are also recorded, making it possible to collect information that contributes to subsequent improvement activities. Furthermore, the present invention promotes training and ability improvement of medical personnel. Based on the generated alert, it is possible to clarify specific points for improvement, such as in what situations medical personnel tend to deviate from the manual or what procedures are difficult.

[0010] The system of the present invention includes the following elements. First, a sensor device, such as a high-resolution camera or motion sensor, is used to capture the movements of medical staff. This allows detailed recording of the doctor's movements during surgery and the operation of surgical tools. Second, an RFID (Radio Frequency Identification) tag or barcode scanner is installed to identify the tools and medicines used.

[0011] Motion sensors and high-resolution cameras capture the movements of medical professionals in real time and send the data to the AI ​​engine. For example, the moment a doctor picks up a surgical tool, his or her hand movements are captured and information is generated. Specific movement patterns during surgery (e.g., the direction and depth of the incision) are also captured as data.

[0012] RFID tags and barcode scanners are used to identify the instruments and drugs used. For example, RFID tags or barcodes attached to syringes, scalpels, and even medicines can be scanned to record which instruments or drugs were used and when. This ensures that the right instruments and drugs are used at the right time.

[0013] This data is sent in real time to the AI ​​engine, which uses deep learning algorithms to determine whether the data is in line with the manual. This determination covers a wide range of areas, including the timing of use of various instruments, surgical procedures, and the amount and timing of drug use.

[0014] If any behavior that does not comply with the manual is detected, the AI ​​engine generates an alert and warns medical personnel. This alert is communicated in the form of a message displayed on the screen, a voice notification, or a vibration on a specific device (e.g., a smartwatch). At the same time, detailed information about the alert and appropriate responses are also provided. In this way, by combining a specific sensor device and AI technology, the present invention monitors compliance with medical procedures in beauty clinics in real time and improves patient safety.

[0015] The audit system according to this embodiment will now be described in detail.

[0016] Treatments at beauty clinics require skill and knowledge, and are important processes that are directly linked to the patient's pursuit of health and beauty. However, currently, the means of checking whether each step is being performed properly mainly relies on human visual inspection. This is labor-intensive, and human inspection may result in oversights or misidentifications. The present invention aims to solve these problems.

[0017] This invention improves the transparency and quality control of the treatment process at beauty clinics. Specifically, the treatment process is automatically recorded and audited using image analysis, significantly reducing human oversights and misconceptions. In addition, by recording the actual treatment process in detail and providing analysis results based on that, it becomes possible to use the results as material for staff training and improvement activities, thereby improving the quality of treatment.

[0018] The medical audit system of the present invention includes a module for analyzing images of a procedure and a module for auditing whether the procedure is being performed properly based on the analysis results. First, the module for analyzing the images of a procedure extracts information on instruments, disinfectants, patients, medical staff, etc. from the images and evaluates whether each action and placement conforms to the actions listed in the checklist. Next, the audit module audits the progress of the procedure based on the above evaluation results and provides feedback or warnings as necessary. In addition, a detailed audit report can be generated after the procedure, which can be used for subsequent improvement activities and training.

[0019] The analysis module of the present invention includes the following models: a first learning model created by machine learning using information indicating whether a first situation is a situation in which a series of procedures related to advance preparation, such as preparation of necessary instruments and items, disinfection, management of the Mayo table, confirmation of abnormalities in instruments and items, and understanding of knowledge related to treatment, are properly performed, and the image as training data; information indicating whether a second situation is a situation in which a series of procedures related to endorsement sheets and drug preparation, such as recording and checking patient information, preparation and checking of medicines, and preparation of a list of prescription drugs, infusions, and anesthesia options for each surgery, are properly performed, and the image as training data; information indicating whether a third situation is a situation in which a series of procedures related to dialogue and support with patients, such as explanations to patients, preparation of rooms, self-introductions, and photographing, are properly performed, and the image as training data; and information indicating whether a fourth situation is a situation in which a series of procedures related to preoperative preparation, such as design support, administration of medicines, preparation for monitoring, and organization of the environment, are properly performed, and the image as training data. a fourth learning model created by machine learning using training data; a fifth learning model created by machine learning using information indicating whether a series of procedures related to preparation of the surgical field, such as appropriate disinfection, draping with clean operation, and final confirmation of instruments and items, is being properly performed; a sixth learning model created by machine learning using information indicating whether a series of procedures related to surgical assistance and instrument operation, such as time-out, management of medicine, and management and support of instruments during surgery, is being properly performed, and the sixth learning model created by machine learning using information indicating whether a series of procedures related to post-operative response, such as checking the patient's condition, organizing the environment, and post-operative explanation and care, is being properly performed, and the seventh ... cleanup, such as counting needles and gauze, cleaning instruments, and organizing the environment, is being properly performed, and the eighth learning model created by machine learning using information indicating whether a series of procedures related to post-operative cleanup, such as counting needles and gauze, cleaning instruments, and organizing the environment, is being properly performed, and the eighth learning model created by machine learning using information indicating whether a series of procedures related to post-operative cleanup, such as counting needles and gauze, cleaning instruments, and organizing the environment, is being properly performed, and the eighth learning model created by machine learning using training data.A ninth learning model created by machine learning using information indicating whether or not a ninth situation is one in which the practitioner has time management skills and the image as training data; a tenth learning model created by machine learning using information indicating whether or not a series of procedures related to safety measures, such as recording in a narcotics management book, is properly performed and the image as training data; an eleventh learning model created by machine learning using information indicating whether or not a eleventh situation is one in which the practitioner has the ability to properly communicate with patients and the image as training data; and a twelfth learning model created by machine learning using information indicating whether or not a twelfth situation is one in which the practitioner has the ability to confirm that the practitioner complies with the clinic's appearance regulations and the image as training data.

[0020] The present invention may further include a video analysis to check whether the following items have been completed: 1. Are you prepared in advance? Check that all necessary equipment for each operation is sterilized and ready. Are you able to disinfect your hands and disinfect the Mayo table with 128 times Oxyvil Five? Are all the instruments, disinfectants, and anesthesia used in the operation being placed on the Mayo stand in a clean manner? Are scalpel blades and other sharp objects placed in a tray in accordance with hazardous materials handling rules? Is the preparation complete without placing gauze on the local anesthesia, disinfection, saline, etc.? Have you checked to see if there are any abnormalities in the equipment and machinery you are using? Understand the purpose and adaptation Understand the anatomy of muscles and nerves involved in treatment Know the approach and insertion site for prosthesis insertion 2. Endorsement Table Drug Ready Have you checked the contents of the endorsement (ID, name, date, content, option, treatment interval, doctor option)? Is the decision order form (current endorsement form) ready? (Has the endorsement form been transcribed so that there are no omissions or errors?) Are the medications prepared according to the list of prescription drugs and infusion anesthesia options for each surgery? Did you double-check the oral medication options, anesthetic concentration, and eye drops as shown in the double-check video? 3. Guidance - Are you able to provide design assistance? Have you prepared the room before showing it to us (check that the Psycho Rich preparation light is on, tidy up the room) Did you provide guidance according to the welcoming manual? Can you call by number? Can you introduce yourself? Have the patient and endorsement details been matched (patient name, treatment name, treatment area, options) Anamnemesis interview (have you checked all the items written on the pre-op anamnemesis form and confirmed the important points?) The pre-op double check sheet allows doctors to determine whether or not a patient is suitable for surgery. Can you check for the presence or absence of ornaments? (If there are any, are you able to encourage the patient to put the items in their bag themselves and confirm that they have done so?) Are you able to take photos of the necessary areas according to the photo manual? 4. After designing - are you ready before starting surgery? Is there assistance with design? Are the medications administered according to the list of prescribed medications and infusion anesthesia options for each surgery (prescribed by the attending physician)? Is the intravenous anesthesia drip route properly secured? Is the monitor properly attached to the surgical site? When the monitor is attached, are the waveforms printed and attached to the patient's chart? Are you able to operate the oxygen cannula? Is the room environment arranged with consideration for traffic flow (handstand, psycho-rich, IV pole, monitor)? The machine cords are neatly organized and not disorganized, and are not prone to damage or danger. 5. Has the surgical field been prepared? Is the disinfection area appropriate and is disinfection being performed with sanitary procedures? Is draping (covering unclean areas) done using clean procedures? Are you ready to organize the Mayo table? Have you been able to make a final check to see if any equipment or items are missing? All preparations are completed by the time the operation begins. 6.Are you able to assist with surgery and operate instruments? Is there a time-out (i.e., those involved confirm the details of the procedure before the operation)? Are the drugs being introduced checked and handled safely according to the manual? Is there assistance with design? Can local anesthesia be safely administered? Are the instruments handed over to doctors in line with their procedures? The instruments can be delivered in a direction, angle, and timing that suits the surgeon (so that the surgeon does not take his / her eyes off the surgical field). Assistance can be provided by anticipating the doctor's next move Double-check the prosthesis and ensure it is handled with sterility. Whether the needle is correctly held by the needle holder Do not directly hand over dangerous goods Stainless steel tray sponge is used for dangerous items such as needles. The Mayo table is always safe and clean. Are you able to assist with hemostasis appropriately (are you able to apply pressure to stop bleeding)? Gauze is provided for each doctor and nurse so that it is easy to remove (do not place anything on the gauze) Whether the field of vision is secured and bleeding is controlled Are sharps (needles, scalpel blades) double-checked in a way that makes it easy for doctors to count them? Or are sharps counted and confirmed with a single check at the end of surgery? Are you able to communicate with the patient according to their pain? 7. Are you able to handle post-surgery care? Is it possible to check for symptoms such as discomfort or pain? Are you able to turn off the Psycho Rich? Is it possible to remove the draping and thoroughly remove any disinfectant or other substances adhering to the body? Is there a mirror check of the finished product? Are postoperative progress, precautions for daily life, and prescribed medications explained according to the critical path? Safety measures: Are prescription drugs handed over in accordance with the procedure manual? Whether postoperative photographs of necessary areas have been taken according to the photography manual (if instructed by the doctor) Are you seeing people off according to the farewell manual? 8. Have you cleaned up after surgery? Are needles and gauze counted and discarded in the treatment room? Are the machines being cleaned in the sterilization and cleaning room according to procedure (are cleaning requests being made promptly after operation)? Have you checked the remaining amount of Psycho Rich and cleared it away? Is your room tidy? Are you able to clear the decision order form (current endorsement form)? Is the medical record written? 9. Are you able to respond with an awareness of time? 10. Safety Measures Is the drug management book filled out? 11. Are you able to speak to patients? Use polite and correct language so that patients do not feel uncomfortable Are you able to avoid using medical terminology that is difficult for patients to understand? Speak to patients with a smile while keeping eye contact with them Do you always speak to patients before touching them? Are you able to ask other staff for help when necessary? 12. Do you check that the therapist is well-groomed? Have you checked whether your clothing, hairstyle, and makeup comply with the clinic's regulations? Do caregivers check to see if they are wearing a cap mask?

[0021] The system may acquire video in real time, and the auditing unit may audit the video in real time. The system may further include an alarm unit that issues an alarm when it is detected that the treatment is not being performed correctly.

[0022] The audit model used by the Audit Department is explained below. The audit model mainly uses deep learning techniques. This model judges the face band application process for each frame of video and evaluates whether the correct application process has been followed. Specifically, it uses a Convolutional Neural Network (CNN) to extract image features for each frame and a Long Short-Term Memory (LSTM) to determine temporal continuity.

[0023] Specifically, the model is generated using the following procedure: Data collection: Collect video data of correct and incorrect use of the faceband, preferably with labels for each step. Data preprocessing: Split the video into frames and organize each frame into a dataset along with its label. Model training: CNN is used to extract image features for each frame, and LSTM is used to learn temporal continuity. Model evaluation: The performance of the model is evaluated using a test dataset. Specific evaluation indicators include accuracy, precision, recall, and F1 score. Model application: The model will be applied to videos from actual medical settings to audit whether treatments are being performed properly.

[0024] [Technology 2] The invention is an AR (Augmented Reality) device that allows medical personnel to smoothly refer to manuals when performing procedures. This device is a headset or glasses type, and displays the manual instructions directly within the field of view of the medical personnel performing surgery. This makes it possible to check the manual more efficiently and quickly than conventional paper-based or electronic manual references.

[0025] The problem that this invention aims to solve is that it is difficult to refer to the manuals required for performing medical procedures, which hinders the smooth implementation of examinations and surgeries. In particular, some procedures are complicated, and if the appropriate manuals cannot be instantly checked, the quality and efficiency of the procedures may decrease.

[0026] The specific content of this invention is a system that utilizes AI and AR (Augmented Reality) technology to provide an appropriate manual for each procedure. When a medical professional starts a procedure, the AI ​​selects the manual corresponding to that procedure from a database and displays it in real time through an AR device (e.g., AR glasses or a head-mounted display). At that time, a voice recognition system is also used, and the medical professional can request the next procedure by voice.

[0027] The effect of this invention is that it becomes much easier to refer to the manual, which results in improved quality and efficiency of medical procedures. Specifically, by visually presenting the manual in real time using AR technology, examinations and surgeries can be performed smoothly. In addition, by using a voice recognition system, it becomes possible to refer to the manual and give instructions on the progress even when one's hands are full.

[0028] Additionally, the present invention can be used in education and training, where the system of the present invention can be used to train new medical personnel and potentially increase the speed at which they learn new procedures.

[0029] As described above, the present invention plays an important role in improving the quality and efficiency of medical treatments in beauty clinics.

[0030] [Technology 3] This invention is an AI audit system that integrates the recording of medical examinations and surgeries with the evaluation of compliance with the manual. This system records video of each stage of medical treatment, and then the AI ​​evaluates the degree of compliance with the manual. The AI ​​evaluation results are used as feedback for medical staff, contributing to the provision of higher quality medical services.

[0031] The problem that this invention aims to solve is the difficulty of properly evaluating whether medical procedures are being performed according to manuals and recording and analyzing the results over the long term. If this problem cannot be solved, it may be difficult to gain insight into improving the quality of medical procedures, preventing medical errors, and improving the education of medical professionals.

[0032] The specific content of this invention is a medical procedure recording and evaluation system that utilizes AI and video recording technology. The AI ​​engine analyzes high-resolution video feeds in real time and evaluates whether each step of the procedure or examination is performed according to the manual. This evaluation is performed automatically and generates a detailed report. The report is stored in an electronic medical history system for later reference and analysis.

[0033] The invention also records high-resolution video of surgical and examination procedures, which are then automatically tagged and evaluated by AI, allowing for the recording of small details and anomalies that may be overlooked during the medical procedure to be recorded and analysed later.

[0034] The benefits of this invention include quality assurance and continuous improvement of medical procedures. Automatic evaluation by AI and high-resolution video recording make it possible to check whether examinations and surgeries are being performed according to the manual and provide appropriate feedback. In addition, the records and evaluation results are stored in an electronic medical history system, making it possible to use them for long-term trend analysis and training material.

[0035] As described above, the present invention plays an important role in improving the efficiency of recording and evaluation of medical procedures in beauty clinics and in improving quality.

[0036] [Technology 4] This invention is a system that uses robotics technology to complement or replace medical procedures in beauty clinics. This system inputs manual information into AI, and the robot performs the medical procedure based on that information. For example, robots are used for procedures that require precision and consistency, such as injections, delicate surgery, and even the application of cosmetics. This makes it possible to standardize the quality of medical care and reduce the workload of medical professionals.

[0037] The problem that this invention aims to solve is that there are limitations to the diagnosis and surgery performed by human medical professionals, and it is difficult to ensure quality and consistency, especially when high precision and delicate operations are required.

[0038] The specific content of this invention is a robotic arm that inputs information from a manual and performs medical procedures as instructed, and an AI engine that controls its movements. First, information from the manual (e.g., surgical procedures, selection and use of surgical instruments, etc.) is input into the system. The AI ​​engine then analyzes the information and generates specific operation instructions for the robotic arm. The robotic arm performs medical procedures as instructed in the manual according to the instructions received from the AI ​​engine.

[0039] The effects of the present invention include improved quality and consistency of medical procedures. In particular, in surgeries that require delicate manipulation, the precise movements of the robot arm can achieve greater accuracy and consistency than human medical personnel. In addition, since the movements of the robot arm based on the manual are controlled by an AI engine, it is easy to respond to updates or changes to the manual.

[0040] Furthermore, the present invention contributes to reducing the workload of medical staff, particularly by reducing fatigue and stress caused by long surgeries and continuous medical examinations, thereby reducing the risk of medical errors.

[0041] As described above, the present invention plays an important role in improving the quality and consistency of medical procedures in beauty clinics and reducing the workload of medical staff.

[0042] Each of the above-mentioned functions (units) can be configured by, for example, hardware provided in a server device, a DSP (Digital Signal Processor), or software. For example, when configured by software, each of the above-mentioned function blocks 11 to 16 is actually configured with a CPU, RAM, ROM, etc. of a computer, and is realized by the operation of a program stored in a recording medium such as the RAM, ROM, hard disk, or semiconductor memory.

[0043] The present invention can include the following four configuration groups.

[0044] [Technology 1] <Item 1> A system that monitors whether medical procedures are being performed appropriately according to a pre-set manual and issues an alarm if inappropriate procedures are detected, A step of storing a standard manual for various medical procedures in beauty clinics in a database; A step of analyzing real-time data acquired during medical procedures and evaluating whether the procedures are being performed in accordance with a database manual; The system has a step of issuing an alarm if a deviation from the manual is detected. <Item 2> In the system of claim 2, the alarm is a combination of visual and audio signals. <Item 3> In the system described in item 1 or 2, the acquisition of real-time data includes video data from a head-mounted display, biometric information from a biosensor, and operation information of a surgical instrument. <Item 4> In the system described in any one of items 1 to 3, the analysis of the real-time data is performed by an AI engine. <Item 5> In the system described in any one of items 1 to 4, the manual describes detailed procedures for various cosmetic treatments and surgical procedures. <Item 6> In the system described in any one of items 1 to 5, the alarm is issued immediately when an action that does not conform to the manual is detected. <Item 7> In the system described in any one of items 1 to 6, after the alarm is issued, the contents of the alarm are stored as a log for review. <Item 8> In the system described in any one of items 1 to 7, if an action that does not conform to the manual continues, a continuous alarm is issued. <Item 9> In the system described in any one of items 1 to 8, the alarm issues different levels of warning depending on the type of violation and its importance. <Item 10> In the system according to any one of items 1 to 9, the manual is periodically updated, and the system performs evaluation based on the latest manual.

[0045] [Technology 2] <Item 1> A system that presents manuals as needed to medical professionals so that they can smoothly perform medical procedures, analyzing the healthcare professional's voice input and identifying an appropriate section of the manual; The system includes the step of immediately presenting the identified section of the manual. <Item 2> In the system described in item 1, the voice input analysis is performed using natural language processing techniques. <Item 3> In the system described in item 1 or 2, the voice input is analyzed not only for the spoken words of the medical professional but also for specific voice commands. <Item 4> In the system described in any one of items 1 to 3, the section of the manual is displayed on a device such as a head mounted display, a tablet, or a smartphone. <Item 5> In the system according to any one of items 1 to 4, when the identified section of the manual is displayed, necessary illustrations and related information are also displayed. <Item 6> In the system described in any one of items 1 to 5, sections of the manual are scrolled according to voice commands of a medical professional. <Item 7> In the system according to any one of items 1 to 6, past patient data and treatment results related to the section of the displayed manual can be referenced. <Item 8> In the system according to any one of items 1 to 7, when a section of the manual is displayed, a specific case study of a patient suitable for that section is also presented. <Item 9> In the system described in any one of items 1 to 8, the manual is updated periodically, and the system operates based on the latest manual. <Item 10> In the system described in any one of items 1 to 9, when a section of the manual is displayed, the document is summarized and key points are highlighted to make it easier for medical professionals to understand.

[0046] [Technology 3] <Item 1> A system for automating the recording and evaluation of medical examinations and surgical procedures in a beauty clinic, comprising: obtaining and storing a high resolution video recording of the medical procedure; analyzing the video recording with an AI engine to evaluate whether the actions were performed according to the manual; The system includes storing the results of the assessment in an electronic medical history system. <Item 2> In the system described in item 1, the real-time video and audio are recorded using a head-mounted display, a body camera, or the like. <Item 3> In the system described in item 1 or 2, the video and audio recording covers all medical procedures. <Item 4> In the system described in any one of items 1 to 3, the analysis of the real-time video and audio data is performed using an AI engine. <Item 5> In the system according to any one of items 1 to 4, the analysis result indicates whether or not an action consistent with a specific manual has been performed. <Item 6> In the system according to any one of items 1 to 5, after the medical procedure is completed, the recorded data is stored as a log for evaluation and review. <Item 7> In the system according to any one of items 1 to 6, the evaluation and review are performed by the medical professional himself, a colleague, or a superior. <Item 8> In the system described in any one of items 1 to 7, the results of the evaluation and review are used as feedback for improvement or training material. <Item 9> In the system according to any one of items 1 to 8, the manual is periodically updated, and the system performs evaluation based on the latest manual. <Item 10> In the system described in any one of items 1 to 9, the AI ​​engine analyzes video and audio data using a machine learning algorithm including deep learning.

[0047] [Technology 4] A system for performing medical procedures according to a manual using a robot arm, inputting medical procedure manual information into the system; The AI ​​engine analyzes the manual information and generates operation commands for the robot arm; A system comprising a step in which a robotic arm performs a medical procedure according to the generated motion command. <Item 2> In the system described in item 1, the robot arm is capable of movement with six or more degrees of freedom. <Item 3> In the system described in item 1 or 2, the robot arm has a high-precision position adjustment function for accurately reproducing specific treatment procedures. <Item 4> In the system described in any one of items 1 to 3, the robot arm detects the body movement of the patient and adjusts its position accordingly. <Item 5> In the system described in any one of items 1 to 4, the robot arm utilizes real-time sensor feedback to respond to various situations that arise during treatment. <Item 6> In the system described in any one of items 1 to 5, the robot arm has an advanced control algorithm for performing delicate medical procedures. <Item 7> In the system described in any one of items 1 to 6, the AI ​​engine controls the robot arm by utilizing a machine learning algorithm including deep learning. <Item 8> In the system described in any one of items 1 to 7, the robot arm can be remotely operated and can be monitored and operated in real time by a specialized medical professional. <Item 9> In the system described in any one of items 1 to 8, the manual is periodically updated, and the system controls the robot arm based on the latest manual. <Item 10> In the system described in any one of items 1 to 9, the operation results of the robot arm are recorded and stored for later review and feedback.

[0048] The above-described embodiment is merely an example for facilitating understanding of the present invention, and is not intended to limit the present invention. The present invention can be modified or improved without departing from the spirit of the present invention, and it goes without saying that the present invention includes equivalents thereof.

Claims

1. A medical audit system for recording and auditing treatments at beauty clinics, comprising: In the images taken during the treatment, A first learning model created by machine learning using information indicating whether or not a series of procedures related to advance preparations, such as preparation of necessary instruments and items, disinfection, management of the Mayo table, checking for abnormalities in the instruments and items, and understanding of knowledge related to treatment, is being properly performed as training data, and the image; A second learning model created by machine learning using information indicating whether a series of procedures related to endorsement sheets and drug preparation, such as recording and checking patient information, preparing and checking medicines, and preparing a list of prescription drugs, infusions, and anesthesia options for each surgery, are properly performed in a second situation and the image as training data; and A third learning model created by machine learning using information indicating whether a series of procedures related to dialogue and support with a patient, such as explaining to the patient, preparing a room, introducing oneself, and taking a photo, is properly performed in a third situation and the image as training data; and A fourth learning model created by machine learning using information indicating whether or not a series of procedures related to preoperative preparation, such as design support, administration of medicine, preparation for monitoring, and arrangement of the environment, is being properly performed and the image as training data; and A fifth learning model created by machine learning using information indicating whether or not a series of procedures for preparing the surgical field, such as proper disinfection, draping with clean operation, and final confirmation of instruments and items, is being performed properly and the image as training data; and A sixth learning model created by machine learning using information indicating whether or not a sixth situation is in which a series of procedures related to surgical assistance and instrument operation, such as timeouts, drug management, and management and support of instruments during surgery, is being properly performed, and the image as training data; and A seventh learning model created by machine learning using information indicating whether or not a series of procedures related to post-operative responses, such as checking the patient's condition, arranging the environment, and post-operative explanation and care, is being properly performed and the image as training data; and An eighth learning model created by machine learning using information indicating whether or not an eighth situation is in which a series of procedures related to cleaning up after surgery, such as counting needles and gauze, cleaning equipment, and tidying up the environment, is being properly performed, and the image as training data; and A ninth learning model created by machine learning using information indicating whether or not the situation is a ninth situation in which the person has time management skills and the image as training data; and A tenth learning model created by machine learning using information indicating whether or not a tenth situation is occurring in which a series of procedures related to safety measures, such as recording in a narcotics management book, are being properly executed, and the image as training data; and An eleventh learning model created by machine learning using information indicating whether or not an eleventh situation in which the doctor has the ability to appropriately communicate with the patient and the image as training data; A twelfth learning model created by machine learning using information indicating whether or not the practitioner is in a twelfth situation in which the practitioner is capable of confirming that the practitioner complies with the clinic's grooming regulations and the image as training data. A learning model storage unit that stores the An acquisition unit for acquiring a video of the treatment; An auditing unit that audits whether the treatment is being performed correctly by providing the video to the first to twelfth learning models and determining whether the video is in the first to twelfth situations; A medical audit system that includes:

2. 2. The audit system according to claim 1, The acquisition unit acquires the video moving image in real time, The auditing unit audits the video footage in real time; The medical audit system further comprises an alarm unit that issues an alarm if it is detected that the treatment method is not being performed correctly.