Treatment audit system

Abstract

To provide a treatment audit system for auditing whether or not aesthetic medicine is appropriately performed.SOLUTION: There is provided a medical audit system for recording treatments in beauty clinics, and auditing whether treatment is performed in accordance with specific procedures of "nipple reduction surgery by breast conserving surgery and wedge resection". The medical audit system includes a function of generating a model relating to each procedure from images obtained by photographing the treatment, a function of analyzing a newly acquired video, and a function of auditing whether or not the treatment in the video is performed according to the procedures. The medical audit system makes it possible to automatically audit whether each procedure of the nipple reduction surgery is performed properly. Accordingly, this makes it possible to efficiently manage quality of the treatment, secure appropriateness of the surgery, and reduce the risk of medical errors.SELECTED DRAWING: None

Description

[Technical Field]

[0001] The present invention relates to a treatment audit system. [Background technology]

[0002] In recent years, the need for aesthetic medical treatment has increased, with various hospitals and clinics offering a wide variety of aesthetic medical treatments. In response to this growing need, it has also become increasingly important to provide aesthetic medical treatment more efficiently, accurately, and safely. [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] Japan Society of Aesthetic Plastic Surgery, "Japan Society of Aesthetic Plastic Surgery Bulletin Cosmetic Medical Practice Guidelines (Reiwa 3 Revised Edition)," published on October 10, 2022 Summary of the Invention [Problem to be solved by the invention]

[0004] The present invention provides a method for evaluating whether cosmetic medical treatment is being performed appropriately in order to meet the need for more efficient, more accurate, and safer cosmetic medical treatment. [Means for solving the problem]

[0005] According to the present invention, there are provided a method for evaluating whether cosmetic medical treatment is being performed more efficiently, accurately, and safely, an evaluation device, an evaluation system, an evaluation program, an analysis method, an analysis device, an analysis system, an analysis program, a medical accident prevention method, a medical accident prevention device, a medical accident prevention system, a medical accident prevention program, a medical safety assurance method, a medical safety assurance device, a medical safety assurance system, and a medical safety assurance program. [Effects of the Invention]

[0006] According to the present invention, it is possible to improve the safety and efficiency of treatment, and to ensure support and safety of treatment by using a terminal. DETAILED DESCRIPTION OF THE INVENTION

[0007] Embodiments of the present invention can be utilized as an evaluation method, evaluation device, evaluation system, evaluation program, analysis method, analysis device, analysis system, analysis program, medical accident prevention method, medical accident prevention device, medical accident prevention system, medical accident prevention program, medical safety assurance method, medical safety assurance device, medical safety assurance system, and medical safety assurance program, for determining whether cosmetic medical care is being performed more efficiently, more accurately, and more safely.

[0008] [Technology 1] This invention is a monitoring system for compliance with manuals for treatment procedures at beauty clinics. Specifically, it captures information on the movements of medical professionals and the tools they use during treatment in real time, and uses AI to determine whether the procedure is being performed according to the manual. If the procedure is not performed properly, the system immediately issues an alert. This improves patient safety and reduces the possibility of medical errors.

[0009] Specifically, the present invention is a system for monitoring compliance with a procedure manual in a beauty clinic. The problem addressed by this invention is the reduction in patient safety due to human error or deviation from the manual during surgery or examination. Specifically, human error and non-compliance with routines are serious issues in beauty clinics, where adherence to procedures is required. Specifically, the present invention is a system that captures information on medical personnel's movements and the tools they use in real time and uses artificial intelligence (AI) to determine whether those actions conform to the manual. If appropriate behavior is not observed, an alert is immediately issued, enabling appropriate response. The effects of this invention include significantly improving patient safety. By detecting deviations from the manual in real time, medical errors can be prevented. Furthermore, by recording the medical personnel's reactions to alerts and their subsequent actions, information useful for subsequent improvement activities can be collected. Furthermore, this invention promotes the training and skill development of medical personnel. Based on the generated alerts, specific areas for improvement can be identified, such as the situations in which medical personnel tend to deviate from the manual or the types of procedures that are difficult.

[0010] The system of the present invention includes the following elements: First, sensor devices, such as high-resolution cameras and motion sensors, are used to capture the movements of medical personnel. This allows detailed recording of the surgeon's movements and the operation of surgical tools during surgery. Second, RFID (Radio Frequency Identification) tags and barcode scanners are installed to identify the tools and chemicals used.

[0011] Motion sensors and high-resolution cameras capture the movements of medical professionals in real time, and the data is sent to the AI ​​engine. For example, the moment a doctor picks up a surgical instrument, their hand movements are captured and information is generated. Specific movement patterns during surgery (e.g., the direction and depth of the incision) are also captured as data.

[0012] RFID tags and barcode scanners are used to identify the instruments and medicines used. For example, RFID tags or barcodes attached to syringes, scalpels, and even medicines can be scanned to record which instruments or medicines were used and when. This ensures that the correct instruments and medicines are used at the right time.

[0013] This data is sent in real time to an AI engine, which uses deep learning algorithms to determine whether the data corresponds to a manual action. This determination covers a wide range of topics, including the timing of use of various instruments, surgical procedures, and the amount and timing of drug use.

[0014] If any behavior that does not comply with the manual is detected, the AI ​​engine generates an alert and warns medical personnel. This alert can be communicated in the form of a message displayed on the screen, an audio notification, or a vibration on a specific device (e.g., a smartwatch). Detailed information about the alert and appropriate responses are also provided. In this way, by combining specific sensor devices and AI technology, this invention monitors compliance with medical procedure manuals in beauty clinics in real time, improving patient safety.

[0015] The auditing system according to this embodiment will be described in detail below. Armpit odor is a serious discomfort in daily life, and traditional treatments only provide temporary relief and may cause side effects. This invention provides a new method for fundamentally eliminating armpit odor by directly dissolving and removing apocrine sweat glands.

[0016] The present invention uses an ultrasonic vibration device with a specific frequency to directly act on the apocrine sweat glands, effectively dissolving and removing them. This fundamentally eliminates the apocrine sweat glands that cause axillary odor, resulting in long-term improvement in axillary odor. Another advantage is that the incision is small, allowing for quick recovery after surgery.

[0017] In this embodiment of the present invention, each step of the procedure is first filmed and a model is generated using these images. The focus is on the following steps: local anesthesia at the incision site, incision with a scalpel, local anesthesia at the wound site, skin turnover, and removal of the apocrine glands with a Metzen's technique. The newly acquired video is then analyzed to verify that the procedure in the video is performed according to the steps based on the generated model.

[0018] The present invention provides a medical audit system for recording and auditing treatments at beauty clinics, In the images taken during the treatment, A first learning model created by machine learning using information indicating whether or not the incision site is in a first situation in which local anesthesia is administered and the image as training data; a second learning model created by machine learning using information indicating whether or not a second situation in which an incision is being made with a scalpel and the image as training data; and A third learning model created by machine learning using information indicating whether or not the third situation is one in which local anesthesia is administered to the wound and the image as training data; a fourth learning model created by machine learning using information indicating whether or not a fourth situation in which the skin is turned inside out and the apocrine glands are removed using Metzen's method and the image as training data; a learning model storage unit that stores the an acquisition unit that acquires a video of the treatment; and an auditing unit that audits whether the treatment is being performed correctly by providing the video footage to the first to fourth learning models and determining whether the first to fourth situations are occurring.

[0019] The "first learning model created by machine learning using information indicating whether the incision site is in the first situation where local anesthesia has been administered and the image as training data" is a model for confirming that local anesthesia has been administered accurately to the incision site before the procedure begins. This model identifies the injection site, injection depth, injection angle, etc. of the local anesthetic.

[0020] The "second learning model created by machine learning using information indicating whether or not a second situation in which an incision is being made with a scalpel and the image as training data" is intended to evaluate whether the incision is being made accurately and safely. This model identifies the depth, direction, length, etc. of the incision and audits whether the incision is being made appropriately.

[0021] The "third learning model created by machine learning using information indicating whether the wound is in the third situation where local anesthesia is administered and the image as training data" is intended to evaluate whether local anesthesia is being administered appropriately to the wound after incision. This model identifies the site and depth of anesthesia re-injection and audits whether pain management is being performed appropriately.

[0022] The "fourth learning model, created by machine learning using information indicating whether the fourth situation, in which the skin is turned inside out and the apocrine glands are removed using Metzen's method and the image as training data," is intended to evaluate whether the apocrine glands have been properly removed. This model identifies the extent and method of gland removal and audits whether the treatment for axillary odor is being carried out appropriately.

[0023] The system may capture video in real time, and the auditing unit may audit the video in real time. The system may further include an alarm unit that issues an alarm when it is detected that the treatment is not being performed correctly.

[0024] The audit model used by the Audit Department is explained below. The audit model primarily uses deep learning techniques. This model determines the face band application process for each frame of video and evaluates whether the correct process has been followed. Specifically, it uses a Convolutional Neural Network (CNN) to extract image features for each frame and a Long Short-Term Memory (LSTM) to determine temporal continuity.

[0025] Specifically, the model is generated using the following steps: Data collection: Collect video data of correct and incorrect use of the face band, preferably with labels for each step. Data preprocessing: The video is divided into frames, and each frame is organized as a dataset along with its label. Model training: CNN is used to extract image features from each frame, and LSTM is used to learn temporal continuity. Model evaluation: The performance of the model is evaluated using a test dataset. Specific evaluation metrics include accuracy, precision, recall, and F1 score. Model application: The model is applied to videos of actual medical settings to audit whether treatments are being performed appropriately.

[0026] [Technology 2] The invention is an augmented reality (AR) device that allows medical professionals to smoothly refer to manuals while performing procedures. This device is headset-type or eyeglass-type and displays manual instructions directly within the field of view of the medical professional while performing surgery. This allows for more efficient and faster manual review than conventional paper-based or electronic manuals.

[0027] The problem that this invention aims to solve is that it is difficult to refer to the manuals required for medical procedures, which hinders the smooth execution of examinations and surgeries. In particular, some procedures are complex, and if the appropriate manual cannot be instantly referenced, the quality and efficiency of the procedures may decrease.

[0028] The specific content of this invention is a system that utilizes AI and Augmented Reality (AR) technology to provide appropriate manuals for each procedure. When a medical professional starts a procedure, the AI ​​selects the manual corresponding to that procedure from a database and displays it in real time through an AR device (e.g., AR glasses or a head-mounted display). A voice recognition system is also used, allowing the medical professional to request the next step by voice.

[0029] The effect of this invention is that it becomes much easier to refer to the manual, thereby improving the quality and efficiency of medical procedures. Specifically, by visually presenting the manual in real time using AR technology, examinations and surgeries can be carried out smoothly. In addition, by using a voice recognition system, it becomes possible to refer to the manual and give instructions on the procedure even when one's hands are full.

[0030] Additionally, the present invention can be used in education and training, where the system of the present invention can be used to educate and train new medical personnel, potentially increasing the speed at which they learn new procedures.

[0031] As described above, the present invention plays an important role in improving the quality and efficiency of medical treatments in beauty clinics.

[0032] [Technology 3] This invention is an AI audit system that integrates the recording of medical examinations and surgeries with the evaluation of compliance with the manual. This system videotapes each stage of the medical treatment, and then the AI ​​evaluates the degree of compliance with the manual. The AI ​​evaluation results are used as feedback for medical professionals, contributing to the provision of higher quality medical services.

[0033] The problem that this invention aims to solve is the difficulty of properly evaluating whether medical procedures are being performed in accordance with a manual and recording and analyzing the results over the long term. If this problem cannot be solved, it may be impossible to gain insight into improving the quality of medical procedures, preventing medical errors, and improving the education of medical professionals.

[0034] The specific content of this invention is a medical procedure recording and evaluation system that utilizes AI and video recording technology. The AI ​​engine analyzes high-resolution video feeds in real time to evaluate whether each step of a procedure or examination is performed according to the manual. This evaluation is performed automatically and a detailed report is generated. The report is stored in an electronic medical history system for later reference and analysis.

[0035] The system also records high-resolution video of surgical and examination procedures, which are then automatically tagged and evaluated by AI, allowing for the recording of minute details and abnormalities that are often overlooked during the medical procedure to be recorded and analyzed later.

[0036] The benefits of this invention include quality assurance and continuous improvement of medical procedures. Automatic evaluation by AI and high-resolution video recording make it possible to check whether examinations and surgeries are being performed according to the manual and provide appropriate feedback. Furthermore, the records and evaluation results are stored in an electronic medical history system, allowing for long-term trend analysis and use as training material.

[0037] As described above, the present invention plays an important role in improving the efficiency and quality of recording and evaluation of medical procedures in beauty clinics.

[0038] [Technology 4] This invention is a system that uses robotics technology to complement or replace medical procedures in beauty clinics. This system inputs manual information into AI, which then uses the input to allow the robot to perform the medical procedure. For example, robots are used for procedures that require precision and consistency, such as injections, delicate surgery, and even the application of cosmetics. This enables standardization of medical quality and reduces the workload of medical professionals.

[0039] The problem that this invention aims to solve is that there are limitations to the examinations and surgeries performed by human medical professionals, and it is difficult to ensure quality and consistency, especially when high precision and delicate operations are required.

[0040] The specific content of this invention is a robotic arm that inputs information from a manual and performs medical procedures as instructed, and an AI engine that controls its movements. First, the information from the manual (e.g., surgical procedures, selection and use of surgical instruments, etc.) is input into the system. The AI ​​engine then analyzes the information and generates specific movement commands for the robotic arm. The robotic arm performs medical procedures as instructed in the manual in accordance with the commands received from the AI ​​engine.

[0041] The benefits of this invention include improved quality and consistency in medical procedures. In particular, in surgeries requiring delicate manipulation, the precise movements of the robotic arm can achieve greater accuracy and consistency than those performed by human medical professionals. In addition, because the robotic arm's movements are based on a manual and controlled by an AI engine, it can easily adapt to updates or changes to the manual.

[0042] Furthermore, the present invention contributes to reducing the workload of medical professionals, particularly by reducing fatigue and stress caused by long surgeries and continuous medical examinations, thereby reducing the risk of medical errors.

[0043] As described above, the present invention plays an important role in improving the quality and consistency of medical procedures in beauty clinics and reducing the workload of medical staff.

[0044] The above-mentioned functions (units) can be configured by, for example, hardware provided in a server device, a DSP (Digital Signal Processor), or software. For example, when configured by software, the above-mentioned function blocks 11 to 16 are actually configured with a CPU, RAM, ROM, etc. of a computer, and are realized by the operation of a program stored in a recording medium such as RAM, ROM, a hard disk, or a semiconductor memory.

[0045] The present invention can include the following four groups of configurations.

[0046] [Technology 1] <Item 1> A system that monitors whether medical procedures are being performed appropriately according to a pre-set manual and issues an alarm if inappropriate procedures are detected, a step of storing a standard manual for various medical procedures in beauty clinics in a database; A step of analyzing real-time data acquired during medical procedures and evaluating whether the procedures are being performed in accordance with the database manual; The system has a step of issuing an alarm if a deviation from the manual is detected. <Item 2> In the system of claim 2, the alarm is a combination of visual and audible signals. <Item 3> In the system described in item 1 or 2, the acquisition of real-time data includes video data from a head-mounted display, biometric information from a biometric sensor, and operation information of a surgical instrument. <Item 4> In the system described in any one of items 1 to 3, the analysis of the real-time data is performed by an AI engine. <Item 5> In the system described in any one of items 1 to 4, the manual describes detailed procedures for various cosmetic treatments and surgical procedures. <Item 6> In the system described in any one of items 1 to 5, the alarm is issued immediately when an act that does not conform to the manual is detected. <Item 7> In the system described in any one of items 1 to 6, after the alarm is issued, the contents of the alarm are saved as a log for review. <Item 8> In the system described in any one of items 1 to 7, if an action that does not conform to the manual continues, a continuous alarm is issued. <Item 9> In the system described in any one of items 1 to 8, the alarm issues different levels of warning depending on the type of violation and its importance. <Item 10> In the system described in any one of items 1 to 9, the manual is updated periodically, and the system performs evaluation based on the latest manual.

[0047] [Technology 2] <Item 1> A system that presents manuals as needed to medical professionals so that they can smoothly carry out medical procedures, analyzing the healthcare professional's voice input and identifying the appropriate section of the manual; The system includes the step of immediately presenting the identified section of the manual. <Item 2> In the system described in item 1, the voice input analysis is performed using natural language processing techniques. <Item 3> In the system according to item 1 or 2, the voice input is analyzed not only for the spoken words of the medical professional but also for specific voice commands. <Item 4> In the system described in any one of items 1 to 3, the section of the manual is displayed on a device such as a head-mounted display, a tablet, or a smartphone. <Item 5> In the system described in any one of items 1 to 4, when the identified section of the manual is displayed, necessary illustrations and related information are also displayed. <Item 6> In the system described in any one of items 1 to 5, sections of the manual are scrolled according to voice commands from a medical professional. <Item 7> In the system described in any one of items 1 to 6, past patient data and treatment results related to the section of the displayed manual can be referenced. <Item 8> In the system according to any one of items 1 to 7, when a section of the manual is displayed, a specific case study of a patient suitable for that section is also presented. <Item 9> In the system described in any one of items 1 to 8, the manual is updated periodically, and the system operates based on the latest manual. <Item 10> In the system described in any one of items 1 to 9, when a section of the manual is displayed, the document is summarized and key points are highlighted to make it easier for medical professionals to understand.

[0048] [Technology 3] <Item 1> A system that automates the recording and evaluation of medical examinations and surgical procedures at beauty clinics, obtaining and storing a high resolution video recording of the medical procedure; analyzing the video recording with an AI engine to assess whether the actions were performed in accordance with the manual; The system includes storing the results of the assessment in an electronic medical history system. <Item 2> In the system described in item 1, the real-time video and audio are recorded using a head-mounted display, a body camera, or the like. <Item 3> In the system described in item 1 or 2, the video and audio recording covers all medical procedures. <Item 4> In the system described in any one of items 1 to 3, the analysis of the real-time video and audio data is performed using an AI engine. <Item 5> In the system described in any one of items 1 to 4, the analysis result indicates whether or not an action consistent with a specific manual is being performed. <Item 6> In the system according to any one of items 1 to 5, after the medical procedure is completed, the recorded data is stored as a log for evaluation and review. <Item 7> In the system according to any one of items 1 to 6, the evaluation and review are performed by the medical professional himself, a colleague, or a superior. <Item 8> In the system described in any one of items 1 to 7, the results of the evaluation and review are used as feedback for improvement or training material. <Item 9> In the system described in any one of items 1 to 8, the manual is updated periodically, and the system performs evaluation based on the latest manual. <Item 10> In the system described in any one of items 1 to 9, the AI ​​engine analyzes video and audio data using a machine learning algorithm including deep learning.

[0049] [Technology 4] A system that performs medical procedures according to a manual using a robotic arm, inputting medical procedure manual information into the system; The AI ​​engine analyzes the manual information and generates operation commands for the robot arm. A system comprising a step in which a robotic arm performs a medical procedure in accordance with the generated motion command. <Item 2> In the system described in item 1, the robot arm is capable of movement with six or more degrees of freedom. <Item 3> In the system described in item 1 or 2, the robot arm has a high-precision position adjustment function for accurately reproducing specific treatment procedures. <Item 4> In the system described in any one of items 1 to 3, the robot arm detects the movement of the patient's body and adjusts its position accordingly. <Item 5> In the system described in any one of items 1 to 4, the robot arm utilizes real-time sensor feedback to respond to various situations that arise during treatment. <Item 6> In the system described in any one of items 1 to 5, the robot arm has an advanced control algorithm for performing delicate medical procedures. <Item 7> In the system described in any one of items 1 to 6, the AI ​​engine controls the robot arm using a machine learning algorithm including deep learning. <Item 8> In the system described in any one of items 1 to 7, the robot arm can be operated remotely and can be monitored and operated in real time by a specialized medical professional. <Item 9> In the system described in any one of items 1 to 8, the manual is updated periodically, and the system controls the robot arm based on the latest manual. <Item 10> In the system described in any one of items 1 to 9, the operation results of the robot arm are recorded and saved for later review and feedback.

[0050] The above-described embodiment is merely an example for facilitating understanding of the present invention, and is not intended to limit the present invention. The present invention can be modified and improved without departing from the spirit thereof, and it goes without saying that the present invention includes equivalents thereof.

Claims

1. A medical audit system for recording and auditing treatments at beauty clinics, comprising: In the images taken during the treatment, A first learning model created by machine learning using information indicating whether or not a first situation in which local anesthesia is administered to an incision site and the image as training data; A second learning model created by machine learning using information indicating whether or not a second situation in which an incision is being made with a scalpel and the image as training data; and A third learning model created by machine learning using information indicating whether or not a third situation in which local anesthesia is administered to the wound and the image as training data; A fourth learning model created by machine learning using information indicating whether or not a fourth situation in which the skin is turned inside out and the apocrine glands are removed by Metzen's method and the image as training data; A learning model storage unit that stores the An acquisition unit for acquiring a video of the treatment; an auditing unit that audits whether the treatment is being performed correctly by providing the video to the first to fourth learning models and determining whether the video is in the first to fourth situations; A medical audit system that includes:

2. 2. The audit system according to claim 1, The acquisition unit acquires the video moving image in real time, The auditing unit audits the video footage in real time; The medical audit system further comprises an alarm unit that issues an alarm if it is detected that the treatment method is not being performed correctly.