Medical accelerator quality assurance system and method based on virtual smart medical platform

Abstract

The application provides a medical accelerator quality assurance system and method based on a virtual intelligent medical platform. The system comprises a mixed reality device for obtaining spatial information in a treatment room and image information of a medical accelerator to be detected; a server comprising a processing device and a database, wherein the database comprises a detection period planning detection item table and an accelerator model library; the mixed reality device is in communication connection with the server, and the obtained spatial information and image information are sent to the processing device of the server; the processing device identifies the image information of the medical accelerator to be detected, finds a corresponding accelerator model in the accelerator model library, calls the detection period planning detection item table of the accelerator of the model, and sends the detection period planning detection item table to the mixed reality device. The application uses the mixed reality device to perform image acquisition and processing, digitizes the QA&QC process, reduces the burden of a physicist, and improves work efficiency.

Description

[0001] This application is a divisional application of Chinese patent application No. 202010040315.4, filed on January 15, 2020, entitled "Quality Assurance System and Method for Medical Accelerator Based on Virtual Intelligent Medical Platform". Technical Field

[0002] This invention belongs to the field of intelligent medicine and relates to external irradiation technology for radiotherapy. Specifically, it relates to a quality assurance system and method for medical accelerators based on a virtual intelligent medical platform. Background Technology

[0003] Malignant tumors are a major chronic disease that seriously endangers human health, and have become the leading cause of death for urban residents and the second leading cause of death for rural residents in my country. Radiotherapy, as one of the main methods of local tumor treatment, plays an increasingly important role in cancer treatment, with approximately 50-70% of patients requiring radiotherapy at some stage of their disease course.

[0004] The clinical goal of radiotherapy is to improve local tumor control and reduce complications in normal tissues. Currently, the mainstream international external beam radiation therapy technology uses linear accelerators. Routine quality assurance of the accelerator reduces uncertainty and errors in instrument performance, ensuring treatment accuracy and equipment precision. The main performance tests include the following three parts: mechanical testing; dose measurement testing; and safety testing.

[0005] Daily quality assurance and quality control (QA & QC) of accelerators is an important job and responsibility of physicists. It is a necessary maintenance measure for the normal operation of accelerators and should be taken seriously, with records kept and archived.

[0006] Currently, quality assurance and quality control of treatment equipment used in tumor radiotherapy are largely reliant on manual management. Data recording during the quality assurance and quality control process is done by quality assurance and quality control personnel using pen and paper. Each hospital's accelerator quality assurance and quality control operates independently, within the framework of mainstream reference standards. When problems arise during quality assurance and quality control, the on-site physicist consults with a senior physicist by telephone.

[0007] Existing quality assurance and quality control methods have many problems. Manual management is not very accurate and is prone to missing individual items without supervision. In some cases, data is even fabricated to reduce workload. There is a lack of unified standard quality control for accelerator quality assurance and quality control processes.

[0008] The lack of digital process recording methods for quality assurance and quality control means that personnel rely on pen and paper to transcribe data, making data recording cumbersome and hindering the accuracy and efficiency of quality assurance and control. Furthermore, there is a lack of remote collaboration methods that allow for a shared perspective in quality assurance and quality control processes, and a lack of process guidance for novice quality assurance and quality control personnel. Summary of the Invention

[0009] This invention aims to establish a quality assurance system and method for medical accelerators based on a virtual intelligent medical platform. Utilizing image recognition, spatial positioning, big data analysis, computer vision, and artificial intelligence technologies provided by the virtual intelligent medical platform, and aided by mixed reality devices, it enables quality control, process recording, and step guidance for accelerator QA & QC.

[0010] According to one aspect of the present invention, a quality assurance system for a medical accelerator based on a virtual intelligent medical platform is provided, the system comprising:

[0011] Mixed reality devices are used to obtain spatial information within the treatment room and image information of the medical accelerometer under examination;

[0012] The server includes a processing device and a database, the database including a detection cycle planning detection item table and an accelerator model library;

[0013] The mixed reality device communicates with the server and sends the obtained spatial and image information to the server's processing device. The processing device identifies the image information of the medical accelerator to be tested, finds the corresponding accelerator model in the accelerator model library, retrieves the testing cycle planning test item table for that model of accelerator, and sends it to the mixed reality device.

[0014] Furthermore, the mixed reality device has a depth camera for performing a full-range spatial scan of the treatment room, and during the scan, spatial anchor points are used to mark the positions of the medical accelerator and its components to be examined in the treatment room.

[0015] Furthermore, the mixed reality device has a visual SLAM positioning module and an IMU positioning module for determining the operator's real-time location.

[0016] Furthermore, the database also includes a tool model library;

[0017] The depth camera of the mixed reality device detects tool images in real time and sends the tool images to the processing device. The processing device identifies the detected tool images, finds the corresponding tool model in the tool model library, and determines whether the detected tool and its usage are correct.

[0018] Furthermore, a menu of testing process steps is generated based on the testing cycle planning testing item list and displayed in the mixed reality device to prompt the operator to perform each test item.

[0019] Furthermore, the mixed reality device reads the detection data in real time and sends it to the processing device. The processing device plans the detection item table based on the detection cycle to determine whether the detection result is within the allowable range. If it is within the allowable range, it prompts that the detection has passed and uploads the obtained data result to the server.

[0020] Furthermore, the mixed reality device records images of the detection process, reads all detection data, and uploads it to the server for storage.

[0021] According to another aspect of the present invention, a method for quality assurance of a medical accelerator based on a virtual intelligent medical platform is provided, the method comprising:

[0022] Using mixed reality devices, spatial information within the treatment room and image information of the medical accelerator under examination are obtained;

[0023] Identify the image information of the medical accelerator to be inspected, find the corresponding accelerator model in the accelerator model library, and retrieve the inspection cycle planning inspection item table for that model of accelerator.

[0024] A menu of steps for guiding the testing process is generated based on the testing project table planned according to the testing cycle, and displayed in the mixed reality device;

[0025] Operators followed the steps of the testing process and the menu to perform each test.

[0026] Furthermore, the method also includes:

[0027] Real-time capture of images from detection tools and matching them with corresponding tool library models to determine whether the selected detection tool and usage method are correct;

[0028] If correct, the permissible range of the detected item is displayed in the mixed reality device, and the next step is performed; if incorrect, prompts and instructions are given.

[0029] Furthermore, the method also includes:

[0030] The mixed reality device reads the detection data in real time and determines whether the detection result is within the acceptable range. If it is within the acceptable range, it indicates that the detection has passed and uploads the obtained data result to the server. If it is not within the acceptable range, it analyzes the reasons and gives corresponding prompts, marks the abnormal data, and uploads it to the server.

[0031] This invention utilizes mixed reality devices for image acquisition and processing, and employs SLAM indoor positioning technology to locate QA & QC personnel, automatically start or end processes, and digitally record QA & QC processes; it intelligently plans process steps, analyzes abnormal situations, reduces the workload of physicists, and improves work efficiency. Attached Figure Description

[0032] The above and other objects, features and advantages of this disclosure will become more apparent from the more detailed description of exemplary embodiments thereof taken in conjunction with the accompanying drawings, wherein like reference numerals generally denote like parts.

[0033] Figure 1 This is a flowchart of the medical accelerator quality assurance method based on a virtual intelligent medical platform according to the present invention.

[0034] Figure 2 This is a block diagram of the medical accelerator quality assurance system based on a virtual intelligent medical platform according to the present invention. Detailed Implementation

[0035] Preferred embodiments of the present disclosure will now be described in more detail with reference to the accompanying drawings. While preferred embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that the present disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

[0036] The Virtual Intelligent (VI) medical platform is an intelligent medical platform built upon holographic technologies such as virtual reality, augmented reality, and mixed reality, as well as technologies such as artificial intelligence and big data. It is used to assist and guide invasive, minimally invasive, and non-invasive clinical diagnosis and treatment processes, and can be applied to fields including but not limited to surgery, internal medicine, radiotherapy, and interventional radiology. This invention is part of the application of the Virtual Intelligent Medical Platform.

[0037] Figure 1 This is a flowchart of the medical accelerator quality assurance method based on a virtual intelligent medical platform according to the present invention. Figure 1 As shown, the quality assurance method for a medical accelerator based on a virtual intelligent medical platform of the present invention includes:

[0038] Using mixed reality devices, spatial information within the treatment room and image information of the medical accelerator under examination are obtained;

[0039] Identify the image information of the medical accelerator to be inspected, find the corresponding accelerator model in the accelerator model library, and retrieve the inspection cycle planning inspection item table for that model of accelerator.

[0040] A menu of steps for guiding the testing process is generated based on the testing project table planned according to the testing cycle, and displayed in the mixed reality device;

[0041] Operators followed the steps of the testing process and the menu to perform each test.

[0042] This invention utilizes mixed reality (MR) devices for image acquisition and processing. MR technology is a further development of virtual reality (VR) technology. By presenting virtual scene information within a real-world setting, it establishes an interactive feedback loop between the real world, the virtual world, and the user, thereby enhancing the realism of the user experience. This invention fully leverages the advantages of MR technology, combining virtual and real elements to present operators with a testing cycle planning and testing item list. This facilitates operators in performing tests according to the list and enables them to obtain testing results information promptly.

[0043] Furthermore, the method also includes:

[0044] The system captures images of the detection tools in real time and matches them with the corresponding tool library models to determine whether the selected detection tools and usage methods are correct. If correct, the system displays the permissible range of the detection items in the mixed reality device and executes the next operation. If incorrect, the system provides prompts and guidance.

[0045] Furthermore, the method also includes:

[0046] The mixed reality device reads the detection data in real time and determines whether the detection result is within the acceptable range. If it is within the acceptable range, it indicates that the detection has passed and uploads the obtained data result to the server. If it is not within the acceptable range, it analyzes the reasons and gives corresponding prompts, marks the abnormal data, and uploads it to the server.

[0047] According to a specific embodiment of the present invention, a quality control method for accelerator QA&QC based on a virtual intelligent medical platform includes the following steps:

[0048] First, the technician or physicist wears the mixed reality device and selects the inspection cycle (daily, monthly, or annual inspection). The mixed reality device communicates with the server, which provides a selection interface. After the operator makes the selection, the corresponding information is uploaded to the server for storage.

[0049] Visual SLAM is used to locate the operator's real-time position and initiate process recording. The SLAM positioning module is installed in the mixed reality device and can determine the operator's real-time position and initiate process recording based on the operator's location.

[0050] The mixed reality device acquires spatial information and image information of each accelerator under examination within the treatment room. Specifically, the depth camera of the mixed reality device performs a 360-degree spatial scan of the treatment room. During the scan, spatial anchor points are used to mark the positions of the accelerators and their components (treatment bed, machine head, etc.) within the treatment room, while simultaneously acquiring 360-degree images of the accelerators under examination.

[0051] The SIFT algorithm is used to extract image features of the accelerator under test for matching. The corresponding model is then found in the accelerator model library and its model number is displayed. SIFT, or Scale-invariant feature transform, is a description used in image processing that possesses scale invariance and can detect image feature points. Based on these image feature points, objects can be easily identified in a feature database. In this embodiment, a model library of accelerators under test is pre-established for various types of accelerators. Based on accelerator images acquired by mixed reality devices, the corresponding model is found in the accelerator model library using the SIFT algorithm.

[0052] Next, based on the accelerator model, the testing cycle planning and testing item table is retrieved, a testing process step-by-step guide menu is generated, and displayed in the mixed reality device. Operators then perform each test according to the prompts in the testing process step-by-step guide menu.

[0053] During the detection process, the mixed reality device captures images of the detection tool in real time and matches them with the corresponding tool library model. The server determines whether the selected detection tool and usage method are correct. If correct, the permissible range of the detection item is displayed in the mixed reality device, and the next step can be performed. If incorrect, prompts and guidance are given.

[0054] The mixed reality device reads the detection data in real time. The server plans the standard values ​​of the detection item table according to the detection cycle, and determines whether the detection results are within the allowable range. If they are within the allowable range, the server indicates that the detection has passed and uploads the obtained data results to the server. If they are not within the allowable range, the server provides a cause analysis and gives corresponding prompts, and marks the abnormal data before uploading it to the server.

[0055] Finally, a combination of a visual SLAM positioning module and an IMU positioning module is used to determine the operator's real-time location. When the operator reaches the appropriate location, the process recording ends and the record is uploaded to the server.

[0056] Figure 2 This is a block diagram of the medical accelerator quality assurance system based on a virtual intelligent medical platform according to the present invention. Figure 2 As shown, the medical accelerator quality assurance system of this embodiment includes:

[0057] Mixed reality devices are used to obtain spatial information within the treatment room and image information of the medical accelerometer under examination;

[0058] The server includes a processing device and a database, the database including a detection cycle planning detection item table and an accelerator model library;

[0059] The mixed reality device communicates with the server and sends the obtained spatial and image information to the server's processing device. The processing device identifies the image information of the medical accelerator to be tested, finds the corresponding accelerator model in the accelerator model library, retrieves the testing cycle planning test item table for that model of accelerator, and sends it to the mixed reality device.

[0060] The processing device plans the inspection items based on the inspection cycle, generates an inspection process step-by-step guidance menu, and sends it to the mixed reality device for display, prompting the operator to perform each item. The mixed reality device records images of the inspection process, reads all inspection data, and uploads it to the server for storage. This achieves digital recording of the entire QA & QC process.

[0061] The medical accelerator quality assurance system in this embodiment consists of two parts: a mixed reality device and a server. This embodiment implements network communication functionality based on the UDP / IP transport layer protocol and the DICOM communication protocol, and uses the ASP.NET Core web application development framework based on .NET Core to implement the mixed reality device. To ensure the security of all communication processes and stored data, all data content is globally encrypted using a non-heap encryption method based on RSA 128.

[0062] In this embodiment, the mixed reality device is a Hololens mobile device, a helmet-mounted mixed reality display device. The Hololens mobile device has a depth camera that can perform a full-range spatial scan of the treatment room. During the scan, spatial anchor points are used to mark the positions of the medical accelerator and its components to be examined in the treatment room.

[0063] Furthermore, the Hololens mobile device features both a visual SLAM positioning module and an IMU positioning module to determine the operator's real-time location. By utilizing indoor SLAM positioning technology to locate the operator, the detection process can be automatically started or stopped. This invention integrates IMU and visual SLAM, complementing the advantages of both IMU and pure visual SLAM, enabling better adaptation to motion-based applications and achieving accurate positioning.

[0064] The database also includes a tool model library. The depth camera of the HoloLens mobile device detects tool images in real time and sends them to a processing unit. The processing unit identifies the detected tool images, finds the corresponding tool model in the tool model library, and determines whether the detection tool and its usage are correct. If correct, the permissible range of the detected item is displayed on the HoloLens mobile device, allowing the next step to be performed. If incorrect, prompts and guidance are provided. Therefore, missed detections are avoided, and detection accuracy is improved.

[0065] The Hololens mobile device reads the detection data in real time and sends it to the processing unit. The processing unit determines whether the detection results are within the acceptable range based on the detection cycle and the planned detection item list. If they are within the acceptable range, the detection is indicated as passed, and the obtained data results are uploaded to the server. If they are not within the acceptable range, the processing unit analyzes the cause and provides corresponding prompts, marks the abnormal data, and then uploads it to the server.

[0066] Furthermore, this embodiment also provides a remote assistance function, enabling perspective sharing between mixed reality devices and mobile phones or tablets. Remote physicists can accurately guide physicists in the treatment room to solve some challenging problems, overcoming spatial barriers and improving upon traditional telephone guidance methods. Through system or remote assistance, abnormal situations can be analyzed, reducing the burden on operators. The remote call process data is video-encoded data, employing a high-compression video compression encoding method based on the MPEG-4 (ISO / IEC 14496-8) encoding standard established by the International Organization for Standardization (ISO) and the International Electrotechnical Commission (IEC). For the application environment and scenarios of this invention, the bit rate and bit rate of the above encoding method are specifically limited to ensure call quality in high-latency, unstable network environments and avoid call stuttering.

[0067] The various embodiments of this disclosure have been described above. These descriptions are exemplary and not exhaustive, and are not limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical applications, or technological improvements to the embodiments in the market, or to enable others skilled in the art to understand the embodiments disclosed herein. This specification generally relates to a treatment device for radiotherapy, and more specifically, to a treatment device combining radiotherapy and magnetic resonance imaging (MRI) techniques.

Claims

1. A quality assurance system for medical accelerators based on a virtual intelligent medical platform, characterized in that, include: Mixed reality equipment is used to obtain spatial information within the treatment room and image information of the medical accelerator under examination, and allows operators to select the testing cycle; The server includes a processing device and a database, the database including a detection cycle planning detection item table and an accelerator model library; The mixed reality device communicates with the server and sends the obtained spatial and image information to the server's processing device. The processing device identifies the image information of the medical accelerator to be tested, finds the corresponding accelerator model in the accelerator model library, retrieves the testing cycle planning test item table for that model of accelerator, generates a testing process step guidance menu based on the testing cycle planning test item table, and sends it to the mixed reality device for display, prompting the operator to perform each test item.

2. The system according to claim 1, characterized in that, The testing cycle includes daily, monthly, and annual testing.

3. The system according to claim 1, characterized in that, The mixed reality device reads the detection data in real time and sends it to the processing device. The processing device determines whether the detection result is within the allowable range based on the detection cycle planning detection item table. If it is within the allowable range, it prompts that the detection has passed and uploads the obtained data result to the server.

4. The system according to claim 1, characterized in that, The mixed reality device has a depth camera that can perform a full-range spatial scan of the treatment room. During the scan, spatial anchor points are used to mark the positions of the medical accelerator and its components to be examined in the treatment room.

5. The system according to claim 4, characterized in that, The database also includes a tool model library; the depth camera of the mixed reality device detects tool images in real time and sends the tool images to the processing device, which identifies and detects the tool images, finds the corresponding tool model in the tool model library, and determines whether the detected tool and its usage are correct. If correct, the permissible range of the current detection item is displayed in the mixed reality device, and the next detection operation is performed. If incorrect, prompts and instructions will be provided.

6. The system according to claim 1, characterized in that, The mixed reality device includes a visual SLAM positioning module, which can determine the real-time location of the operator and determine to start process recording based on the operator's location.

7. The system according to claim 6, characterized in that, The mixed reality device further includes an IMU positioning module. The visual SLAM positioning module is combined with the IMU positioning module to determine the real-time location of the operator. When the operator reaches the appropriate location, the process recording ends and the record is uploaded to the server.

8. The system according to claim 1, characterized in that, The mixed reality device records images of the detection process, reads all detection data, and uploads it to the server for storage.

9. The system according to claim 1, characterized in that, The mixed reality device shares the view with a mobile phone or tablet.

10. A quality assurance method for medical accelerators based on a virtual intelligent medical platform, characterized in that, The method includes: Using mixed reality devices, spatial information within the treatment room and image information of the medical accelerator under examination are obtained; Receive the testing cycle selected by the operator; Identify the image information of the medical accelerator to be inspected, find the corresponding accelerator model in the accelerator model library, and retrieve the inspection cycle planning inspection item table for that model of accelerator. Based on the testing cycle planning testing item list, a testing process step guide menu is generated and displayed in the mixed reality device to prompt operators to perform testing item by item according to the testing process step guide menu.

Images