Information monitoring system and method, electronic equipment and medium
The patient's skin color characteristic information is obtained through the RGB camera and the structured light camera exposure parameters are adjusted, which solves the problem that changes in skin color affect the monitoring accuracy of body surface information, realizes automatic adjustment, improves monitoring accuracy and efficiency, and ensures precise radiotherapy.
Patent Information
- Application Number
- CN202411380364.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-30
- Publication Date
- 2024-12-06
AI Technical Summary
Changes in the patient's skin color characteristics affect the accuracy of body surface information monitoring. The existing technology relies on technicians to subjectively adjust exposure parameters, making it difficult to achieve accurate radiotherapy.
The skin color characteristic information is obtained through the RGB camera, the structured light camera exposure parameters are adjusted, the body surface 3D point cloud information is obtained, and the patient's position changes are characterized by large-field image information to improve monitoring accuracy.
It realizes automatic adjustment of exposure parameters, improves the accuracy and efficiency of body surface information monitoring, simplifies the workflow of doctors, and ensures the implementation of precise radiotherapy.
Smart Images

Figure CN119075210A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the medical field, and in particular to an information monitoring system, method, electronic equipment and medium. Background Art
[0002] Radiation therapy is an important method of cancer treatment. In recent years, image-guided radiotherapy has gradually become a means of implementing precision radiotherapy. Image-guided equipment is used to obtain the patient's anatomical and positional information on the treatment bed, thereby providing clinicians with a reference for further correcting systematic errors and random errors in radiotherapy, thereby improving the accuracy of treatment.
[0003] However, in actual clinical applications, it is found that the skin color characteristics of patients vary widely due to factors such as race, region, and light exposure. In addition, tumors in different parts of the same patient will have different degrees of pigmentation on the skin surface as the course of radiotherapy progresses (increase in the number of radiotherapy sessions and radiation dose), and the skin color characteristics will change within a certain range. This change in skin color characteristics will affect the monitoring of the patient's body surface information (deterioration in accuracy). In clinical practice, technicians are required to manually adjust the camera exposure parameters based on their own subjective judgment, but due to personal experience, this adjustment is often difficult to achieve ideal monitoring effects, and thus cannot effectively guide radiotherapy, affecting the implementation of precision radiotherapy. Summary of the invention
[0004] The purpose of the present invention is to provide an information monitoring system, method, electronic device and medium. Before monitoring the patient's body surface information, this solution first obtains the patient's skin color feature information through an RGB camera, and adjusts the exposure parameters of the structured light camera to an appropriate value based on the skin color feature information, thereby improving the accuracy of body surface information monitoring.
[0005] In order to solve the above technical problems, the present invention provides an information monitoring system, comprising:
[0006] A plurality of visual sampling components, used to control the RGB camera to obtain the patient's skin color feature information after receiving the first trigger pulse signal, and control the structured light camera to obtain the patient's body surface 3D point cloud information according to the adjusted current exposure parameters after receiving the second trigger pulse signal, the visual sampling components including: the RGB camera and the structured light camera;
[0007] A trigger control unit, configured to simultaneously output the first trigger pulse signal to each of the visual sampling components after receiving a first start instruction sent by the processing unit, and simultaneously output the second trigger pulse signal to each of the visual sampling components after receiving a second start instruction sent by the processing unit;
[0008] The processing unit is used to adjust the current exposure parameters of the structured light camera based on the skin color feature information, and determine the large field of view image information based on the body surface 3D point cloud information, the monitoring field of view size corresponding to the large field of view image information meets the preset large field of view judgment condition, and is used to characterize the patient's positioning posture changes.
[0009] Optionally, the processing unit is specifically used to:
[0010] Determine the target exposure parameter corresponding to the skin color feature information according to the skin color feature information and a preset patient skin color and camera exposure parameter think tank, wherein the preset patient skin color and camera exposure parameter think tank includes a plurality of groups of one-to-one corresponding preset patient skin colors and preset camera exposure parameters;
[0011] The target exposure parameter is used as a new exposure parameter of the structured light camera.
[0012] Optionally, also include:
[0013] A filtering module, used for filtering the skin color feature information and the body surface 3D point cloud information accordingly, and transmitting the filtered skin color feature information and the filtered body surface 3D point cloud information to the amplification module;
[0014] The amplification module is used to amplify the signals corresponding to the filtered skin color feature information and the filtered body surface 3D point cloud information, and transmit the amplified signals to the processing unit.
[0015] Optionally, the structured light camera is a stripe structured light camera or a random speckle structured light camera.
[0016] Optionally, the processing unit is further used for:
[0017] Determining whether the patient's body position change exceeds a preset change threshold range according to the body surface 3D point cloud information;
[0018] If the patient's body position changes beyond a preset change threshold range, the direct addition system is controlled to stop outputting the treatment beam to the patient.
[0019] Optionally, the processing unit is further used for:
[0020] Determine the current respiratory state of the patient according to the body surface 3D point cloud information;
[0021] Gated treatment is performed on a characteristic organ of the patient based on the current respiratory state.
[0022] Optionally, the processing unit is further used for:
[0023] Acquiring X-ray fluorescence image information of the patient during radiotherapy positioning;
[0024] Performing bone structure registration on the large field of view image information and the X-ray fluorescence image information to obtain a positioning posture offset;
[0025] The setup posture of the patient is adjusted based on the setup posture offset.
[0026] Optionally, also include:
[0027] The power management unit is used to convert the mains power into the first power required for the operation of each of the visual sampling components, convert the mains power into the second power required for the operation of the trigger control unit, and convert the mains power into the third power required for the operation of the processing unit.
[0028] In order to solve the above technical problems, the present invention also provides an information monitoring method, comprising:
[0029] Using a plurality of visual sampling components to control an RGB camera to obtain skin color feature information of a patient after receiving a first trigger pulse signal, and to control a structured light camera to obtain 3D point cloud information of the patient's body surface according to an adjusted current exposure parameter after receiving a second trigger pulse signal, the visual sampling components comprising: the RGB camera and the structured light camera;
[0030] Using the trigger control unit to simultaneously output the first trigger pulse signal to each of the visual sampling components after receiving the first start instruction sent by the processing unit, and to simultaneously output the second trigger pulse signal to each of the visual sampling components after receiving the second start instruction sent by the processing unit;
[0031] The processing unit is used to adjust the current exposure parameters of the structured light camera based on the skin color feature information, and determine the large field of view image information based on the body surface 3D point cloud information. The monitoring field size corresponding to the large field of view image information meets the preset large field of view judgment condition, which is used to characterize the patient's positioning posture changes.
[0032] In order to solve the above technical problems, the present invention further provides an electronic device, comprising:
[0033] Memory, used to store computer programs;
[0034] A processor is used to execute the computer program to implement the information monitoring method as described above.
[0035] In order to solve the above technical problems, the present invention also provides a computer-readable storage medium for storing a computer program, and the computer program implements the information monitoring method as described above when executed by a processor.
[0036] The purpose of the present invention is to provide an information monitoring system, method, electronic device and medium. Considering that changes in the patient's skin color characteristics will affect the accuracy of monitoring the patient's body surface information, before monitoring the patient's body surface information, this scheme first sends a first trigger pulse signal through a trigger control unit to enable a processing unit to obtain the patient's skin color characteristic information collected by an RGB camera, and adjust the exposure parameters of the structured light camera to an appropriate value through the skin color characteristic information, and then send a second pulse signal through the trigger control unit to obtain the patient's body surface 3D point cloud information through the adjusted structured light camera. The processing unit can determine a large field of view image information based on the body surface 3D point cloud information, so as to use the large field of view image information to characterize the patient's positioning posture changes, thereby greatly improving the accuracy of body surface information monitoring. BRIEF DESCRIPTION OF THE DRAWINGS
[0037] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.
[0038] Figure 1 A structural schematic diagram of an information monitoring system provided by the present invention;
[0039] Figure 2 A schematic diagram of information monitoring optimization provided by the present invention;
[0040] Figure 3 A schematic diagram of the structure of another information monitoring system provided by the present invention;
[0041] Figure 4 A process flow chart of an information monitoring method provided by the present invention;
[0042] Figure 5 The present invention provides a schematic structural diagram of an electronic device. DETAILED DESCRIPTION
[0043] The core of the present invention is to provide an information monitoring system, method, electronic device and medium. Before monitoring the patient's body surface information, this solution first obtains the patient's skin color feature information through an RGB (Red Green Blue) camera, and adjusts the exposure parameters of the structured light camera to a suitable value based on the skin color feature information, thereby improving the accuracy of body surface information monitoring.
[0044] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0045] Please refer to Figure 1 , Figure 1 This is a schematic diagram of the structure of an information monitoring system provided by the present invention. The system includes:
[0046] A plurality of visual sampling components 1, used to control the RGB camera to obtain the patient's skin color feature information after receiving the first trigger pulse signal, and control the structured light camera to obtain the patient's body surface 3D point cloud information according to the adjusted current exposure parameters after receiving the second trigger pulse signal, the visual sampling component 1 includes: an RGB camera and a structured light camera;
[0047] A trigger control unit 2, configured to simultaneously output a first trigger pulse signal to each visual sampling component 1 after receiving a first start instruction sent by the processing unit 3, and simultaneously output a second trigger pulse signal to each visual sampling component 1 after receiving a second start instruction sent by the processing unit 3;
[0048] Processing unit 3 is used to adjust the current exposure parameters of the structured light camera based on the skin color feature information, and determine the large field of view image information based on the 3D point cloud information of the body surface. The monitoring field size corresponding to the large field of view image information meets the preset large field of view judgment conditions and is used to characterize the patient's positioning posture changes.
[0049] In the present invention, considering that during radiotherapy, the patient's skin color characteristics will cause different degrees of pigmentation on the skin surface as the number of radiotherapy times and the radiation dose increase, resulting in a certain range of changes in the skin color characteristics, thereby affecting the monitoring accuracy of the patient's body surface information, so before monitoring the patient's body surface information, this solution first sends a first trigger pulse signal to each visual sampling component 1 through the trigger control unit 2, so that the RGB camera in each visual sampling component 1 collects the patient's skin color feature information, and the processing unit 3 adjusts the exposure parameters of the structured light camera in each visual sampling component 1 according to the skin color feature information collected by the RGB camera, so as to adapt In response to changes in the patient's skin color feature information, a second trigger pulse signal is sent to each visual sampling component 1 through the trigger control unit 2, so that the adjusted structured light camera in each visual sampling component 1 works and collects the patient's body surface 3D (Three-Dimensional) point cloud information. The processing unit 3 determines the large-field image information representing the patient's positioning posture changes based on the collected body surface 3D point cloud information, so as to complete the body surface information monitoring of the patient during radiotherapy. This solution can adjust the exposure parameters of the structured light camera in time according to the changes in the patient's skin color feature information, so that the final large-field image information is more accurate.
[0050] It should be noted that this solution can use one or more visual sampling components 1 (when there are multiple visual sampling components 1, in order to expand the monitoring field of view and avoid occlusion, each visual sampling component 1 should be installed at a certain angle). In addition, each visual sampling component 1 is integrated with an RGB camera and a structured light camera, and each visual sampling component 1 can be connected to the 10G network interface of the processing unit 3 through a network cable or an optical fiber. The trigger control unit 2 and the processing unit 3 are connected through a network cable to output a trigger signal to the visual sampling unit. The visual sampling unit performs shooting sampling under the trigger signal. The trigger control unit 2 can output a trigger pulse signal, which can be connected in parallel to each visual sampling component 1 to control the synchronous exposure shooting of multiple visual sampling components 1; the processing unit 3 is a high-performance computer equipped with an algorithm processing library and user interface software. The computer has multiple 10G network ports, which receives the body surface 3D point cloud information and skin color feature information output by the visual sampling component 1, and after processing these information with a certain algorithm, outputs data information that can reflect the patient's posture information and respiratory movement body surface changes, which is used to guide the positioning posture correction and the patient's respiratory observation and gated treatment implementation during the treatment process.
[0051] It should also be noted that when monitoring body surface information in the traditional way, if the individual differences in the patient's skin color characteristics are relatively large, due to the different absorption of light by the skin, the number of light spot signals projected by the structured light camera on the patient's skin after reflection is uncertain, which will lead to a decrease in the number of effective patient surface three-dimensional point cloud data obtained by the structured light camera. In this way, the monitoring accuracy of the patient's body surface information by the structured light camera will be affected to varying degrees, and it is impossible to effectively guarantee the implementation of precise radiotherapy. In the traditional mode, in order to solve the above problems, it is usually necessary for technicians to repeatedly adjust the exposure parameters of the structured light camera on site, and adjust the image quality to the so-called "optimal" in the technician's subjective cognition based on personal experience. This process is relatively cumbersome. In addition, due to the level of on-site technicians, the adjusted parameters may not be the most suitable for the current patient. In this way, the patient's body surface three-dimensional point cloud data obtained by the adjusted structured light camera cannot guarantee the true reflection of the patient's body surface information changes. In this solution, firstly, a large number of patient skin color features and exposure parameters of the structured light camera are mapped and associated by machine learning and big data, and a think tank is formed and stored in the processing unit 3; after different patients are registered and positioned in the center of the laser light (rough positioning), the system will call the integrated RGB camera to shoot the patient, and then extract the skin color features of the current patient, and then dynamically match this skin color feature with the exposure parameters of the structured light camera in the think tank, and then obtain the exposure parameters of the structured light camera that best suits the skin color features of the current patient, and then the system automatically configures the parameters to the corresponding structured light camera. After the configuration, the structured light camera can perform three-dimensional monitoring of the patient's body surface information, so that the three-dimensional point cloud data information of the patient's body surface obtained can better reflect the patient's real body surface information changes, and will not depend on the level of the on-site technician. At the same time, because the system automatically identifies and adjusts the parameters, this process will be very short (about 1 second). Compared with the traditional technician's repeated on-site parameter adjustment (several minutes or even more than ten minutes at a time), this solution will simplify the doctor's workflow, improve his work efficiency, and better serve precision radiotherapy. The process of optimizing the existing technical solution to this solution is as follows Figure 2 shown.
[0052] The present embodiment provides an information monitoring system. Considering that changes in the patient's skin color characteristics may affect the accuracy of monitoring the patient's body surface information, before monitoring the patient's body surface information, the present scheme first sends a first trigger pulse signal through the trigger control unit 2, so that the processing unit 3 obtains the patient's skin color characteristic information collected by the RGB camera, and adjusts the exposure parameters of the structured light camera to an appropriate value through the skin color characteristic information, and then sends a second pulse signal through the trigger control unit 2, so as to obtain the patient's body surface 3D point cloud information through the adjusted structured light camera. The processing unit 3 can determine the large-field-of-view image information based on the body surface 3D point cloud information, so as to use the large-field-of-view image information to characterize the patient's positioning posture changes, thereby greatly improving the accuracy of body surface information monitoring.
[0053] As an optional embodiment, the processing unit 3 is specifically configured to:
[0054] Determine the target exposure parameter corresponding to the skin color feature information according to the skin color feature information and the preset patient skin color and camera exposure parameter think tank, wherein the preset patient skin color and camera exposure parameter think tank includes several groups of one-to-one corresponding preset patient skin colors and preset camera exposure parameters;
[0055] The target exposure parameters are used as new exposure parameters of the structured light camera.
[0056] In the present invention, the specific process of the processing unit 3 adjusting the current exposure parameters of the structured light camera based on the skin color feature information is as follows: determining a preset patient skin color and camera exposure parameter think tank including several groups of one-to-one corresponding preset patient skin colors and preset camera exposure parameters, and then determining the target exposure parameters corresponding to the skin color feature information according to the correspondence between the skin color feature information collected by the RGB camera and the preset patient skin color and camera exposure parameter think tank, and using the target exposure parameters as the new exposure parameters of the structured light camera to adjust the exposure parameters of the structured light camera, thereby ensuring the integrity of the solution.
[0057] It should be noted that the skin color feature information of the patient obtained by the RGB camera can be dynamically matched with the "Patient Skin Color & Camera Exposure Parameter Think Tank" integrated in the processing unit 3, and the structured light camera exposure parameters suitable for the skin color features of the patient on site can be adjusted in real time. The "Patient Skin Color & Camera Exposure Parameter Think Tank" is obtained through machine learning training, and the camera exposure parameters adapted to different skin color features are stored and mapped in a big data manner. In this way, when doctors face patients with different skin colors or patients at different stages of treatment (the increase in the number of radiotherapy and dose will cause skin pigmentation in certain lesions and changes in skin color features), they can directly monitor the patient's body surface information in three dimensions without the need for technicians to repeatedly adjust and adapt on site, thereby reducing the impact of changes in patient skin color characteristics on the accuracy of monitoring patient surface information, thereby ensuring the implementation of accurate radiotherapy for patients.
[0058] As an optional embodiment, it also includes:
[0059] A filtering module, used to filter the skin color feature information and the body surface 3D point cloud information accordingly, and transmit the filtered skin color feature information and the filtered body surface 3D point cloud information to the amplification module;
[0060] The amplification module is used to amplify the signals corresponding to the filtered skin color feature information and the filtered body surface 3D point cloud information, and transmit the amplified signals to the processing unit 3.
[0061] In the present invention, a filtering module and an amplifying module are further provided in the information monitoring system. Considering that the skin color feature information and the body surface 3D point cloud information are easily affected by factors such as environmental noise during the transmission process from the visual sampling component 1 to the processing unit 3, the present scheme first performs corresponding filtering on the skin color feature information and the body surface 3D point cloud information through the filtering module during the transmission process of the skin color feature information and the body surface 3D point cloud information, and then transmits the filtered skin color feature information and the filtered body surface 3D point cloud information to the amplifying module, and performs corresponding amplification on the signals corresponding to the filtered skin color feature information and the filtered body surface 3D point cloud information through the amplifying module, and transmits the amplified signals to the processing unit 3, so as to reduce or eliminate the interference of factors such as environmental noise on the information transmission process, thereby greatly improving the accuracy of the scheme.
[0062] As an optional embodiment, the structured light camera is a stripe structured light camera or a random speckle structured light camera.
[0063] In the present invention, considering that both the streak structured light camera and the random speckle structured light camera have the advantages of small size and precise measurement and control, the structured light camera in this solution can be a streak structured light camera or a random speckle structured light camera.
[0064] It should be noted that, in practical applications, a specific type of structured light camera can be selected according to actual needs, and this application does not make any special limitations here.
[0065] As an optional embodiment, the processing unit 3 is further configured to:
[0066] Judging whether the patient's body position change exceeds a preset change threshold range based on the body surface 3D point cloud information;
[0067] If the patient's body position changes beyond a preset change threshold, the direct addition system is controlled to stop outputting the treatment beam to the patient.
[0068] In the present invention, because the information monitoring system serves patients undergoing radiotherapy, and the body surface 3D point cloud information can characterize the patient's body position changes, the processing unit 3 can also determine whether the patient's body position changes exceed the preset change threshold range based on the body surface 3D point cloud information collected by the structured light camera, and when it is determined that the patient's body position changes exceed the preset change threshold range, the direct addition system in the radiotherapy device is controlled to stop outputting the treatment beam to the patient, so as to reasonably control the direct addition system to output the treatment beam rate according to the large field of view information.
[0069] As an optional embodiment, the processing unit 3 is further configured to:
[0070] Determine the patient's current respiratory state based on the 3D point cloud information of the body surface;
[0071] Gated therapy is performed on the patient's characteristic organs based on the current respiratory state.
[0072] In the present invention, because the patient's body surface 3D cloud information can characterize the patient's respiratory state, this scheme takes into account that when certain specific parts of the patient are subjected to radiotherapy, gated treatment can be performed according to the patient's respiratory state, thereby ensuring that the diseased parts of the patient's body receive the maximum effective dose and the non-lesioned parts are affected by the treatment dose as little as possible, so as to ensure the accuracy of the radiotherapy process. Therefore, in this scheme, the processing unit 3 determines the patient's current respiratory state based on the body surface 3D point cloud information collected by the structured light camera, and performs gated treatment on the patient's characteristic organs based on the patient's current respiratory state, that is, the gated treatment process is reasonably controlled according to the body surface 3D cloud information.
[0073] As an optional embodiment, the processing unit 3 is further configured to:
[0074] Obtain X-ray fluorescence image information of patients during radiotherapy positioning;
[0075] Perform bone structure registration on the wide field of view image information and X-ray fluorescence image information to obtain the position offset;
[0076] Adjust the patient's setup posture based on the setup posture offset.
[0077] In the present invention, considering that the wide field of view information represents the changes in the patient's positioning posture, the processing unit 3 will also adjust the patient's positioning posture for the effect of subsequent treatment, but it is necessary to first obtain the patient's X-ray fluorescence image information during radiotherapy positioning, and perform bone structure alignment on the determined wide field of view image information and X-ray fluorescence image information to obtain the positioning posture offset, and finally adjust the patient's positioning posture based on the positioning posture offset to facilitate subsequent treatment.
[0078] It should be noted that when a patient is treated for the first time, the patient's body surface information monitoring system will obtain the patient's skin color feature information through RGB camera shooting, and dynamically match the "Patient Skin Color & Camera Exposure Parameter Think Tank" according to the current skin color feature information, and adjust the structured light camera exposure parameters (such as gain, integration, etc.) in real time. After matching the patient's skin color feature parameters in real time, multiple groups of structured light cameras are exposed and shot under the synchronous trigger control of the trigger pulse signal output by the trigger control unit 2 to obtain the patient's current body surface 3D point cloud information. This information is the same as the CT (Computed Tomography) when the patient is positioned. The system uses computer tomography (CT) image information for registration, and its deviation data is used to guide the patient's precise positioning before treatment. Then, during the treatment, multiple groups of structured light cameras continuously and synchronously capture the patient's body surface 3D point cloud information to monitor whether the patient's position changes during radiotherapy and whether the change is within the acceptable threshold range. If it exceeds the acceptable threshold range, the system immediately controls the direct addition system to stop the treatment beam output. At the same time, for radiotherapy of certain parts of the body, the system monitors the changes in the patient's body surface 3D point cloud information in real time to map the patient's respiratory status information. The respiratory status information is used to perform gated treatment on specific parts of the patient, such as the breast (such as DIBH (Deep Inspiration Breath Holding) treatment). This can ensure that the diseased parts of the patient's body receive the maximum effective dose, and the non-lesioned parts are affected by the treatment dose as little as possible, thereby ensuring the precise radiotherapy effect. When the patient undergoes follow-up treatment, the patient's body surface information monitoring system will also first use the RGB camera to capture the patient's skin color feature information and match the optimal structured light camera exposure parameters to ensure that the obtained body surface 3D point cloud information can well assist the patient in positioning before re-treatment (in the traditional mode, if the body surface information is not accurate enough due to changes in skin color characteristics, CBCT (Cone Beam, cone beam computed tomography) verification is required, so that the patient will receive an additional dose), reducing the use of CBCT while ensuring that the patient's re-treatment can be accurate and effective.
[0079] As an optional embodiment, it also includes:
[0080] The power management unit 4 is used to convert the mains power into the first power required for the operation of each visual sampling component 1, convert the mains power into the second power required for the operation of the trigger control unit 2, and convert the mains power into the third power required for the operation of the processing unit 3.
[0081] In the present invention, considering that the visual sampling component 1, the trigger control unit 2 and the processing unit 3 all need electricity to work, and the power supply required by the above devices is too much, considering the volume of the information monitoring system, the present solution integrates a power management unit 4 inside the information monitoring system, such as Figure 3As shown, the function of the power management unit 4 is to convert the received mains power into the electric energy required for the visual sampling component 1, the trigger control unit 2 and the processing unit 3 to work respectively, thereby reducing the size of the information monitoring system.
[0082] It should be noted that in actual applications, the information monitoring system can also consider a built-in power supply to ensure the portability of the information monitoring system. That is, because of the built-in power supply, the entire information monitoring process can still be guaranteed when there is no AC charging port in the environment.
[0083] Please refer to Figure 4 , Figure 4 A process flow chart of an information monitoring method provided by the present invention. The method comprises:
[0084] S11: using a plurality of visual sampling components 1 to control an RGB camera to obtain skin color feature information of a patient after receiving a first trigger pulse signal, and to control a structured light camera to obtain 3D point cloud information of a patient's body surface according to an adjusted current exposure parameter after receiving a second trigger pulse signal, wherein the visual sampling component 1 includes an RGB camera and a structured light camera;
[0085] S12: using the trigger control unit 2 to simultaneously output a first trigger pulse signal to each visual sampling component 1 after receiving a first start instruction sent by the processing unit 3, and to simultaneously output a second trigger pulse signal to each visual sampling component 1 after receiving a second start instruction sent by the processing unit 3;
[0086] S13: Using the processing unit 3, current exposure parameters of the structured light camera are adjusted based on the skin color feature information, and the large field of view image information is determined based on the body surface 3D point cloud information. The monitoring field size corresponding to the large field of view image information meets the preset large field of view judgment condition, which is used to characterize the patient's positioning posture changes.
[0087] The information monitoring method provided in this embodiment corresponds to the above-mentioned device, and therefore has the same beneficial effects as the above-mentioned device. Therefore, for the embodiments of the information monitoring method part, please refer to the description of the embodiments of the device part, which will not be repeated here.
[0088] Please refer to Figure 5 , Figure 5 A schematic diagram of the structure of an electronic device provided by the present invention. The electronic device comprises:
[0089] A memory 20, for storing computer programs;
[0090] The processor 21 is used to execute a computer program to implement the above-mentioned information monitoring method.
[0091] The electronic device provided in this embodiment may include but is not limited to a smart phone, a tablet computer, a laptop computer or a desktop computer.
[0092] Among them, the processor 21 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 21 can be implemented in at least one hardware form of a digital signal processor (DSP), a field-programmable gate array (FPGA), and a programmable logic array (PLA). The processor 21 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a central processing unit (CPU); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 21 may be integrated with a graphics processing unit (GPU), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 21 may also include an artificial intelligence (AI) processor, which is used to process computing operations related to machine learning.
[0093] The memory 20 may include one or more computer-readable storage media, which may be non-transitory. The memory 20 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In this embodiment, the memory 20 is at least used to store the following computer program 201, wherein, after the computer program is loaded and executed by the processor 21, it can implement the relevant steps of the information monitoring method disclosed in any of the aforementioned embodiments. In addition, the resources stored in the memory 20 may also include an operating system 202 and data 203, etc., and the storage method may be temporary storage or permanent storage. Among them, the operating system 202 may include Windows, Unix, Linux, etc. Data 203 may include but is not limited to information monitoring methods, etc.
[0094] In some embodiments, the electronic device may further include a display screen 22 , an input / output interface 23 , a communication interface 24 , a power source 25 , and a communication bus 26 .
[0095] Those skilled in the art will understand that Figure 5 The structure shown in the figure does not constitute a limitation on the electronic device, and may include more or fewer components than shown in the figure.
[0096] The purpose of this embodiment is to provide an electronic device, in which the memory 20 is used to store computer programs, and the processor 21 is used to implement the steps of the above-mentioned information monitoring method when executing the computer program, so that the monitoring process is more efficient and accurate.
[0097] The present invention also provides an embodiment corresponding to a computer-readable storage medium, which is used to store a computer program, and when the computer program is executed by a processor, the information monitoring method as described above is implemented.
[0098] It is understandable that if the method in the above embodiment is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium to execute all or part of the steps of the methods of each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program codes.
[0099] The computer-readable storage medium provided in this embodiment corresponds to the above method, and therefore has the same beneficial effects as the above method. Therefore, for the embodiments of the computer-readable storage medium part, please refer to the description of the embodiments of the method part, which will not be repeated here.
[0100] It should be noted that, in this specification, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.
[0101] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. An information monitoring system, It is characterized in that include: A plurality of visual sampling components, used to control the RGB camera to obtain the patient's skin color feature information after receiving the first trigger pulse signal, and control the structured light camera to obtain the patient's body surface 3D point cloud information according to the adjusted current exposure parameters after receiving the second trigger pulse signal, the visual sampling components including: the RGB camera and the structured light camera; A trigger control unit, configured to simultaneously output the first trigger pulse signal to each of the visual sampling components after receiving a first start instruction sent by the processing unit, and simultaneously output the second trigger pulse signal to each of the visual sampling components after receiving a second start instruction sent by the processing unit; The processing unit is used to adjust the current exposure parameters of the structured light camera based on the skin color feature information, and determine the large field of view image information based on the body surface 3D point cloud information, the monitoring field of view size corresponding to the large field of view image information meets the preset large field of view judgment condition, and is used to characterize the patient's positioning posture changes.
2. The information monitoring system according to claim 1, It is characterized in that The processing unit is specifically used for: Determine the target exposure parameter corresponding to the skin color feature information according to the skin color feature information and a preset patient skin color and camera exposure parameter think tank, wherein the preset patient skin color and camera exposure parameter think tank includes a plurality of groups of one-to-one corresponding preset patient skin colors and preset camera exposure parameters; The target exposure parameter is used as a new exposure parameter of the structured light camera.
3. The information monitoring system according to claim 1, It is characterized in that Also includes: A filtering module, used for filtering the skin color feature information and the body surface 3D point cloud information accordingly, and transmitting the filtered skin color feature information and the filtered body surface 3D point cloud information to the amplification module; The amplification module is used to amplify the signals corresponding to the filtered skin color feature information and the filtered body surface 3D point cloud information, and transmit the amplified signals to the processing unit.
4. The information monitoring system according to claim 1, It is characterized in that The structured light camera is a streak structured light camera or a random speckle structured light camera.
5. The information monitoring system according to claim 1, It is characterized in that The processing unit is further used for: Determining whether the patient's body position change exceeds a preset change threshold range according to the body surface 3D point cloud information; If the patient's body position changes beyond a preset change threshold range, the direct addition system is controlled to stop outputting the treatment beam to the patient.
6. The information monitoring system according to claim 1, It is characterized in that The processing unit is further used for: Determining the current respiratory state of the patient according to the large field of view information; Gated treatment is performed on a characteristic organ of the patient based on the current respiratory state.
7. The information monitoring system according to claim 1, It is characterized in that The processing unit is further used for: Acquiring X-ray fluorescence image information of the patient during radiotherapy positioning; Performing bone structure registration on the large field of view image information and the X-ray fluorescence image information to obtain a positioning posture offset; The setup posture of the patient is adjusted based on the setup posture offset.
8. The information monitoring system according to any one of claims 1 to 7, It is characterized in that Also includes: The power management unit is used to convert the mains power into the first power required for the operation of each of the visual sampling components, convert the mains power into the second power required for the operation of the trigger control unit, and convert the mains power into the third power required for the operation of the processing unit.
9. An information monitoring method, It is characterized in that include: Using a plurality of visual sampling components to control an RGB camera to obtain skin color feature information of a patient after receiving a first trigger pulse signal, and to control a structured light camera to obtain 3D point cloud information of the patient's body surface according to an adjusted current exposure parameter after receiving a second trigger pulse signal, the visual sampling components comprising: the RGB camera and the structured light camera; Using the trigger control unit to simultaneously output the first trigger pulse signal to each of the visual sampling components after receiving the first start instruction sent by the processing unit, and to simultaneously output the second trigger pulse signal to each of the visual sampling components after receiving the second start instruction sent by the processing unit; The processing unit is used to adjust the current exposure parameters of the structured light camera based on the skin color feature information, and determine the large field of view image information based on the body surface 3D point cloud information. The monitoring field size corresponding to the large field of view image information meets the preset large field of view judgment condition, which is used to characterize the patient's positioning posture changes.
10. An electronic device, It is characterized in that include: Memory, used to store computer programs; A processor, configured to execute the computer program to implement the information monitoring method as claimed in claim 9.
11. A computer-readable storage medium, It is characterized in that Used to store a computer program, which, when executed by a processor, implements the information monitoring method as claimed in claim 9.
