Tacrolimus blood concentration detection device and method based on hyperspectral imaging

Abstract

The invention discloses a tacrolimus blood concentration detection device and method based on hyperspectral imaging, and relates to the technical field of drug concentration detection.The device comprises a light-proof shell, and a touch display screen is arranged on the shell; a central processing unit, an automatic lifting mechanism composed of a plurality of lifting supporting sliding rods, an object carrying platform which is arranged on the automatic lifting mechanism and can perform XY two-dimensional displacement, and a hyperspectral camera, a laser transmitter and a laser receiver which are arranged at the top of the shell are arranged in the shell; wherein the central processing unit is used for roughly adjusting the positions of the automatic lifting mechanism and the loading platform according to a touch instruction; according to the laser transmit-receive data and the obtained hyperspectral image, detecting the balance of the loading platform, and automatically and finely adjusting the positions of the automatic lifting mechanism and the loading platform; and performing automatic focusing and imaging on the hyperspectral camera according to the acquired hyperspectral image. The device provided by the invention is high in automation degree, and can quickly acquire clear and effective hyperspectral images.

Description

Technical Field

[0001] The present invention belongs to the technical field of drug concentration detection, and in particular relates to a device and method for detecting tacrolimus blood drug concentration based on hyperspectral imaging. Background Art

[0002] Tacrolimus (FKS06) is a macrolide immunosuppressant, clinically used for immunosuppressive therapy after liver, kidney and other organ transplants. The individual differences in blood concentration of oral tacrolimus are large, the therapeutic window is narrow, the therapeutic dose is very close to the toxic dose, and the effective blood concentration of tacrolimus is closely related to renal function and the occurrence of rejection after kidney transplantation. Therefore, it is very necessary to conduct routine blood concentration testing and individualized dose adjustment of this drug.

[0003] At present, the methods for determining the blood concentration of tacrolimus mainly include high performance liquid chromatography (HPLC), microparticle capture enzyme immunoluminescence technology (MEIA), enzyme-linked immunosorbent assay technology (ELISA), liquid-mass spectrometry (LC-MS / MS) and enzyme amplification immunoassay technology (EMIT). Among them, high performance liquid chromatography refers to the concentration analysis through the hyperspectral image of the patient's blood. This concentration detection method is one of the most commonly used methods at present, and its important premise is to quickly obtain effective hyperspectral images. At present, the existing technology mostly collects hyperspectral images manually, but there are certain problems with manual image collection, such as: the size of the collected image is different, which affects the subsequent processing of the hyperspectral image; the artificial focusing during the collection process may make the clarity of the collected image not meet the requirements of subsequent image processing; the collection steps are cumbersome, inefficient, and low in automation. These problems will affect the accuracy and efficiency of the subsequent detection of tacrolimus blood concentration based on high performance liquid chromatography. Summary of the invention

[0004] In view of the shortcomings of the prior art, the present invention proposes a device and method for detecting tacrolimus blood concentration based on hyperspectral imaging. By designing a highly automated detection device, efficient, high-definition and effective hyperspectral image acquisition is performed, laying a foundation for the subsequent use of hyperspectral imaging to perform non-invasive and rapid detection of tacrolimus blood concentration in patients' peripheral blood after renal transplantation, thereby improving the accuracy and efficiency of detection.

[0005] To achieve the above objectives, one or more embodiments of the present invention provide the following technical solutions:

[0006] A first aspect of the present invention provides a tacrolimus blood concentration detection device based on hyperspectral imaging.

[0007] A tacrolimus blood drug concentration detection device based on hyperspectral imaging, comprising a light-proof shell; a touch screen is provided on the shell, a central processing unit, an automatic lifting mechanism composed of a plurality of lifting support slide bars, an object-carrying platform arranged on the automatic lifting mechanism and capable of XY two-dimensional displacement, a hyperspectral camera arranged on the top of the shell, and a laser transmitter and receiver are arranged inside the shell;

[0008] The central processing unit is electrically connected to the touch display screen, the automatic lifting mechanism, the loading platform, the hyperspectral camera, the laser transmitter and the receiver respectively, and is used to roughly adjust the position of the automatic lifting mechanism according to the touch command; detect the balance of the loading platform according to the laser transceiver data and the acquired hyperspectral image, and automatically fine-adjust the position of the automatic lifting mechanism and the loading platform; and automatically focus and image the hyperspectral camera according to the acquired hyperspectral image.

[0009] In a further technical solution, the laser transmitter emits laser beams to illuminate the four corners of the loading platform respectively, and each laser beam is reflected to the laser receiver respectively;

[0010] The laser transmitter and receiver transmit the laser transceiver data to the central processor, which detects the balance of the loading platform according to the received laser transceiver data and automatically fine-tunes the automatic lifting mechanism in combination with the feedback mechanism.

[0011] A further technical solution, automatic fine adjustment of the automatic lifting mechanism, includes:

[0012] According to each laser transceiver data received, the distance from the laser transmitter to each corner of the loading platform is calculated and determined;

[0013] Compare the determined distances. If the distances corresponding to the four corners are the same, it is considered that the loading platform is in a horizontal state. Otherwise, it is considered that the loading platform is not in a horizontal state.

[0014] When it is determined that the loading platform is not in a horizontal state, the height difference Δj required to adjust each corner is calculated according to the distances corresponding to the four corners. i , according to the height difference Δj i Fine-tune the vertical positions of multiple lifting support slide bars in the automatic lifting mechanism, and combine the feedback mechanism until the loading platform is adjusted to a horizontal state to complete the fine adjustment.

[0015] A further technical solution is to obtain a hyperspectral image using a hyperspectral camera, and transmit the obtained hyperspectral image to a central processor, and the central processor automatically focuses and images the hyperspectral camera according to the received hyperspectral image, including:

[0016] Based on the acquired hyperspectral image, the Sobel operator is used to calculate the clarity score of the image, and the current focus state is determined based on the clarity score;

[0017] Automatically adjust the focus of the hyperspectral camera according to the current focus status;

[0018] Repeat the steps of image acquisition, processing and focusing until the clarity score of the acquired image meets the set requirements.

[0019] A further technical solution is to use a hyperspectral camera to obtain a hyperspectral image of the sample tray on the loading platform, and transmit the obtained hyperspectral image to a central processor, and the central processor automatically fine-tunes the position of the loading platform according to the received hyperspectral image, including:

[0020] Performing image processing according to the acquired hyperspectral image to identify the sample area on the sample tray in the image;

[0021] Automatically adjust the position of the loading platform in the X and Y directions according to the position of the identified sample area in the current image;

[0022] The steps of image acquisition, recognition, and automatic adjustment are repeated until the loading platform moves to the point where the sample tray is precisely aligned with the hyperspectral camera.

[0023] According to a further technical solution, a camera is also provided on the housing, and the camera is electrically connected to the central processing unit;

[0024] The camera is used to obtain a facial image of the operator;

[0025] The central processor is used to identify whether the operator is an authorized person based on the acquired face image using face recognition technology, and control whether the entire device is powered on or not based on the recognition result.

[0026] According to a further technical solution, an incandescent lamp and an integrated sensor are also provided inside the shell; the incandescent lamp is used to provide light, and the integrated sensor includes a temperature sensor, a humidity sensor, and an oxygen concentration sensor, which are used to monitor the temperature, humidity, and oxygen concentration environmental parameters in the sample chamber in real time.

[0027] According to a further technical solution, the hyperspectral camera and the laser transmitter and receiver are arranged on the same horizontal plane of the top of the shell, and are separated from the lower part of the shell by a fixed heat insulation plate.

[0028] According to a further technical solution, the housing is further provided with an electric door, which is electrically connected to the central processor and is used to drive the opening and closing of the electric door according to a control instruction issued by the central processor;

[0029] The electric door includes a driving mechanism, two door panels, and two raised sliders electrically connected to the driving mechanism. The raised sliders are stuck in the sliding track and a door panel is fixedly hung on each raised slider. The central processing unit drives the driving mechanism so that the raised sliders serve as fulcrums to drive the door panels to move in the sliding track.

[0030] A second aspect of the present invention provides a method for detecting tacrolimus blood concentration based on hyperspectral imaging.

[0031] A method for detecting tacrolimus blood concentration based on hyperspectral imaging is implemented by using the tacrolimus blood concentration detection device based on hyperspectral imaging proposed in the first aspect, comprising the following steps:

[0032] Obtain peripheral blood supernatant from patients after kidney transplantation and place it in a culture dish. After face recognition, start the electric door of the device, place the culture dish on the sample tray of the loading platform and close the electric door.

[0033] Use the touch screen to roughly adjust the position of the automatic lifting mechanism;

[0034] After the rough adjustment is completed, the balance of the loading platform is automatically checked, the position of the automatic lifting mechanism and the loading platform is automatically fine-tuned, and the hyperspectral camera is automatically focused and imaged to obtain a clear hyperspectral image of the culture dish sample area;

[0035] Based on the acquired hyperspectral images, high performance liquid chromatography is used for processing and analysis to detect and display the tacrolimus blood concentration in the samples.

[0036] One or more of the above technical solutions have the following beneficial effects:

[0037] The present invention proposes a tacrolimus blood concentration detection device and method based on hyperspectral imaging. By designing a highly automated detection device, efficient, high-definition and effective hyperspectral image acquisition is performed, laying a foundation for the subsequent non-invasive and rapid detection of tacrolimus blood concentration in patients' peripheral blood after renal transplantation using hyperspectral imaging, thereby improving the accuracy and efficiency of the detection. The entire device has a high degree of automation. After manual coarse adjustment is performed through the touch display screen to align the sample to be tested with the hyperspectral camera, automatic fine adjustment can be performed. On the one hand, the loading platform is adjusted to keep the sample to be tested in horizontal balance, thereby improving the accuracy of the final detection. On the other hand, the loading platform is adjusted to automatically focus and align the sample to be tested with the hyperspectral camera, thereby quickly acquiring clear and effective hyperspectral images, thereby providing a reliable basis for subsequent concentration detection. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The accompanying drawings in the specification, which constitute a part of the present invention, are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations on the present invention.

[0039] Figure 1 It is a front schematic diagram of a tacrolimus blood drug concentration detection device based on hyperspectral imaging according to an embodiment of the present invention;

[0040] Figure 2 It is a top schematic diagram of a tacrolimus blood concentration detection device based on hyperspectral imaging according to an embodiment of the present invention;

[0041] Figure 3 This is an internal schematic diagram of a tacrolimus blood concentration detection device based on hyperspectral imaging according to an embodiment of the present invention;

[0042] Figure 4 It is a schematic diagram of the back side of the tacrolimus blood concentration detection device based on hyperspectral imaging according to an embodiment of the present invention;

[0043] Figure 5 It is a left side schematic diagram of a tacrolimus blood drug concentration detection device based on hyperspectral imaging according to an embodiment of the present invention;

[0044] Figure 6 This is a schematic diagram of a touch panel in a tacrolimus blood concentration detection device based on hyperspectral imaging according to an embodiment of the present invention;

[0045] Figure 7 The present invention is a flowchart of a method for detecting tacrolimus blood concentration based on hyperspectral imaging according to an embodiment of the present invention.

[0046] Among them, 1. Shell; 2. Touch screen; 3. Electric door; 3-1. Door panel; 3-2. Raised slider; 3-3. Sliding track; 4. Main switch of the device; 5. Main power interface of the device; 6. Camera power interface; 7. Camera-computer data transmission interface; 8. Automatic lifting mechanism; 9. Loading platform; 10. Hyperspectral camera; 11. Laser transmitter and receiver; 12. Heat insulation board; 13. Camera fixing slot; 14. Conical block; 15. Incandescent lamp; 16. Integrated sensor; 17. USB interface; 18. HDMI interface; 19. Camera; 20. Display; 21. Camera power cord; 22. Touch panel; 23. Lifting touch point; 24. Automatic door control switch; 25. Incandescent lamp control switch. DETAILED DESCRIPTION

[0047] It should be noted that the following detailed descriptions are exemplary and are intended to provide further explanation of the present invention. Unless otherwise specified, all technical and scientific terms used herein have the same meanings as those commonly understood by those skilled in the art to which the present invention belongs.

[0048] It should be noted that the terms used herein are only for describing specific embodiments and are not intended to limit exemplary embodiments according to the present invention. As used herein, unless the context clearly indicates otherwise, the singular form is also intended to include the plural form. In addition, it should be understood that when the terms "comprising" and / or "including" are used in this specification, it indicates the presence of features, steps, operations, devices, components and / or combinations thereof.

[0049] Embodiment 1

[0050] This embodiment proposes a tacrolimus blood concentration detection device based on hyperspectral imaging, such as Figure 1 to Figure 5 As shown, the device includes a light-proof shell 1, on which a touch screen 2, an electric door 3, a main switch 4, a main power interface 5, a camera power interface 6, and a camera-computer data transmission interface 7 are provided. A central processing unit, an automatic lifting mechanism 8 composed of a plurality of lifting support slide bars, a loading platform 9 disposed on the automatic lifting mechanism and capable of XY two-dimensional displacement, a hyperspectral camera 10 disposed on the top of the shell, and a laser transmitter and receiver 11 are provided inside the shell 1; wherein the central processing unit is electrically connected to the touch screen 2, the automatic lifting mechanism 8, the loading platform 9, the hyperspectral camera 10, the laser transmitter and the receiver 11 respectively. In this embodiment, the central processing unit is used to roughly adjust the position of the automatic lifting mechanism and the loading platform according to the touch command; detect the balance of the loading platform according to the laser transceiver data and the acquired hyperspectral image, and automatically fine-adjust the position of the automatic lifting mechanism and the loading platform; and automatically focus and image the hyperspectral camera according to the acquired hyperspectral image.

[0051] like Figure 3 As shown, the hyperspectral camera 10 and the laser transmitter and receiver 11 are arranged on the same horizontal plane at the top of the housing 1, and are separated from the lower part of the housing by a fixed heat insulation board 12; the heat insulation board 12 is made of glass fiber and high temperature resistant resin composite material, and is provided with a circular hole in the middle for the camera lens and the laser transmitter and receiver to pass through. By setting the heat insulation board 12, the influence of the environment under the housing on the camera, the laser transmitter and the receiver is avoided, and the service life of the device is effectively extended.

[0052] Preferably, a camera fixing groove 13 is further provided on the top of the shell 1. The camera fixing groove 13 is welded inside the device and has a round hole in the middle for the camera lens to pass through. Conical blocks 14 are placed on both sides of the camera fixing groove 13 for strengthening fixation.

[0053] Furthermore, the housing 1 is provided with an incandescent lamp 15 and an integrated sensor 16 electrically connected to the central processing unit, wherein the incandescent lamp 15 is used to provide light, and the integrated sensor 16 includes a temperature sensor, a humidity sensor, and an oxygen concentration sensor, which are respectively used to monitor the temperature, humidity, and oxygen concentration environmental parameters in the sample chamber in real time to ensure the best detection conditions. A camera 19 and a display screen 20 are also provided on the outside of the housing, and the camera 19 and the display screen 20 are both electrically connected to the central processing unit; the camera 19 is used to obtain the facial image of the operator, and the display screen 20 is used to display the image obtained by the camera; the central processing unit is used to identify whether the operator is an authorized person based on the acquired facial image using facial recognition technology, and control whether the entire device is powered on or not based on the recognition result, wherein if the operator is identified as an unauthorized person, the entire device cannot be powered on and cannot be started and operated normally; if the operator is identified as an authorized person, the entire device is powered on and can be started and operated normally. In addition, after the entire device is powered on, the display screen 20 is used to display the image collected by the hyperspectral camera in real time; as another embodiment, after the acquisition of the hyperspectral image is completed, the display screen 20 is used to display the tacrolimus blood concentration in the detected sample.

[0054] In addition, the electric door 3 is provided on the housing 1, and the electric door 3 is electrically connected to the central processor, and is used to drive the opening and closing of the electric door according to the control instructions issued by the central processor. Figure 1 As shown, the electric door 3 includes a driving mechanism, two raised sliders 3-2 electrically connected to the driving mechanism, and two door panels 3-1. The raised sliders 3-2 are stuck in the sliding track 3-3 and the door panels 3-1 are fixedly hung on the raised sliders 3-2. The central processing unit drives the driving mechanism so that the raised sliders 3-2 serve as a fulcrum to drive the door panels 3-1 to move in the sliding track 3-3.

[0055] like Figure 2 As shown, the interface part is arranged on the top surface of the device, and the interface part includes a camera power interface 6, a camera-computer data transmission interface 7, a USB interface 17, and an HDMI interface 18, so as to facilitate the connection with other devices. For example, the camera power interface 6 can be connected to an external power source by connecting a camera power line 21 to power the hyperspectral camera; the camera-computer data transmission interface 7 can be connected to an external computer or processor through a data line to facilitate the subsequent processing of the hyperspectral image. Figure 4 As shown, the device main switch 4 and the device main power interface 5 are arranged on the back of the device. The device main power interface 5 is connected to the external power supply through a main power line. The device main switch 4 is electrically connected to the device main power interface 5 and the central processing unit. When the device main switch 4 is turned on, the external power supply powers on the central processing unit and the entire device.

[0056] like Figure 5As shown, the touch display screen 2 is arranged on a touch panel 22 of the device, and the touch panel 22 where the touch display screen 2 is located is embedded in the lower right part of the left side of the device, as shown in FIG. Figure 6 As shown, the touch display screen 2 is provided with a touchable automatic lifting mechanism lifting touch area 23 (including lifting and lowering touch areas), an automatic door control switch 24, an incandescent lamp control switch 25 and an incandescent lamp brightness adjustment touch area, which can be used for automatic lifting mechanism control, light brightness and switch control, and electric door switch control.

[0057] The lifting and lowering of the automatic lifting mechanism is controlled by lifting and lowering the touch point of the touch-sensitive automatic lifting mechanism on the touch display screen 2. Considering that the automatic lifting mechanism is composed of a plurality of lifting support slide bars (the lifting support slide bars are existing mechanisms), and there may be certain errors between the plurality of lifting support slide bars, that is, the loading platform on the automatic lifting mechanism may have a certain inclination after manual adjustment, which will further affect the acquisition of the hyperspectral image. Therefore, this embodiment, on the basis of manual coarse adjustment, also carries out a highly automated fine adjustment strategy, which specifically includes the following steps:

[0058] (1) The balance of the loading platform is detected by a laser transmitter and a receiver, including: first, the laser transmitter emits a laser beam to illuminate the four corners of the loading platform respectively, and each laser beam is reflected to the laser receiver respectively; secondly, the laser transmitter and the receiver transmit the laser transceiver data to the central processor, and the central processor detects the balance of the loading platform according to the received laser transceiver data, and automatically fine-tunes the automatic lifting mechanism in combination with the feedback mechanism, specifically:

[0059] Step S1.1: Calculate and determine the distance from the laser transmitter to each corner of the loading platform according to each laser transceiver data received, that is, calculate and obtain the distance from the laser beam from emission to reception.

[0060] Step S1.2: Compare the determined distances. If the distances corresponding to the four corners are the same, the loading platform is considered to be in a horizontal state. Otherwise, the loading platform is considered to be not in a horizontal state. At this time, the height difference Δh required to adjust each corner is calculated according to the distances corresponding to the four corners. i , according to the height difference Δh i Fine-tune the vertical positions of multiple lifting support slide bars in the automatic lifting mechanism, and combine the feedback mechanism until the loading platform is adjusted to a horizontal state to complete the fine adjustment.

[0061] Through the above calculation method, redundant calculation can be avoided, and the vertical position of the slide bar can be directly and automatically adjusted to make the loading platform in a horizontal state.

[0062] As another implementation, after the coarse adjustment is performed manually through the touch screen, the central processor determines that if no control instruction transmitted by the touch screen is received within a set time, the fine adjustment control scheme is automatically started. In this way, the automation level of the detection device is further improved.

[0063] (2) After the above adjustment is completed, a hyperspectral camera is used to obtain a hyperspectral image including the sample tray on the loading platform, and the obtained hyperspectral image is transmitted to a central processing unit. The central processing unit automatically focuses and images the hyperspectral camera according to the received hyperspectral image, specifically including the following steps:

[0064] Step S2.1: Calculate the clarity score of the image using the Sobel operator based on the acquired hyperspectral image, and determine the current focus state based on the clarity score.

[0065] Specifically, the Sobel operator is an image processing operator used for edge detection. It calculates the gradient value by performing a convolution operation on the image, thereby highlighting the edge in the image. In this embodiment, the Sobel operator is used for image processing to calculate and determine the clarity of the acquired image, which is:

[0066] First, the acquired hyperspectral image is grayed out;

[0067] Secondly, the Sobel operator is used to calculate the horizontal and vertical gradients of each pixel (i, j) in the image, that is, Gx i,j and Gy i,j ;

[0068] After that, the modulus of the gradient of each pixel in the image is calculated as:

[0069] Considering that the larger the gradient, the more obvious the image edge is, the clearer the image is, therefore, the clarity of the image is finally measured based on the average value or variance of the gradient modulus values ​​of all pixels in the image, that is, the clarity score is calculated Where N is the total number of pixels in the image.

[0070] As another implementation method, the machine learning technology can be combined to further improve the focusing accuracy and response speed by training the model. Specifically, a large number of hyperspectral images in different focusing states are obtained, and the acquired images are annotated with clarity scores in the above manner. The large number of acquired images are used as sample data sets. On this basis, the convolutional neural network CNN is used as a clarity detection model. The clarity detection model is trained using the constructed sample data set to learn the relationship between different clarity scores and image features to obtain a trained model. Finally, in actual operation, the trained model is used to analyze the hyperspectral image in real time, and the clarity score of the image is quickly determined to guide subsequent automatic focusing. In this way, the acquisition of image clarity can be further accelerated, thereby improving the speed of subsequent camera focus adjustment.

[0071] Furthermore, the current focus state is determined according to the clarity score calculated above, and the focus state can be divided into unfocused, preliminarily focused, and fully focused states according to the clarity of the image. Specifically, a clarity score threshold is preset, and when the calculated clarity score S is higher than the threshold, the image acquired at this time is considered to be a clear image, and it is in a fully focused state; conversely, when the clarity score S is lower than the threshold, the image acquired at this time is considered to be an unclear image. At this time, if the clarity score S is much lower than the threshold (such as the difference exceeds the set value), it is considered to be an unfocused state, and if the clarity score S is slightly lower than the threshold (such as the difference is less than the set value), it is considered to be a preliminarily focused state.

[0072] Step S2.2, automatically adjust the focal length of the hyperspectral camera according to the current focus state. Specifically, when the current focus state is an unfocused state, the focal length is automatically adjusted to increase a larger set step length (i.e., a first focus step length); when the current focus state is a preliminary focus state, the focal length is automatically adjusted to increase a smaller set step length (i.e., a second focus step length); when the current focus state is a fully focused state, the focal length remains unchanged, and it is considered that the focus is completed at this time.

[0073] Step S2.3, repeat the image acquisition and processing, and focusing steps until the clarity score of the acquired image meets the set requirements. That is, after each adjustment, repeat the image acquisition and processing steps of steps S2.1 and S2.2 above until the clarity requirements are met and the automatic focusing is completed.

[0074] Through the above steps, a clear hyperspectral image is obtained. On this basis, considering that there may be a placement deviation when placing the sample tray on the loading platform manually, the acquired hyperspectral image cannot completely include the sample tray area. At this time, if manual adjustment is performed, that is, the electric door is opened to manually adjust the tray placement position, on the one hand, it may affect the sample collection environment, and on the other hand, the manual adjustment steps are relatively cumbersome. Therefore, as an implementation method, the position of the loading platform on the horizontal plane can be automatically fine-tuned in this embodiment so that the sample on the loading platform can be displayed in the center of the hyperspectral image.

[0075] (3) In this embodiment, the loading platform is an XY two-dimensional displacement platform based on an electric slide rail and a stepper motor. A sample tray is placed on the loading platform, and the movement of the sample tray in the X and Y directions is automatically controlled by the central processing unit. That is, by fine-tuning the displacement on the horizontal plane of the loading platform, the hyperspectral camera can be aligned with the sample to be tested on the sample tray, thereby ensuring the effectiveness of the final image obtained.

[0076] Specifically, a hyperspectral camera is used to obtain a hyperspectral image of a sample tray on a loading platform, and the obtained hyperspectral image is transmitted to a central processor, and the central processor automatically fine-tunes the position of the loading platform according to the received hyperspectral image, including:

[0077] Step S3.1, performing image processing based on the acquired hyperspectral image to identify the sample area on the sample tray in the image; wherein the image processing method adopted is an existing target detection algorithm, which can identify the sample area in the image.

[0078] Step S3.2: Automatically adjust the position of the loading platform in the X and Y directions according to the position of the identified sample area in the current image.

[0079] Step S3.3, repeat the steps of image acquisition, recognition, and automatic adjustment until the loading platform moves to the point where the sample tray is precisely aligned with the hyperspectral camera.

[0080] After the above operations are automatically completed, the final hyperspectral image is displayed through an external display screen connected to the camera, and the acquired clear hyperspectral image is processed and analyzed by an external processor, that is, the image contains spectral information of the sample, and the spectral characteristics of the sample are extracted from the hyperspectral image. The spectral characteristics are converted into tacrolimus concentration values ​​using a pre-established spectral analysis model, so as to detect and determine the tacrolimus blood concentration in the sample.

[0081] As another implementation, the central processing unit in this embodiment is provided with a corresponding image processing and concentration analysis program. After a clear hyperspectral image is acquired by the camera, the image is transmitted to the central processing unit. The central processing unit calls up the program to perform high performance liquid chromatography analysis, detects the tacrolimus blood concentration in the sample, and displays it on the display screen 20, which is more convenient to use.

[0082] Embodiment 2

[0083] This embodiment proposes a method for detecting tacrolimus blood concentration based on hyperspectral imaging, which is implemented by using the tacrolimus blood concentration detection device based on hyperspectral imaging proposed in Example 1. Figure 7 As shown, the following steps are included:

[0084] Step S1, preparation. Connect the main power cord of the device, connect the power cord of the camera, turn on the main switch of the device, and make the camera run normally; check whether various interface cables are connected normally, whether the cone block fixes the camera well, and ensure that each module can run normally.

[0085] Step S2, obtaining a culture dish containing the sample to be tested, that is, using drip irrigation to obtain the peripheral blood supernatant from the patient after kidney transplantation and placing it in the culture dish, and try to make the liquid evenly distributed in the culture dish and keep the liquid level.

[0086] Step S3, placing the culture dish inside the detection device. After face recognition, the electric door of the device is started. After successful recognition, the electric door is driven by the motor, and the raised slider is stuck in the sliding track and pulled forward to both sides to open the electric door; turn on the incandescent lamp switch, place the culture dish (containing peripheral blood supernatant) as the sample to be tested on the sample tray, and adjust the brightness of the incandescent lamp according to experimental needs; finally, close the electric door.

[0087] Step S4: Use the touch screen to roughly adjust the position of the automatic lifting mechanism to roughly adjust the position of the culture dish until the camera lens can capture the liquid interface in the entire culture dish.

[0088] Step S5, automatically fine-adjust the position of the culture dish and obtain a clear hyperspectral image of the sample to be tested. If there is no touch signal after the set time period, it can be considered that the coarse adjustment is completed. After the coarse adjustment is completed, the balance of the loading platform is automatically detected, and the position of the automatic lifting mechanism and the loading platform is automatically fine-adjusted, and the hyperspectral camera is automatically focused and imaged to obtain a clear hyperspectral image of the sample area of ​​the culture dish, and the obtained image is displayed on the display screen on the device or the external display screen.

[0089] Step S6: Based on the acquired hyperspectral image, high performance liquid chromatography is used for processing and analysis to detect and display the tacrolimus blood concentration in the sample.

[0090] The device proposed in this embodiment is used for detection. The entire device has a high degree of automation. Through the method of manual coarse adjustment + automatic fine adjustment, the loading platform is adjusted to keep the sample to be tested in horizontal balance to ensure the accuracy of the final detection. The loading platform is adjusted to make the sample to be tested and the hyperspectral camera automatically focus and align, so that clear and effective hyperspectral images can be quickly obtained, laying the foundation for subsequent concentration detection.

[0091] Although the above describes the specific implementation mode of the present invention in conjunction with the accompanying drawings, it is not intended to limit the scope of protection of the present invention. Those skilled in the art should understand that various modifications or variations that can be made by those skilled in the art on the basis of the technical solution of the present invention without creative work are still within the scope of protection of the present invention.

Claims

1. A tacrolimus blood concentration detection device based on hyperspectral imaging, characterized in that: It comprises a light-proof shell; a touch screen is arranged on the shell, a central processing unit, an automatic lifting mechanism composed of a plurality of lifting support slide bars, a loading platform capable of XY two-dimensional displacement arranged on the automatic lifting mechanism, a hyperspectral camera arranged on the top of the shell, and a laser transmitter and receiver are arranged inside the shell; The central processing unit is electrically connected to the touch display screen, the automatic lifting mechanism, the loading platform, the hyperspectral camera, the laser transmitter and the receiver respectively, and is used to roughly adjust the position of the automatic lifting mechanism according to the touch command; detect the balance of the loading platform according to the laser transceiver data and the acquired hyperspectral image, and automatically fine-adjust the position of the automatic lifting mechanism and the loading platform; and automatically focus and image the hyperspectral camera according to the acquired hyperspectral image.

2. The tacrolimus blood concentration detection device based on hyperspectral imaging according to claim 1, characterized in that: The laser transmitter emits laser beams to illuminate the four corners of the loading platform respectively, and each laser beam is reflected to the laser receiver respectively; The laser transmitter and receiver transmit the laser transceiver data to the central processor, which detects the balance of the loading platform according to the received laser transceiver data and automatically fine-tunes the automatic lifting mechanism in combination with the feedback mechanism.

3. The tacrolimus blood concentration detection device based on hyperspectral imaging according to claim 2, characterized in that: Automatic fine adjustment of automatic lifting mechanism, including: According to each laser transceiver data received, the distance from the laser transmitter to each corner of the loading platform is calculated and determined; Compare the determined distances. If the distances corresponding to the four corners are the same, it is considered that the loading platform is in a horizontal state. Otherwise, it is considered that the loading platform is not in a horizontal state. When it is determined that the loading platform is not in a horizontal state, calculate the height difference Δh required to adjust each corner according to the distances corresponding to the four corners. i , according to the height difference Δj i Fine-tune the vertical positions of multiple lifting support slide bars in the automatic lifting mechanism, and combine the feedback mechanism until the loading platform is adjusted to a horizontal state to complete the fine adjustment.

4. The tacrolimus blood concentration detection device based on hyperspectral imaging according to claim 1, characterized in that: A hyperspectral camera is used to obtain a hyperspectral image, and the obtained hyperspectral image is transmitted to a central processor. The central processor automatically focuses and images the hyperspectral camera according to the received hyperspectral image, including: Based on the acquired hyperspectral image, the Sobel operator is used to calculate the clarity score of the image, and the current focus state is determined based on the clarity score; Automatically adjust the focus of the hyperspectral camera according to the current focus status; Repeat the steps of image acquisition, processing and focusing until the clarity score of the acquired image meets the set requirements.

5. The tacrolimus blood concentration detection device based on hyperspectral imaging according to claim 1, characterized in that: A hyperspectral camera is used to obtain a hyperspectral image of the sample tray on the loading platform, and the obtained hyperspectral image is transmitted to a central processor. The central processor automatically fine-tunes the position of the loading platform according to the received hyperspectral image, including: Performing image processing according to the acquired hyperspectral image to identify the sample area on the sample tray in the image; Automatically adjust the position of the loading platform in the X and Y directions according to the position of the identified sample area in the current image; The steps of image acquisition, recognition, and automatic adjustment are repeated until the loading platform moves to the point where the sample tray is precisely aligned with the hyperspectral camera.

6. The tacrolimus blood concentration detection device based on hyperspectral imaging according to claim 1, characterized in that: The housing is also provided with a camera, which is electrically connected to the central processing unit; The camera is used to obtain a facial image of the operator; The central processor is used to identify whether the operator is an authorized person based on the acquired face image using face recognition technology, and control whether the entire device is powered on or not based on the recognition result.

7. The tacrolimus blood concentration detection device based on hyperspectral imaging according to claim 1, characterized in that: An incandescent lamp and an integrated sensor are also provided inside the shell; the incandescent lamp is used to provide light, and the integrated sensor includes a temperature sensor, a humidity sensor, and an oxygen concentration sensor, which are used to monitor the temperature, humidity, and oxygen concentration environmental parameters in the sample chamber in real time.

8. The tacrolimus blood concentration detection device based on hyperspectral imaging according to claim 1, characterized in that: The hyperspectral camera, the laser transmitter and the receiver are arranged on the same horizontal plane on the top of the shell, and are separated from the lower part of the shell by a fixed heat insulation plate.

9. The tacrolimus blood concentration detection device based on hyperspectral imaging according to claim 1, characterized in that: The housing is also provided with an electric door, which is electrically connected to the central processor and is used to drive the opening and closing of the electric door according to the control instructions issued by the central processor; The electric door includes a driving mechanism, two door panels, and two raised sliders electrically connected to the driving mechanism. The raised sliders are stuck in the sliding track and a door panel is fixedly hung on each raised slider. The central processing unit drives the driving mechanism so that the raised sliders serve as fulcrums to drive the door panels to move in the sliding track.

10. A method for detecting tacrolimus blood concentration based on hyperspectral imaging, characterized in that: The method is implemented by using the tacrolimus blood concentration detection device based on hyperspectral imaging as described in any one of claims 1 to 9, comprising the following steps: Obtain peripheral blood supernatant from patients after kidney transplantation and place it in a culture dish. After face recognition, start the electric door of the device, place the culture dish on the sample tray of the loading platform and close the electric door. Use the touch screen to roughly adjust the position of the automatic lifting mechanism; After the rough adjustment is completed, the balance of the loading platform is automatically checked, the position of the automatic lifting mechanism and the loading platform is automatically fine-tuned, and the hyperspectral camera is automatically focused and imaged to obtain a clear hyperspectral image of the culture dish sample area; Based on the acquired hyperspectral images, high performance liquid chromatography is used for processing and analysis to detect and display the tacrolimus blood concentration in the samples.

Images