Object positioning analysis method, system, medium, and device

Abstract

SOLUTION: Irradiating a first region of a body surface with infrared light and imaging the first region to obtain a first image of an imaging region, dividing the imaging region into different grayscale regions based on a grayscale distribution of the first image, selecting a grayscale region having a grayscale value meeting a preset requirement as a region where a blood vessel is located, selecting a grayscale region having a grayscale value within a preset deviation range from the grayscale value of the region where the blood vessel is located from an edge of the region where the blood vessel is located as a region where skin is located, and irradiating the region where the blood vessel is located and the region where the skin is located with ultraviolet light, and collecting fluorescence emission signals excited by the region where the blood vessel is located and the region where the skin is located respectively.EFFECT: To accurately locate the position of a blood vessel in the skin of various skin colors, to improve the efficiency of specifying the position of the blood vessel and to reduce labor costs.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to the field of medical imaging, and in particular to object location analysis methods, systems, media, and devices. [Background technology]

[0002] Commonly used blood glucose detection technologies include electrochemical and optical methods. Electrochemical methods target the superficial subcutaneous layer and do not reach the deep blood vessels, eliminating the need to distinguish and locate blood vessels. However, this detection method has the disadvantage of being invasive. Optical methods require blood vessel location because the blood glucose content in blood vessels is higher than that in the skin. Conventional optical detection methods do not address how to distinguish between these two areas, resulting in reduced accuracy of the detection results.

[0003] Additionally, skin color varies from person to person and even within the same person, and darker skin can make it difficult to locate blood vessels under visible light.

[0004] Patent document CN112842257B discloses a method and apparatus for locating blood vessels, which includes the steps of: acquiring a first infrared vascular image and a second infrared vascular image from at least two frames of continuously acquired infrared vascular images, where the acquisition time of the second infrared vascular image is slower than that of the first infrared vascular image; identifying a target blood vessel in the first infrared vascular image; locating the target blood vessel in the second infrared vascular image using a pyramidal optical flow tracking method according to the target blood vessel; and identifying the target blood vessel from the first infrared vascular image and then locating the target blood vessel in the second infrared image using the pyramidal optical flow tracking method. Because the pyramidal optical flow tracking method can adapt to the problem of large frame-to-frame changes, the pyramidal optical flow tracking method can accurately locate the target blood vessel in the second infrared vascular image according to the target blood vessel, thereby ensuring accurate positioning of the target blood vessel. An advantage of this solution is that the pyramidal optical flow tracking method can accurately locate the target blood vessel in the second infrared vascular image according to the target blood vessel, thereby ensuring accurate positioning of the target blood vessel. However, a drawback is that due to differences in skin color, it is difficult for the human eye or a camera to accurately locate the location of blood vessels on the skin. Patent document CN118078277A discloses a non-invasive blood glucose detection method based on hyperspectral data analysis, which achieves non-invasive detection. This document uses absorption spectroscopy, and factors such as the excitation light source, human skin color, and differences in epidermal layer thickness also affect the intensity of the spectral signal. Because the blood glucose content in blood vessels is higher than that in the skin, traditional optical detection methods do not address how to distinguish between these two regions, resulting in poor detection results. Therefore, there is a need to propose a new technical solution to improve the above technical problems. Summary of the Invention [Problem to be solved by the invention]

[0005] SUMMARY OF THE INVENTION In view of the shortcomings of the prior art, it is an object of the present invention to provide an object positioning analysis method, system, medium and device. [Means for solving the problem]

[0006] The object positioning analysis method provided by the present invention comprises: a first imaging step of irradiating a first region of a body surface with infrared light and imaging the first region to obtain a first image of the imaging region; a segmentation step of segmenting the imaging region into different grayscale regions based on the grayscale distribution of the first image; an object positioning step of selecting a grayscale region having grayscale values ​​that satisfy a predetermined requirement as a region in which the object is located; a non-object positioning step of selecting a grayscale area in which the grayscale value of the area in which the object is located is within a predetermined deviation range from the edge of the area in which the object is located as an area in which a non-object is located; a second imaging step of irradiating ultraviolet light onto the region where the object is located and the region where the non-object is located, and collecting fluorescent emission signals excited by the region where the object is located and the region where the non-object is located, respectively; The target object is a venous blood vessel, and the non-target object is skin.

[0007] Preferably, the first imaging step comprises collecting a first image under illumination with infrared radiation within a first wavelength range; The first image includes data reflecting a distribution state in the imaging region of a reflected signal or an excitation signal generated by the first region when irradiated with a light beam.

[0008] Preferably, the splitting step comprises: The method includes dividing the imaging area into detection point candidate areas and reference point candidate areas based on the grayscale distribution of pixel points in the first image, selecting detection points from the detection point candidate areas, selecting reference points from the reference point candidate areas, and respectively acquiring spectral data of the detection points and spectral data of the reference points.

[0009] Preferably, the second imaging step comprises collecting a second image under illumination with light within a second wavelength range, the light within the second wavelength range includes ultraviolet light; selecting, from a detection point candidate region, as a detection point, one pixel point having a grayscale value that satisfies predetermined requirements, or selecting a combination of the pixel point and adjacent pixel points as a detection point, based on the grayscale value of the pixel point in the second image; selecting, from a reference point candidate region, one pixel point having a grayscale value that falls within a predetermined deviation range from the grayscale value of the selected detection point, or selecting a combination of the pixel point and a plurality of adjacent pixel points as reference points; and calculating and obtaining fluorescence spectrum data of the detection point and the reference point.

[0010] Preferably, the second wavelength range is 300 to 390 nanometers, and the second wavelength range is outside the effective response range of the imaging spectrum detection device; Light in the second wavelength range can excite a fluorescent emission signal from the analyte, and a main peak of the fluorescent spectrum of the fluorescent emission signal is located within an effective response range of the imaging spectral detection device.

[0011] Preferably, the first imaging step includes collecting a first image under irradiation with infrared light in the wavelength range of 800 to 1000 nanometers; the second imaging step includes collecting a second image under irradiation with ultraviolet light in the wavelength range of 300 to 390 nanometers; the first image includes data reflecting a grayscale distribution state in an imaging area of ​​a reflected signal generated by a first area when irradiated with infrared light; the second image includes spectral data in an imaging area reflecting fluorescent emission signals excited by an area where the object is located and an area where the non-object is located when irradiated with ultraviolet light; the dividing step includes dividing the imaging area into detection point candidate areas having smaller grayscale values ​​and reference point candidate areas having larger grayscale values ​​based on the grayscale distribution data; selecting one pixel point having a grayscale value that satisfies a predetermined requirement from the second image as the detection point, or a combination of the pixel point and adjacent pixel points as the detection point, based on the detection point candidate areas; and selecting one pixel point having a grayscale value within a predetermined deviation range from the grayscale value of the detection point from the second image as the reference point, or a combination of the pixel point and multiple adjacent pixel points as the reference point, based on the reference point candidate areas; Substituting the grayscale values ​​of the detection points in the second image into a spectral reconstruction algorithm to obtain spectral data of the detection points, and substituting the grayscale values ​​of the reference points in the second image into a spectral reconstruction algorithm to obtain spectral data of the reference points.

[0012] The present invention further provides a method for detecting an analyte, which includes the above-described method for locating and analyzing an object.

[0013] The present invention provides a first imaging module that irradiates a first region of a body surface with infrared light and captures an image of the first region to obtain a first image of the imaging region; a segmentation module for segmenting the imaging region into different grayscale regions based on the grayscale distribution of the first image; an object positioning module for selecting a grayscale region having a grayscale value that satisfies a preset requirement as a region where the object is located; a non-object positioning module for selecting, from an edge of the area where the object is located, a grayscale area having a grayscale value within a preset deviation range from the grayscale value of the area where the object is located, as an area where a non-object is located; The present invention further provides an object positioning analysis system, which includes a second imaging module that irradiates ultraviolet light onto the area where the object is located and the area where the non-object is located, and collects fluorescent emission signals excited by the area where the object is located and the area where the non-object is located, respectively. Preferably, the first imaging module includes collecting a first image under irradiation with infrared light within a first wavelength range; The first image includes data reflecting a distribution state in the imaging region of a reflected signal or an excitation signal generated by the first region when irradiated with a light beam.

[0014] Preferably, the division module comprises: The method includes dividing the imaging area into detection point candidate areas and reference point candidate areas based on the grayscale distribution of pixel points in the first image, selecting detection points from the detection point candidate areas, selecting reference points from the reference point candidate areas, and respectively acquiring spectral data of the detection points and spectral data of the reference points.

[0015] Preferably, the second imaging module collects a second image under illumination with light within a second wavelength range, the light within the second wavelength range includes ultraviolet light; selecting, from a detection point candidate region, as a detection point, one pixel point having a grayscale value that satisfies predetermined requirements, or selecting a combination of the pixel point and adjacent pixel points as a detection point, based on the grayscale value of the pixel point in the second image; selecting, from a reference point candidate region, one pixel point having a grayscale value that falls within a predetermined deviation range from the grayscale value of the selected detection point, or selecting a combination of the pixel point and a plurality of adjacent pixel points as reference points; and calculating and obtaining fluorescence spectrum data of the detection point and the reference point.

[0016] Preferably, the second wavelength range is 300 to 390 nanometers, and the second wavelength range is outside the effective response range of the imaging spectrum detection device; Light in the second wavelength range can excite a fluorescent emission signal from the analyte, and a main peak of the fluorescent spectrum of the fluorescent emission signal is located within an effective response range of the imaging spectral detection device.

[0017] Preferably, the first imaging module includes collecting a first image under irradiation with infrared light in a wavelength range of 800 to 1000 nanometers; the second imaging module includes collecting a second image under irradiation with ultraviolet light in a wavelength range of 300 to 390 nanometers; the first image includes grayscale distribution status data in an imaging area that reflects a reflection signal generated by the first area when irradiated with infrared light; the second image includes spectral data in an imaging area reflecting fluorescent emission signals excited by an area where the object is located and an area where the non-object is located when irradiated with ultraviolet light; the division module divides the imaging area into detection point candidate areas with smaller grayscale values ​​and reference point candidate areas with larger grayscale values ​​based on the grayscale distribution status data; selects, from the second image, one pixel point having a grayscale value that meets a preset requirement as a detection point, or a combination of the pixel point and adjacent pixel points as a detection point based on the detection point candidate areas; and selects, from the second image, one pixel point having a grayscale value within a preset deviation range from the grayscale value of the detection point, or a combination of the pixel point and multiple adjacent pixel points as a reference point based on the reference point candidate areas; Substituting the grayscale values ​​of the detection points in the second image into a spectral reconstruction algorithm to obtain spectral data of the detection points, and substituting the grayscale values ​​of the reference points in the second image into a spectral reconstruction algorithm to obtain spectral data of the reference points.

[0018] The present invention further provides an analyte detection system including the object positioning analysis system described above.

[0019] The present invention further provides a computer-readable storage medium having a computer program stored thereon, the computer program being capable of realizing the steps of the object positioning analysis method described above when executed by a processor.

[0020] The present invention further provides an electronic device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein when the computer program is executed by the processor, the steps of the object positioning analysis method described above are realized. [Effects of the Invention]

[0021] Compared with the prior art, the present invention has the following beneficial effects: 1. The technical solution of the present application uses infrared energy to accurately locate blood vessels in skin of different skin colors, thereby improving the efficiency of locating blood vessels and reducing labor costs. 2. The technical solution of the present application does not require electrochemical reaction with the analyte, the detection method is simpler, and the goal of non-invasive detection can be achieved, especially when detecting analytes in vivo. 3. The present application utilizes the uneven distribution of the analyte in the imaging area to obtain spectral data in different areas, and since the distribution of components other than the analyte in the imaging area is relatively uniform, the difference in spectral data in different areas can directly reflect information about the analyte, such as the concentration of the analyte, which is correlated with the spectral data after substantially excluding the influence of non-analytes. 4. The present application avoids the traditional method of using Raman to measure analytes, and instead uses fluorescence spectroscopy for detection, thereby achieving low-cost and compact detection systems and achieving the purpose of real-time detection.

[0022] Other features, objects and advantages of the present invention will become more apparent through the detailed description given below, given by way of non-limiting example with reference to the drawings in which: [Brief explanation of the drawings]

[0023] [Figure 1] 1 is a flowchart of the first embodiment. [Figure 2] FIG. 1 is a schematic diagram of a first image collected in Example 2. [Figure 3] FIG. 10 is a schematic diagram of a second image collected in Example 2. [Figure 4] FIG. 10 is a diagram illustrating the principle of a detection model according to a second embodiment. [Figure 5] FIG. 1 is a schematic diagram of detection point-reference point spectrum data obtained in Example 2. [Figure 6] These are experimental results of the accuracy of the analytical results of the analytical model. [Figure 7] 1 is a structural schematic diagram of an analyte detection device provided by Example 5. FIG. [Figure 8] FIG. 1 is a structural schematic diagram of an electronic device provided by Example 6. [Figure 9] 1 is a structural schematic diagram of a wristwatch for detecting an analyte provided by Example 5. FIG. [Figure 10] FIG. 1 is a schematic diagram of the back of an analyte detection wristwatch. [Figure 11] FIG. 1 is an exploded view of a wristwatch for detecting an analyte. [Figure 12] FIG. 1 is a schematic diagram of a wristwatch for detecting an analyte in use. DETAILED DESCRIPTION OF THE INVENTION

[0024] The present invention will be described in detail below with reference to specific examples. The following examples will help those skilled in the art to further understand the present invention, but are not intended to limit the present invention in any way. It should be noted that those skilled in the art may make some modifications and improvements without departing from the concept of the present invention, all of which fall within the protection scope of the present invention.

[0025] Example 1 FIG. 1 is a flow chart of this embodiment, in which the method for detecting an analyte includes the following steps:

[0026] Imaging step: Irradiating a first region with light within a predetermined wavelength range through a light source, and imaging the first region through an imaging spectrum detector to obtain an image of the imaging region. By irradiating the first region with light within the predetermined wavelength range, distribution data and spectral data of the reflected or excited signals generated by the analyte when the light is irradiated can be reflected in the image. The first region may be a specific region on the surface of human skin. To prevent external light such as ambient light from affecting the detection, the collection window of the imaging spectrum detector must be tightly attached to the surface of the human skin in the first region. The imaging region refers to the region within the lens range of the imaging spectrum detector. Generally, the imaging region may be a part of the first region or the same region as the first region.

[0027] Since light rays with different wavelength ranges are required to obtain analyte distribution data and spectral data, two methods can be used: light rays with a wider wavelength range provided by one light source, or light rays with narrower wavelength ranges provided by two light sources. When one light source is used, the wavelength range of the light rays provided by the light source must simultaneously cover the wavelength range for obtaining analyte distribution data and the wavelength range for obtaining analyte spectral data. When two light sources are used, the two light sources provide different light rays, with the wavelength of one light ray covering the wavelength range for obtaining analyte distribution data and the wavelength of the other light ray covering the wavelength range for obtaining analyte spectral data. At the same time, when one light source is used, only one image is captured, and when two light sources are used, two images are captured. For ease of processing, the capturing areas of the two images must be the same, i.e., the collection window of the imaging spectrum detection device does not move on the surface of human skin.

[0028] In the present application, the analyte may be vascular glucose, ketones, alcohol, lactate, oxygen, hemoglobin A1C, acetylcholine, amylase, bilirubin, cholesterol, chorionic gonadotropin, creatine kinase (e.g., CK-MB), creatine, creatinine, DNA, fructosamine, glutamine, growth hormone, hormones, peroxides, prostate-specific antigen, prothrombin, RNA, thyroid-stimulating hormone, or troponin, or may be a drug such as an antibiotic (e.g., gentamicin, vancomycin, etc.), digitoxin, digoxin, a drug of abuse, theophylline, or warfarin. In embodiments where more than one analyte is detected, the analytes may be monitored at the same or different times. In other embodiments, the analyte may be any other substance within a body surface that can be noninvasively detected using the present invention.

[0029] Spectral acquisition step: Acquire spectral data from the image, which reflects the non-uniform distribution of reflected or excited signals generated by the object to be analyzed when the light beam is irradiated in the imaging region via the imaging spectral detection device. Specifically, the imaging region can be divided based on different distribution status data, and positions for acquiring spectral data from different sections can be selected.

[0030] Analysis stage: Based on the acquired spectral data, information about the analyte in the imaging area is acquired, including information about the analyte correlated with the spectral data. Because the distribution of the analyte in different sections is different, the reflected or excited signals generated by the analyte when irradiated with light also differ. Taking human skin as an example, it is divided into three parts: the epidermis, the dermis, and the subcutaneous tissue, and blood vessels such as veins are located in the subcutaneous tissue. UV light can be used to irradiate skin areas with blood vessels and skin areas without blood vessels to acquire corresponding spectral data, or to irradiate skin areas with thick blood vessels and skin areas with thin blood vessels to acquire corresponding spectral data. The difference between the two spectral data can reflect information about the analyte correlated with the spectral data in the blood vessels. Intermediate information, such as data about the degree of impact of the analyte on the spectral data, can be acquired for further analysis, or information such as the concentration of the analyte can be directly acquired through an analytical model.

[0031] Example 2 This embodiment is based on the first embodiment and takes glucose detection in human blood vessels as an example to provide a non-invasive glucose detection method, which includes the following steps:

[0032] Imaging step: Irradiate the skin where veins are located on the wrist, back of the hand, etc. with infrared light in a first wavelength range of 800 to 1000 nanometers, preferably in the near-infrared band, to capture a first image of the imaging area, and then irradiate the same location with ultraviolet light in a second wavelength range of 300 to 390 nanometers to capture a second image of the imaging area.

[0033] 2, where the horizontal axis is the horizontal coordinate of the first image, the vertical axis is the vertical coordinate of the first image, the white box represents the pixel point block of the detection point selected on the venous blood vessel, and the black box represents the pixel point block of the reference point selected on the surrounding skin. In the first image, some of the infrared light penetrates the human skin, and some of it is absorbed by the human skin. At the same time, the area where the venous blood vessel is located is absorbed in large amounts by the venous blood vessel, so the grayscale value of the pixel in the area where the venous blood vessel is located is smaller, and the grayscale value of the pixel in the area where the non-venous blood vessel is located is larger, which makes it easy to divide the imaging area into the area where the venous blood vessel is located and the area where the non-venous blood vessel is located.

[0034] As shown in Figure 3, the horizontal axis represents the horizontal coordinate of the second image, the vertical axis represents the vertical coordinate of the second image, the white box represents the pixel point block of the detection point selected on the venous blood vessel, and the black box represents the pixel point block of the reference point selected on the surrounding skin. Because it is difficult to distinguish between venous and non-venous blood vessels in the second image, it is necessary to distinguish between them in the first image. The purpose of using excitation light in the second wavelength range of 300-390 nanometers is to obtain a high-quality effective fluorescence spectral signal. This is because the main response band of the imaging spectral detection device is between 400 and 800 nm. If the wavelength of the excitation light used is less than 300 nm, the main peak of the fluorescence spectrum of the excited fluorescence emission signal is located in the <400 nm band, making it difficult for the imaging spectral detection device to obtain a high-quality effective fluorescence spectral signal. If the wavelength of the excitation light used exceeds 390 nm, the excitation light itself will be visible light, and the spectral signal of the excitation light will be superimposed on the fluorescence spectral signal, making it difficult to extract an effective fluorescence spectral signal without interference from the excitation light. Glucose in venous blood vessels absorbs ultraviolet light in the wavelength range of 300-390 nanometers and then emits a fluorescent emission signal in the visible light band of 400-800 nm, which is within the effective response range of the imaging spectral detector. The characteristic spectral intensity of this fluorescent emission signal is positively correlated with the glucose concentration, resulting in higher fluorescence excitation efficiency.

[0035] Spectrum acquisition step: based on the grayscale distribution of the pixel points in the first image, divide the imaging area into areas where venous blood vessels are located and areas where non-venous blood vessels are located, select a detection point from the position of the area where venous blood vessels are located corresponding to the second image, select a reference point from the position of the area where non-venous blood vessels are located corresponding to the second image, and respectively acquire spectral data of the detection point and the reference point. Specifically, based on the grayscale values ​​of the pixel points in the second image, select one pixel point having a grayscale value that meets a predetermined requirement as the detection point from the area where venous blood vessels are located, or select a combination of this pixel point and adjacent pixel points as the detection point, and select one pixel point having a grayscale value within a predetermined deviation range from the grayscale value of the selected detection point as the reference point from the area where non-venous blood vessels are located, or select a combination of this pixel point and multiple adjacent pixel points as reference points, and calculate and acquire fluorescence spectral data of the detection point and the reference point in the second image. The spectral data can be selected from a single pixel point of the detection point, the reference point, or an average of a combination of multiple pixel points, and can be appropriately selected based on the width of the blood vessel. Averaging a combination of multiple pixel points improves the signal-to-noise ratio but is limited by the width of the blood vessel and avoids acquiring data from areas outside the blood vessel. Selecting a single pixel point provides high spatial resolution and is suitable for situations with thin blood vessels, but has a lower signal-to-noise ratio. As a preset requirement for grayscale values, it is possible to use the point with the smallest grayscale value as the detection point, but this application is not limited to this. The calculation results are shown in Figure 5, where the horizontal axis is wavelength (unit: nm) and the vertical axis is relative radiance (unit: W / nm). The solid line represents the spectral data of the detection point, and the dotted line represents the spectral data of the reference point.Here, the reason why the grayscale value of the reference point and the grayscale value of the selected detection point are within the predetermined deviation range is that the skin in the imaging area has influencing factors such as skin color, blemishes, and cosmetics, which may directly affect the spectral data of the reference point. However, the first image does not distinguish the areas of these influencing factors, so by setting a predetermined deviation range of the grayscale value, these influencing factors can be effectively excluded. Furthermore, because the grayscale value and the grayscale value of the selected detection point are within the predetermined deviation range, it is guaranteed that a reference point close to the detection point, such as the edge of a venous blood vessel, will be selected. This ensures that, excluding the blood vessels, the parameters of the remaining epidermis, dermis, and subcutaneous tissue, such as color and thickness, are closest. This makes it possible to exclude as much as possible the influence of non-analyte objects due to the deviation between the spectral data of the detection point and the spectral data of the reference point.

[0036] In addition to the spectral reconstruction algorithm, the method of obtaining the spectral data is to form the radiation calibration coefficient through pre-radiation calibration, and then calculate the grayscale value * radiation calibration coefficient to obtain the spectral line.

[0037] When a combination of multiple pixel points is selected from the detection point, the fluorescence spectrum data of the detection point can be the average value of the fluorescence spectrum data of these pixel points. At the same time, the number of detection points and reference points can be one or more. When the number of detection points and reference points is multiple, the average value of the fluorescence spectrum data of all the detection points and the average value of the fluorescence spectrum data of all the reference points can be calculated respectively.

[0038] Analysis stage: The acquired spectral data of the detection points and reference points is preprocessed and then input into a trained detection model, which outputs the glucose concentration or an intermediate result showing the correlation between glucose and the spectral data. When training the detection model, it is necessary to simultaneously acquire the subject's spectral data and accurate test results such as blood test results, and use the spectral data as the input of the detection model and the blood test results as the output of the detection model to train the detection model.

[0039] The detection model may employ a convolutional neural network model, which sequentially includes an input layer, at least two convolutional layers, at least two activation function layers, a flattened layer, a fully connected layer, and an output layer, where the convolutional layers and the activation function layers are spaced apart, and the activation function used in the activation function layer is a Relu function.

[0040] Here, the size of the convolution kernel of each layer in the convolutional neural network model is 1, the number of convolution kernels in the first convolutional layer is 32, and the number of convolution kernels in the second layer is 64. Both are used to extract blood glucose features and nonlinearly transform the output of the convolutional layer through an activation function. The Flatten layer flattens the output of the convolutional layer into a one-dimensional vector to facilitate connection to the subsequent fully connected layer, and the final output dimension is 1. In the model training process, the Adam optimizer is used to train the model, and the mean squared error is used as the loss function, and the mean absolute error is simultaneously calculated as the performance indicator for model evaluation.

[0041] If the output result of the detection model is a glucose concentration, the training for obtaining the detection model is stopped when the error between the output result and the measured standard glucose concentration value satisfies a preset condition. If the output result of the detection model is an intermediate result correlating glucose with spectral data, such as an intermediate neuron result, the training for obtaining the detection model is stopped when the error between the output result and the intermediate neuron result satisfies a preset condition. The intermediate neuron result is further processed by model correction to obtain the glucose concentration.

[0042] As shown in Figure 4, the input layer is a spectral data input layer obtained by preprocessing the original spectral data. The hidden layer is an intermediate hidden layer that uses deep learning convolutional operations to combine features and output the final predicted blood glucose concentration value as an output layer. Deep learning convolutional operations can also output one neuron, Output1, as an intermediate result after combining features. The intermediate result, Output1, and the two infrared IR feature intensity values ​​are then used for further model training to further correct the blood glucose prediction error and output the final predicted blood glucose concentration value, Output2. The degree of training of the detection model can be determined by setting different parameters as needed. The extracted glucose feature values ​​are continuously trained according to different parameter settings. When the error between the output result and the standard glucose value of the above label value meets the requirements, the training for obtaining the detection model is stopped.

[0043] Through multiple repeated training, the neurons can learn the corresponding change rules between different glucose concentrations and glucose spectrum features of different samplers, thereby improving the generality of the detection model and achieving the goal of predicting the glucose concentrations of different users.

[0044] The entire glucose detection process does not require blood sampling or skin puncture or skin implantation, but rather obtains the subject's spectral information based on the fluorescence spectrum, and then obtains the subject's glucose detection result based on the spectral information, thereby avoiding pain and discomfort and improving the discomfort and convenience of detection. This method allows for detailed differentiation of the spectral signals from the blood vessel site and the skin site, allowing for accurate extraction of the subsequent glucose signal, and at the same time, the intensity of the spectral signal and the glucose concentration are closely correlated, achieving accurate measurement of the glucose concentration, resulting in more accurate results and easier processing.

[0045] Figure 6 shows a schematic diagram of the experimental results of the trained detection model. The horizontal axis represents the reference blood glucose concentration (unit: mmol / L) collected by the blood glucose meter, and the vertical axis represents the blood glucose concentration (unit: mmol / L) predicted by the patented method. The total number of samples collected by the subjects was 2,037, of which 1,537 samples were in the training set and 500 samples were in the prediction set. The figure shows the distribution of the detection results of the detection model. The MARD value of the predicted samples was 11.32%, and most of the samples were classified into regions A and B. The samples in region A accounted for 87.03%, and the samples in region B accounted for 12.77%, indicating that the detection accuracy of the detection model is relatively high.

[0046] Example 3 This example is based on Example 2, replacing infrared light with visible light, to provide another non-invasive glucose detection method, which includes the following steps:

[0047] Imaging step: Visible light is irradiated onto the skin where veins are located, such as on the wrist or back of the hand, to capture a first image of the imaging area, and ultraviolet light within a second wavelength range of 300 to 390 nanometers is irradiated onto the same location to capture a second image of the imaging area.

[0048] In the first image, the color of the area where venous blood vessels are located is different from the color of the area where non-venous blood vessels are located, so the imaged area can be easily divided into areas where venous blood vessels are located and areas where non-venous blood vessels are located.

[0049] Because it is difficult to distinguish between venous and non-venous blood vessels in the second image, it is necessary to distinguish between the first and second images. The purpose of using excitation light in the second wavelength range of 300-390 nanometers is to obtain a high-quality effective fluorescence spectral signal. This is because the main response band of the imaging spectral detection device is 400-800 nm. If the wavelength of the excitation light used is less than 300 nm, the main peak of the fluorescence spectrum of the excited fluorescence emission signal is located in the <400 nm band, making it difficult for the imaging spectral detection device to obtain a high-quality effective fluorescence spectral signal. If the wavelength of the excitation light used is greater than 390 nm, the excitation light itself is visible light, and the spectral signal of the excitation light is superimposed on the fluorescence spectral signal, making it difficult to extract the effective fluorescence spectral signal without interference from the spectral signal of the excitation light. Glucose in the venous blood vessels absorbs ultraviolet light in the wavelength range of 300 to 390 nanometers, and then emits fluorescent radiation signals in the visible light band of 400 to 800 nm, which is located within the effective response range of the imaging spectrum detection device. The characteristic spectral intensity of the fluorescent radiation signals is positively correlated with the glucose concentration and has higher fluorescence excitation efficiency.

[0050] Spectrum acquisition step: based on the grayscale distribution of pixel points in the first image, divide the imaging area into areas where venous blood vessels are located and areas where non-venous blood vessels are located, select detection points from the positions of the areas where venous blood vessels are located corresponding to the second image, select reference points from the positions of the areas where non-venous blood vessels are located corresponding to the second image, and obtain spectral data of the detection points and spectral data of the reference points, respectively. Specifically, based on the grayscale values ​​of the pixel points in the second image, select one pixel point having a grayscale value that satisfies a predetermined requirement or a combination of the pixel point and adjacent pixel points as the detection point from the areas where venous blood vessels are located, select one pixel point having a grayscale value that falls within a predetermined deviation range from the grayscale value of the selected detection point or a combination of the pixel point and multiple adjacent pixel points as the reference point from the areas where non-venous blood vessels are located, and calculate and obtain fluorescence spectral data of the detection points and fluorescence spectral data of the reference points. Here, the reason why the grayscale value of the reference point and the grayscale value of the selected detection point are within a preset deviation range is that the skin in the imaging area has influencing factors such as skin color, blemishes, cosmetics, etc., which may directly affect the spectral data of the reference point. However, in the first image, it is not possible to distinguish the areas of all influencing factors at the same time. By setting a preset deviation range of the grayscale value, these influencing factors can be effectively excluded.

[0051] When a combination of multiple pixel points is selected from the detection point, the fluorescence spectrum data of the detection point can be the average value of the fluorescence spectrum data of these pixel points. At the same time, the number of detection points and reference points can be one or more. When the number of detection points and reference points is multiple, the average value of the fluorescence spectrum data of all the detection points and the average value of the fluorescence spectrum data of all the reference points can be calculated respectively.

[0052] Analysis stage: The acquired spectral data of the detection point and reference point are preprocessed and then input into a trained detection model to output the glucose concentration. When training the detection model, it is necessary to simultaneously acquire the subject's spectral data and accurate test results such as blood test results, use the spectral data as the input of the detection model, and use the blood test results as the output of the detection model to train the detection model.

[0053] The detection model may employ a convolutional neural network model, which sequentially includes an input layer, at least two convolutional layers, at least two activation function layers, a flattened layer, a fully connected layer, and an output layer, where the convolutional layers and the activation function layers are spaced apart, and the activation function used in the activation function layer is a Relu function.

[0054] Here, the size of the convolution kernel of each layer in the convolutional neural network model is 1, the number of convolution kernels in the first convolutional layer is 32, and the number of convolution kernels in the second layer is 64. Both are used to extract blood glucose features and nonlinearly transform the output of the convolutional layer through an activation function. The Flatten layer flattens the output of the convolutional layer into a one-dimensional vector to facilitate connection to the subsequent fully connected layer, and the final output dimension is 1. In the model training process, the Adam optimizer is used to train the model, and the mean squared error is used as the loss function, and the mean absolute error is simultaneously calculated as the performance indicator for model evaluation.

[0055] When the error between the output result of the detection model and the standard glucose value satisfies a preset condition, the training for obtaining the detection model is stopped.

[0056] The degree of training of the detection model needs to set different parameters as needed, and the extracted multiple glucose feature values ​​are continuously learned according to different parameter settings. When the error between the output result and the standard glucose value of the above label value meets the requirement, the training to obtain the detection model is stopped.

[0057] Through multiple repeated training, the neurons can learn the corresponding change rules between different glucose concentrations and glucose spectrum features of different samplers, thereby improving the generality of the detection model and achieving the goal of predicting the glucose concentrations of different users.

[0058] The entire glucose detection process does not require blood sampling or skin puncture, but rather obtains the subject's spectral information based on the fluorescence spectrum, and then obtains the subject's glucose detection result based on the spectral information, thereby avoiding pain and discomfort and improving the discomfort and convenience of detection. This method allows for the detailed distinction of the spectral signals from the blood vessel site and the skin site, allowing for the accurate extraction of the subsequent glucose signal, and at the same time, the intensity of the spectral signal and the glucose concentration are closely correlated, achieving accurate measurement of the glucose concentration, resulting in more accurate results and easier processing.

[0059] Example 4 This embodiment provides an analyte detection system, which can be realized by performing the process steps of the analyte detection method, i.e., those skilled in the art can understand the analyte detection method as a preferred embodiment of the analyte detection system. The analyte detection system includes:

[0060] The imaging module includes a light source that provides light within a predetermined wavelength range to illuminate a first region, and an imaging spectrum detector that captures an image of the first region to capture the image of the region. By irradiating the light within the predetermined wavelength range, the image can reflect distribution data and spectral data of the reflected or excited signal generated by the analyte when the light is irradiated. Because different wavelength ranges are required to capture the distribution data and spectral data of the analyte, the light may be light of two corresponding wavelength ranges, or one wavelength range may be wider and cover the two required wavelength ranges. When two types of light are used, two images are obtained, and for ease of processing, the imaging areas of the two images typically need to be the same.

[0061] In the present application, the analyte may be glucose, ketones, alcohol, lactate, oxygen, hemoglobin A1C, acetylcholine, amylase, bilirubin, cholesterol, chorionic gonadotropin, creatine kinase (e.g., CK-MB), creatine, creatinine, DNA, fructosamine, glutamine, growth hormone, hormones, peroxide, prostate-specific antigen, prothrombin, RNA, thyroid-stimulating hormone, troponin, or drugs such as antibiotics (e.g., gentamicin, vancomycin, etc.), digitoxin, digoxin, drugs of abuse, theophylline, and warfarin in an animal's blood vessels. In embodiments where more than one analyte is detected, the analytes can be monitored at the same or different times. In other embodiments, the analyte may be other substances in the fluid.

[0062] Spectral acquisition module: Acquires spectral data from the image, which reflects the non-uniform distribution of reflected or excited signals generated by the object to be analyzed when the imaging area is irradiated with light via the imaging spectrum detection device. Specifically, the imaging area can be divided based on different distribution status data, and positions for acquiring spectral data from different sections can be selected.

[0063] The analysis module acquires information about the analyte in the imaging region based on the acquired spectral data, and the analyte information includes information about the analyte correlated with the spectral data. Because the distribution of the analyte in different regions is different, the reflected or excited signals generated by the analyte when irradiated with light are also different. By utilizing this characteristic, the difference between the two spectral data can be obtained, and the information about the analyte correlated with the spectral data, such as the concentration of the analyte, can be accurately reflected.

[0064] Those skilled in the art will recognize that in addition to implementing the system provided by the present invention and its respective devices, modules, and units purely in the form of computer-readable program codes, the system provided by the present invention and its respective devices, modules, and units can also realize similar functions in the form of logic gates, switches, application-specific integrated circuits, programmable logic controllers, embedded microcontrollers, etc. by performing logic programming in method steps. Therefore, the system provided by the present invention and its various devices, modules, and units can be considered as hardware components, and the devices, modules, and units included therein that realize various functions can also be considered as structures within the hardware components, and the devices, modules, and units for implementing various functions can be considered both as software modules for implementing methods or as structures within the hardware components.

[0065] Example 5 Shown in Figure 7 is an electronic device of this embodiment, specifically an analyte detection device 200. The detection device 200 is a portable, non-invasive detection device for the human body, which can be used as a standalone detection device or integrated into a wristwatch or mobile phone, realizing convenient and rapid detection of analytes on the body surface.

[0066] The detection device 200 includes a light source 201, an imaging spectrum detector 202, a controller 203, a first bandpass filter 204, a second bandpass filter 206, and a lens 205. The controller 203 establishes an electrical or communication connection with the light source 201 and the imaging spectrum detector 202, respectively.

[0067] The light source 201 can provide light within a predetermined wavelength range. Since light of different wavelength ranges is required to obtain distribution data and spectral data of an analyte, two methods can be used: one light source that can provide light of a wider wavelength range, or two light sources that provide light of narrower wavelength ranges. When a single light source is used, the wavelength range of the light provided by the light source must simultaneously cover the wavelength range for obtaining distribution data of the analyte, such as a halogen lamp, and the wavelength range for obtaining spectral data of the analyte. When two light sources are used, the two light sources provide different light beams, with one light beam having a wavelength covering the wavelength range for obtaining distribution data of the analyte, and the other light beam having a wavelength covering the wavelength range for obtaining spectral data of the analyte, such as a combination of infrared and ultraviolet light, or a combination of visible light and ultraviolet light.

[0068] To uniformly illuminate the imaging area 100, a ring-shaped light source can be used, which has multiple light-emitting modules uniformly distributed on the same circumference. When there are two types of light sources, the light-emitting modules of the two types of light sources are arranged relative to each other.

[0069] The imaging spectral detector 202 can image the imaging region 100 to obtain a corresponding image upon command, and can also obtain corresponding spectral data upon command. The imaging spectral detector 202 includes a sensor and a periodic pixel-level optical filter structure disposed on a surface of the sensor. The periodic pixel-level optical filter structure is used to perform spectral modulation on an incident optical signal, thereby enabling the sensor to generate an image containing the spectral information of interest.

[0070] The periodic pixel-level optical filter structure includes a plurality of optical filter pixel channels with different shapes of pixel-level structures, each having the same specifications and size, uniformly arranged, and each having a length and width that is an integer multiple of the pixel point size of the pixel sensor. The optical filter pixel channels of the different shapes of the pixel-level optical filter structures correspond to different spectral wave filter coefficients, and the pixel-level optical filter structures with different spectral optical filter coefficients are periodically arranged after being combined in a fixed order. The sensor modulates the received first detection light through the periodic pixel-level optical filter structures arranged on its surface to form a mosaic image containing spectral information, and then uses an algorithm to reconstruct a grayscale image containing the measured spectral information.

[0071] The controller 203 is configured to control the light source to provide light within a predetermined wavelength range to illuminate a first region, and to control the imaging spectral detector to image the first region to acquire an image of the imaging region, and to control the imaging spectral detector to acquire, from the image, spectral data reflecting the non-uniform distribution of reflected or excited signals generated by the analyte when the imaging region is illuminated with the light. The method further includes the steps of: acquiring information about the analyte in the imaging region based on the acquired spectral data, the analyte information including information about the analyte correlated with the spectral data. When the light source 201 is one type, one image is acquired; when the light source 201 is two types, two images are acquired. When the first light source is turned on, the second light source is turned off; similarly, when the second light source is turned on, the first light source is turned off, so that the two light sources do not interfere with each other.

[0072] The first bandpass filter 204 is located between the light source 201 and the imaging area 100, and its function is to pass light within a predetermined wavelength range and block light outside the predetermined wavelength range, thereby reducing the influence of other external light on the detection results.

[0073] The second bandpass filter 206 is located between the imaging spectrum detector 202 and the lens 205, and its function is to pass light in the wavelength range in which the reflection signal or excitation signal generated by the analyte when irradiated with light is located, and to block light in other wavelength ranges, thereby reducing the influence of reflection signals or excitation signals other than those of the analyte on the detection results.

[0074] The lens 205 can be used for focusing to obtain a clear image. In another embodiment, the second bandpass filter 206 can be located on one side of the lens 205, away from the imaging spectrum detector 202, but the present invention is not limited thereto.

[0075] According to the above description, FIG. 9 shows a wristwatch for detecting an analyte provided by this embodiment. The front of the wristwatch is a display, and as shown in FIG. 10, the back of the wristwatch is a light-transmitting window with a built-in detection device 200. As shown in FIG. 11, the light source 201 and the first band-pass filter 204 are all annular structures. The light-emitting modules of the light source 201 are distributed in a ring shape, and the emitted light is optically filtered by the first band-pass filter 204 to output light of a required wavelength, which is then irradiated onto the human body through the light-transmitting window on the back of the wristwatch. The reflected signal or excitation signal from the human body enters the light-transmitting window, passes through the central hollow part of the light source 201 and the first band-pass filter 204, and enters the second band-pass filter 206 through the lens 205. After being optically filtered by the second band-pass filter 206, it enters the imaging spectrum detection device 202. The imaging spectrum detector 202 is mounted on a circuit board 207, and at the same time, a controller 203 (not shown) of the detector device 200 is also mounted on the circuit board 207. As shown in Figure 12, the watch can also be worn on the inside of the wrist to more accurately identify the location of the venous blood vessels.

[0076] Example 6 FIG. 8 is a structural schematic diagram of an electronic device provided by an embodiment of the present application, which includes at least one processor 501, as shown in FIG. 8, and a memory 502 communicatively connected to the at least one processor 501, wherein the memory 502 stores instructions executable by the at least one processor 501, the instructions are executed by the at least one processor 501, and the at least one processor 501 can perform the above-mentioned analyte detection method.

[0077] Here, the memory 502 and the processor 501 are connected in a bus manner, which may include any number of interconnected buses and bridges, connecting various circuits of one or more processors 501 and memories 502. The bus may also connect various other circuits, such as peripheral devices, voltage regulators, and power management circuits, which are well known in the art and will not be further described in the present invention. A bus interface provides an interface between the bus and a transceiver. The transceiver may be a single component or multiple components, for example, multiple receivers and transmitters, providing a unit for communicating with various other devices via a transmission medium. Data processed by the processor 501 is transmitted over a wireless medium via an antenna, which receives data and transmits data to the processor 501.

[0078] The processor 501 is responsible for bus management and general processing, and may also provide a variety of functions including timing, peripheral interfaces, voltage regulation, power management, and other control functions. The memory 502 may be used to store data used by the processor 501 when performing operations.

[0079] The present invention further provides a computer-readable storage medium having stored thereon a computer program, which, when executed by a processor, implements the above-described method for detecting an analyte.

[0080] That is, those skilled in the art will understand that all or some of the steps of implementing the methods of the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a storage medium containing some instructions that enable a device (which may be a single-chip microcomputer, chip, etc.) or a processor to execute all or some of the steps of the methods described in each embodiment of the present application. The storage medium includes various media that can store program code, such as a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0081] Those skilled in the art will understand that the above embodiments are specific examples for realizing the present invention, and that in actual applications, various changes in form and details are possible without departing from the spirit and scope of the present invention.

[0082] The above describes specific examples of the present invention. The present invention is not limited to the above specific embodiments, and it should be understood that those skilled in the art can make various changes or modifications within the scope of the claims without affecting the essential content of the present invention. Unless inconsistent, the examples and features of the examples in this application can be combined with each other in any way. [Explanation of symbols]

[0083] 100: Imaging area 200:Detection device 201: Light source 202: Imaging spectrum detector 203: Controller 204: 1st bandpass filter 205: Lens 206: Second bandpass filter 207: Circuit board 501: Processor 502: Memory

Claims

1. 1. A method for object location analysis, comprising: a first imaging step of irradiating a first region of a body surface with infrared light and imaging the first region to obtain a first image of the imaging region; a segmentation step of segmenting the image area into different grayscale areas based on the grayscale distribution of the first image; an object positioning step of selecting a grayscale region having grayscale values ​​that satisfy a predetermined requirement as a region in which the object is located; a non-object positioning step of selecting a grayscale area within a preset deviation range from the edge of the area where the object is located as an area where a non-object is located; a second imaging step of irradiating ultraviolet light onto the region where the object is located and the region where the non-object is located, and collecting fluorescent emission signals excited by the region where the object is located and the region where the non-object is located, respectively. Object positioning analysis method.

2. the first imaging step includes collecting a first image under illumination with infrared light within a first wavelength range; The first image includes data reflecting a distribution state in the imaging area of ​​a reflected signal or an excited signal generated by the first area when irradiated with a light beam.

2. The method of claim 1.

3. The dividing step comprises: the method further comprising: dividing the imaging area into detection point candidate areas and reference point candidate areas based on a grayscale distribution of pixel points in the first image; selecting detection points from the detection point candidate areas; selecting reference points from the reference point candidate areas; and acquiring spectral data of the detection points and spectral data of the reference points, respectively.

2. The method of claim 1.

4. The second imaging step includes collecting a second image under illumination with light within a second wavelength range, the light within the second wavelength range includes ultraviolet light; selecting, from a position of a detection point candidate region corresponding to the second image, one pixel point having a grayscale value that satisfies a predetermined requirement as a detection point, or selecting a combination of the pixel point and adjacent pixel points as a detection point, based on the grayscale value of the pixel point in the second image; selecting, from a position of a reference point candidate region corresponding to the second image, one pixel point having a grayscale value that falls within a predetermined deviation range from the selected detection point, or selecting a combination of the pixel point and a plurality of adjacent pixel points as reference points; and calculating and acquiring fluorescence spectrum data of the detection point and the reference point.

2. The method of claim 1.

5. the second wavelength range is 300 to 390 nanometers, and the second wavelength range is outside the effective response range of an imaging spectral detection device; The light in the second wavelength range can excite a fluorescent emission signal from the analyte, and a main peak of the fluorescent spectrum of the fluorescent emission signal is located within an effective response range of the imaging spectrum detection device.

5. The method of claim 4.

6. A method for detecting an analyte, comprising the method for locating and analyzing an object according to any one of claims 1 to 5.

7. 1. An object location analysis system, comprising: a first imaging module that irradiates a first region of a body surface with infrared light and captures an image of the first region to obtain a first image of the imaging region; a segmentation module for segmenting the image area into different grayscale areas based on the grayscale distribution of the first image; an object positioning module for selecting a grayscale region having a grayscale value that satisfies a preset requirement as a region where the object is located; a non-object positioning module for selecting, from an edge of the area where the object is located, a grayscale area having a grayscale value within a preset deviation range from the grayscale value of the area where the object is located, as an area where a non-object is located; a second imaging module that irradiates ultraviolet light onto the area where the object is located and the area where the non-object is located, and collects fluorescent emission signals excited by the area where the object is located and the area where the non-object is located, respectively. Object positioning analysis system.

8. The first imaging module includes collecting a first image under irradiation with infrared light within a first wavelength range; The first image includes data reflecting a distribution state in the imaging area of ​​a reflected signal or an excited signal generated by the first area when irradiated with a light beam. The object location and analysis system of claim 7 .

9. The division module: the method further comprising: dividing the imaging area into detection point candidate areas and reference point candidate areas based on a grayscale distribution of pixel points in the first image; selecting detection points from the detection point candidate areas; selecting reference points from the reference point candidate areas; and acquiring spectral data of the detection points and spectral data of the reference points, respectively. The object location and analysis system of claim 7 .

10. The second imaging module captures a second image under illumination with light within a second wavelength range, the light within the second wavelength range includes ultraviolet light; selecting, from a position of a detection point candidate region corresponding to the second image, one pixel point having a grayscale value that satisfies a predetermined requirement as a detection point, or selecting a combination of the pixel point and adjacent pixel points as a detection point, based on the grayscale value of the pixel point in the second image; selecting, from a position of a reference point candidate region corresponding to the second image, one pixel point having a grayscale value that falls within a predetermined deviation range from the selected detection point, or selecting a combination of the pixel point and a plurality of adjacent pixel points as reference points; and calculating and acquiring fluorescence spectrum data of the detection point and the reference point. The object location and analysis system of claim 7 .

11. the second wavelength range is 300 to 390 nanometers, and the second wavelength range is outside the effective response range of an imaging spectral detection device; The light in the second wavelength range can excite a fluorescent emission signal from the analyte, and a main peak of the fluorescent spectrum of the fluorescent emission signal is located within an effective response range of the imaging spectrum detection device. The object location and analysis system of claim 10.

12. A system for detecting an analyte, comprising the object positioning and analysis system according to any one of claims 7 to 11.

13. A computer-readable storage medium having a computer program stored thereon, A computer-readable storage medium having stored thereon a computer program, characterized in that when the computer program is executed by a processor, the steps of the object positioning analysis method according to any one of claims 1 to 5 are realized.

14. 1. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, The electronic device, characterized in that when the computer program is executed by a processor, the steps of the object positioning analysis method according to any one of claims 1 to 5 are realized.

Images