Flexible acousto-optic patch, signal processing method, computer device and storage medium

Abstract

The invention discloses a flexible acousto-optic patch, a signal processing method, a computer device and a storage medium, multi-modal detection of various different types of parameter indexes can be realized, the flexible acousto-optic patch is a patch in form, the occupied skin area is small when the flexible acousto-optic patch is attached to a patient, discomfort and inconvenience caused to the patient are light, and the flexible acousto-optic patch can be applied to the patient. Therefore, the use comfort and convenience of the patient are improved; the flexible acousto-optic patch can detect various different types of parameter indexes, so that the structure of monitoring equipment is simplified, and the use cost is reduced; according to the signal processing method of the flexible acousto-optic patch, data detected by the flexible acousto-optic patch can be processed, so that multi-modal results such as ultrasonic imaging, photoacoustic computed tomography and photoelectric volume are realized, and multi-modal data reference is provided for a patient. The signal processing method of the flexible acousto-optic patch can provide multi-modal data reference for a patient. The method is widely applied to the technical field of signal processing.

Description

Technical Field

[0001] The present invention relates to the field of signal processing technology, in particular to a flexible acousto-optic patch, a signal processing method, a computer device and a storage medium. Background Art

[0002] Flexible patches can be used in technical fields such as medical monitoring, mechanical assistance, and tracking and rescue. For example, patients who have undergone gastrointestinal surgery face the risk of complications such as bleeding and infection, and need to monitor their vital signs throughout the perioperative period. The professional monitoring equipment used by medical institutions is not suitable for home use. Some current home monitoring equipment has disadvantages such as being bulky and inconvenient to carry, which limits real-time monitoring of patients. Monitoring equipment based on flexible patches can install sensors and other devices on the flexible patches, and attach the flexible patches to the parts of the patient that need to be monitored to monitor the patient. In addition, flexible patches have the advantages of being small in size and light in weight, thereby achieving portability of monitoring equipment, which is conducive to increasing the effective use time of monitoring equipment and achieving real-time monitoring of patients.

[0003] Because some patients have complex conditions, they usually need to monitor multiple different types of parameters. Current technology requires the use of multiple different types of monitoring equipment, and wearable devices connected to multiple parts of the patient's body, causing discomfort and inconvenience to the patient and increasing the cost of using the equipment. Summary of the Invention

[0004] In response to technical problems such as the inability of current monitoring equipment to monitor different types of parameters, causing discomfort and inconvenience to patients, and the high cost of using the equipment, the purpose of the present invention is to provide a flexible acousto-optic patch, a signal processing method, a computer device and a storage medium.

[0005] In one aspect, an embodiment of the present invention includes a flexible acousto-optic patch, comprising:

[0006] An ultrasonic imaging layer; the ultrasonic imaging layer is located on a side close to the skin, the ultrasonic imaging layer is provided with a transparent ultrasonic transducer array, and the ultrasonic imaging layer is used for performing first modality detection;

[0007] A light imaging layer; the light imaging layer is adhered to the ultrasound imaging layer, the light imaging layer is located on the side away from the skin, the light imaging layer is provided with an LED light source array and a photodetector array, and the light imaging layer is used to perform second modality detection and third modality detection.

[0008] Furthermore, the first modal detection includes:

[0009] transmitting ultrasonic signals to skin tissue through the ultrasonic transducer array;

[0010] The ultrasonic transducer array receives the ultrasonic signal reflected by the skin tissue.

[0011] Furthermore, the second modal detection includes:

[0012] emitting a first wavelength laser signal and a second wavelength laser signal to the skin tissue respectively through the LED light source array;

[0013] The photodetector array receives a first wavelength reflection signal reflected by the skin tissue in response to the first wavelength laser signal and a second wavelength reflection signal reflected by the skin tissue in response to the second wavelength laser signal.

[0014] Furthermore, the third modal detection includes:

[0015] Transmitting a detection signal to the skin tissue via the LED light source array;

[0016] The photoelectric detection array receives a photoplethysmography signal reflected by the skin tissue in response to the detection signal.

[0017] Further, determining a trigger window width based on the photoplethysmography signal;

[0018] performing pulse triggering on the first modal detection, the second modal detection, and the third modal detection according to the trigger window width;

[0019] determining the validity of two modal detections according to a triggering time difference between two modal detections triggered by the pulse; the two modal detections are any two of the first modal detection, the second modal detection, and the third modal detection;

[0020] Obtaining an energy entropy mean and an energy entropy standard deviation of a photoacoustic signal, wherein the photoacoustic signal includes an ultrasonic signal reflected by skin tissue, a first wavelength reflection signal, a second wavelength reflection signal, and a photoplethysmography signal;

[0021] Determining a collection threshold according to the energy entropy mean and the energy entropy standard deviation;

[0022] Respiratory gating is performed on the first modality detection, the second modality detection, and the third modality detection according to the acquisition threshold.

[0023] On the other hand, an embodiment of the present invention further includes a signal processing method for a flexible acousto-optic patch, which is applied to the flexible acousto-optic patch in the embodiment. The signal processing method for the flexible acousto-optic patch includes:

[0024] In the first modality detection, information about the underlying structure of the skin is obtained based on the ultrasonic signal reflected by the skin tissue;

[0025] In the second modality detection, determining the blood oxygen saturation according to the first wavelength reflection signal and the second wavelength reflection signal;

[0026] In the third modality detection, an AC component in the photoplethysmography signal is extracted, and a cardiovascular physiological parameter is determined based on the AC component in the photoplethysmography signal.

[0027] Furthermore, determining the blood oxygen saturation according to the first wavelength reflection signal and the second wavelength reflection signal includes:

[0028] According to the formula

[0029]

[0030] Calculate; wherein sO2 is the blood oxygen saturation, is the signal strength of the first wavelength reflected signal, is the signal strength of the second wavelength reflected signal, is the absorption coefficient of deoxyhemoglobin to the first wavelength reflection signal, is the absorption coefficient of deoxyhemoglobin to the second wavelength reflection signal, is the absorption coefficient of oxygenated hemoglobin to the first wavelength reflection signal, is the absorption coefficient of oxygenated hemoglobin to the second wavelength reflection signal.

[0031] Furthermore, determining cardiovascular physiological parameters based on the AC component in the photoplethysmography signal includes:

[0032] According to the formula

[0033]

[0034]

[0035]

[0036]

[0037] Calculate; where HR is heart rate, Δt R-R is the time interval between two adjacent peaks in the AC component, P is the blood pressure, d is the conduction distance of the AC component, PTT is the time required for the AC component to propagate between two determined points in the artery, k1 and k2 are individual fitting parameters, PWV is the pulse wave transmission velocity, AIx is the augmentation index, P r is the reflected wave amplitude of the AC component, P f is the forward wave amplitude of the AC component.

[0038] On the other hand, an embodiment of the present invention further includes a computer device including a memory and a processor, wherein the memory is used to store at least one program, and the processor is used to load at least one program to execute the method for processing signals collected by the flexible patch in the embodiment.

[0039] On the other hand, an embodiment of the present invention further includes a computer-readable storage medium storing a program executable by a processor. When the program is executed by the processor, it is used to execute the method for processing the signal collected by the flexible patch in the embodiment.

[0040] The beneficial effects of the present invention are as follows: the flexible acousto-optic patch in the embodiment can perform a first modal detection to provide the host computer with the data required for processing for ultrasonic imaging, thereby realizing the ultrasonic imaging function of structures such as organs and blood vessels; it can perform a second modal detection to provide the host computer with the data required for processing for photoacoustic computed tomography, thereby realizing the detection of physiological parameters such as blood oxygen saturation; it can perform a third modal detection to provide the host computer with the data required for processing for photoplethysmography (PPG), thereby realizing the detection of physiological parameters such as heart rate and blood pressure. Therefore, the monitoring device uses the flexible acousto-optic patch in this embodiment to realize multimodal detection of multiple different types of parameter indicators. The flexible acousto-optic patch is a patch in form. When it is attached to the patient, it occupies a small skin area and causes relatively little discomfort and inconvenience to the patient, thereby improving the patient's comfort and convenience of use; since a flexible acousto-optic patch can detect multiple different types of parameter indicators, it is beneficial to simplify the structure of the monitoring device, thereby reducing the cost of use; the signal processing method of the flexible acousto-optic patch can process the data detected by the flexible acousto-optic patch, thereby realizing multimodal results such as ultrasound imaging, photoacoustic computed tomography and photoelectric capacitance, and providing patients with multimodal data references. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 Schematic diagram of the structure of the flexible acousto-optic patch in the embodiment;

[0042] Figure 2 Schematic diagram of the structure of the optical imaging layer in the flexible acousto-optic patch in the embodiment

[0043] Figure 3 Schematic diagram of the effect of the flexible acousto-optic patch performing multimodal detection in an embodiment;

[0044] Figure 4 Schematic diagram of the steps of a method for processing signals collected by a flexible patch in an embodiment;

[0045] Figure 5Schematic diagram of the first modal detection, the second modal detection and the third modal detection in the embodiment. DETAILED DESCRIPTION

[0046] Explanation of terms:

[0047] PPG (Photoplethysmography): A technique that optically detects changes in subcutaneous blood volume. It uses an LED light source to illuminate the skin and a photodetector to receive the reflected light signal. It is used to measure physiological parameters such as heart rate, blood oxygen saturation, and blood pressure.

[0048] PD: Photoelectric Detector, photoelectric detector;

[0049] UT: Ultrasonic Testing, ultrasonic detection.

[0050] In this embodiment, refer to Figure 1 The flexible acousto-optic patch includes an ultrasound imaging layer and a light imaging layer, which are bonded together to form the flexible acousto-optic patch. When using the flexible acousto-optic patch, the ultrasound imaging layer is placed on the side closest to the skin, while the light imaging layer is placed on the side away from the skin, allowing the flexible acousto-optic patch to adhere to the skin.

[0051] Reference Figure 1 The ultrasonic imaging layer is provided with an ultrasonic transducer array (UT). The ultrasonic transducer array (UT) can be made of a transparent iron crystal material, allowing light in the visible light band to pass through the ultrasonic transducer array (UT). Specifically, an alternating electric field can be used to polarize the PMN-PT ferroelectric crystal, thereby eliminating the ferroelectric domain walls that scatter light, resulting in a ferroelectric crystal material with a high piezoelectric coefficient (>2100pC / N), a high electro-optical coefficient (220pm / V), and a theoretical limit transmittance, which can be used to manufacture the ultrasonic transducer array (UT).

[0052] Reference Figure 1 The light imaging layer is provided with an LED light source array (LED) and a photodetector array (PD). When viewed from the direction perpendicular to the light imaging layer, the arrangement of the LED light source array (LED) and the photodetector array (PD) is as follows: Figure 2 shown.

[0053] Reference Figure 1The ultrasonic transducer array (UT) in the ultrasonic imaging layer and the LED light source array (LED) and photodetector array (PD) in the optical imaging layer are respectively connected to the host computer through data lines. The ultrasonic transducer array (UT) in the ultrasonic imaging layer can generate ultrasonic signals through electro-acoustic transduction and transmit ultrasonic signals to the skin tissue. The skin tissue absorbs and reflects the ultrasonic signals, and the ultrasonic signals reflected to the ultrasonic transducer array (UT) generate electrical signals through acoustic-electrical transduction.

[0054] Reference Figure 1 Since the ultrasound imaging layer is transparent, the light emitted by the LED light source array (LED) in the optical imaging layer to the skin tissue can pass through the optical imaging layer and reach the skin tissue, and the light reflected by the skin tissue to the optical imaging layer can also pass through the optical imaging layer and reach the photodetector array (PD) in the optical imaging layer.

[0055] In this embodiment, the ultrasonic imaging layer can perform first modality detection, and the optical imaging layer can perform second modality detection and third modality detection.

[0056] Specifically, the first modality detection performed by the ultrasound imaging layer includes the following steps:

[0057] A1. Transmitting ultrasonic signals to skin tissue through an ultrasonic transducer array;

[0058] A2. Receive ultrasonic signals reflected by skin tissue through the ultrasonic transducer array.

[0059] In step A1 of the first modal detection, the ultrasonic signal emitted by the ultrasonic transducer array (UT) can penetrate deep into the skin tissue (e.g., reaching a position 10 cm below the skin surface), where it is partially absorbed and reflected by the skin tissue. The reflected ultrasonic signal is then received by the ultrasonic transducer array in step A2, generating an electrical signal. The ultrasonic transducer array can then transmit the electrical signal to a host computer, which runs an ultrasonic imaging algorithm to process the electrical signal corresponding to the received ultrasonic signal, thereby performing ultrasonic imaging.

[0060] Specifically, the second modality detection performed by the optical imaging layer includes the following steps:

[0061] B1. Transmitting a first wavelength laser signal and a second wavelength laser signal to the skin tissue through an LED light source array;

[0062] B2. Receive, through a photodetector array, a first wavelength reflection signal reflected by the skin tissue in response to the first wavelength laser signal, and a second wavelength reflection signal reflected by the skin tissue in response to the second wavelength laser signal.

[0063] In this embodiment, the second modality detection is a photoacoustic computed tomography mode.

[0064] In step B1, the host computer controls the LED light source array (LED) to emit two wavelengths of laser signals to the skin tissue, namely a first wavelength laser signal with a wavelength of λ1 and a second wavelength laser signal with a wavelength of λ2. The wavelengths of the two laser signals are not equal, that is, λ1≠λ2. The first wavelength laser signal and the second wavelength laser signal can both be short pulses in the nanosecond range. After the skin tissue (especially tissues such as blood therein) receives the first wavelength laser signal, it absorbs and reflects a part of it, and the reflected part forms a first wavelength reflection signal. Similarly, after the skin tissue receives the second wavelength laser signal, it absorbs and reflects a part of it, and the reflected part forms a second wavelength reflection signal. Executing step B2, the photodetector array (PD) receives the first wavelength reflection signal and the second wavelength laser signal, and generates corresponding electrical signals respectively, which are uploaded to the host computer for processing.

[0065] Specifically, the third modality detection performed by the optical imaging layer includes the following steps:

[0066] C1. Transmitting detection signals to skin tissue through an LED light source array;

[0067] C2. Receive the photoplethysmographic signal reflected by the skin tissue in response to the detection signal through a photodetector array.

[0068] In this embodiment, the third modality detection is a PPG detection mode. The third modality detection and the second modality detection multiplex the LED light source array (LED) and the photodetector array (PD) in the optical imaging layer.

[0069] In step C1, an LED light source array (LED) transmits a detection signal to the skin tissue. The detection signal can be laser light, infrared light, or visible light of a specific wavelength. After receiving the detection signal, the skin tissue (particularly tissue such as blood vessels) absorbs and reflects a portion of it, with the reflected portion forming a photoplethysmography (PPE) signal. In step C2, a photodetector array (PD) receives the PPE signal and generates a corresponding electrical signal, which is then uploaded to a host computer for processing.

[0070] The flexible acousto-optic patch in this embodiment, such as Figure 3As shown, the first modal detection can be performed to provide the host computer with the data required for ultrasonic imaging, thereby realizing the ultrasonic imaging function of structures such as organs and blood vessels; the second modal detection can be performed to provide the host computer with the data required for photoacoustic computed tomography, thereby realizing the detection of physiological parameters such as blood oxygen saturation; the third modal detection can be performed to provide the host computer with the data required for photoplethysmography (PPG), thereby realizing the detection of physiological parameters such as heart rate and blood pressure. Therefore, the monitoring device uses the flexible acoustic-optic patch in this embodiment to realize multimodal detection of multiple different types of parameter indicators, and the flexible acoustic-optic patch is a patch in shape. When it is attached to the patient, it occupies a small area of ​​skin and causes less discomfort and inconvenience to the patient, thereby improving the patient's comfort and convenience; since a flexible acoustic-optic patch can detect multiple different types of parameter indicators, it is conducive to simplifying the structure of the monitoring device, thereby reducing the cost of use.

[0071] In this embodiment, Figure 4 As shown, the signal processing method applied to the flexible acousto-optic patch includes the following steps:

[0072] S1. In the first modal detection, information about the underlying skin structure is obtained based on the ultrasonic signal reflected by the skin tissue;

[0073] S2. In the second modal detection, the blood oxygen saturation is determined according to the first wavelength reflected signal and the second wavelength reflected signal;

[0074] S3. In the third modality detection, the AC component in the photoplethysmography signal is extracted, and the cardiovascular physiological parameters are determined based on the AC component in the photoplethysmography signal.

[0075] Steps S1-S3 can be executed by a host computer.

[0076] In step S1, when the flexible acousto-optic patch performs the first modal detection, the host computer can obtain the ultrasonic signal detected by the ultrasonic transducer array (UT) in the ultrasonic imaging layer, run the ultrasonic imaging algorithm to process the ultrasonic signal, and thus obtain the subcutaneous structure information in the form of an ultrasonic image. The subcutaneous structure information can specifically include images of the patient's internal organs or vascular structure.

[0077] In step S2, when the host computer performs the second modal detection on the flexible acousto-optic patch, it can be specifically determined according to the formula

[0078]

[0079] Calculate. Where sO2 is the blood oxygen saturation, is the signal strength of the reflected signal at the first wavelength, is the signal strength of the second wavelength reflected signal, is the absorption coefficient of deoxyhemoglobin to the first wavelength reflection signal, is the absorption coefficient of deoxyhemoglobin to the second wavelength reflection signal, is the absorption coefficient of oxygenated hemoglobin to the first wavelength reflection signal, is the absorption coefficient of oxygenated hemoglobin to the second wavelength reflection signal.

[0080] In the calculation formula of blood oxygen saturation sO2, and The isoabsorption coefficient is a constant that can be set in advance in the host computer based on experimental data or medical manuals, and called when calculating according to the formula. and the signal strength of the second wavelength reflected signal is the detection value of the photodetector array (PD) in the photoimaging layer.

[0081] In this embodiment, the principle of the calculation formula of blood oxygen saturation sO2 is that the amplitude of the reflected signal that can be detected by the photoelectric detector can be expressed as

[0082] P=kΓ0ηFμ a

[0083] Where P is the amplitude of the reflected signal, k is the sensitivity of the photodetector, Γ0 is the Gruneisen coefficient at a certain temperature, which represents the conversion efficiency of heat energy to pressure, η is the light-to-heat conversion efficiency, F is the luminous flux detected by the photodetector, and μ a is the absorption coefficient of biological tissue to light. Under the condition that other parameters remain constant, the amplitude of the photoacoustic signal is proportional to the absorption coefficient of biological tissue to light. The higher the absorption coefficient, the greater the amplitude of the photoacoustic signal. There are two types of hemoglobin in blood, namely oxyhemoglobin and deoxyhemoglobin. Then it can be obtained that under the condition of a specific wavelength λ, the intensity of the photoacoustic signal generated by blood is

[0084]

[0085] in represents the absorption coefficient of oxygenated hemoglobin to light of wavelength λ, represents the absorption coefficient of deoxyhemoglobin to light of wavelength λ, Indicates the concentration of oxygenated hemoglobin in the blood, C Hb Indicates the concentration of deoxygenated hemoglobin in the blood. Blood oxygen saturation refers to the percentage of oxygenated hemoglobin in the blood to the total amount of hemoglobin. Therefore, blood oxygen saturation sO2 satisfies

[0086]

[0087] Oxygenated hemoglobin and deoxygenated hemoglobin have different absorption coefficients for different wavelengths, and the absorption coefficient is constant. So in the formula for blood oxygen saturation sO2, only and C Hb Therefore, when the first wavelength laser signal with wavelength λ1 and the second wavelength laser signal with wavelength λ2 are used for detection, that is, λ is λ1 and λ2 respectively, the formulas of blood oxygen saturation sO2 corresponding to λ=λ1 and λ1λ2 can be combined to obtain

[0088]

[0089] Therefore, when the flexible acousto-optic patch performs the second modality detection, the host computer can accurately detect the patient's blood oxygen saturation sO2.

[0090] In step S3, when the upper computer performs the third modal detection on the flexible acousto-optic patch, it can first separate the DC component and the original AC component in the photoplethysmographic signal by the moving average method, and pass the original AC component through a bandpass filter to retain the signal components in the 0.5-8 Hz frequency band covering characteristics such as heart rate, respiratory rate and vascular pulsation, thereby filtering out high-frequency noise and low-frequency baseline drift to obtain the AC component. The upper computer can specifically use the formula

[0091]

[0092]

[0093]

[0094]

[0095] Calculations are performed to obtain cardiovascular physiological parameters such as heart rate, blood pressure, pulse wave velocity and augmentation index.

[0096] Specifically, the formula The principle is:

[0097] The AC component of the PPG signal is synchronized with the heartbeat, and its dynamic amplitude changes directly reflect the instantaneous fluctuations in arterial blood volume during the cardiac cycle. Specifically, each complete pulse wave cycle (i.e., the time interval between adjacent main wave peaks) accurately corresponds to one cardiac contraction and relaxation process. Therefore, the time interval between adjacent pulse wave peaks (Δt R-R ) to calculate heart rate.

[0098] formula The principle is:

[0099] Blood pressure variables can be directly correlated with the phase difference, amplitude ratio, and time-domain morphological characteristics of the PPG signal waveform. One of the most common methods for estimating blood pressure is pulse wave transit time (PTT), which measures the time it takes for a pulse wave to propagate between two points in an artery. Research has shown a significant negative correlation between PTT and blood pressure. Based on this mechanism, this project proposes to simultaneously acquire proximal and distal PPG signals, calculate the corresponding PTT parameters, and convert them into blood pressure values ​​through personalized calibration. The correlation between PTT and blood pressure is supported by two mechanisms. According to fluid dynamics, reduced arterial compliance (i.e., arteriosclerosis) significantly shortens PTT, meaning that pulse waves propagate faster in stiffened arteries. Furthermore, due to the material properties of the arterial wall, arterial compliance decreases with increasing blood pressure. This means that the arterial wall becomes stiffer when subjected to higher blood pressure. The physical basis for this is that elastin plays a primary role in the initial stretching of the arterial wall, while the more rigid collagen gradually takes over as the stretch increases. This mechanism can be quantitatively explained using the Bramwell-Hill equation and the Wesseling aortic blood volume / compliance equation. Therefore, the inverse relationship between PTT and blood pressure can be obtained in, k2=P1.

[0100] formula and The principle is:

[0101] By combining the analysis of pulse wave dynamic characteristics and waveform morphology parameters, PPG signals can reflect the mechanical properties of blood vessels through pulse wave velocity (PWV) and augmentation index. Among them, PWV can be directly calculated by PTT when the pulse wave conduction distance is d, that is, By calculating the reflected wave amplitude P r and the forward wave amplitude P f The augmentation index AIx obtained by the ratio of is positively correlated with aortic stiffness and can therefore represent aortic stiffness.

[0102] In this embodiment, the upper computer can utilize the unique spectral characteristics and high acoustic resolution of the flexible acousto-optic patch to perform quantitative imaging analysis of multiple physiological parameters of blood (including vascular structure, blood pressure, blood oxygen content, and vascular elasticity, etc.) by executing steps S1-S3, thereby realizing the functional combination of trimodal imaging and monitoring; the multiplexing of the ultrasonic transducer and LED light source of the flexible acousto-optic patch can save space and cost, making the device smaller and lighter, meeting wearable requirements without increasing the burden of wearing; the flexible acousto-optic patch's flexible characteristics enable the device to fit closely to human skin, realizing continuous physiological monitoring.

[0103] In this embodiment, the flexible acousto-optic patch can perform the first mode detection, the second mode detection and the third mode detection at the same time, or it can only work in any one of the first mode detection, the second mode detection and the third mode detection at a certain moment, and can switch to other mode detections. Figure 5 When the flexible acousto-optic patch performs multimodal detection of the first modal detection, the second modal detection and the third modal detection, pulse triggering and respiratory gating can be performed on each modal detection.

[0104] In this embodiment, the host computer can obtain the photoelectric volume pulse wave signal (PPG) obtained by the third modality detection performed last, and the photoelectric volume pulse wave signal (PPG) can be calculated by the formula The heart rate is calculated by the formula

[0105]

[0106] The trigger window width W is calculated, where k is a coefficient, specifically k=0.2 or k=0.4, and pulse triggering (PPG-gating) is performed on the first modal detection, the second modal detection, and the third modal detection according to the trigger window width W.

[0107] Specifically, the calculated trigger window width W can be regarded as the duration of the patient's cardiac diastole (the period of weakest movement), and pulse triggering is performed on the first modal detection, the second modal detection and the third modal detection. Specifically, the first modal detection, the second modal detection or the third modal detection can be triggered within a time window of length W, which is beneficial to reduce the displacement artifacts caused by the patient's heart beating.

[0108] In this embodiment, the host computer can also set the priority of the first modal detection, the second modal detection and the third modal detection according to the impact of the detection results on the patient's movement (for example, the order of priority from high to low can be the first modal detection, the second modal detection, the third modal detection), and determine the validity of the two modal detections based on the triggering time difference between the two modal detections triggered by the pulse, where the two modal detections are any two of the first modal detection, the second modal detection and the third modal detection.

[0109] For example, when the first modality detection and the second modality detection are triggered and executed within the same time period, the host computer can calculate the time difference between the triggering moment of the first modality detection and the triggering moment of the second modality detection. If the time difference is less than or equal to a threshold value (for example, 10ms), the triggering of the first modality detection and the second modality detection is judged to be a valid trigger, and the results of both modality detections are adopted; if the time difference is greater than the threshold value, then only the detection result with a higher priority (first modality detection) can be adopted, thereby reducing the impact of artifacts such as patient movement on the detection results.

[0110] In this embodiment, the host computer can also record the photoacoustic signals such as the ultrasonic signal, the first wavelength reflection signal, the second wavelength reflection signal, and the photoelectric volume pulse wave signal detected by the last performed first modal detection, the second modal detection, and the third modal detection (for example, the sum of the ultrasonic signal, the first wavelength reflection signal, the second wavelength reflection signal, and the photoelectric volume pulse wave signal can be calculated as the photoacoustic signal), and obtain the energy entropy mean μ of the photoacoustic signal. E and the standard deviation of energy entropy σ E , according to the formula

[0111] Threshold=μ E -0.5σ E

[0112] An acquisition threshold Threshold is calculated, and respiratory gating is performed on the first modality detection, the second modality detection, and the third modality detection according to the acquisition threshold Threshold.

[0113] For example, a patient's respiratory intensity can be tested, with the acquisition threshold Threshold as the threshold for respiratory intensity. When the patient's respiratory intensity is detected to be lower than the acquisition threshold Threshold, it can be determined that the patient has entered or is in a apnea period (from the end of exhalation to the beginning of inspiration), that is, a period of low motion artifacts, and the first modality detection, second modality detection, or third modality detection can be triggered. By calculating the acquisition threshold Threshold for respiratory gating, the impact of motion artifacts on the first, second, and third modal detections can be effectively reduced.

[0114] A computer program that executes the method for processing the flexible patch acquisition signal in this embodiment can be written and written into a computer device or storage medium. When the computer program is read out and run, the method for processing the flexible patch acquisition signal in this embodiment is executed, thereby achieving the same technical effect as the method for processing the flexible patch acquisition signal in the embodiment.

[0115] It should be noted that, unless otherwise specified, when a feature is referred to as being "fixed" or "connected" to another feature, it may be directly fixed or connected to the other feature, or it may be indirectly fixed or connected to the other feature. In addition, the descriptions of up, down, left, right, etc. used in this disclosure are only relative to the relative positional relationship of the components of the present disclosure in the accompanying drawings. The singular forms of "a" and "the" used in this disclosure are also intended to include the plural forms, unless the context clearly indicates otherwise. In addition, unless otherwise defined, all technical and scientific terms used in this embodiment have the same meaning as those generally understood by those skilled in the art. The terms used in the specification of this embodiment are only for describing specific embodiments and are not intended to limit the present invention. The term "and / or" used in this embodiment includes any combination of one or more related listed items.

[0116] It should be understood that, although the present disclosure may adopt the term first, second, third etc. to describe various elements, these elements should not be limited to these terms.These terms are only used to distinguish the elements of the same type from each other.For example, without departing from the scope of the present disclosure, the first element may also be referred to as the second element, and similarly, the second element may also be referred to as the first element.The use of any and all examples or exemplary language ("for example", "such as" etc.) provided by the present embodiment is only intended to better illustrate embodiments of the present invention, and unless otherwise required, the scope of the present invention will not be limited.

[0117] It should be appreciated that embodiments of the present invention can be implemented or practiced by computer hardware, a combination of hardware and software, or by computer instructions stored in a non-transitory computer-readable memory. The methods can be implemented in a computer program using standard programming techniques - including a non-transitory computer-readable storage medium configured with a computer program, wherein the storage medium so configured causes the computer to operate in a specific and predefined manner - according to the methods and figures described in the specific embodiments. Each program can be implemented in a high-level procedural or object-oriented programming language to communicate with the computer system. However, if desired, the program can be implemented in assembly or machine language. In any case, the language can be a compiled or interpreted language. In addition, the program can be run on a programmed application-specific integrated circuit for this purpose.

[0118] In addition, the operations of the process described in this embodiment may be performed in any suitable order, unless otherwise indicated in this embodiment or otherwise clearly contradicted by the context. The process described in this embodiment (or variations and / or combinations thereof) may be performed under the control of one or more computer systems configured with executable instructions, and may be implemented as a code (e.g., executable instructions, one or more computer programs, or one or more applications) executed on one or more processors, by hardware or a combination thereof. A computer program includes a plurality of instructions that may be executed by one or more processors.

[0119] Furthermore, the method can be implemented in any type of computing platform that is operably connected to a suitable computer, including but not limited to a personal computer, a minicomputer, a mainframe, a workstation, a network or distributed computing environment, a separate or integrated computer platform, or in communication with a charged particle tool or other imaging device, etc. Various aspects of the present invention can be implemented as machine-readable code stored on a non-transitory storage medium or device, whether removable or integrated into a computing platform, such as a hard disk, an optical read and / or write storage medium, RAM, ROM, etc., so that it can be read by a programmable computer, and when the storage medium or device is read by the computer, it can be used to configure and operate the computer to perform the process described herein. In addition, the machine-readable code, or portions thereof, can be transmitted over a wired or wireless network. When such media includes instructions or programs that implement the above steps in conjunction with a microprocessor or other data processor, the invention of this embodiment includes these and other different types of non-transitory computer-readable storage media. When programmed according to the methods and techniques of the present invention, the present invention also includes the computer itself.

[0120] The computer program can be applied to input data to perform the functions of the present embodiment, thereby converting the input data to generate output data that is stored in a non-volatile memory. The output information can also be applied to one or more output devices such as a display. In a preferred embodiment of the present invention, the converted data represents a physical and tangible object, including a specific visual depiction of the physical and tangible object produced on the display.

[0121] The above are merely preferred embodiments of the present invention. The present invention is not limited to the aforementioned embodiments. As long as the technical effects of the present invention are achieved by the same means, any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention shall be included within the scope of protection of the present invention. Within the scope of protection of the present invention, various modifications and variations of the technical solutions and / or implementation methods may be made.

Claims

1. A flexible acousto-optic patch, characterized in that: The flexible acousto-optic patch comprises: An ultrasonic imaging layer; the ultrasonic imaging layer is located on a side close to the skin, the ultrasonic imaging layer is provided with a transparent ultrasonic transducer array, and the ultrasonic imaging layer is used for performing first modality detection; A light imaging layer; the light imaging layer is adhered to the ultrasound imaging layer, the light imaging layer is located on the side away from the skin, the light imaging layer is provided with an LED light source array and a photodetector array, and the light imaging layer is used to perform second modality detection and third modality detection.

2. The flexible acousto-optic patch according to claim 1, characterized in that: The first modal detection includes: transmitting ultrasonic signals to skin tissue through the ultrasonic transducer array; The ultrasonic transducer array receives the ultrasonic signal reflected by the skin tissue.

3. The flexible acousto-optic patch according to claim 3, characterized in that: The second modal detection includes: emitting a first wavelength laser signal and a second wavelength laser signal to the skin tissue respectively through the LED light source array; The photodetector array receives a first wavelength reflection signal reflected by the skin tissue in response to the first wavelength laser signal and a second wavelength reflection signal reflected by the skin tissue in response to the second wavelength laser signal.

4. The flexible acousto-optic patch according to claim 4, characterized in that: The third modality detection includes: Transmitting a detection signal to the skin tissue via the LED light source array; The photoelectric detection array receives a photoplethysmography signal reflected by the skin tissue in response to the detection signal.

5. The flexible acousto-optic patch according to any one of claims 2 to 4, characterized in that: Determine the trigger window width based on the photoplethysmography signal; performing pulse triggering on the first modal detection, the second modal detection, and the third modal detection according to the trigger window width; Determining the validity of the two modal detections based on the triggering time difference between the two modal detections triggered by the pulse; The two modal detections are any two of the first modal detection, the second modal detection, and the third modality; Obtaining an energy entropy mean and an energy entropy standard deviation of a photoacoustic signal, wherein the photoacoustic signal includes an ultrasonic signal reflected by skin tissue, a first wavelength reflection signal, a second wavelength reflection signal, and a photoplethysmography signal; Determining a collection threshold according to the energy entropy mean and the energy entropy standard deviation; Respiratory gating is performed on the first modality detection, the second modality detection, and the third modality detection according to the acquisition threshold.

6. A signal processing method for a flexible acousto-optic patch, applied to the flexible acousto-optic patch according to any one of claims 2 to 5, characterized in that: The signal processing method of the flexible acousto-optic patch includes: In the first modality detection, information about the underlying structure of the skin is obtained based on the ultrasonic signal reflected by the skin tissue; In the second modality detection, determining the blood oxygen saturation according to the first wavelength reflection signal and the second wavelength reflection signal; In the third modality detection, an AC component in the photoplethysmography signal is extracted, and a cardiovascular physiological parameter is determined based on the AC component in the photoplethysmography signal.

7. The signal processing method according to claim 6, characterized in that: The determining of the blood oxygen saturation according to the first wavelength reflection signal and the second wavelength reflection signal includes: According to the formula Calculate; wherein sO2 is the blood oxygen saturation, is the signal strength of the first wavelength reflected signal, is the signal strength of the second wavelength reflected signal, is the absorption coefficient of deoxyhemoglobin to the first wavelength reflection signal, is the absorption coefficient of deoxyhemoglobin to the second wavelength reflection signal, is the absorption coefficient of oxygenated hemoglobin to the first wavelength reflection signal, is the absorption coefficient of oxygenated hemoglobin to the second wavelength reflection signal.

8. The signal processing method according to claim 6 or 7, characterized in that: Determining cardiovascular physiological parameters based on the AC component in the photoplethysmography signal includes: According to the formula Calculate; where HR is heart rate, Δt R-R is the time interval between two adjacent peaks in the AC component, P is the blood pressure, d is the conduction distance of the AC component, PTT is the time required for the AC component to propagate between two determined points in the artery, k1 and k2 are individual fitting parameters, PWV is the pulse wave transmission velocity, AIx is the augmentation index, P r is the reflected wave amplitude of the AC component, P f is the forward wave amplitude of the AC component.

9. A computer device, characterized in that: The method comprises a memory and a processor, wherein the memory is used to store at least one program, and the processor is used to load at least one program to execute the method for processing signals collected by a flexible patch according to any one of claims 6 to 8.

10. A computer-readable storage medium storing a program executable by a processor, characterized in that: The program executable by the processor is used to execute the method for processing signals collected by the flexible patch as described in any one of claims 6 to 8 when executed by the processor.

Images