Absolute respiratory amplitude measurement method, device, terminal equipment and storage medium based on structured light

Abstract

The present application relates to the field of biomedical engineering technology. The present application discloses a method and apparatus for measuring absolute respiratory amplitude based on structured light, a terminal device, and a storage medium, which can realize the measurement of absolute respiratory amplitude. The method for measuring absolute respiratory amplitude based on structured light includes using a target sensor to collect an initial video of the surface of a target object when structured light is irradiated onto the surface of the target object; calculating a first target average spot spacing based on all spots on each frame of the initial video; extracting respiratory amplitude features from the initial video, and calculating the average value of the extracted respiratory amplitude features to obtain a first average respiratory amplitude; and using a first linear fitting model to measure and calculate the first average respiratory amplitude and the first target average spot spacing to obtain the absolute respiratory amplitude of the target object.

Description

Technical Field

[0001] The present application relates to the field of biomedical engineering technology. More specifically, the present application relates to a method, apparatus, terminal device, and storage medium for measuring absolute respiratory amplitude based on structured light. Background Art

[0002] Absolute respiratory amplitude refers to the distance between the maximum expansion and contraction of the chest during breathing. It is often used to assist medical staff in assessing a patient's respiratory function. In other words, medical staff can use absolute respiratory amplitude to assess a patient's respiratory function. However, in existing technologies, most methods for measuring respiratory signal characteristics are limited to the respiratory amplitude range, and cannot directly measure absolute respiratory amplitude. For example, traditional methods obtain historical respiratory signals from a target subject over a preset time interval. A preset window is slid across the historical respiratory signals, and the historical respiratory signals within the sliding preset window are decomposed using the EMD algorithm. The window length is iteratively adjusted based on the frequency concentration characteristics of the signal components to segment the historical respiratory signals to obtain respiratory segments. The cluster distance between any two respiratory segments is determined based on the difference in respiratory amplitude and signal components between the two segments. Based on the cluster distance, the respiratory segments are clustered, with each cluster corresponding to a respiratory pattern. The respiratory amplitude range for each respiratory pattern is determined based on the overall characteristics of the respiratory amplitude range of all respiratory segments within each cluster, as well as the frequency distribution characteristics of all first signal components. This method can only measure the respiratory amplitude range and cannot directly measure absolute respiratory amplitude. Therefore, the existing technology needs to be improved and enhanced. Summary of the Invention

[0003] The purpose of the embodiments of the present application is to provide a method, apparatus, terminal device, and storage medium for measuring absolute respiratory amplitude based on structured light, which can achieve the measurement of absolute respiratory amplitude. The embodiments of the present application are mainly achieved through the following technical solutions:

[0004] A first aspect of an embodiment of the present application provides a method for measuring absolute respiratory amplitude based on structured light, comprising:

[0005] When the structured light is irradiated onto the surface of the target object, an initial video of the surface of the target object is collected using a target sensor;

[0006] Obtaining a first target average spot spacing based on all spots on each frame of the initial video;

[0007] Performing a respiratory amplitude feature extraction process on the initial video, and performing an average calculation process on the extracted respiratory amplitude feature to obtain a first average respiratory amplitude;

[0008] The first average respiratory amplitude and the first target average spot distance are measured and calculated using a first linear fitting model to obtain an absolute respiratory amplitude of the target object.

[0009] According to one embodiment of the present application, the step of calculating and obtaining a first target average spot spacing based on all spots on each frame of the initial video includes:

[0010] Calculating the distance between each light spot on each frame image in the initial video and the nearest light spot on the same frame image to obtain a first distance corresponding to each light spot on each frame image;

[0011] All the first distances are averaged to obtain the first target average spot spacing.

[0012] According to one embodiment of the present application, the steps of extracting respiratory amplitude features from the initial video and calculating an average value of the extracted respiratory amplitude features to obtain a first average respiratory amplitude include:

[0013] Performing respiratory signal extraction processing on the initial video to obtain a plurality of target respiratory signals corresponding to the initial video, wherein each target respiratory signal has a one-to-one correspondence with one of the light spots on the first frame image in the initial video;

[0014] Set the first sliding window and step size;

[0015] performing amplitude extraction processing on each target respiratory signal based on the first sliding window and the step size to obtain a target amplitude corresponding to each target respiratory signal;

[0016] All target amplitudes are averaged to obtain the first average respiratory amplitude.

[0017] According to one embodiment of the present application, after the step of measuring and calculating the first average respiratory amplitude and the first target average spot distance using a first linear fitting model to obtain the absolute respiratory amplitude of the target object, the absolute respiratory amplitude measurement method based on structured light further includes:

[0018] Acquire a second distance between the target sensor and the surface of the target object and a third distance between a photosensitive element and a lens in the target sensor;

[0019] performing a ratio calculation process on the second distance and the third distance using a preset distance measurement algorithm to obtain a second target average spot distance of the structured light irradiated on the surface of the target object;

[0020] performing a ratio calculation process on the second distance and the third distance using a preset average respiratory amplitude measurement algorithm to obtain a second average respiratory amplitude;

[0021] Using a second linear fitting model to measure and calculate the second average respiratory amplitude and the second target average spot spacing to obtain a calibration value;

[0022] The absolute respiratory amplitude is calibrated based on the calibration value.

[0023] According to one embodiment of the present application, a preset spacing measurement algorithm is used to calculate the ratio of the second distance and the third distance, and a calculation formula for obtaining the second target average spot spacing of the surface of the target object irradiated by the structured light is:

[0024] ;

[0025] in, is a second target average spot spacing of the structured light irradiated on the surface of the target object; is the average of all spot spacings of the structured light irradiating the surface of the target object; is the third distance; is the second distance.

[0026] According to one embodiment of the present application, a preset average respiratory amplitude measurement algorithm is used to perform ratio calculation processing on the second distance and the third distance, and a calculation formula for obtaining the second average respiratory amplitude is:

[0027] ;

[0028] in, is the second average respiratory amplitude; It is the displacement of the target object in the horizontal direction of the focal plane generated by the same observation point of the target object on the focal plane of the target sensor when the target object undergoes vertical displacement.

[0029] According to one embodiment of the present application, a first linear fitting model is used to measure and calculate the first average respiratory amplitude and the first target average spot spacing, and a calculation formula for obtaining the absolute respiratory amplitude of the target object is:

[0030] ;

[0031] in, is the absolute respiratory amplitude; The angle is the angle formed by the straight line connecting the center of the lens of the target sensor and the center of the surface of the target object, and the straight line perpendicular to the center of the surface of the target object; is the first average respiratory amplitude; is the first target average spot spacing; is the preset error.

[0032] A second aspect of the embodiments of the present application provides a device for measuring absolute respiratory amplitude based on structured light, comprising:

[0033] an initial video acquisition module, configured to acquire an initial video of the surface of a target object using a target sensor when the structured light is irradiated onto the surface of the target object;

[0034] A first target average spot spacing calculation module is used to calculate the first target average spot spacing based on all spots on each frame of the initial video;

[0035] a first average respiratory amplitude obtaining module, configured to extract respiratory amplitude features from the initial video, and average the extracted respiratory amplitude features to obtain a first average respiratory amplitude;

[0036] The measurement and calculation module is used to measure and calculate the first average respiratory amplitude and the first target average spot distance using a first linear fitting model to obtain the absolute respiratory amplitude of the target object.

[0037] In a third aspect of an embodiment of the present application, a terminal device is provided, comprising: a processor and a memory, the memory being used to store a computer program, the processor being used to call and run the computer program stored in the memory, and executing the steps of the absolute respiratory amplitude measurement method based on structured light provided in the first aspect of the embodiment of the present application.

[0038] In a fourth aspect of an embodiment of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium is used to store a computer program, and the computer program enables a computer to execute the steps of the absolute respiratory amplitude measurement method based on structured light provided in the first aspect of the embodiment of the present application.

[0039] The beneficial effects of the embodiments of the present application include:

[0040] The embodiment of the present application combines the average spot spacing of the structured light and the average respiratory amplitude of the respiratory signal to measure the absolute respiratory amplitude. Specifically, the embodiment of the present application uses a target sensor to collect an initial video of the surface of the target object when the structured light is irradiated to the surface of the target object; a first target average spot spacing is calculated based on all the spots on each frame of the image in the initial video; the initial video is subjected to respiratory amplitude feature extraction processing, and the extracted respiratory amplitude feature is subjected to average value calculation processing to obtain a first average respiratory amplitude; the first average respiratory amplitude and the first target average spot spacing are measured and calculated using a first linear fitting model to obtain the absolute respiratory amplitude of the target object. Therefore, compared with the existing technology that cannot directly measure the absolute respiratory amplitude, the embodiment of the present application can achieve the measurement of the absolute respiratory amplitude. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the conventional technology, the following briefly introduces the drawings required for use in the embodiments or the conventional technology descriptions. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0042] Figure 1 A flowchart of the method for measuring absolute respiratory amplitude based on structured light in some embodiments of the present application;

[0043] Figure 2 Flowcharts of other embodiments of the method for measuring absolute respiratory amplitude based on structured light of the present application;

[0044] Figure 3 A reference diagram for the positional relationship between a target sensor and a target object in some embodiments;

[0045] Figure 4 A reference diagram for the positional relationship between the target sensor and the target object in some other embodiments;

[0046] Figure 5 This is a principle block diagram of the device for measuring absolute respiratory amplitude based on structured light in some embodiments of the present application;

[0047] Figure 6 This is a principle block diagram of the terminal device of the present application in some embodiments. DETAILED DESCRIPTION

[0048] To make the above-mentioned objects, features, and advantages of the present application more clearly understood, the specific embodiments of the present application are described in detail below with reference to the accompanying drawings. The following description sets forth many specific details to facilitate a full understanding of the present application. However, the present application can be implemented in many other ways than those described herein, and those skilled in the art can make similar improvements without violating the scope of the present application. Therefore, the present application is not limited to the specific embodiments disclosed below.

[0049] It should be noted that the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of the technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of such features. In the description of this application, "plurality" means at least two, for example, two, three, etc., unless otherwise specifically defined.

[0050] The terms "exemplary" or "for example" are used to indicate an example, illustration, or description. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0051] The terms "comprises," "comprising," or any other variations thereof are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, product, or apparatus.

[0052] Unless otherwise defined, all technical and scientific terms used in the specification of this application have the same meaning as commonly understood by those skilled in the art to which this application belongs. The terms used in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application. The term "and / or" used in the specification of this application includes any and all combinations of one or more of the relevant listed items.

[0053] The specific implementation of this application is further described below with reference to the accompanying drawings.

[0054] refer to Figure 1 FIG. 1 is a flow chart of a method for measuring absolute respiratory amplitude based on structured light according to the first aspect of the present invention. Figure 1 In the method, the absolute respiratory amplitude measurement method based on structured light includes:

[0055] S1. When structured light illuminates a surface of a target object, an initial video of the surface of the target object is collected using a target sensor.

[0056] The surface of the target object may be an abdominal area or a chest area of ​​the target object.

[0057] The target sensor is a camera.

[0058] In other embodiments, a single laser light source may be used instead of the structured light source, and the specific configuration can be made by those skilled in the art according to actual needs. In the case of using a single laser light source, the absolute respiratory amplitude extracted at different distances can be calibrated according to the size of the laser spot.

[0059] S2. Calculate and obtain a first target average light spot spacing based on all light spots on each frame of the initial video.

[0060] Furthermore, step S2 includes: calculating the distance between each light spot on each frame image in the initial video and the nearest light spot on the same frame image to obtain a first distance corresponding to each light spot on each frame image; and performing average calculation processing on all first distances to obtain the first target average light spot spacing.

[0061] S3. Perform respiratory amplitude feature extraction on the initial video, and perform average value calculation on the extracted respiratory amplitude features to obtain a first average respiratory amplitude.

[0062] Furthermore, step S3 includes: performing respiratory signal extraction processing on the initial video to obtain multiple target respiratory signals corresponding to the initial video, wherein each target respiratory signal has a one-to-one correspondence with one of the light spots on the first frame image in the initial video; setting a first sliding window and step size; performing amplitude extraction processing on each target respiratory signal based on the first sliding window and the step size to obtain a target amplitude corresponding to each target respiratory signal; performing average calculation processing on all target amplitudes to obtain the first average respiratory amplitude.

[0063] The length of the first sliding window is set to 7 seconds, and 7 seconds contains 210 frames of images. In other embodiments, the length of the first sliding window can be set by those skilled in the art according to actual needs.

[0064] The step length is set to 2.33 seconds, and 70 frames of images are included in 2.33 seconds. In other embodiments, the length of the step length can be set by those skilled in the art according to actual needs.

[0065] Furthermore, the initial video is subjected to respiratory signal extraction processing to obtain a plurality of target respiratory signals corresponding to the initial video, wherein each target respiratory signal has a one-to-one correspondence with one of the light spots on the first frame image in the initial video. The steps include: performing region of interest recognition processing on the first frame image to obtain a target region of interest; performing binarization processing on each frame image of the initial video using the Bradley threshold method (the Bradley threshold method is an adaptive threshold algorithm for image binarization) to obtain a binarized image corresponding to each frame image, and locating each light spot in the target region of interest of each frame binary image; obtaining a bounding box of each light spot from each frame binary image using the regionprops function of MATLAB software (the regionprops function is used to measure various properties of connected areas marked in an image); and calculating the target respiratory signal corresponding to each light spot using the optical flow method based on the bounding box corresponding to each light spot. For details, please refer to Figure 2 The "Initial Video", "Region of Interest", "Bounding Box", and "Target Respiration Signal" steps in

[15] .

[0066] The ROI recognition process can be implemented by edge detection algorithms or convolutional neural networks. In other embodiments, the ROI recognition process can also be implemented by other algorithms, which can be specifically configured by those skilled in the art according to actual needs.

[0067] The region of interest may be an abdominal region or a chest region of the target object.

[0068] Furthermore, after obtaining the bounding box of each light spot from each binary image frame using the regionprops function in MATLAB software, respiratory signal extraction processing is performed on the initial video to obtain multiple target respiratory signals corresponding to the initial video, wherein each target respiratory signal has a one-to-one correspondence with a light spot on the first frame of the initial video, and the step further includes increasing the bounding box of each light spot by a preset pixel value in the y-axis direction. Implementation of this step can improve the integrity of the target respiratory signal.

[0069] The preset pixel value is 20 pixel values. In other implementations, the specific numerical value of the preset pixel value can be set by those skilled in the art according to actual needs.

[0070] Furthermore, based on the bounding box corresponding to each light spot, the step of using the optical flow method to calculate the target breathing signal corresponding to each light spot includes: using the optical flow method to estimate the target features of each pixel point in the bounding box corresponding to each light spot in multiple predetermined directions between consecutive frames; accumulating and calculating all target features of each pixel point in the bounding box corresponding to each light spot in each predetermined direction between consecutive frames to obtain a displacement signal corresponding to each pixel point in the bounding box corresponding to each light spot in each predetermined direction between consecutive frames; calculating the average value of all displacement signals in each predetermined direction to obtain a physiological motion signal corresponding to each predetermined direction; and fusing the physiological motion signals of all predetermined directions to obtain a target breathing signal corresponding to each light spot.

[0071] The multiple predetermined directions are horizontal directions and vertical directions. In other embodiments, those skilled in the art can set other directions according to actual needs.

[0072] The target feature is a velocity component. In other embodiments, those skilled in the art can set it to other features according to actual needs, such as an acceleration component.

[0073] Furthermore, before the step of using the optical flow method to estimate the target features of each pixel point in the bounding box corresponding to each light spot in multiple predetermined directions between consecutive frames, the step of using the optical flow method to calculate the target breathing signal corresponding to each light spot based on the bounding box corresponding to each light spot also includes: subtracting the mean of the bounding box corresponding to each light spot.

[0074] Furthermore, while using the regionprops function of MATLAB software to obtain the bounding box of each light spot from each frame of the binary image, the center of mass of each light spot is also obtained from each frame of the binary image. The center of mass can be used to calculate the distance between the light spots.

[0075] Furthermore, the step of calculating the target respiratory signal corresponding to each light spot using the optical flow method based on the bounding box corresponding to each light spot also includes extracting the movement distance of each light spot using a second sliding window and calculating the zero-mean displacement. This step can eliminate the influence of background motion on signal extraction and improve the signal-to-noise ratio of the target respiratory signal.

[0076] Furthermore, the step of performing amplitude extraction processing on each target respiratory signal based on the first sliding window and the step size to obtain the target amplitude corresponding to each target respiratory signal includes: dividing each target respiratory signal based on the first sliding window and the step size to obtain multiple sub-signals corresponding to each target respiratory signal; performing standard deviation extraction processing on each sub-signal to obtain the target standard deviation corresponding to each sub-signal; and using all target standard deviations corresponding to each target respiratory signal as the target amplitude.

[0077] S4, using a first linear fitting model to measure and calculate the first average respiratory amplitude and the first target average spot distance to obtain the absolute respiratory amplitude of the target object. Figure 2 The "Average Respiration Amplitude", "Average Spot Spacing", "Ratio", and "Absolute Respiration Amplitude" steps in the .

[0078] The measurement of the absolute respiratory amplitude is used to assist medical personnel in diagnosing diseases such as chronic obstructive pulmonary disease, asthma, pneumonia, and heart disease.

[0079] Furthermore, the calculation formula of S4 is:

[0080] ;

[0081] in, is the absolute respiratory amplitude; The angle is the angle formed by the straight line connecting the center of the lens of the target sensor and the center of the surface of the target object, and the straight line perpendicular to the center of the surface of the target object; is the first average respiratory amplitude; is the first target average spot spacing; is a preset error. The preset error is caused by the potential misalignment between the focal plane of the target sensor and the highest position of the surface of the target object. and Small errors between. That is Figure 2 The Ratio step in .

[0082] Through the above implementation, the embodiment of the present application can achieve the measurement of absolute respiratory amplitude and ensure the accuracy of the absolute respiratory amplitude.

[0083] In some embodiments, after step S4, the method for measuring the absolute respiratory amplitude based on structured light further includes: obtaining a second distance between the target sensor and the surface of the target object and a third distance between the photosensitive element and the lens in the target sensor; using a preset spacing measurement algorithm to perform ratio calculation processing on the second distance and the third distance to obtain a second target average spot spacing of the structured light irradiated on the surface of the target object; using a preset average respiratory amplitude measurement algorithm to perform ratio calculation processing on the second distance and the third distance to obtain a second average respiratory amplitude; using a second linear fitting model to measure and calculate the second average respiratory amplitude and the second target average spot spacing to obtain a calibration value; and calibrate the absolute respiratory amplitude based on the calibration value.

[0084] Furthermore, a preset distance measurement algorithm is used to perform ratio calculation processing on the second distance and the third distance, and a calculation formula for obtaining the second target average spot distance of the structured light irradiated on the surface of the target object is:

[0085] ;

[0086] in, is a second target average spot spacing of the structured light irradiated on the surface of the target object; is the average of all spot spacings of the structured light irradiating the surface of the target object; is the third distance; is the second distance. 、 、 and You can refer to Figure 3 shown.

[0087] Furthermore, a preset average respiratory amplitude measurement algorithm is used to perform ratio calculation processing on the second distance and the third distance, and a calculation formula for obtaining the second average respiratory amplitude is:

[0088] ;

[0089] in, is the second average respiratory amplitude; It is the displacement of the target object in the horizontal direction of the focal plane generated by the same observation point of the target object on the focal plane of the target sensor when the target object undergoes vertical displacement. 、 、 and You can refer to Figure 4 shown.

[0090] Furthermore, when the target object undergoes vertical displacement, a calculation formula for the displacement of the target object in the horizontal direction of the focal plane at the same observation point of the focal plane of the target sensor is:

[0091] ;

[0092] in, is the vertical displacement of the target object.

[0093] Furthermore, a second linear fitting model is used to measure and calculate the second average respiratory amplitude and the second target average spot spacing, and the calculation formula for obtaining the calibration value is:

[0094] ;

[0095] in, is the calibration value.

[0096] Furthermore, the step of calibrating the absolute respiratory amplitude based on the calibration value includes: comparing the calibration value with the absolute respiratory amplitude, and using the calibration value as the absolute respiratory amplitude when the calibration value is not equal to the absolute respiratory amplitude.

[0097] refer to Figure 5 FIG. 1 is a block diagram showing the principle of a device for measuring absolute respiratory amplitude based on structured light according to the second aspect of the present invention. Figure 5 In the embodiment, the absolute respiratory amplitude measurement device 100 based on structured light includes:

[0098] The initial video acquisition module 101 is configured to acquire an initial video of the surface of a target object using a target sensor when the structured light is irradiated onto the surface of the target object;

[0099] A first target average spot spacing calculation module 102 is configured to calculate a first target average spot spacing based on all spots on each frame of the initial video;

[0100] A first average respiratory amplitude obtaining module 103 is configured to extract respiratory amplitude features from the initial video and average the extracted respiratory amplitude features to obtain a first average respiratory amplitude;

[0101] The measurement and calculation module 104 is configured to perform measurement and calculation processing on the first average respiratory amplitude and the first target average spot spacing using a first linear fitting model to obtain an absolute respiratory amplitude of the target object.

[0102] The third aspect of the embodiment of the present application provides a terminal device, the principle block diagram of the terminal device can be as follows: Figure 6 As shown. The terminal device includes a processor, a memory, a network interface, a display screen and a temperature sensor connected via a system bus. The processor is used to provide computing and control capabilities. The memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the terminal device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a method for measuring absolute respiratory amplitude based on structured light is implemented. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the temperature sensor is pre-set inside the terminal device to detect the operating temperature of the internal device.

[0103] Those skilled in the art will understand that Figure 6 The principle block diagram shown in the figure is only a block diagram of a partial structure related to the solution of the present invention, and does not constitute a limitation on the terminal device to which the solution of the present invention is applied. The specific terminal device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0104] In some embodiments, embodiments of the present application provide a terminal device, comprising a processor and a memory, the memory being configured to store a computer program, the processor being configured to call and execute the computer program stored in the memory to perform the steps of the structured light-based absolute respiration amplitude measurement method provided in the first aspect of the embodiments of the present application. A fourth aspect of the embodiments of the present application provides a computer-readable storage medium, the computer-readable storage medium being configured to store a computer program that causes a computer to perform the steps of the structured light-based absolute respiration amplitude measurement method provided in the first aspect of the embodiments of the present application.

[0105] Those skilled in the art will appreciate that all or part of the processes in the above-described method embodiments can be implemented by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the above-described method embodiments. Any reference to memory, storage, database, or other media used in the various embodiments provided herein may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct RAMbus dynamic RAM (DRDRAM), and RAMbus dynamic RAM (RDRAM).

[0106] The technical features of the above embodiments can be combined without changing the basic principles of this application. In order to make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0107] The above embodiments merely illustrate several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the patent application. It should be noted that a person skilled in the art could make various modifications and improvements without departing from the spirit of the present application, all of which fall within the scope of protection of the present application. Therefore, the scope of patent protection for the present application shall be determined by the appended claims.

Claims

1. A method for measuring absolute respiratory amplitude based on structured light, characterized in that: include: When the structured light is irradiated onto the surface of the target object, an initial video of the surface of the target object is collected using a target sensor; Obtaining a first target average spot spacing based on all spots on each frame of the initial video; Performing a respiratory amplitude feature extraction process on the initial video, and performing an average calculation process on the extracted respiratory amplitude feature to obtain a first average respiratory amplitude; Using a first linear fitting model to measure and calculate the first average respiratory amplitude and the first target average spot spacing to obtain an absolute respiratory amplitude of the target object; The steps of performing respiratory amplitude feature extraction processing on the initial video and performing average calculation processing on the extracted respiratory amplitude features to obtain a first average respiratory amplitude include: performing respiratory signal extraction processing on the initial video to obtain multiple target respiratory signals corresponding to the initial video, wherein each target respiratory signal has a one-to-one correspondence with one of the light spots on the first frame image of the initial video; setting a first sliding window and a step size; performing amplitude extraction processing on each target respiratory signal based on the first sliding window and the step size to obtain a target amplitude corresponding to each target respiratory signal; and performing average calculation processing on all target amplitudes to obtain the first average respiratory amplitude; The first average respiratory amplitude and the first target average spot distance are measured and calculated using a first linear fitting model to obtain the absolute respiratory amplitude of the target object using the following calculation formula: ； in, is the absolute respiratory amplitude; The angle is the angle formed by the straight line connecting the center of the lens of the target sensor and the center of the surface of the target object, and the straight line perpendicular to the center of the surface of the target object; is the first average respiratory amplitude; is the first target average spot spacing; is the preset error; It is the average value of all spot spacings of the structured light irradiating the surface of the target object.

2. The method for measuring absolute respiratory amplitude based on structured light according to claim 1, characterized in that: The step of calculating and obtaining the first target average spot spacing based on all spots on each frame of the initial video includes: Calculating the distance between each light spot on each frame image in the initial video and the nearest light spot on the same frame image to obtain a first distance corresponding to each light spot on each frame image; All the first distances are averaged to obtain the first target average spot spacing.

3. The method for measuring absolute respiratory amplitude based on structured light according to claim 1, characterized in that: After the step of measuring and calculating the first average respiratory amplitude and the first target average spot distance using a first linear fitting model to obtain the absolute respiratory amplitude of the target object, the method for measuring the absolute respiratory amplitude based on structured light further includes: Acquire a second distance between the target sensor and the surface of the target object and a third distance between a photosensitive element and a lens in the target sensor; performing a ratio calculation process on the second distance and the third distance using a preset distance measurement algorithm to obtain a second target average spot distance of the structured light irradiated on the surface of the target object; performing a ratio calculation process on the second distance and the third distance using a preset average respiratory amplitude measurement algorithm to obtain a second average respiratory amplitude; Using a second linear fitting model to measure and calculate the second average respiratory amplitude and the second target average spot spacing to obtain a calibration value; The absolute respiratory amplitude is calibrated based on the calibration value.

4. The method for measuring absolute respiratory amplitude based on structured light according to claim 3, characterized in that: The preset distance measurement algorithm is used to perform ratio calculation processing on the second distance and the third distance, and the calculation formula for obtaining the second target average spot distance of the structured light irradiated on the surface of the target object is: ； in, is a second target average spot spacing of the structured light irradiated on the surface of the target object; is the average of all spot spacings of the structured light irradiating the surface of the target object; is the third distance; is the second distance.

5. The method for measuring absolute respiratory amplitude based on structured light according to claim 4, characterized in that: The preset average respiratory amplitude measurement algorithm is used to perform ratio calculation processing on the second distance and the third distance, and the calculation formula for obtaining the second average respiratory amplitude is: ； in, is the second average respiratory amplitude; It is the displacement of the target object in the horizontal direction of the focal plane generated by the same observation point of the target object on the focal plane of the target sensor when the target object undergoes vertical displacement.

6. A device for measuring absolute respiratory amplitude based on structured light, characterized in that: include: an initial video acquisition module, configured to acquire an initial video of the surface of a target object using a target sensor when the structured light is irradiated onto the surface of the target object; A first target average spot spacing calculation module is used to calculate the first target average spot spacing based on all spots on each frame of the initial video; a first average respiratory amplitude obtaining module, configured to extract respiratory amplitude features from the initial video, and average the extracted respiratory amplitude features to obtain a first average respiratory amplitude; a measurement and calculation module, configured to measure and calculate the first average respiratory amplitude and the first target average spot spacing using a first linear fitting model to obtain an absolute respiratory amplitude of the target object; The first average respiratory amplitude obtaining module is further configured to perform respiratory signal extraction processing on the initial video to obtain a plurality of target respiratory signals corresponding to the initial video, wherein each target respiratory signal has a one-to-one correspondence with one of the light spots on the first frame image of the initial video; set a first sliding window and a step size; perform amplitude extraction processing on each target respiratory signal based on the first sliding window and the step size to obtain a target amplitude corresponding to each target respiratory signal; and perform average calculation processing on all target amplitudes to obtain the first average respiratory amplitude; The first average respiratory amplitude and the first target average spot distance are measured and calculated using a first linear fitting model to obtain the absolute respiratory amplitude of the target object using the following calculation formula: ； in, is the absolute respiratory amplitude; The angle is the angle formed by the straight line connecting the center of the lens of the target sensor and the center of the surface of the target object, and the straight line perpendicular to the center of the surface of the target object; is the first average respiratory amplitude; is the first target average spot spacing; is the preset error; It is the average value of all spot spacings of the structured light irradiating the surface of the target object.

7. A terminal device, characterized in that: include: A processor and a memory, the memory being used to store a computer program, the processor being used to call and run the computer program stored in the memory to perform the steps of the method for measuring absolute respiratory amplitude based on structured light as described in any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that Used to store a computer program, wherein the computer program enables a computer to execute the steps of the method for measuring absolute respiratory amplitude based on structured light according to any one of claims 1 to 5.

Images