Method, device, terminal equipment and storage medium for detecting three-dimensional motion signals of the heart

Abstract

The present application relates to the field of biomedical engineering technology. The present application discloses a method, apparatus, terminal device and storage medium for detecting three-dimensional motion signals of the heart, which can improve the accuracy of detecting three-dimensional motion signals of the heart. The method includes obtaining the motion signal of the speckle in the X-axis direction of the imaging plane in each sensor when multiple sensors shoot the chest surface of the user, and obtaining the X-axis motion signal corresponding to each sensor; while obtaining all X-axis motion signals, obtaining the Y-axis motion signal corresponding to each sensor; using a preset algorithm to calculate and process all X-axis motion signals and all Y-axis motion signals, and obtaining the vertical motion signal of the user's chest surface, the rotational motion signal in the X-axis direction and the rotational motion signal in the Y-axis direction.

Description

Technical Field

[0001] The present application relates to the field of biomedical engineering technology. More specifically, the present application relates to a method, apparatus, terminal device, and storage medium for detecting three-dimensional cardiac motion signals. Background Art

[0002] Traditional methods for detecting three-dimensional cardiac motion signals are typically based on radio frequency (RF) methods (such as radar and ultrasound). RF-based methods capture the overall cardiac motion by measuring the echo signal reflected by the RF signal from the user's chest surface. During RF signal propagation, the signal's energy distribution and reflection characteristics are most pronounced in the direction perpendicular to the transmitting antenna (i.e., vertical direction). When the RF signal strikes the user's chest surface, vertical heart movement causes significant changes in the distance between the chest surface and the RF antenna, significantly altering the characteristics of the reflected light (i.e., echo signal). However, horizontal or other non-vertical heart movement has a relatively small impact on the RF signal propagation path and echo characteristics. Because horizontal motion does not significantly change the vertical distance between the chest surface and the antenna, the impact on RF signal propagation in the horizontal direction is limited, and the echo signal changes are not noticeable. Therefore, RF-based methods struggle to accurately sense and measure motion in horizontal or other non-vertical directions. Consequently, RF-based methods are only sensitive to vertical motion of the user's chest surface, making them unable to accurately reconstruct three-dimensional cardiac motion. Summary of the Invention

[0003] The purpose of the embodiments of the present application is to provide a method, apparatus, terminal device, and storage medium for detecting three-dimensional cardiac motion signals, which can improve the accuracy of detecting three-dimensional cardiac motion signals. The embodiments of the present application are mainly achieved through the following technical solutions:

[0004] According to a first aspect of an embodiment of the present application, a method for detecting a three-dimensional cardiac motion signal is provided, comprising:

[0005] When multiple sensors are used to capture the chest surface of the user, a motion signal of the speckle in each sensor in the X-axis direction of the imaging plane is obtained to obtain an X-axis motion signal corresponding to each sensor;

[0006] While acquiring all X-axis motion signals, acquire the Y-axis motion signal corresponding to each sensor;

[0007] A preset algorithm is used to calculate and process all X-axis motion signals and all Y-axis motion signals to obtain a vertical motion signal of the user's chest surface, a rotational motion signal in the X-axis direction, and a rotational motion signal in the Y-axis direction.

[0008] According to one embodiment of the present application, the steps of calculating and processing all X-axis motion signals and all Y-axis motion signals using a preset algorithm to obtain a vertical motion signal of the user's chest surface, a rotational motion signal in the X-axis direction, and a rotational motion signal in the Y-axis direction include:

[0009] Set the first coefficient, the second coefficient, the third coefficient and the fourth coefficient;

[0010] Obtaining a distance between a lens plane and an imaging plane of a target sensor and a distance between a focal plane and a lens plane of each sensor, wherein the target sensor is any one of the multiple sensors;

[0011] Based on the first coefficient, the second coefficient, the third coefficient, the fourth coefficient, the distance between the lens plane and the imaging plane of the target sensor, the distance between the focal plane and the lens plane of each sensor, all X-axis motion signals and all Y-axis motion signals, calculation and processing are performed according to the preset algorithm to obtain the vertical motion signal of the user's chest surface, the rotational motion signal in the X-axis direction, and the rotational motion signal in the Y-axis direction.

[0012] According to one embodiment of the present application, when the multiple sensors include a first sensor and a second sensor, the calculation formula for the step of obtaining the vertical motion signal of the user's chest surface, the rotational motion signal in the X-axis direction, and the rotational motion signal in the Y-axis direction is as follows: based on the first coefficient, the second coefficient, the third coefficient, the fourth coefficient, the distance between the lens plane and the imaging plane of the target sensor, the distance between the focal plane of each sensor and the lens plane, all X-axis motion signals, and all Y-axis motion signals, and performing calculation processing according to the preset algorithm:

[0013] ;

[0014] ;

[0015] ;

[0016] in, yes The vertical motion signal corresponding to the moment; yes time; is the distance between the lens plane and the imaging plane of the target sensor; is the third coefficient; is the distance between the focal plane of the first sensor and the lens plane; The second sensor is X-axis motion signal corresponding to the moment; is the fourth coefficient; is the distance between the focal plane of the second sensor and the lens plane; The first sensor is X-axis motion signal corresponding to the moment; is the second coefficient; is the first coefficient; yes The rotational motion signal in the Y-axis direction corresponding to the moment; yes The rotational motion signal in the X-axis direction corresponding to the moment; The first sensor is The Y-axis motion signal corresponding to the moment; The second sensor is The Y-axis motion signal corresponding to the moment.

[0017] According to one embodiment of the present application, when multiple sensors are used to image the chest surface of a user, the step of obtaining a motion signal of speckle in the X-axis direction of an imaging plane from each sensor and obtaining the X-axis motion signal corresponding to each sensor includes:

[0018] When the user makes a vertical movement, a motion signal of the speckle in each sensor in the X-axis direction of the imaging plane is acquired to obtain a first motion signal to be processed corresponding to each sensor;

[0019] When the user performs a rotational motion, a motion signal of the speckle in each sensor in the X-axis direction of the imaging plane is acquired to obtain a second motion signal to be processed corresponding to each sensor;

[0020] The first to-be-processed motion signal and the second to-be-processed motion signal corresponding to each sensor are summed to obtain an X-axis direction motion signal corresponding to each sensor.

[0021] According to one embodiment of the present application, when the user performs vertical motion, the step of acquiring a motion signal of the speckle in each sensor in the X-axis direction of the imaging plane and obtaining a first to-be-processed motion signal corresponding to each sensor includes:

[0022] When the user makes a vertical movement, obtaining a distance between a focal plane of each sensor and the chest surface;

[0023] Obtaining an initial incident angle of the laser emitted by the laser device onto the chest surface of the user;

[0024] A first motion signal to be processed corresponding to each sensor is obtained by calculation based on the distance between the focal plane of each sensor and the chest cavity surface, the initial incident angle and preset conditions.

[0025] According to one embodiment of the present application, when the user performs a rotational motion, the step of acquiring a motion signal of the speckle in each sensor in the X-axis direction of the imaging plane and obtaining a second motion signal to be processed corresponding to each sensor includes:

[0026] When the user performs a rotational motion, obtaining a reflection angle of the laser on each sensor;

[0027] The second motion signal to be processed corresponding to each sensor is calculated based on the reflection angle on each sensor, the distance between the lens plane and the imaging plane of the target sensor, the distance between the focal plane of each sensor and the chest surface, and the distance between the focal plane and the lens plane of each sensor.

[0028] According to one embodiment of the present application, while acquiring all X-axis motion signals, the step of acquiring the Y-axis motion signal corresponding to each sensor includes:

[0029] Obtain the rotation angle of the user along the X-axis;

[0030] The Y-axis motion signal corresponding to each sensor is calculated based on the distance between the lens plane and the imaging plane of the target sensor, the distance between the focal plane of each sensor and the lens plane, the distance between the focal plane of each sensor and the chest surface, the initial incident angle and the initial phase angle of each sensor.

[0031] A second aspect of the embodiments of the present application provides a device for detecting a three-dimensional cardiac motion signal, comprising:

[0032] An X-axis direction motion signal acquisition module is used to acquire a motion signal of the speckle in the X-axis direction of the imaging plane in each sensor when multiple sensors are imaging the chest surface of the user, thereby obtaining an X-axis direction motion signal corresponding to each sensor;

[0033] The Y-axis motion signal acquisition module is used to obtain the Y-axis motion signal corresponding to each sensor while obtaining all X-axis motion signals;

[0034] The calculation module is used to calculate and process all X-axis motion signals and all Y-axis motion signals using a preset algorithm to obtain the vertical motion signal of the user's chest surface, the rotational motion signal in the X-axis direction, and the rotational motion signal in the Y-axis direction.

[0035] The third aspect of an embodiment of the present application provides a terminal device, including: a processor and a memory, the memory being used to store a computer program, the processor being used to call and run the computer program stored in the memory, and executing the steps of the method for detecting the three-dimensional motion signal of the heart provided in the first aspect of the embodiment of the present application.

[0036] According to a fourth aspect of an embodiment of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium is used to store a computer program, and the computer program enables a computer to execute the steps of the method for detecting three-dimensional motion signals of the heart provided in the first aspect of the embodiment of the present application.

[0037] The beneficial effects of the embodiments of the present application include:

[0038] The present embodiment provides a preset algorithm that can be used to effectively decouple the vertical motion signal and rotational motion signal of the heart. Specifically, when multiple sensors are used to image the user's chest surface, the present embodiment obtains the motion signal of the speckle in the X-axis direction of the imaging plane in each sensor to obtain the X-axis motion signal corresponding to each sensor; while obtaining all X-axis motion signals, the Y-axis motion signal corresponding to each sensor is also obtained; and a preset algorithm is used to calculate and process all X-axis motion signals and all Y-axis motion signals to obtain the vertical motion signal of the user's chest surface, the rotational motion signal in the X-axis direction, and the rotational motion signal in the Y-axis direction. Compared with the prior art, the present embodiment can not only capture the vertical motion signal of the heart, but also has higher sensitivity to the rotational motion signal in the X-axis direction and the rotational motion signal in the Y-axis direction, overcoming the limitation of radio frequency-based methods that are only sensitive to vertical motion signals, thereby improving the accuracy of three-dimensional motion signal detection of the heart. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the conventional technology, the following briefly introduces the drawings required for use in the embodiments or the conventional technology descriptions. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0040] Figure 1 A flowchart of a method for detecting a three-dimensional cardiac motion signal of the present application in some embodiments;

[0041] Figure 2 A reference diagram for the relationship between the laser, the first sensor, the second sensor, and the user when the user makes vertical movements in this application;

[0042] Figure 3 A reference diagram for the relationship between the laser, the first sensor, the second sensor, and the user when the user performs a rotational motion in this application;

[0043] Figure 4 The reference image of the reconstructed motion signal corresponding to a 5mm motion amplitude;

[0044] Figure 5 The reference image of the reconstructed motion signal corresponding to a motion amplitude of 10 mm;

[0045] Figure 6 The reference image of the reconstructed motion signal corresponding to a motion amplitude of 15 mm;

[0046] Figure 7 A reference diagram for performing spectrum analysis on motion signals restored by a method for detecting three-dimensional motion signals of the heart when the motion frequency of the motion simulator is 1 Hz;

[0047] Figure 8 A reference diagram for performing spectrum analysis on motion signals restored by a method for detecting three-dimensional motion signals of the heart when the motion simulator has a motion frequency of 1.5 Hz;

[0048] Figure 9 A reference diagram for performing spectrum analysis on motion signals restored by a method for detecting three-dimensional motion signals of the heart when the motion frequency of the motion simulator is 2 Hz;

[0049] Figure 10 A reference diagram for performing spectrum analysis on motion signals restored by a method for detecting three-dimensional motion signals of the heart when the motion simulator has a motion frequency of 3 Hz;

[0050] Figure 11 A reference image for reconstructing the vertical motion signal, reconstructing the vertical motion average signal and the reference vertical motion average signal;

[0051] Figure 12 A reference graph of the original speckle motion signal in the X direction, the original speckle motion average signal in the X direction, and the reference vertical motion average signal corresponding to the first sensor;

[0052] Figure 13 A reference graph of the original speckle motion signal in the X direction, the original speckle motion average signal in the X direction, and the reference vertical motion average signal corresponding to the second sensor;

[0053] Figure 14 A reference graph for reconstructing the rotational motion signal in the Y-axis direction, reconstructing the average rotational motion signal in the Y-axis direction, and referring to the average rotational motion signal in the Y-axis direction;

[0054] Figure 15A reference graph of the original speckle motion signal in the X direction corresponding to the first sensor, the original speckle motion average signal in the X direction, and the rotation motion average signal in the reference Y-axis direction;

[0055] Figure 16 A reference graph of the original speckle motion signal in the X direction corresponding to the second sensor, the original speckle motion average signal in the X direction, and the rotational motion average signal in the reference Y-axis direction;

[0056] Figure 17 A reference graph for reconstructing the rotational motion signal in the X-axis direction, reconstructing the average rotational motion signal in the X-axis direction, and referring to the average rotational motion signal in the X-axis direction;

[0057] Figure 18 A reference graph of the original speckle motion signal in the Y direction corresponding to the first sensor, the original speckle motion average signal in the Y direction, and the rotation motion average signal in the reference X-axis direction;

[0058] Figure 19 A reference graph of the original speckle motion signal in the Y direction corresponding to the second sensor, the original speckle motion average signal in the Y direction, and the rotation motion average signal in the reference X-axis direction;

[0059] Figure 20 This is a principle block diagram of a device for detecting three-dimensional cardiac motion signals according to some embodiments of the present application;

[0060] Figure 21 This is a principle block diagram of the terminal device of the present application in some embodiments. DETAILED DESCRIPTION

[0061] To make the above-mentioned objects, features, and advantages of the present application more clearly understood, the specific embodiments of the present application are described in detail below with reference to the accompanying drawings. The following description sets forth many specific details to facilitate a full understanding of the present application. However, the present application can be implemented in many other ways than those described herein, and those skilled in the art can make similar improvements without violating the scope of the present application. Therefore, the present application is not limited to the specific embodiments disclosed below.

[0062] It should be noted that the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of the technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of such features. In the description of this application, "plurality" means at least two, for example, two, three, etc., unless otherwise specifically defined.

[0063] The terms "exemplary" or "for example" are used to indicate an example, illustration, or description. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0064] The terms "comprises," "comprising," or any other variations thereof are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, product, or apparatus.

[0065] Unless otherwise defined, all technical and scientific terms used in the specification of this application have the same meaning as commonly understood by those skilled in the art to which this application belongs. The terms used in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application. The term "and / or" used in the specification of this application includes any and all combinations of one or more of the relevant listed items.

[0066] The specific implementation of this application is further described below with reference to the accompanying drawings.

[0067] refer to Figure 1 FIG. 1 is a flow chart of a method for detecting a three-dimensional motion signal of a heart provided in the first aspect of the embodiment of the present application. Figure 1 In the method, the three-dimensional motion signal detection method of the heart includes:

[0068] S1. When multiple sensors capture the chest surface of a user, a motion signal of the speckle in each sensor in the X-axis direction of the imaging plane is acquired to obtain an X-axis direction motion signal corresponding to each sensor.

[0069] In the embodiment of the present application, the plurality of sensors include a first sensor and a second sensor. In other embodiments, the number of the sensors can be set by those skilled in the art according to actual needs, that is, the plurality of sensors is not limited to the first sensor and the second sensor.

[0070] S2. While acquiring all X-axis motion signals, acquire the Y-axis motion signal corresponding to each sensor.

[0071] S3. Use a preset algorithm to calculate and process all X-axis motion signals and all Y-axis motion signals to obtain the vertical motion signal of the user's chest surface, the rotational motion signal in the X-axis direction, and the rotational motion signal in the Y-axis direction.

[0072] Furthermore, step S3 includes: setting a first coefficient, a second coefficient, a third coefficient and a fourth coefficient; obtaining the distance between the lens plane and the imaging plane of the target sensor and the distance between the focal plane and the lens plane of each sensor, wherein the target sensor is any one of the multiple sensors; based on the first coefficient, the second coefficient, the third coefficient, the fourth coefficient, the distance between the lens plane and the imaging plane of the target sensor, the distance between the focal plane and the lens plane of each sensor, all X-axis motion signals and all Y-axis motion signals, calculating and processing according to the preset algorithm to obtain the vertical motion signal of the user's chest surface, the rotational motion signal in the X-axis direction and the rotational motion signal in the Y-axis direction.

[0073] It should be understood that the focal plane refers to the two-dimensional plane where light in the sensor converges after passing through a lens or a reflector to form a clear image. In the case of focusing, the focal plane should be on the surface of the imaging object.

[0074] Furthermore, in the case where the multiple sensors include a first sensor and a second sensor, the calculation formula for the step of obtaining the vertical motion signal of the user's chest surface, the rotational motion signal in the X-axis direction, and the rotational motion signal in the Y-axis direction is as follows based on the first coefficient, the second coefficient, the third coefficient, the fourth coefficient, the distance between the lens plane and the imaging plane of the target sensor, the distance between the focal plane of each sensor and the lens plane, all X-axis motion signals, and all Y-axis motion signals, and performing calculation processing according to the preset algorithm:

[0075] ;

[0076] ;

[0077] ;

[0078] in, yes The vertical motion signal corresponding to the moment; yes time; is the distance between the lens plane and the imaging plane of the target sensor; is the third coefficient; is the distance between the focal plane of the first sensor and the lens plane; The second sensor is X-axis motion signal corresponding to the moment; is the fourth coefficient; is the distance between the focal plane of the second sensor and the lens plane; The first sensor is X-axis motion signal corresponding to the moment; is the second coefficient; is the first coefficient; yes The rotational motion signal in the Y-axis direction corresponding to the moment; yes The rotational motion signal in the X-axis direction corresponding to the moment; The first sensor is The Y-axis motion signal corresponding to the moment; The second sensor is The Y-axis motion signal corresponding to the moment.

[0079] Through the above-described implementation, the present embodiment provides a preset algorithm that can be used to effectively decouple the heart's vertical motion signal from its rotational motion signal. Compared to the prior art, the present embodiment not only captures the heart's vertical motion signal but also has a high sensitivity to rotational motion signals in the X-axis direction and the Y-axis direction. This overcomes the limitation of radio frequency-based methods that are only sensitive to vertical motion signals, thereby improving the accuracy of detecting the heart's three-dimensional motion signals.

[0080] In some embodiments, step S1 includes: when the user performs vertical motion, acquiring a motion signal of the speckle in each sensor in the X-axis direction of the imaging plane, and obtaining a first motion signal to be processed corresponding to each sensor; when the user performs rotational motion, acquiring a motion signal of the speckle in each sensor in the X-axis direction of the imaging plane, and obtaining a second motion signal to be processed corresponding to each sensor; and summing the first motion signal to be processed and the second motion signal to be processed corresponding to each sensor to obtain an X-axis motion signal corresponding to each sensor.

[0081] When the user makes vertical motion, the relationship between the laser, the first sensor, the second sensor and the user can be referred to in the reference diagram Figure 2 shown.

[0082] Furthermore, when the user makes a vertical movement, a motion signal of the speckle in each sensor in the X-axis direction of the imaging plane is obtained, and the step of obtaining a first motion signal to be processed corresponding to each sensor includes: when the user makes a vertical movement, obtaining the distance between the focal plane of each sensor and the chest surface; obtaining an initial incident angle of the laser emitted by the laser to the chest surface of the user; and calculating the first motion signal to be processed corresponding to each sensor based on the distance between the focal plane of each sensor and the chest surface, the initial incident angle, and preset conditions.

[0083] The preset conditions include a first preset condition and a second preset condition.

[0084] In the embodiment of the present application, the calculation formula for the first motion signal to be processed corresponding to the first sensor is:

[0085] ;

[0086] ;

[0087] in, The first sensor is A first motion signal to be processed corresponding to the moment; is the distance between the lens plane and the imaging plane of the target sensor; The user is The vertical distance traveled at any moment; is the initial incident angle; is the distance between the focal plane of the first sensor and the surface of the thorax; is the first precondition; is the distance between the focal plane of the first sensor and the lens plane; is the distance between the laser emitting the laser and the chest surface of the user; is the initial phase angle of the first sensor.

[0088] The target sensor may be the first sensor or the second sensor. The distance between the lens plane of the first sensor and the imaging plane is equal to the distance between the lens plane of the second sensor and the imaging plane. In other embodiments, these two distances may be unequal, and can be set by those skilled in the art based on actual needs.

[0089] The calculation formula of the first motion signal to be processed corresponding to the second sensor is:

[0090] ;

[0091] ;

[0092] in, The second sensor is A first motion signal to be processed corresponding to the moment; is the distance between the focal plane of the second sensor and the surface of the thorax; is the second precondition; is the distance between the focal plane of the second sensor and the lens plane; is the initial phase angle of the second sensor.

[0093] It should also be understood that all first motion signals to be processed are obtained when the multiple sensors are in a defocused state.

[0094] The magnitude of the change in the laser incident angle is proportional to the vertical movement distance of the user, satisfying ;in, The overall is the laser incident angle change.

[0095] When the user performs vertical movement, the phase angles of the multiple sensors remain unchanged.

[0096] When the user performs a rotational motion, the relationship between the laser, the first sensor, the second sensor and the user can be referred to in the reference diagram Figure 3 shown.

[0097] Furthermore, when the user performs a rotational motion, a motion signal of the speckle in each sensor in the X-axis direction of the imaging plane is obtained, and the step of obtaining a second motion signal to be processed corresponding to each sensor includes: when the user performs a rotational motion, obtaining a reflection angle of the laser on each sensor; and calculating the second motion signal to be processed corresponding to each sensor based on the reflection angle on each sensor, the distance between the lens plane and the imaging plane of the target sensor, the distance between the focal plane of each sensor and the chest cavity surface, and the distance between the focal plane and the lens plane of each sensor.

[0098] In the embodiment of the present application, the calculation formula for the second motion signal to be processed corresponding to the first sensor is:

[0099] ;

[0100] in, is a second motion signal to be processed corresponding to the first sensor; The integral is the reflection angle on the first sensor; The user is The rotation angle along the Y axis at the moment.

[0101] The user rotates along the Y axis When , the initial incident angle will also change by the same angle, i.e. , is the user in The deviation of the angle of rotation along the Y axis at a moment from the initial incident angle.

[0102] The calculation formula of the second motion signal to be processed corresponding to the second sensor is:

[0103] ;

[0104] in, is a second motion signal to be processed corresponding to the second sensor; Integral is the reflection angle on the second sensor.

[0105] The change in the reflection angle is caused by two changes. One is caused by the rotation of the user itself. The magnitude of the reflection angle is the same as the rotation angle of the user. The other is caused by the change in the illumination angle. In order to observe the same speckle pattern after the user rotates, it is necessary to ensure that the speckle pattern before and after the rotation has the same initial phase difference (that is, the light path difference remains unchanged). According to this constraint, the angle change caused by the change in illumination angle must satisfy and .

[0106] It should be understood that when the user rotates along the Y axis, the speckle pixels will be caused to move along the X axis of the imaging planes in the multiple sensors; when the user rotates along the X axis, the speckle pixels will be caused to move along the Y axis of the imaging planes in the multiple sensors.

[0107] In the embodiment of the present application, the calculation formula for the X-axis direction motion signal corresponding to the first sensor is:

[0108] ;

[0109] in, The first sensor is The X-axis motion signal corresponding to the moment, that is, the speckle on the imaging plane of the first sensor is The motion signal in the X-axis direction corresponding to the moment.

[0110] exist In the calculation formula, is the first coefficient, is the third coefficient, , .

[0111] The calculation formula of the X-axis motion signal corresponding to the second sensor is:

[0112] ;

[0113] in, The second sensor is The X-axis motion signal corresponding to the moment, that is, the speckle on the imaging plane of the second sensor is The motion signal in the X-axis direction corresponding to the moment.

[0114] exist In the calculation formula, is the second coefficient, is the fourth coefficient, , .

[0115] It should also be noted that when the user performs vertical and rotational movements, the multiple sensors all capture the chest surface of the user.

[0116] In some embodiments, step S2 comprises:

[0117] Obtain the rotation angle of the user along the X-axis;

[0118] The Y-axis motion signal corresponding to each sensor is calculated based on the distance between the lens plane and the imaging plane of the target sensor, the distance between the focal plane of each sensor and the lens plane, the distance between the focal plane of each sensor and the chest surface, the initial incident angle and the initial phase angle of each sensor.

[0119] In the embodiment of the present application, the calculation formula for the Y-axis motion signal corresponding to the first sensor is:

[0120] ;

[0121] in, The first sensor is The Y-axis motion signal corresponding to the moment, that is, the speckle on the imaging plane of the first sensor is The motion signal in the Y-axis direction corresponding to the moment; The user is The rotation angle along the X axis at the moment.

[0122] The calculation formula of the Y-axis motion signal corresponding to the second sensor is:

[0123] ;

[0124] in, The second sensor is The Y-axis motion signal corresponding to the moment, that is, the speckle on the imaging plane of the second sensor is The motion signal in the Y-axis direction corresponding to the moment.

[0125] In order to verify the mapping relationship between the motion signals recovered by the method (that is, the vertical motion signal, the rotational motion signal in the X-axis direction, and the rotational motion signal in the Y-axis direction) and the real motion signal, the embodiment of the present application further adopts a motion simulator that can accurately control the motion amplitude and frequency to evaluate the performance of the method in extracting depth motion (that is, vertical motion). Specifically, the embodiment of the present application provides two square wave pulse signals to the motion simulator through a signal generator, wherein one square wave pulse is used to control the motion direction (that is, to set the motion frequency), and the other square wave pulse is used to adjust the motion amplitude. Through the above-mentioned control method, the motion simulator is made to move precisely according to the set parameters, so as to verify the accuracy and applicability of the method under different motion conditions.

[0126] In the implementation of this application, in order to verify the effectiveness of the method, the motion simulator is controlled to move at amplitudes of 5mm, 10mm, and 15mm respectively, and a 120s video signal is processed, and the corresponding motion signal is restored using the method. Figure 4 As shown, it is the reconstructed motion signal corresponding to the 5mm motion amplitude. Figure 4 The average peak-to-peak value of the reconstructed motion signal in the reference is 36.878; Figure 5 As shown, it is the reconstructed motion signal corresponding to the 10mm motion amplitude. Figure 5 The average peak-to-peak value of the reconstructed motion signal in the reference is 73.507; Figure 6 As shown, it is the reconstructed motion signal corresponding to the 15mm motion amplitude. Figure 5 The average peak-to-peak value of the reconstructed motion signal in is 115.2757. It should be understood that the average peak-to-peak value refers to Figure 4 、 Figure 5 or Figure 6 The value corresponding to the blue line is subtracted from the value corresponding to the yellow line and divided by the number of peaks.

[0127] After adjusting the motion frequency of the motion simulator to 1 Hz, the motion signal recovered by the method is subjected to spectrum analysis. Figure 7 As shown, the main frequency of the obtained signal is consistent with the real motion frequency; after adjusting the motion frequency of the motion simulator to 1.5 Hz, the motion signal restored by the method is subjected to spectrum analysis. Figure 8As shown, the main frequency of the obtained signal is consistent with the real motion frequency; after adjusting the motion frequency of the motion simulator to 2 Hz, the motion signal restored by the method is subjected to spectrum analysis. Figure 9 As shown, the main frequency of the obtained signal is consistent with the real motion frequency; after adjusting the motion frequency of the motion simulator to 3 Hz, the motion signal restored by the method is subjected to spectrum analysis. Figure 10 As shown, the main frequency of the obtained signal is consistent with the actual motion frequency. The above experimental results show that the method of the present application can effectively restore the amplitude and frequency information of the motion signal, and preliminarily verify its feasibility and accuracy in non-contact cardiac motion detection.

[0128] In some embodiments, after step S3, the method for detecting the three-dimensional motion signal of the heart further includes: performing standardization processing on the vertical motion signal, the rotational motion signal in the X-axis direction, and the rotational motion signal in the Y-axis direction to obtain a standardized vertical motion signal, a standardized rotational motion signal in the X-axis direction, and a standardized rotational motion signal in the Y-axis direction; performing band-pass filtering processing on the standardized vertical motion signal, the standardized rotational motion signal in the X-axis direction, and the standardized rotational motion signal in the Y-axis direction to obtain a filtered vertical motion signal, a filtered rotational motion signal in the X-axis direction, and a filtered rotational motion signal in the Y-axis direction.

[0129] The filtering range of the band-pass filtering process is 0.5-50 Hz. In other embodiments, those skilled in the art can set the specific value of the filtering range according to actual needs, and this document does not impose any further restrictions on this.

[0130] The implementation of the above steps can remove the interference of noise in the signal and improve the signal quality.

[0131] In some embodiments, after performing bandpass filtering on the standardized vertical motion signal, the standardized X-axis rotational motion signal, and the standardized Y-axis rotational motion signal to obtain the filtered vertical motion signal, the filtered X-axis rotational motion signal, and the filtered Y-axis rotational motion signal, the method for detecting the three-dimensional motion signal of the heart further includes: using the R peak in the electrocardiogram signal as a time reference, detecting the AO peak in the filtered vertical motion signal (the AO peak refers to the reflected wave peak when the aorta is closed), the Gi peak in the filtered X-axis rotational motion signal, and the Gj peak in the filtered Y-axis rotational motion signal, and calculating the interval between adjacent heartbeats (i.e., the IBI value, where IBI refers to the time interval between two consecutive heartbeats). Based on the AO peak, Gi peak, Gj peak, and IBI value, the filtered vertical motion signal, the filtered X-axis rotational motion signal, and the filtered Y-axis rotational motion signal are periodically segmented. The starting point of the i-th cycle in the filtered vertical motion signal is defined as AOi+1-0.3×IBIi, and the ending point is defined as AOi+1+0.7×IBIi+1, where AOi is the AO peak of the i-th cycle and IBIi is the IBI value of the i-th cycle. Finally, the n signal cycles in each video record are interpolated and normalized to a uniform length, and their average waveform is calculated to improve signal stability and comparability.

[0132] The Gi peak is the first major peak in the rotational motion signal in the X-axis direction, and the Gi peak occurs roughly simultaneously with the mitral valve closure; the Gj peak is the main maximum peak in the rotational motion signal in the Y-axis direction, and the Gj peak is related to the aortic valve opening event.

[0133] refer to Figures 11-19 This is an example of a user reconstructing a signal average waveform, an original speckle motion average signal, and a reference signal average signal using the method described in the embodiment of the present application. Figures 11-19 In the analysis, for the SCG signal (i.e., vertical motion signal) and the GCGy signal (i.e., rotational motion signal along the Y-axis), the reconstructed waveforms are closer to the average waveform of the reference signal in multiple detail features, preliminarily verifying the effectiveness of the method proposed in this embodiment of the application in separating the SCG and GCGy signals from the original speckle motion signal. Furthermore, for the GCGx signal (i.e., rotational motion signal along the X-axis), theoretical analysis shows that rotational motion in this direction can be fully reproduced through the motion characteristics of the speckle along the Y-axis. Therefore, according to the principle of this method, the reconstructed signal should maintain a high degree of consistency with the original speckle motion signal. Experimental results further confirm this theoretical expectation. Figures 11-19The comparison of the visualization results in shows that the waveform characteristics of the reconstructed signal in the GCGx signal direction are consistent with the waveform trend of the original speckle motion signal, further illustrating the reliability of the method proposed in the embodiment of the present application in separating different motion components.

[0134] This embodiment of the present application quantifies the accuracy of the method for 3D cardiac motion reconstruction by calculating the Pearson correlation coefficient between the average waveform of the reconstructed signal, the average signal of the original speckle motion, and the average signal of the reference signal. Specifically, based on the band independence of laser interferometry, this embodiment of the present application used the R-band and G-band to conduct experimental repeatability verification at two similar locations. The correlation index was calculated based on data from 10 users (approximately 20,000 cardiac cycles). The experimental results are shown in Table 1.

[0135] Table 1

[0136]

[0137] The data in Table 1 demonstrates that the proposed method achieves high reconstruction accuracy for both SCG and GCGy signals. The reconstruction effect for the SCG signal is particularly significant. Specifically, the reconstructed signal (i.e., the reconstructed vertical motion signal in Table 1) exhibits the most significant correlation improvement with the original speckle X-axis motion signal (i.e., the original speckle motion signal in the X direction corresponding to the first sensor and the original speckle motion signal in the X direction corresponding to the second sensor in Table 1). The Pearson correlation coefficient with the reference signal reaches a high level (R band: 0.6269, G band: 0.5889), demonstrating that the proposed method can effectively extract and separate different cardiac motion components, particularly with respect to the vertical motion component (motion depth). As previously mentioned, the Pearson correlation coefficient between the reconstructed signal and the original speckle Y-axis motion signal (i.e., the original speckle motion waveform in the Y direction corresponding to the first sensor and the original speckle motion waveform in the Y direction corresponding to the second sensor in Table 1) is similar to that of the reference signal, which is consistent with theoretical expectations and further supports the effectiveness of the proposed method in decoupling different motion components. It is particularly noteworthy that the positions of the R and G bands show a consistent trend, which further improves the credibility of the experimental results and proves the robustness and applicability of this application.

[0138] Given that a small time deviation between averaged signals may lead to a decrease in the Pearson correlation coefficient, thereby affecting the accuracy of the correlation analysis, this application further introduces a waveform similarity index to more comprehensively quantify the effectiveness of the reconstructed signal, thereby improving the reliability of the experimental results. The similarity index is defined as follows:

[0139] ;

[0140] in, is the similarity index between the reference signal and the reconstructed signal, or the similarity index between the reference signal and the original speckle motion signal; is the reconstructed signal or the original speckle motion signal; is the reference signal; is the product of the maximum height of the reference signal and its length; It is the dynamic time warping distance between the reference signal and the reconstructed signal, or the dynamic time warping distance between the reference signal and the original speckle motion signal.

[0141] Based on the band independence of laser interferometry, this application uses the R band and G band to verify the repeatability of the experiment at two similar locations. The similarity index is calculated based on the data of 10 users (approximately 20,000 cardiac cycles). The experimental results are shown in Table 2.

[0142] Table 2

[0143]

[0144] The data analysis in Table 2 shows that the reconstruction effect of the SCG signal is the most significant. The similarity index of the reconstructed signal (i.e., the reconstructed vertical motion signal in Table 2) reaches 93.288% and 92.809% in the R and G bands, respectively, significantly higher than the original speckle motion signal, further verifying the superiority of the present invention in extracting the vertical motion component (motion depth). For the GCGy signal, the similarity index of the reconstructed signal (i.e., the reconstructed rotational motion signal in the Y-axis direction in Table 2) is also higher than the original signal, reaching 88.380% (R band) and 89.557% (G band), respectively, indicating that the present invention's motion reconstruction capability in this direction is also reliable. At the same time, the similarity index between the reconstructed signal in the GCGx direction (i.e., the reconstructed rotational motion signal in the X-axis direction in Table 2) and the reference signal reaches 92.372% and 90.170% in the R band and G band, respectively. This is very similar to the performance of the original speckle Y-axis motion signal (i.e., the original speckle motion waveform in the Y direction corresponding to the first sensor and the original speckle motion waveform in the Y direction corresponding to the second sensor in Table 2), which is consistent with theoretical expectations and further verifies the effectiveness of this application in separating different motion components.

[0145] In summary, the experimental results fully demonstrate the ability of the present application to accurately reconstruct different motion components, and show consistency in both the R band and the G band, further improving the stability and applicability of the method.

[0146] refer to Figure 20 The figure is a principle block diagram of a device for detecting three-dimensional motion signals of the heart provided in the second aspect of the embodiment of the present application. Figure 20 In the embodiment, the device 100 for detecting a three-dimensional cardiac motion signal includes:

[0147] An X-axis direction motion signal acquisition module 101 is configured to acquire a motion signal of speckle in the X-axis direction of the imaging plane of each sensor when multiple sensors are imaging the chest surface of the user, thereby obtaining an X-axis direction motion signal corresponding to each sensor;

[0148] The Y-axis motion signal acquisition module 102 is used to acquire the Y-axis motion signal corresponding to each sensor while acquiring all X-axis motion signals;

[0149] The calculation module 103 is used to calculate and process all X-axis motion signals and all Y-axis motion signals using a preset algorithm to obtain the vertical motion signal of the user's chest surface, the rotational motion signal in the X-axis direction, and the rotational motion signal in the Y-axis direction.

[0150] The third aspect of the embodiment of the present application provides a terminal device, the principle block diagram of the terminal device can be as follows: Figure 21 As shown. The terminal device includes a processor, a memory, a network interface, a display screen and a temperature sensor connected via a system bus. The processor is used to provide computing and control capabilities. The memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the terminal device is used to communicate with an external terminal via a network connection. When the computer program is executed by the processor, a method for detecting the three-dimensional motion signal of the heart is implemented. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the temperature sensor is pre-set inside the terminal device to detect the operating temperature of the internal device.

[0151] Those skilled in the art will understand that Figure 21 The principle block diagram shown in the figure is only a block diagram of a partial structure related to the solution of the present invention, and does not constitute a limitation on the terminal device to which the solution of the present invention is applied. The specific terminal device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0152] In some embodiments, embodiments of the present application provide a terminal device comprising a processor and a memory, the memory being configured to store a computer program, the processor being configured to call and execute the computer program stored in the memory to perform the steps of the method for detecting three-dimensional cardiac motion signals provided in the first aspect of the embodiments of the present application. A fourth aspect of the embodiments of the present application provides a computer-readable storage medium, the computer-readable storage medium being configured to store a computer program that causes a computer to perform the steps of the method for detecting three-dimensional cardiac motion signals provided in the first aspect of the embodiments of the present application.

[0153] Those skilled in the art will appreciate that all or part of the processes in the above-described method embodiments can be implemented by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the above-described method embodiments. Any reference to memory, storage, database, or other media used in the various embodiments provided herein may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct RAMbus dynamic RAM (DRDRAM), and RAMbus dynamic RAM (RDRAM).

[0154] The technical features of the above embodiments can be combined without changing the basic principles of this application. In order to make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0155] The above embodiments merely illustrate several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the patent application. It should be noted that a person skilled in the art could make various modifications and improvements without departing from the spirit of the present application, all of which fall within the scope of protection of the present application. Therefore, the scope of patent protection for the present application shall be determined by the appended claims.

Claims

1. A method for detecting a three-dimensional cardiac motion signal, characterized in that: include: When multiple sensors are used to capture the chest surface of the user, a motion signal of the speckle in each sensor in the X-axis direction of the imaging plane is obtained to obtain an X-axis motion signal corresponding to each sensor; While acquiring all X-axis motion signals, acquire the Y-axis motion signal corresponding to each sensor; Using a preset algorithm to calculate and process all X-axis motion signals and all Y-axis motion signals to obtain a vertical motion signal of the user's chest surface, a rotational motion signal in the X-axis direction, and a rotational motion signal in the Y-axis direction; The steps of calculating and processing all X-axis motion signals and all Y-axis motion signals using a preset algorithm to obtain the vertical motion signal of the user's chest surface, the X-axis rotational motion signal, and the Y-axis rotational motion signal include: setting a first coefficient, a second coefficient, a third coefficient, and a fourth coefficient; obtaining the distance between the lens plane and the imaging plane of the target sensor and the distance between the focal plane of each sensor and the lens plane, wherein the target sensor is any one of the multiple sensors; and calculating and processing according to the preset algorithm based on the first coefficient, the second coefficient, the third coefficient, the fourth coefficient, the distance between the lens plane and the imaging plane of the target sensor, the distance between the focal plane of each sensor and the lens plane, all X-axis motion signals, and all Y-axis motion signals to obtain the vertical motion signal of the user's chest surface, the X-axis rotational motion signal, and the Y-axis rotational motion signal; In a case where the multiple sensors include a first sensor and a second sensor, the calculation formula for obtaining the vertical motion signal of the user's chest surface, the rotational motion signal in the X-axis direction, and the rotational motion signal in the Y-axis direction is as follows: based on the first coefficient, the second coefficient, the third coefficient, the fourth coefficient, the distance between the lens plane and the imaging plane of the target sensor, the distance between the focal plane of each sensor and the lens plane, all X-axis motion signals, and all Y-axis motion signals, and performing calculation processing according to the preset algorithm: ； ； ； in, yes The vertical motion signal corresponding to the moment; yes time; is the distance between the lens plane and the imaging plane of the target sensor; is the third coefficient; is the distance between the focal plane of the first sensor and the lens plane; The second sensor is The X-axis motion signal corresponding to the moment; is the fourth coefficient; is the distance between the focal plane of the second sensor and the lens plane; The first sensor is X-axis motion signal corresponding to the moment; is the second coefficient; is the first coefficient; yes The rotational motion signal in the Y-axis direction corresponding to the moment; yes The rotational motion signal in the X-axis direction corresponding to the moment; The first sensor is The Y-axis motion signal corresponding to the moment; The second sensor is The Y-axis motion signal corresponding to the moment.

2. The method for detecting three-dimensional cardiac motion signals according to claim 1, wherein: When multiple sensors capture the chest surface of a user, the steps of obtaining a motion signal of the speckle in the X-axis direction of the imaging plane in each sensor and obtaining the X-axis direction motion signal corresponding to each sensor include: When the user makes a vertical movement, a motion signal of the speckle in each sensor in the X-axis direction of the imaging plane is acquired to obtain a first motion signal to be processed corresponding to each sensor; When the user performs a rotational motion, a motion signal of the speckle in each sensor in the X-axis direction of the imaging plane is acquired to obtain a second motion signal to be processed corresponding to each sensor; The first to-be-processed motion signal and the second to-be-processed motion signal corresponding to each sensor are summed to obtain an X-axis direction motion signal corresponding to each sensor.

3. The method for detecting three-dimensional cardiac motion signals according to claim 2, wherein: When the user makes a vertical movement, the step of acquiring a motion signal of the speckle in each sensor in the X-axis direction of the imaging plane and obtaining a first motion signal to be processed corresponding to each sensor includes: When the user makes a vertical movement, obtaining a distance between a focal plane of each sensor and the chest surface; Obtaining an initial incident angle of the laser emitted by the laser device onto the chest surface of the user; A first motion signal to be processed corresponding to each sensor is obtained by calculation based on the distance between the focal plane of each sensor and the chest cavity surface, the initial incident angle and preset conditions.

4. The method for detecting three-dimensional cardiac motion signals according to claim 3, wherein: When the user performs a rotational motion, the step of acquiring a motion signal of the speckle in each sensor in the X-axis direction of the imaging plane and obtaining a second motion signal to be processed corresponding to each sensor includes: When the user performs a rotational motion, obtaining a reflection angle of the laser on each sensor; The second motion signal to be processed corresponding to each sensor is calculated based on the reflection angle on each sensor, the distance between the lens plane and the imaging plane of the target sensor, the distance between the focal plane of each sensor and the chest surface, and the distance between the focal plane and the lens plane of each sensor.

5. The method for detecting three-dimensional cardiac motion signals according to claim 3, wherein: While acquiring all X-axis motion signals, the steps of acquiring the Y-axis motion signal corresponding to each sensor include: Obtain the rotation angle of the user along the X-axis; The Y-axis motion signal corresponding to each sensor is calculated based on the distance between the lens plane and the imaging plane of the target sensor, the distance between the focal plane of each sensor and the lens plane, the distance between the focal plane of each sensor and the chest surface, the initial incident angle and the initial imaging angle of each sensor.

6. A device for detecting three-dimensional cardiac motion signals, characterized in that: include: An X-axis direction motion signal acquisition module is used to acquire a motion signal of the speckle in the X-axis direction of the imaging plane in each sensor when multiple sensors are imaging the chest surface of the user, thereby obtaining an X-axis direction motion signal corresponding to each sensor; The Y-axis motion signal acquisition module is used to obtain the Y-axis motion signal corresponding to each sensor while obtaining all X-axis motion signals; a calculation module, configured to calculate and process all X-axis motion signals and all Y-axis motion signals using a preset algorithm to obtain a vertical motion signal of the user's chest surface, a rotational motion signal in the X-axis direction, and a rotational motion signal in the Y-axis direction; The calculation module is further configured to set a first coefficient, a second coefficient, a third coefficient, and a fourth coefficient; obtain a distance between a lens plane and an imaging plane of a target sensor and a distance between a focal plane of each sensor and the lens plane, wherein the target sensor is any one of the plurality of sensors; and perform calculation processing according to the preset algorithm based on the first coefficient, the second coefficient, the third coefficient, the fourth coefficient, the distance between the lens plane and the imaging plane of the target sensor, the distance between the focal plane of each sensor and the lens plane, all X-axis motion signals, and all Y-axis motion signals to obtain a vertical motion signal of the user's chest surface, a rotational motion signal in the X-axis direction, and a rotational motion signal in the Y-axis direction; In a case where the multiple sensors include a first sensor and a second sensor, the calculation formula for obtaining the vertical motion signal of the user's chest surface, the rotational motion signal in the X-axis direction, and the rotational motion signal in the Y-axis direction is as follows: based on the first coefficient, the second coefficient, the third coefficient, the fourth coefficient, the distance between the lens plane and the imaging plane of the target sensor, the distance between the focal plane of each sensor and the lens plane, all X-axis motion signals, and all Y-axis motion signals, and performing calculation processing according to the preset algorithm: ； ； ； in, yes The vertical motion signal corresponding to the moment; yes time; is the distance between the lens plane and the imaging plane of the target sensor; is the third coefficient; is the distance between the focal plane of the first sensor and the lens plane; The second sensor is X-axis motion signal corresponding to the moment; is the fourth coefficient; is the distance between the focal plane of the second sensor and the lens plane; The first sensor is X-axis motion signal corresponding to the moment; is the second coefficient; is the first coefficient; yes The rotational motion signal in the Y-axis direction corresponding to the moment; yes The rotational motion signal in the X-axis direction corresponding to the moment; The first sensor is The Y-axis motion signal corresponding to the moment; The second sensor is The Y-axis motion signal corresponding to the moment.

7. A terminal device, characterized in that: include: A processor and a memory, the memory being used to store a computer program, the processor being used to call and run the computer program stored in the memory to execute the steps of the method for detecting three-dimensional motion signals of the heart as described in any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that Used to store a computer program, wherein the computer program enables a computer to execute the steps of the method for detecting a three-dimensional cardiac motion signal according to any one of claims 1 to 5.

Images