Periodic heartbeat observation method and device and electronic equipment

Abstract

The invention provides a periodic heartbeat observation method and device and electronic equipment, and relates to the technical field of computers. The method comprises the following steps: in response to a triggering observation instruction, acquiring measured acceleration data of an acceleration sensor in first electronic equipment; smoothing the measured acceleration data, and determining gravitational acceleration data at the current moment; determining motion acceleration data of the first electronic equipment at the current moment based on the measured acceleration data and the gravitational acceleration data at the current moment; performing data dimension reduction on the motion acceleration data of the first electronic equipment at the current moment to obtain heartbeat data at the current moment; and sending the heartbeat data at the current moment to the second electronic equipment based on the first connection between the first electronic equipment and the second electronic equipment. Therefore, the person calling for help can continuously and timely obtain the heartbeat data of the patient through the first electronic equipment, and can transmit the heartbeat data of the patient to the second electronic equipment at the distance in real time.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a periodic heartbeat observation method, device, and electronic equipment. Background Art

[0002] Currently, when conducting emergency telephone or video guidance, the person calling for help will make a subjective judgment on the patient's heartbeat, for example, judging the patient's heartbeat through breathing, heart sounds, pulse and abdominal rise and fall, and then pass the patient's heartbeat condition to the telephone dispatcher or doctor.

[0003] However, the person calling for help usually does not have professional medical knowledge and first aid skills. In addition, in an emergency situation, the person calling for help is often in extreme tension, anxiety or even panic, and may not be able to accurately judge the patient's heartbeat, such as ignoring the patient's weak heartbeat signs. Moreover, when describing the patient's condition to the telephone dispatcher or doctor, the person calling for help may only use vague language and cannot organize accurate terms, or may miss important details of the patient due to panic, such as whether the patient has indirect manifestations related to the heartbeat such as dying sigh-like breathing. In addition, the person calling for help can only convey the patient's heartbeat condition at a certain moment to the telephone dispatcher or doctor, and cannot continuously and in real time observe the patient's heartbeat. If the patient's heartbeat changes subsequently, the telephone dispatcher or doctor will find it difficult to know in time, which is not conducive to the overall assessment of the patient's condition and the timely adjustment of first aid measures. Summary of the Invention

[0004] The present disclosure provides a periodic heartbeat observation method, device, and electronic device to at least solve the above technical problems existing in the prior art.

[0005] According to a first aspect of the present disclosure, a periodic heartbeat observation method is provided, comprising: in response to triggering an observation instruction, obtaining measured acceleration data of an acceleration sensor in a first electronic device; the observation instruction can establish a first connection between the first electronic device and a second electronic device; smoothing the measured acceleration data to determine the gravity acceleration data at the current moment; determining the motion acceleration data of the first electronic device at the current moment based on the measured acceleration data and the gravity acceleration data at the current moment; performing data dimensionality reduction on the motion acceleration data of the first electronic device at the current moment to obtain the heartbeat data at the current moment; and sending the heartbeat data at the current moment to the second electronic device based on the first connection between the first electronic device and the second electronic device; wherein the first electronic device is placed in an area on the patient's body surface that is less than a first distance from the patient's heart, and no new applications are added to the first electronic device.

[0006] In one possible implementation manner, the response to triggering the observation instruction includes: receiving an observation request sent by the second electronic device, and in response to the observation link in the observation request being triggered, determining that the observation instruction is triggered; the observation link includes an observation service entrance and the first connection information between the first electronic device and the second electronic device; or, in response to receiving the first connection information between the first electronic device and the second electronic device at the observation service entrance, determining that the observation instruction is triggered.

[0007] In one possible implementation manner, obtaining the measured acceleration data of the acceleration sensor in the first electronic device includes at least one of the following: in response to the first electronic device having a first operating system, obtaining the measured acceleration data of the acceleration sensor in the first electronic device based on the sensor manager and the sensor event listener in the first operating system; in response to the first electronic device having a second operating system, obtaining the measured acceleration data of the acceleration sensor in the first electronic device based on the core motion framework in the second operating system; in response to the first electronic device having a third operating system, obtaining the measured acceleration data of the acceleration sensor in the first electronic device based on the sensor manager in the third operating system; and obtaining the measured acceleration data of the acceleration sensor in the first electronic device based on the acceleration sensor listening interface in the target application in the first electronic device.

[0008] In one possible implementation manner, the smoothing of the measured acceleration data to determine the gravity acceleration data at the current moment includes: smoothing the measured acceleration data based on the gravity acceleration data at the previous moment through an exponential moving average method or a Kalman filter method to determine the gravity acceleration data at the current moment; or smoothing the measured acceleration data through at least one of a weighted moving average method, a low-pass filter method, a Gaussian filter method, and a median filter method to determine the gravity acceleration data at the current moment.

[0009] In one possible implementation manner, determining the motion acceleration data of the first electronic device at the current moment based on the measured acceleration data and the gravity acceleration data at the current moment includes: determining the difference between the measured acceleration data and the gravity acceleration data at the current moment as the motion acceleration data of the first electronic device at the current moment.

[0010] In one possible implementation manner, performing data dimensionality reduction on the motion acceleration data of the first electronic device at the current moment to obtain the heartbeat data at the current moment includes: performing data dimensionality reduction on the motion acceleration data of the first electronic device at the current moment based on at least one of principal component analysis, independent component analysis, autoencoder method and factor analysis method to obtain the heartbeat data at the current moment.

[0011] In one possible implementation manner, sending the heartbeat data at the current moment to the second electronic device includes: generating a heartbeat fluctuation graph based on heartbeat data at multiple consecutive moments including the heartbeat data at the current moment; and sending the heartbeat fluctuation graph to the second electronic device based on a first connection between the first electronic device and the second electronic device, so that the second electronic device displays the heartbeat fluctuation graph.

[0012] In one possible embodiment, before responding to triggering the observation instruction, the method further includes: establishing a second connection between the first electronic device and the second electronic device; the second connection is used to transmit voice data between the first electronic device and the second electronic device; accordingly, after sending the heartbeat data at the current moment to the second electronic device, the method further includes: in response to the second connection between the first electronic device and the second electronic device being disconnected, determining that the first connection between the first electronic device and the second electronic device is disconnected, and stopping obtaining the measured acceleration data of the acceleration sensor in the first electronic device.

[0013] According to a second aspect of the present disclosure, a periodic heartbeat observation device is provided, including: an acquisition module for acquiring measured acceleration data of an acceleration sensor in a first electronic device in response to a triggered observation instruction; the observation instruction can establish a first connection between the first electronic device and a second electronic device; a smoothing module for smoothing the measured acceleration data to determine the gravity acceleration data at the current moment; a determination module for determining the motion acceleration data of the first electronic device at the current moment based on the measured acceleration data and the gravity acceleration data at the current moment; a dimensionality reduction module for performing data dimensionality reduction on the motion acceleration data of the first electronic device at the current moment to obtain the heartbeat data at the current moment; a sending module for sending the heartbeat data at the current moment to the second electronic device based on the first connection between the first electronic device and the second electronic device; wherein the first electronic device is placed in an area on the patient's body surface that is less than a first distance away from the patient's heart, and no new applications are added to the first electronic device.

[0014] According to a third aspect of the present disclosure, there is provided an electronic device, including:

[0015] at least one processor; and

[0016] a memory communicatively connected to the at least one processor; wherein,

[0017] The memory stores instructions that can be executed by the at least one processor. The instructions are executed by the at least one processor to enable the at least one processor to perform the method described in the present disclosure.

[0018] According to a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to cause the computer to execute the method described in the present disclosure.

[0019] The present invention discloses a method, device and electronic device for periodic heartbeat observation. The method places a first electronic device in an area on the patient's body surface that is less than a first distance from the patient's heart. No new application needs to be installed in the first electronic device. After responding to a trigger observation instruction, the first electronic device obtains the measured acceleration data of the acceleration sensor in the first electronic device, and then performs smoothing, correction and dimensionality reduction processing on the measured acceleration data to obtain the patient's current heartbeat data, and based on the first connection between the first electronic device and the second electronic device, the current heartbeat data is sent to the second electronic device. Thus, the person calling for help can continuously and timely obtain the patient's heartbeat data through the first electronic device, and can transmit the patient's heartbeat data to the distant second electronic device in real time through the first connection between the first electronic device and the second electronic device, so as to ensure that the telephone dispatcher or doctor at the second electronic device can obtain the patient's heartbeat data in a timely manner, so as to make timely adjustments to the overall assessment of the patient's condition and emergency measures.

[0020] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The above and other objects, features and advantages of the exemplary embodiments of the present disclosure will become readily understood by reading the detailed description below with reference to the accompanying drawings, in which several embodiments of the present disclosure are shown by way of example and not limitation, wherein:

[0022] In the drawings, the same or corresponding reference numerals denote the same or corresponding parts.

[0023] Figure 1 The process diagram of a periodic heartbeat observation method according to an embodiment of the present disclosure is shown as follows Figure 1 ;

[0024] Figure 2 The process diagram of a periodic heartbeat observation method according to an embodiment of the present disclosure is shown as follows Figure 2 ;

[0025] Figure 3A schematic diagram of a periodic heartbeat observation method according to an embodiment of the present disclosure is shown. Figure 1 ;

[0026] Figure 4 A schematic diagram of a periodic heartbeat observation method according to an embodiment of the present disclosure is shown. Figure 2 ;

[0027] Figure 5 A schematic diagram of a periodic heartbeat observation method according to an embodiment of the present disclosure is shown. Figure 3 ;

[0028] Figure 6 A schematic diagram of a periodic heartbeat observation method according to an embodiment of the present disclosure is shown. Figure 4 ;

[0029] Figure 7 A schematic diagram of a periodic heartbeat observation method according to an embodiment of the present disclosure is shown. Figure 5 ;

[0030] Figure 8 A schematic structural diagram of a periodic heartbeat observation device according to an embodiment of the present disclosure is shown;

[0031] Figure 9 A schematic diagram of the structure of an electronic device according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0032] To make the purposes, features, and advantages of the present disclosure more apparent and understandable, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of the present disclosure without creative work shall fall within the scope of protection of the present disclosure.

[0033] Figure 1 The process diagram of a periodic heartbeat observation method according to an embodiment of the present disclosure is shown as follows Figure 1 ,like Figure 1 As shown, a periodic heartbeat observation method includes:

[0034] Step S101: in response to a triggering observation instruction, obtaining acceleration data measured by an acceleration sensor in a first electronic device.

[0035] In this embodiment, the first electronic device can be any electronic device with an acceleration sensor, such as a mobile phone, a smart watch, etc., wherein the mobile phone includes but is not limited to smart phones based on iOS system, Android system and Hongmeng system. The first electronic device can be used to observe the patient's heartbeat, that is, the first electronic device is a terminal for collecting the patient's heartbeat data. When observing the patient's heartbeat, the first electronic device needs to be placed in an area on the patient's body surface that is less than a first distance from the patient's heart, that is, near the patient's heart, and there is no need to add new applications and other sensors in the first electronic device, such as applications or sensors specifically used for heartbeat observation. Figure 3 A schematic diagram of a periodic heartbeat observation method according to an embodiment of the present disclosure is shown. Figure 1 ,like Figure 3 As shown, in a scenario where the person calling for help performs telephone first aid or video first aid, the first electronic device can be the mobile phone of the person calling for help. When observing the patient's heartbeat, the mobile phone is placed in front of the patient's left chest, with the head of the mobile phone (the end close to the camera and receiver of the mobile phone) facing the patient's head, and the center point of the mobile phone is placed on the line connecting the two nipples of the patient, close to 1 / 3 of the left chest. The placement position of the mobile phone is less than the first distance from the patient's heart. The value of the first distance can be determined by itself according to actual conditions, and this disclosure does not limit it. Of course, the closer the placement position of the mobile phone is to the patient's heart, the more accurate the observation result will be.

[0036] In this embodiment, the monitoring instruction is an instruction to instruct the first electronic device to perform heartbeat observation, and the observation instruction can establish a first connection between the first electronic device and the second electronic device, the first connection being used to transmit heartbeat data between the first electronic device and the second electronic device, that is, after triggering the observation instruction, the first electronic device will begin to observe the heartbeat and establish the first connection with the second electronic device, and can transmit the observed heartbeat data to the second electronic device through the first connection. Wherein, the second electronic device is an electronic device capable of receiving and displaying heartbeat data, such as a laptop, a tablet computer, a mobile phone, or a telephone with a display screen (video phone), etc. The distance between the second electronic device and the first electronic device is greater than the second distance, that is, the second electronic device is the remote end of the patient's heartbeat display, and the value of the second distance can be determined according to actual conditions, and this disclosure does not limit it. In actual applications, the first electronic device and the second electronic device are often not in the same room, the same community, the same street, or the same county, etc. In the scenario of a call for emergency telephone or video emergency, the second electronic device can be the telephone of a 120 telephone dispatcher in the hospital or the mobile phone or laptop of a doctor.

[0037] In this embodiment, the first electronic device will start heartbeat observation in response to triggering the observation instruction. First, it needs to obtain the measured acceleration data of the acceleration sensor configured by itself. The measured acceleration data can reflect the tiny periodic vibrations and vibration intensity caused by the patient's heartbeat. These periodic vibrations and vibration intensity can reflect the patient's heartbeat frequency and heartbeat intensity to a certain extent. Therefore, the patient's heartbeat data can be observed based on the measured acceleration data of the acceleration sensor.

[0038] Step S102: Smoothing the measured acceleration data to determine the gravity acceleration data at the current moment.

[0039] In this embodiment, the acceleration data measured by the acceleration sensor in the first electronic device includes gravitational acceleration data and motion acceleration data generated by the movement of the first electronic device itself. In the scenario of observing a patient's heartbeat, the motion acceleration data is the acceleration data generated by the patient's heartbeat. To obtain accurate motion acceleration data, it is necessary to remove the accurate gravitational acceleration data from the measured acceleration data. In other words, accurate gravitational acceleration data must first be obtained. Because gravitational acceleration changes slowly, it is a low-frequency signal, while motion acceleration changes rapidly, it is a high-frequency signal. Smoothing the measured acceleration data can highlight the low-frequency signals in the measured acceleration data and weaken the high-frequency signals. In other words, the result of smoothing the measured acceleration data can more accurately reflect the characteristics of gravitational acceleration. Therefore, the result of smoothing the measured acceleration data can be determined as the gravitational acceleration data at the current moment.

[0040] Furthermore, measured acceleration data often contains random noise, which can arise from the accuracy limitations of the accelerometer, environmental interference, or subtle muscle movements of the patient. Smoothing the measured acceleration data can filter out this noise, reduce short-term fluctuations in the measured acceleration data, and further ensure the accuracy of the gravity acceleration data. In one example, the measured acceleration data can be smoothed using methods such as moving average filtering, low-pass filtering, and median filtering to determine the current gravity acceleration data.

[0041] Step S103: determining the motion acceleration data of the first electronic device at the current moment based on the measured acceleration data and the gravity acceleration data at the current moment.

[0042] In this embodiment, after obtaining the gravity acceleration data at the current moment, it is necessary to remove the gravity acceleration data at the current moment from the measured acceleration data to obtain the motion acceleration data of the first electronic device at the current moment. The motion acceleration data can reflect the patient's heartbeat condition.

[0043] Step S104: performing data dimension reduction on the motion acceleration data of the first electronic device at the current moment to obtain the heartbeat data at the current moment.

[0044] In this embodiment, although the motion acceleration data can reflect the patient's heartbeat, the motion acceleration data is often multi-dimensional data, and the heartbeat data used for display needs to be single-dimensional. Therefore, it is necessary to perform data dimensionality reduction on the motion acceleration data of the first electronic device at the current moment, and reduce the multi-dimensional motion acceleration data to one-dimensional data. The one-dimensional data after dimensionality reduction effectively preserves the periodicity of the patient's original heart motion acceleration, and can therefore be used as the patient's heartbeat data at the current moment.

[0045] Step S105: Based on the first connection between the first electronic device and the second electronic device, the heartbeat data at the current moment is sent to the second electronic device.

[0046] In this embodiment, after obtaining the heartbeat data at the current moment, it is necessary to send the heartbeat data at the current moment to the second electronic device based on the first connection between the first electronic device and the second electronic device, so that the telephone dispatcher or doctor and other personnel on the second electronic device can obtain the patient's heartbeat data in time.

[0047] In the present disclosure, the person calling for help can continuously and timely obtain the patient's periodic heartbeat data through a first electronic device that only has an acceleration sensor and does not require the addition of other applications, and can transmit the patient's heartbeat data to a distant second electronic device in real time through a first connection between the first electronic device and the second electronic device, so as to ensure that the telephone dispatcher or doctor at the second electronic device can obtain the patient's heartbeat data in a timely manner, judge the patient's heartbeat condition, and thus make timely adjustments to the overall assessment of the patient's condition and first aid measures; in addition, the method in the present disclosure can be implemented by any electronic device with an acceleration sensor and has strong compatibility.

[0048] In another embodiment, in response to triggering an observation instruction, the method includes:

[0049] Receiving an observation request sent by the second electronic device, and in response to an observation link in the observation request being triggered, determining to trigger an observation instruction; the observation link includes an observation service entrance and first connection information between the first electronic device and the second electronic device; or,

[0050] In response to receiving first connection information between the first electronic device and the second electronic device at the observation service portal, it is determined to trigger an observation instruction.

[0051] In this embodiment, in a scenario where the person calling for help performs telephone first aid or video first aid, a first electronic device on the person calling for help and a second electronic device on the 120 telephone dispatcher or doctor's side will first establish a voice connection, such as a phone call or video call, and the 120 telephone dispatcher or doctor can send an observation request to the first electronic device through the second electronic device based on the voice connection. The observation request can be sent to the first electronic device through text messages or WeChat, and the observation request includes an observation link. The observation link can be a web link or a QR code of a WeChat applet, etc. The person calling for help on the first electronic device clicks on the web link or scans the QR code of the WeChat applet with WeChat to trigger the observation link. The observation link includes an observation service entrance and first connection information between the first electronic device and the second electronic device, wherein the observation service entrance is an entrance to a web page, application software or WeChat applet that can perform heartbeat observation, and the first connection information includes information required to establish a first connection between the first electronic device and the second electronic device, such as the Internet Protocol (IP) between the first electronic device and the second electronic device. Protocol) address, port number, transmission protocol, authentication information and network mask, etc. If the observation link is triggered, the first electronic device will enter the observation service through the observation service entrance, start heartbeat observation, and establish a first connection with the second electronic device based on the first connection information.

[0052] In this embodiment, in the scenario where the person calling for help is performing telephone first aid or video first aid, after the first electronic device on the person calling for help establishes a voice connection with the second electronic device on the 120 telephone dispatcher or doctor's side, the first electronic device can enter the heartbeat observation state on its own without the second electronic device sending an observation request to the first electronic device. For example, the person calling for help can use the first electronic device to fill in the first connection information between the first electronic device and the second electronic device at the entrance of a web page or WeChat applet where heartbeat observation can be performed, and determine to start observation, such as clicking the "Start Observation" button. If the first electronic device receives the first connection information between the first electronic device and the second electronic device at the observation service entrance, it determines to trigger the observation instruction.

[0053] In another embodiment, obtaining measured acceleration data of an acceleration sensor in the first electronic device includes at least one of the following:

[0054] In response to a first electronic device having a first operating system, acceleration data measured by an acceleration sensor in the first electronic device is obtained based on a sensor manager and a sensor event listener in the first operating system. The first operating system is an Android system, the sensor manager is a SensorManager, and the sensor event listener is a SensorEventListener. The SensorManager is used to manage various sensors, and the SensorEventListener is used to monitor changes in sensor data. Therefore, based on the SensorManager and the SensorEventListener, the acceleration data measured by the acceleration sensor in the first electronic device can be obtained.

[0055] In response to the first electronic device having a second operating system, acceleration data measured by an acceleration sensor in the first electronic device is obtained based on a core motion framework in the second operating system. The second operating system is an Apple (iOS) system, and the core motion framework is a Core Motion framework. The Core Motion framework can access and process motion sensor data on a device. Therefore, the acceleration data measured by the acceleration sensor in the first electronic device can be obtained based on the Core Motion framework.

[0056] In response to the first electronic device having a third operating system, acceleration data measured by an acceleration sensor in the first electronic device is obtained based on a sensor manager in the third operating system. The third operating system is HarmonyOS, and the sensor manager is a SensorManager. The SensorManager in the HarmonyOS can manage sensors and monitor changes in sensor data. Therefore, the acceleration data measured by the acceleration sensor in the first electronic device can be obtained based on the SensorManager.

[0057] Based on the accelerometer monitoring interface in the target application in the first electronic device, the measured acceleration data of the accelerometer in the first electronic device is obtained. The target application can be a WeChat applet, and the accelerometer monitoring interface can be wx.onAccelerometerChange in the WeChat applet. wx.onAccelerometerChange is an application programming interface (API) provided by the WeChat applet for monitoring changes in device accelerometer data. Therefore, based on wx.onAccelerometerChange, the measured acceleration data of the accelerometer in the first electronic device can be obtained.

[0058] In another embodiment, smoothing the measured acceleration data to determine the gravity acceleration data at the current moment includes:

[0059] Smoothing the measured acceleration data based on the gravity acceleration data at the previous moment by using the exponential moving average method or the Kalman filter method to determine the gravity acceleration data at the current moment; or

[0060] The measured acceleration data is smoothed by at least one of a weighted moving average method, a low-pass filtering method, a Gaussian filtering method, and a median filtering method to determine the gravity acceleration data at the current moment.

[0061] In this embodiment, the measured acceleration data can be smoothed by at least one of the exponential moving average method (EMA), Kalman filtering method, weighted moving average method, low-pass filtering method, Gaussian filtering method and median filtering method. Among them, the exponential moving average method and Kalman filtering method will smooth the measured acceleration data with the help of the gravity acceleration data of the previous moment, and the weighted moving average method, low-pass filtering method, Gaussian filtering method and median filtering method can directly smooth the measured acceleration data.

[0062] In one example, the exponential moving average method can be used to smooth the measured acceleration data because EMA is simple to calculate, has a fast response speed, good smoothing effect, flexible parameter adjustment, and is suitable for real-time data processing. Assume that when the caller places the phone, the screen is vertically facing upwards, and the modulus of gravity acceleration is 9.8m / s. 2 , then the initial value of the gravity acceleration data can be: G x (0) = 0, G y (0) = 0, G z (0) = -0.98, where G x (0) is the gravitational acceleration data component on the x-axis, G y (0) is the gravitational acceleration data component on the y-axis, G z (0) is the gravitational acceleration data component on the z-axis;

[0063] At time T, the measured acceleration data acquired by the acceleration sensor in the first electronic device is x(T), y(T), and z(T), where x(T) is the measured acceleration data component on the x-axis at time T, y(T) is the measured acceleration data component on the y-axis at time T, and z(T) is the measured acceleration data component on the z-axis at time T;

[0064] At the moment before time T, that is, time T-1, the gravity acceleration data is determined to be G x (T-1), G y (T-1), Gz (T-1), where G x (T-1) is the gravitational acceleration data component on the x-axis at time T-1, G y (T-1) is the gravitational acceleration data component on the y-axis at time T-1, G z (T-1) is the gravitational acceleration data component on the z-axis at time T-1;

[0065] Then the gravitational acceleration data at time T can be:

[0066] G x (T) = (1-α)·G x (T-1)+α·x(T)

[0067] G y (T) = (1-α)·G y (T-1)+α·y(T)

[0068] G z (T) = (1-α)·G z (T-1)+α·z(T)

[0069] Among them, G x (T) is the gravitational acceleration data component on the x-axis at time T, G y (T) is the gravitational acceleration data component on the y-axis at time T, G z (T) is the gravity acceleration data component on the z-axis at time T, and α is the smoothing coefficient. The selection of the smoothing coefficient α is very important for the accuracy of EMA. The value of the smoothing coefficient α can be determined by the size of the observation window N. For example, if the sampling frequency of the sensor data obtained through the WeChat applet is 60Hz, the size of the observation window N can be set to 60, then

[0070] In another embodiment, determining the motion acceleration data of the first electronic device at the current moment based on the measured acceleration data and the gravity acceleration data at the current moment includes:

[0071] The difference between the measured acceleration data and the gravity acceleration data at the current moment is determined as the motion acceleration data of the first electronic device at the current moment.

[0072] In this embodiment, the difference between the measured acceleration data and the gravity acceleration data at the current moment can be directly determined as the motion acceleration data of the first electronic device at the current moment. The motion acceleration data of the first electronic device at the current moment (i.e., moment T) can be:

[0073] a x (T) = x(T) - G x (T)

[0074] a y (T) = y(T) - G y (T)

[0075] a z (T) = z(T) - G z (T)

[0076] Among them, a x (T) is the motion acceleration data component on the x-axis at time T, a y (T) is the motion acceleration data component on the y-axis at time T, a z (T) is the motion acceleration data component on the z-axis at time T.

[0077] In another embodiment, performing data dimensionality reduction on the motion acceleration data of the first electronic device at the current moment to obtain the heartbeat data at the current moment includes:

[0078] Based on at least one of principal component analysis, independent component analysis, autoencoder method and factor analysis method, data dimension reduction is performed on the motion acceleration data of the first electronic device at the current moment to obtain the heartbeat data at the current moment.

[0079] In this embodiment, data dimension reduction may be performed on the motion acceleration data of the first electronic device at the current moment based on at least one of principal component analysis (PCA), independent component analysis, autoencoder method, and factor analysis.

[0080] In one example, PCA can be used to reduce the dimensionality of the motion acceleration data of the first electronic device at the current moment because it is simple to calculate, applicable to high-dimensional data, and suitable for visualization. First, it is necessary to calculate the first W sample data of the time series signal and select the appropriate principal component. Based on the continuous W samples, the data matrix A can be constructed. The motion acceleration data at time T is recorded as a9T)=(a x (T), a y (T), a z (T)), then the data matrix A is:

[0081] Then based on the data matrix A, calculate the covariance matrix C: And perform eigenvalue decomposition on the covariance matrix C to obtain eigenvalues ​​and eigenvectors. The decomposition form is: C = VΛV T , where Λ is a diagonal matrix with eigenvalues ​​on the diagonal, V is the eigenvector matrix, and the transpose of the T matrix;

[0082] Finally, according to the size of the eigenvalue, the largest eigenvalue is selected, and the eigenvector V1 corresponding to the largest eigenvalue is used as the principal component, and the original motion acceleration data a(T)=(a x (T), a y (T), a z (T)) is projected onto the feature vector V1 to obtain the reduced-dimensional data: A reduced =A·V1, the data after dimensionality reduction effectively preserves the periodicity of the patient's original heart acceleration, and therefore can be used as the patient's heartbeat data at time T.

[0083] In another embodiment, sending the current heartbeat data to the second electronic device includes:

[0084] Generate a heartbeat fluctuation graph based on heartbeat data at a plurality of consecutive moments including the current moment's heartbeat data;

[0085] Based on the first connection between the first electronic device and the second electronic device, the heartbeat fluctuation graph is sent to the second electronic device, so that the second electronic device displays the heartbeat fluctuation graph.

[0086] In this embodiment, a heartbeat fluctuation graph can be generated based on heartbeat data at multiple consecutive moments including the current moment, and the heartbeat fluctuation graph can be sent to the second electronic device through the first connection between the first electronic device and the second electronic device, so that the second electronic device can display the heartbeat fluctuation graph.

[0087] Figure 4 A schematic diagram of a periodic heartbeat observation method according to an embodiment of the present disclosure is shown. Figure 2 ,like Figure 4 As shown, in the scenario where the person calling for help performs telephone first aid or video first aid, the first electronic device can be the mobile phone of the person calling for help, and the phone screen can display the precautions during the heartbeat observation process and the observed heartbeat fluctuation graph of the patient, such as Figure 4 As shown, it can be seen that the patient's heartbeat fluctuation graph is periodic.

[0088] Figure 5 A schematic diagram of a periodic heartbeat observation method according to an embodiment of the present disclosure is shown. Figure 3 ,like Figure 5 As shown, in a scenario where the person calling for help performs telephone first aid or video first aid, the second electronic device can be the telephone of the hospital's 120 telephone dispatcher. The screen of the telephone can display the patient's real-time heartbeat fluctuation graph transmitted by the first electronic device, that is, real-time heartbeat data, and can also display the patient's historical heartbeat fluctuation graph transmitted by the first electronic device, that is, historical heartbeat data.

[0089] Figure 6A schematic diagram of a periodic heartbeat observation method according to an embodiment of the present disclosure is shown. Figure 4 ,like Figure 6 As shown, in a scenario where a person calling for help performs telephone first aid or video first aid, the first electronic device can be the mobile phone of the person calling for help, and the second electronic device can be the telephone of the hospital's 120 telephone dispatcher. During the observation process, at the same moment, the heartbeat fluctuation graphs displayed on the first electronic device and the second electronic device are the same.

[0090] Figure 2 The process diagram of a periodic heartbeat observation method according to an embodiment of the present disclosure is shown as follows Figure 2 ,like Figure 2 As shown, a periodic heartbeat observation method includes:

[0091] Step S201: Establish a second connection between a first electronic device and a second electronic device.

[0092] In this embodiment, the second connection is used to transmit voice data between the first electronic device and the second electronic device. The second connection can be a voice connection established between the first electronic device on the caller's side and the second electronic device on the 120 telephone dispatcher or doctor's side, such as a telephone connection or a video connection.

[0093] Step S202: In response to the triggering observation instruction, obtain acceleration data measured by the acceleration sensor in the first electronic device.

[0094] Step S203: Smoothing the measured acceleration data to determine the gravity acceleration data at the current moment.

[0095] Step S204: determining the motion acceleration data of the first electronic device at the current moment based on the measured acceleration data and the gravity acceleration data at the current moment.

[0096] Step S205 : performing data dimension reduction on the motion acceleration data of the first electronic device at the current moment to obtain the heartbeat data at the current moment.

[0097] Step S206: Based on the first connection between the first electronic device and the second electronic device, the heartbeat data at the current moment is sent to the second electronic device.

[0098] The specific implementation details of steps S202 to S206 are similar to those of steps S101 to S105 and are not repeated here.

[0099] Step S207 : In response to the second connection between the first electronic device and the second electronic device being disconnected, determining that the first connection between the first electronic device and the second electronic device is disconnected, and stopping obtaining the measured acceleration data of the acceleration sensor in the first electronic device.

[0100] In this embodiment, if the second connection between the first electronic device and the second electronic device is disconnected, the first connection between the first electronic device and the second electronic device is automatically disconnected, and the first electronic device stops acquiring acceleration data measured by the acceleration sensor in the first electronic device, i.e., stops observing the patient's heartbeat. In one example, if a person calling for help dials 120 via a mobile phone, after the call is connected, the person's mobile phone establishes a second connection with the 120 dispatcher's phone. The person then uses the mobile phone to observe the patient's heartbeat. At this time, the person's mobile phone and the 120 dispatcher's phone establish a first connection. When the call between the person's mobile phone and the 120 dispatcher's phone is hung up, i.e., the second connection is disconnected, the first connection between the person's mobile phone and the 120 dispatcher's phone is also disconnected, and the person's mobile phone stops observing the patient's heartbeat.

[0101] To facilitate understanding of the present disclosure, the following provides a code that can implement the periodic heartbeat observation method in the present disclosure:

[0102]

[0103]

[0104]

[0105] The following is the measured acceleration data obtained based on the actual measurement of a real person's heartbeat by the first electronic device: [(x:0.17,y:-0.14,z:-0.96,timestamp:1736487936888), (x:0.16,y:-0.15,z:-0.95,timestamp:1736487936907), (x:0.16,y:-0.16,z:-0.96,timestamp:1736487936927), (x:0.14,y:-0.17,z:-0.96,timestamp:1736487936948), (x:0.13,y:-0.16,z:-0.97,timestamp: 1736487936967), (x:0.14,y:-0.16,z:-0.98,timestamp:1736487936990), ( x:0.16,y:-0.15,z:-0.96,timestamp:1736487937006), (x:0.15,y:-0.15,z: -0.95,timestamp:1736487937026), (x:0.15,y:-0.17,z:-0.97,timestamp:1736487937045), (x:0.15,y:-0.17,z:-0.94,timestamp:1736487937066)...]. The actual measured acceleration data is quite large, so only 10 pieces of measured acceleration data are listed here. Here, x, y, and z represent the measured acceleration values ​​on the x-axis, y-axis, and z-axis, respectively, and timestamp is the timestamp when the corresponding measured acceleration was obtained.

[0106] The heartbeat data calculated based on the above code and the measured acceleration data are: [-0.000837, -0.010109, -0.000477, 0.002069, 0.012114, -0.000925, -0.000894, -0.000865, -0.000836, -0.000808…].

[0107] Figure 7 A schematic diagram of a periodic heartbeat observation method according to an embodiment of the present disclosure is shown. Figure 5 ,like Figure 7 The fluctuation diagram of the heartbeat data calculated based on the above code and the measured acceleration data is shown, wherein the horizontal axis represents time and the vertical axis represents amplitude, that is, the heartbeat data is based on Figure 7 It can intuitively reflect the heartbeat of the patient being tested. Obviously, Figure 7The heartbeat data in is periodic.

[0108] Figure 8 A schematic diagram of the structure of a periodic heartbeat observation device according to an embodiment of the present disclosure is shown. Figure 8 As shown, a periodic heartbeat observation device includes:

[0109] An acquisition module 10 is used to acquire measured acceleration data of an acceleration sensor in a first electronic device in response to a triggered observation instruction; the observation instruction can establish a first connection between the first electronic device and the second electronic device; a smoothing module 11 is used to smooth the measured acceleration data to determine the gravity acceleration data at the current moment; a determination module 12 is used to determine the motion acceleration data of the first electronic device at the current moment based on the measured acceleration data and the gravity acceleration data at the current moment; a dimensionality reduction module 13 is used to perform data dimensionality reduction on the motion acceleration data of the first electronic device at the current moment to obtain the heartbeat data at the current moment; a sending module 14 is used to send the heartbeat data at the current moment to the second electronic device based on the first connection between the first electronic device and the second electronic device; wherein the first electronic device is placed in an area on the patient's body surface that is less than a first distance away from the patient's heart, and no new application is added to the first electronic device.

[0110] In one embodiment, the acquisition module 10 is further used to: receive an observation request sent by the second electronic device, and determine to trigger an observation instruction in response to an observation link in the observation request being triggered; the observation link includes an observation service entrance and first connection information between the first electronic device and the second electronic device; or, determine to trigger an observation instruction in response to receiving the first connection information between the first electronic device and the second electronic device at the observation service entrance.

[0111] In one embodiment, the acquisition module 10 is also used for at least one of the following: in response to the first electronic device having a first operating system, obtaining the measured acceleration data of the acceleration sensor in the first electronic device based on the sensor manager and the sensor event listener in the first operating system; in response to the first electronic device having a second operating system, obtaining the measured acceleration data of the acceleration sensor in the first electronic device based on the core motion framework in the second operating system; in response to the first electronic device having a third operating system, obtaining the measured acceleration data of the acceleration sensor in the first electronic device based on the sensor manager in the third operating system; and obtaining the measured acceleration data of the acceleration sensor in the first electronic device based on the acceleration sensor listening interface in the target application in the first electronic device.

[0112] In one embodiment, the smoothing module 11 is further used to: smooth the measured acceleration data based on the gravity acceleration data at the previous moment by an exponential moving average method or a Kalman filter method to determine the gravity acceleration data at the current moment; or, smooth the measured acceleration data by at least one of a weighted moving average method, a low-pass filter method, a Gaussian filter method, and a median filter method to determine the gravity acceleration data at the current moment.

[0113] In one embodiment, the determining module 12 is further configured to determine the difference between the measured acceleration data and the gravity acceleration data at the current moment as the motion acceleration data of the first electronic device at the current moment.

[0114] In one embodiment, the dimensionality reduction module 13 is also used to: perform data dimensionality reduction on the motion acceleration data of the first electronic device at the current moment based on at least one of principal component analysis, independent component analysis, autoencoder method and factor analysis method to obtain the heartbeat data at the current moment.

[0115] In one possible implementation mode, the sending module 14 is further used to: generate a heartbeat fluctuation graph based on heartbeat data at multiple consecutive moments including the heartbeat data at the current moment; and send the heartbeat fluctuation graph to the second electronic device based on the first connection between the first electronic device and the second electronic device, so that the second electronic device displays the heartbeat fluctuation graph.

[0116] In one possible implementation, the periodic heartbeat observation device further includes: an establishment module, configured to establish a second connection between the first electronic device and the second electronic device; the second connection is configured to transmit voice data between the first electronic device and the second electronic device.

[0117] In one embodiment, the determining module 12 is further configured to: in response to a disconnection of the second connection between the first electronic device and the second electronic device, determine that the first connection between the first electronic device and the second electronic device is disconnected.

[0118] In one embodiment, the acquisition module 10 is further configured to stop acquiring acceleration data measured by an acceleration sensor in the first electronic device.

[0119] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device and a readable storage medium.

[0120] Figure 9A schematic block diagram of an example electronic device 800 that can be used to implement embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are provided as examples only and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0121] like Figure 9 As shown, the device 800 includes a computing unit 801, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 802 or a computer program loaded from a storage unit 808 into a random access memory (RAM) 803. Various programs and data required for the operation of the device 800 can also be stored in the RAM 803. The computing unit 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0122] Various components in device 800 are connected to I / O interface 805, including an input unit 806, such as a keyboard, mouse, etc.; an output unit 807, such as various types of displays, speakers, etc.; a storage unit 808, such as a magnetic disk, optical disk, etc.; and a communication unit 809, such as a network card, modem, wireless communication transceiver, etc. The communication unit 809 allows device 800 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0123] The computing unit 801 can be any general-purpose and / or specialized processing component with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 801 performs the various methods and processes described above, such as a periodic heartbeat observation method. For example, in some embodiments, a periodic heartbeat observation method can be implemented as a computer software program tangibly embodied in a machine-readable medium, such as the storage unit 808. In some embodiments, part or all of the computer program can be loaded and / or installed onto the device 800 via the ROM 802 and / or the communication unit 809. When the computer program is loaded into the RAM 803 and executed by the computing unit 801, one or more steps of the periodic heartbeat observation method described above can be performed. Alternatively, in other embodiments, the computing unit 801 can be configured to perform a periodic heartbeat observation method in any other suitable manner (e.g., via firmware).

[0124] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip systems (SOCs), programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0125] The program code for implementing the method of the present disclosure can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device so that when the program code is executed by the processor or controller, the functions / operations specified in the flow chart and / or block diagram are implemented. The program code can be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0126] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0127] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0128] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.

[0129] A computer system may include a client and a server. The client and server are generally remote from each other and typically interact through a communication network. The client-server relationship arises through computer programs running on the respective computers and having a client-server relationship with each other. The server may be a cloud server, a server in a distributed system, or a server integrated with a blockchain.

[0130] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this disclosure can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved. This is not limited herein.

[0131] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features being referred to. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. Throughout the present disclosure, "plurality" means two or more, unless otherwise specifically defined.

[0132] The above description is merely a specific embodiment of the present disclosure, but the scope of protection of the present disclosure is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this disclosure should be included in the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure should be based on the scope of protection of the claims.

Claims

1. A periodic heartbeat observation method, characterized in that: The method comprises: In response to triggering an observation instruction, acquiring measured acceleration data of an acceleration sensor in a first electronic device; the observation instruction can establish a first connection between the first electronic device and a second electronic device; Smoothing the measured acceleration data to determine the gravity acceleration data at the current moment; Determining motion acceleration data of the first electronic device at a current moment based on the measured acceleration data and gravity acceleration data at a current moment; Performing data dimensionality reduction on the motion acceleration data of the first electronic device at the current moment to obtain the heartbeat data at the current moment; Based on the first connection between the first electronic device and the second electronic device, sending the current heartbeat data to the second electronic device; The first electronic device is placed in an area on the patient's body surface that is less than a first distance from the patient's heart, and no new application is added to the first electronic device.

2. The method according to claim 1, characterized in that The responding to triggering the observation instruction includes: receiving an observation request sent by the second electronic device, and determining to trigger the observation instruction in response to an observation link in the observation request being triggered; the observation link includes an observation service entrance and first connection information between the first electronic device and the second electronic device; or In response to receiving first connection information between the first electronic device and the second electronic device at the observation service portal, it is determined to trigger the observation instruction.

3. The method according to claim 1, characterized in that The acquiring of acceleration data measured by an acceleration sensor in the first electronic device includes at least one of the following: In response to the first electronic device having a first operating system, obtaining acceleration data measured by an acceleration sensor in the first electronic device based on a sensor manager and a sensor event listener in the first operating system; In response to the first electronic device having a second operating system, obtaining acceleration data measured by an acceleration sensor in the first electronic device based on a core motion framework in the second operating system; In response to the first electronic device having a third operating system, obtaining acceleration data measured by an acceleration sensor in the first electronic device based on a sensor manager in the third operating system; Based on the acceleration sensor monitoring interface in the target application in the first electronic device, measured acceleration data of the acceleration sensor in the first electronic device is obtained.

4. The method according to claim 1, wherein The smoothing process of the measured acceleration data to determine the gravity acceleration data at the current moment includes: Smoothing the measured acceleration data based on the gravity acceleration data at the previous moment by an exponential moving average method or a Kalman filter method to determine the gravity acceleration data at the current moment; or The measured acceleration data is smoothed by at least one of a weighted moving average method, a low-pass filtering method, a Gaussian filtering method, and a median filtering method to determine the gravity acceleration data at the current moment.

5. The method according to claim 1, wherein The determining, based on the measured acceleration data and the gravity acceleration data at the current moment, motion acceleration data of the first electronic device at the current moment includes: The difference between the measured acceleration data and the gravity acceleration data at the current moment is determined as the motion acceleration data of the first electronic device at the current moment.

6. The method according to claim 1, characterized in that The performing data dimensionality reduction on the motion acceleration data of the first electronic device at the current moment to obtain the heartbeat data at the current moment includes: Based on at least one of principal component analysis, independent component analysis, autoencoder method and factor analysis method, data dimension reduction is performed on the motion acceleration data of the first electronic device at the current moment to obtain the heartbeat data at the current moment.

7. The method according to claim 1, characterized in that The sending of the current heartbeat data to the second electronic device includes: Generate a heartbeat fluctuation graph based on heartbeat data at a plurality of consecutive moments including the current moment's heartbeat data; Based on the first connection between the first electronic device and the second electronic device, the heartbeat fluctuation graph is sent to the second electronic device, so that the second electronic device displays the heartbeat fluctuation graph.

8. The method according to any one of claims 1 to 7, characterized in that Before responding to the triggering observation instruction, the method further includes: Establishing a second connection between the first electronic device and the second electronic device; the second connection is used to transmit voice data between the first electronic device and the second electronic device; Accordingly, after sending the heartbeat data at the current moment to the second electronic device, the method further includes: In response to the second connection between the first electronic device and the second electronic device being disconnected, it is determined that the first connection between the first electronic device and the second electronic device is disconnected, and acquisition of measured acceleration data of the acceleration sensor in the first electronic device is stopped.

9. A periodic heartbeat observation device, characterized in that: The device comprises: an acquisition module, configured to acquire acceleration data measured by an acceleration sensor in a first electronic device in response to triggering an observation instruction, wherein the observation instruction can establish a first connection between the first electronic device and a second electronic device; A smoothing module, configured to smooth the measured acceleration data to determine the gravity acceleration data at the current moment; a determination module, configured to determine motion acceleration data of the first electronic device at a current moment based on the measured acceleration data and gravity acceleration data at a current moment; a dimensionality reduction module, configured to perform data dimensionality reduction on the motion acceleration data of the first electronic device at the current moment to obtain the heartbeat data at the current moment; a sending module, configured to send the heartbeat data at a current moment to the second electronic device based on the first connection between the first electronic device and the second electronic device; The first electronic device is placed in an area on the patient's body surface that is less than a first distance from the patient's heart, and no new application is added to the first electronic device.

10. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 8.

Images