Electrocardiographic data monitoring method and device, vehicle, and storage medium

Abstract

Disclosed in the embodiments of the present application are an electrocardiographic data monitoring method and device, a vehicle, and a storage medium. The method comprises: when a vehicle is in a dynamic driving process, in response to a data acquisition instruction, acquiring a steering wheel angle signal of the vehicle and acquiring a target image by means of an image acquisition device, wherein the target image is an image of a driver holding the steering wheel with both hands, and a plurality of electrocardiogram monitoring sensors are arranged spaced apart in the steering wheel; determining a first sensor group and a second sensor group from the plurality of electrocardiogram monitoring sensors on the basis of the steering wheel angle signal and the target image; acquiring first electrocardiographic data of the driver by means of the first sensor group, and acquiring second electrocardiographic data of the driver by means of the second sensor group; and determining target electrocardiographic data of the driver on the basis of the first electrocardiographic data, the second electrocardiographic data, and preset electrocardiographic data. By means of the described method, the credibility of the target electrocardiographic data of the driver can be improved.

Description

ECG data monitoring methods, devices, vehicles and storage media

[0001] Cross-reference to related applications

[0002] This application claims priority to Chinese application No. 2024105098368, filed on April 25, 2024, the entire contents of which are incorporated herein by reference for all purposes. Technical Field

[0003] This application belongs to the field of vehicle technology, specifically relating to an electrocardiogram (ECG) data monitoring method, device, vehicle, and storage medium. Background Technology

[0004] With the continuous increase in the number of vehicles in my country, road traffic safety issues are becoming increasingly serious. Data shows that most traffic accidents are caused by driver error, especially accidents involving sudden cardiovascular events leading to vehicle destruction and fatalities. Therefore, it is necessary to monitor drivers' vital signs to understand their driving status and physical condition in a timely manner, effectively improving driving safety. Monitoring drivers' electrocardiogram (ECG) signals is particularly important. However, the reliability of ECG data collected during dynamic driving needs improvement, as drivers' hand movements can affect the accuracy of the collected data. Summary of the Invention

[0005] In view of the above problems, this application proposes a method, device, vehicle, and storage medium for monitoring electrocardiogram data to improve the above problems.

[0006] In a first aspect, embodiments of this application provide a method for monitoring electrocardiogram (ECG) data. The method includes: during dynamic driving of a vehicle, in response to a data acquisition command, acquiring a steering wheel angle signal and acquiring a target image via an image acquisition device, wherein the target image is an image of the driver holding the steering wheel with both hands, and a plurality of ECG monitoring sensors are spaced apart on the steering wheel; based on the steering wheel angle signal and the target image, determining a first sensor group and a second sensor group from the plurality of ECG monitoring sensors, wherein the first sensor group includes at least two ECG monitoring sensors with a coverage greater than a coverage threshold, and the second sensor group includes at least two ECG monitoring sensors with a coverage less than the coverage threshold; acquiring first ECG data of the driver through the first sensor group, and acquiring second ECG data of the driver through the second sensor group; and determining target ECG data of the driver based on the first ECG data, the second ECG data, and preset ECG data, wherein the preset ECG data is obtained by analyzing the driver's basic ECG data acquired by the ECG acquisition module when the vehicle is stationary.

[0007] Secondly, embodiments of this application provide an electrocardiogram (ECG) data monitoring device, comprising: a first data acquisition unit, configured to acquire a steering wheel angle signal of the vehicle and acquire a target image via an image acquisition device in response to a data acquisition command during dynamic driving of the vehicle, wherein the target image is an image of the driver holding the steering wheel with both hands, and a plurality of ECG monitoring sensors are spaced apart in the steering wheel; a first determination unit, configured to determine a first sensor group and a second sensor group from the plurality of ECG monitoring sensors based on the steering wheel angle signal and the target image, wherein the first sensor group includes at least two ECG monitoring sensors with a coverage greater than a coverage threshold, and the second sensor group includes at least two ECG monitoring sensors with a coverage less than the coverage threshold; a second data acquisition unit, configured to acquire first ECG data of the driver through the first sensor group and second ECG data of the driver through the second sensor group; and a second determination unit, configured to determine target ECG data of the driver based on the first ECG data, the second ECG data, and preset ECG data, wherein the preset ECG data is obtained by analyzing the driver's basic ECG data acquired by the ECG acquisition module when the vehicle is stationary.

[0008] Thirdly, embodiments of this application provide a vehicle including one or more processors and a memory; one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to perform the methods described above.

[0009] Fourthly, embodiments of this application provide a computer-readable storage medium storing program code, wherein the above-described method is executed when the program code is run.

[0010] This application provides a method, device, vehicle, and storage medium for monitoring electrocardiogram (ECG) data. During vehicle operation, in response to a data acquisition command, the system acquires the steering wheel angle signal and a target image (image of the driver holding the steering wheel with both hands) via an image acquisition device. Multiple ECG monitoring sensors are spaced apart on the steering wheel. Based on the steering wheel angle signal and the target image, a first sensor group and a second sensor group are determined from the multiple ECG monitoring sensors. The first sensor group includes at least two ECG monitoring sensors with coverage greater than a coverage threshold, and the second sensor group includes at least two ECG monitoring sensors with coverage less than the coverage threshold. First ECG data of the driver is acquired through the first sensor group, and second ECG data is acquired through the second sensor group. Finally, based on the first ECG data, the second ECG data, and preset ECG data, target ECG data of the driver is determined. The preset ECG data is obtained by analyzing the driver's basic ECG data acquired by the ECG acquisition module when the vehicle is stationary. This method improves the accuracy and stability of driver ECG data monitoring and enhances the reliability of the driver's target ECG data. Attached Figure Description

[0011] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0012] Figure 1 shows a flowchart of an electrocardiogram data monitoring method according to an embodiment of this application;

[0013] Figure 2 shows a flowchart of an electrocardiogram data monitoring method according to another embodiment of this application;

[0014] Figure 3 shows a flowchart of an electrocardiogram data monitoring method according to another embodiment of this application;

[0015] Figure 4 shows a structural block diagram of an electrocardiogram data monitoring device according to an embodiment of this application;

[0016] Figure 5 shows a structural block diagram of a vehicle used to perform the electrocardiogram data monitoring method according to an embodiment of this application;

[0017] Figure 6 shows a storage unit in an embodiment of this application for storing or carrying program code that implements the electrocardiogram data monitoring method according to an embodiment of this application. Detailed Implementation

[0018] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0019] This application proposes a method, device, vehicle, and storage medium for monitoring electrocardiogram (ECG) data. During vehicle operation, in response to a data acquisition command, the system acquires the steering wheel angle signal and a target image (image of the driver holding the steering wheel with both hands) via an image acquisition device. Multiple ECG monitoring sensors are spaced apart on the steering wheel. Based on the steering wheel angle signal and the target image, a first sensor group and a second sensor group are determined from the multiple ECG monitoring sensors. The first sensor group includes at least two ECG monitoring sensors with coverage greater than a coverage threshold, and the second sensor group includes at least two ECG monitoring sensors with coverage less than the coverage threshold. First ECG data of the driver is acquired through the first sensor group, and second ECG data is acquired through the second sensor group. Finally, based on the first ECG data, the second ECG data, and preset ECG data, target ECG data of the driver is determined. The preset ECG data is obtained by analyzing the driver's basic ECG data acquired by the ECG acquisition module when the vehicle is stationary. This method improves the accuracy and stability of monitoring the driver's ECG data and enhances the reliability of the driver's target ECG data.

[0020] The embodiments of this application will now be described in detail with reference to the accompanying drawings.

[0021] Please refer to Figure 1. An embodiment of this application provides a method for monitoring electrocardiogram (ECG) data, the method comprising:

[0022] Step S110: During the dynamic driving process of the vehicle, in response to the data acquisition command, the steering wheel angle signal of the vehicle is acquired and the target image is acquired through the image acquisition device. The target image is an image of the driver holding the steering wheel with both hands. Multiple electrocardiogram monitoring sensors are arranged at intervals in the steering wheel.

[0023] In this embodiment, the data acquisition instruction is an instruction to begin acquiring electrocardiogram (ECG) data. This data acquisition instruction can be triggered when a specified operation is detected on a specified control within the vehicle. The specified control within the vehicle can be a control used to control the intelligent health monitoring function. When a specified operation is detected on this control, it can be determined that the data acquisition instruction has been triggered. The specified operation can be an operation that instructs the intelligent health monitoring function to be activated, such as a click or swipe operation, and is not specifically limited here.

[0024] As one approach, before detecting whether a specified operation applies to a specified control, you can first detect whether the driver is the vehicle owner. If the driver is the vehicle owner, then you can then detect whether a specified operation applies to the specified control.

[0025] When detecting whether a driver is the vehicle owner, an image acquisition device can be used to capture the driver's image. This captured image is then compared with pre-set images to verify the driver's ownership. Specifically, if the similarity between the captured driver's image and the pre-set image is greater than or equal to a preset similarity score, the driver is confirmed to be the vehicle owner; conversely, if the similarity is less than the preset similarity score, the driver is not confirmed to be the vehicle owner. The image acquisition device can be a DMS (Driver Monitoring System) / OMS (Occupancy Monitoring System) camera; the pre-set images can be images of the vehicle owner, and may include multiple images of the owner, without specific limitations; the preset similarity score is the minimum similarity score required for the driver to be the vehicle owner when represented by a pre-set image.

[0026] Furthermore, when the driver powers on the vehicle, the DMS / OMS system can verify the vehicle owner's information by comparing the captured image of the driver with a pre-set image and send the verification result back to the T-Box module. The T-Box module then sends the verification result to the IVI (In-Vehicle Infotainment) terminal. If the verification result indicates that the driver is the vehicle owner, the "Intelligent Health Detection System" function can be activated.

[0027] When the vehicle is in dynamic driving, once the intelligent health detection function is activated, it can be determined that a data acquisition command has been triggered, and the vehicle's steering wheel angle signal at the current moment and the target image at the current moment can be acquired through the image acquisition device.

[0028] The current steering wheel angle signal represents the angle of the steering wheel rotation and can be acquired by a steering wheel angle sensor. Simultaneously, an image of the target is acquired by an image acquisition device.

[0029] The target image is the image of the driver's hands gripping the steering wheel at the moment the steering wheel angle signal is acquired. That is, the target image includes at least the driver's hands and the steering wheel.

[0030] In this embodiment, a plurality of electrocardiogram (ECG) monitoring sensors are spaced apart on the steering wheel of the vehicle. The spacing between any two adjacent ECG monitoring sensors is equal. Furthermore, the multiple ECG monitoring sensors spaced apart on the steering wheel ensure that at least two ECG monitoring sensors are covered / partially covered when a normal person holds one side of the steering wheel. The ECG monitoring sensors can be conductive leather or electrode pads, and no specific limitation is made herein.

[0031] Step S120: Based on the steering wheel angle signal and the target image, determine a first sensor group and a second sensor group from the plurality of ECG monitoring sensors, wherein the first sensor group includes at least two ECG monitoring sensors with coverage greater than a coverage threshold, and the second sensor group includes at least two ECG monitoring sensors with coverage less than the coverage threshold.

[0032] In this embodiment, the coverage threshold can be a pre-set coverage value that divides multiple ECG monitoring sensors with coverage greater than zero at the current time into two equal sensor groups. The first sensor group may include at least two ECG monitoring sensors, which can be the two ECG monitoring sensors with the highest coverage among the multiple ECG monitoring sensors with coverage greater than zero at the current time. The second sensor group may also include at least two ECG monitoring sensors, which can be the remaining ECG monitoring sensors among the multiple ECG monitoring sensors with coverage greater than zero at the current time, excluding the ECG monitoring sensors in the first sensor group. The number of sensors included in the first sensor group is the same as the number of sensors included in the second sensor group.

[0033] After obtaining the steering wheel angle signal and target image at the current moment, two sensor groups with different confidence levels can be determined from multiple ECG monitoring sensors based on these signals. Here, confidence level refers to the confidence level of the ECG data collected by the two sensor groups. The coverage of the ECG monitoring sensors in the first sensor group is greater than the coverage of the ECG monitoring sensors in the second sensor group. Therefore, it can be considered that the confidence level of the ECG data collected by the first sensor group is greater than the confidence level of the ECG data collected by the second sensor group; that is, the confidence level of the first sensor group is greater than the confidence level of the second sensor group.

[0034] Step S130: Obtain the driver's first electrocardiogram data through the first sensor group, and obtain the driver's second electrocardiogram data through the second sensor group.

[0035] In this embodiment, after determining the first sensor group and the second sensor group, the driver's electrocardiogram (ECG) data can be collected using the first sensor group and the second sensor group, respectively. Specifically, when collecting the driver's first ECG data using the first sensor group, at least two ECG monitoring sensors included in the first sensor group can be connected in parallel, and the first ECG data can be collected using the parallel-connected first sensor group. Similarly, when collecting the driver's second ECG data using the second sensor group, at least two ECG monitoring sensors included in the second sensor group can be connected in parallel, and the second ECG data can be collected using the parallel-connected second sensor group.

[0036] Step S140: Based on the first ECG data, the second ECG data, and the preset ECG data, determine the target ECG data of the driver. The preset ECG data is obtained by analyzing the basic ECG data of the driver collected by the ECG acquisition module when the vehicle is stationary.

[0037] In this embodiment, the preset ECG data is obtained by analyzing the driver's basic ECG data collected by the ECG acquisition module when the vehicle is stationary. At this time, the vehicle is stationary, the driver's hands are on the steering wheel, and the ECG acquisition module monitors / collects the driver's basic ECG data in real time, analyzing it based on stable ECG waveform data to obtain highly reliable preset ECG data. The ECG acquisition module refers to a module composed of multiple ECG monitoring sensors installed in the steering wheel. Optionally, the preset ECG data can be dynamically updated based on a combination of multiple static test data or dynamic driving monitoring data from the current driver.

[0038] In one approach, when determining preset ECG data, if the vehicle is stationary and the driver is holding the steering wheel with both hands, the DMS / OMS camera can identify the position range of the driver's left / right hand on the steering wheel. Based on this position range, a first sensor group and a second sensor group can be selected from multiple ECG monitoring sensors. By collecting ECG data from the first and second sensor groups over a long period, the collected ECG data can be input into a pre-trained prediction model. This prediction model can then output the driver's predicted ECG data, i.e., the preset ECG data.

[0039] In this embodiment of the application, after obtaining the first ECG data and the second ECG data at the current moment, the driver's target ECG data can be determined based on the first ECG data, the second ECG data and the preset ECG data. The target ECG data refers to the driver's ECG data displayed on the mobile terminal.

[0040] When determining the driver's target ECG data based on the first ECG data, the second ECG data, and preset ECG data, the determination method for the driver's target ECG data is determined by whether the first ECG data and the second ECG data are within a threshold range. The threshold range is a preset threshold range for ECG data of normal individuals.

[0041] In one approach, if both the first and second ECG data are within a threshold range, the first ECG data is used as the driver's target ECG data; if neither the first nor the second ECG data is within the threshold range, the preset ECG data is used as the driver's target ECG data; if either the first or the second ECG data is within the threshold range, the ECG data within the threshold range is used as the driver's target ECG data.

[0042] Specifically, the first and second ECG data points are compared sequentially with two threshold values ​​within a threshold interval to determine whether they fall within that interval. The two threshold values ​​are a first threshold value and a second threshold value. The first threshold value is less than the second threshold value. The first threshold value is the minimum ECG data point within the threshold interval, and the second threshold value is the maximum ECG data point within the threshold interval. If the first ECG data point is greater than or equal to the first threshold value and less than or equal to the second threshold value, it is determined that the first ECG data point is within the threshold interval. Conversely, if the first ECG data point is less than the first threshold value or greater than the second threshold value, it is determined that the first ECG data point is not within the threshold interval. Similarly, if the second ECG data point is greater than or equal to the first threshold value and less than or equal to the second threshold value, it is determined that the second ECG data point is within the threshold interval. Conversely, if the second ECG data point is less than the first threshold value or greater than the second threshold value, it is determined that the second ECG data point is not within the threshold interval.

[0043] Using the above method, if both the first and second ECG data points are determined to be within the threshold range, the first ECG data with higher confidence can be selected as the driver's target ECG data. If neither the first nor the second ECG data points are within the threshold range, the preset ECG data can be directly used as the driver's target ECG data. If the first ECG data is within the threshold range but the second ECG data is not, the first ECG data can be used as the driver's target ECG data. If the first ECG data is not within the threshold range but the second ECG data is, the second ECG data can be used as the driver's target ECG data. However, when the first and second ECG data are determined to be outside the threshold range and the preset ECG data is used as the driver's target ECG data, the time available for using the preset data is limited. In this case, the parameters of the multiple ECG monitoring sensors spaced at intervals along the steering wheel can be adjusted so that the adjusted ECG monitoring sensors can collect ECG data with high confidence.

[0044] The present application provides a method for monitoring electrocardiogram (ECG) data, which can improve the accuracy and stability of monitoring driver ECG data and enhance the reliability of the driver's target ECG data.

[0045] Please refer to Figure 2. An embodiment of this application provides a method for monitoring electrocardiogram (ECG) data, the method comprising:

[0046] Step S210: During the dynamic driving process of the vehicle, in response to the data acquisition command, it is identified whether the driver's hands are sliding on the steering wheel.

[0047] In this embodiment, when the vehicle is detected to be in dynamic driving, if a data acquisition command is detected, it is necessary to first identify whether the driver's hands are sliding on the steering wheel using a DMS / OMS camera. Specifically, multiple images can be continuously acquired by the DMS / OMS camera, and the position of the driver's hands on the steering wheel can be identified based on the continuously acquired images to determine whether the driver's hands are sliding on the steering wheel.

[0048] Step S220: If the driver's hands are not sliding on the steering wheel, acquire the vehicle's steering wheel angle signal and acquire the target image through the image acquisition device.

[0049] In this embodiment of the application, when determining whether the driver's hands are sliding on the steering wheel in the above manner, the position of the driver's hands on the steering wheel can be identified by continuously collecting multiple images. If there is a change, it can be determined that the driver's hands are sliding on the steering wheel; otherwise, it can be determined that the driver's hands are not sliding on the steering wheel.

[0050] Once it is determined that the driver's hands are not slipping on the steering wheel, the steering wheel angle signal of the vehicle at the current moment can be obtained, and the target image at the current moment can be acquired through the image acquisition device.

[0051] Step S230: Input the target image into a pre-trained image recognition model and obtain the image recognition result output by the image recognition model. The image recognition result includes the planar coordinate points of the driver's left and right hands on the steering wheel.

[0052] In this embodiment, the image recognition model is a pre-trained model used to identify the planar coordinates of the driver's hands on the steering wheel. After acquiring the target image at the current moment, the target image can be input into the pre-trained image recognition model to obtain the image recognition result corresponding to the target image output by the image recognition model.

[0053] Before inputting the target image into the pre-trained image recognition model, a training dataset is obtained. This training dataset includes multiple training images, each labeled with the planar coordinates of the driver's hands on the steering wheel. The training dataset is then input into the model to be trained, and the model is iteratively trained until a training termination condition is met, resulting in the image recognition model. The training termination condition can be set to the number of iterations reaching a preset number, or it can be set to the loss value reaching a preset loss value and no longer decreasing.

[0054] In this embodiment of the application, the planar coordinate points of the driver's left and right hands on the steering wheel can be used to characterize the positions of the driver's left and right hands on the steering wheel.

[0055] Step S240: Based on the image recognition result and the steering wheel angle signal, determine the landing point area of ​​the driver's left and right hands on the steering wheel.

[0056] In this embodiment, after obtaining the image recognition result of the target image through the image recognition model, the image recognition result can be combined with the steering wheel angle signal at the current moment to determine the landing point area of ​​the driver's left and right hands on the steering wheel at the current moment relative to 0 angle. The landing point area of ​​the driver's left and right hands on the steering wheel can be determined by the boundary coordinate points of the driver's left and right hands.

[0057] Step S250: Determine the coverage of each of the plurality of ECG monitoring sensors based on the location of the driver's left and right hands on the steering wheel.

[0058] In this embodiment, after determining the landing positions of the driver's left and right hands on the steering wheel, the ECG monitoring sensor covered by the driver's left hand can be determined based on the landing position of the driver's left hand, and the ECG monitoring sensor covered by the driver's right hand can be determined based on the landing position of the driver's right hand. Since the positions of the ECG sensors in the steering wheel are known about the vehicle and their sizes are fixed, after determining the ECG monitoring sensors covered by the driver's left and right hands, the coverage of each ECG monitoring sensor covered by the driver's left hand can be further determined based on the landing position of the driver's left hand, and the coverage of each ECG monitoring sensor covered by the driver's right hand can be determined based on the landing position of the driver's right hand. The coverage of the remaining uncovered ECG monitoring sensors in the steering wheel is 0. Coverage can be understood as the contact area between the driver's left and right hands and the ECG monitoring sensors; a larger coverage area results in a larger contact area between the driver's left and right hands and the ECG monitoring sensors, and vice versa.

[0059] It is known that the larger the contact area of ​​an ECG monitoring sensor, the more stable the ECG data it collects and the higher its fault tolerance.

[0060] Step S260: Based on the coverage of each of the plurality of ECG monitoring sensors, determine the first sensor group and the second sensor group from the plurality of ECG monitoring sensors.

[0061] In this embodiment of the application, after obtaining the coverage of each of the multiple ECG monitoring sensors in the above manner, the first sensor group and the second sensor group can be determined from the ECG monitoring sensors based on the coverage of each of the multiple ECG monitoring sensors.

[0062] In one approach, based on the coverage of each of the plurality of ECG monitoring sensors, a plurality of target ECG monitoring sensors are determined from the plurality of ECG monitoring sensors, wherein the plurality of target ECG monitoring sensors are ECG monitoring sensors with a coverage greater than zero among the plurality of ECG monitoring sensors; among the plurality of target ECG monitoring sensors, the target ECG monitoring sensors with a coverage greater than the coverage threshold are determined as a first sensor group; and among the plurality of target ECG monitoring sensors, the target ECG monitoring sensors with a coverage less than the coverage threshold are determined as a second sensor group.

[0063] Specifically, the ECG monitoring sensors with coverage greater than 0 and coverage greater than the coverage threshold among the multiple ECG monitoring sensors are determined as the first sensor group; the ECG monitoring sensors with coverage greater than 0 and coverage less than the coverage threshold among the multiple ECG monitoring sensors are determined as the second sensor group.

[0064] As another approach, after obtaining the coverage of multiple ECG monitoring sensors, they can be sorted according to coverage from high to low or low to high, resulting in a sorted set of ECG monitoring sensors. The ECG monitoring sensors ranked at a first designated position are defined as the first sensor group; the ECG monitoring sensors ranked at a second designated position are defined as the second sensor group. Specifically, if the sorting is based on coverage from high to low, the first designated position precedes the second designated position; for example, the first designated position might be the first two positions, and the second designated positions might be the third and fourth positions. Conversely, if the sorting is based on coverage from high to low, the first designated position follows the second designated position.

[0065] Step S270: Obtain the driver's first electrocardiogram data through the first sensor group, and obtain the driver's second electrocardiogram data through the second sensor group.

[0066] Step S280: Based on the first ECG data, the second ECG data, and the preset ECG data, determine the target ECG data of the driver. The preset ECG data is obtained by analyzing the basic ECG data of the driver collected by the ECG acquisition module when the vehicle is stationary.

[0067] In this embodiment, after obtaining the target ECG data, a more comprehensive vehicle owner health system can be generated based on the target ECG data. Optionally, the driver's target ECG data can also be uploaded to the cloud, allowing the driver to view the target ECG data in real time on a mobile terminal.

[0068] The present application provides a method for monitoring electrocardiogram (ECG) data, which can improve the accuracy and stability of monitoring driver ECG data and enhance the reliability of the driver's target ECG data.

[0069] Please refer to Figure 3. An embodiment of this application provides a method for monitoring electrocardiogram (ECG) data, the method comprising:

[0070] Step S310: During the dynamic driving process of the vehicle, in response to the data acquisition command, it is identified whether the driver's hands are sliding on the steering wheel.

[0071] Step S320: If the driver's hands slide on the steering wheel, the steering wheel angle signal is acquired in real time within a preset time, and the target image is acquired in real time through the image acquisition device.

[0072] In this embodiment, the position of the driver's hands on the steering wheel can be identified based on multiple continuously acquired images. If a change occurs, it can be determined that the driver's hands are sliding on the steering wheel; otherwise, it can be determined that the driver's hands are not sliding on the steering wheel.

[0073] If the driver's hands are sliding on the steering wheel (steering scenario) using the above method, the sensor that the driver's left / right hand is in contact with will be constantly switching. At this time, the steering wheel angle signal and target image can be acquired in real time within a preset time period.

[0074] Step S330: Based on the real-time acquired steering wheel signal and the real-time acquired target image, determine the first sensor group and the second sensor group from the plurality of ECG monitoring sensors in real time.

[0075] In this embodiment of the application, the first sensor group and the second sensor group can be determined in real time based on the real-time acquired steering wheel angle signal and target image.

[0076] Step S340: The driver's first electrocardiogram data is acquired in real time through a first sensor group determined in real time, and the driver's second electrocardiogram data is acquired in real time through a second sensor group determined in real time.

[0077] Step S350: Based on the real-time acquired first and second ECG data and the preset ECG data, determine the driver's target ECG data in real time.

[0078] In this embodiment, ECG data can be acquired in real time using a first sensor group and a second sensor group determined in real time. The acquired ECG data is then fused based on the first ECG data, the second ECG data, and preset ECG data to automatically generate a temporary, highly reliable target ECG data segment for display, ensuring uninterrupted ECG data acquisition. The fusion of the first ECG data, the second ECG data, and the preset ECG data refers to the fusion process described in step S140.

[0079] Step S360: If the preset time is exceeded, interrupt the real-time ECG data acquisition.

[0080] In this embodiment of the application, when ECG data collection begins through the first sensor group and the second sensor group, a timer is started. When the timer exceeds a preset time, the real-time ECG data collection is interrupted.

[0081] The present application provides a method for monitoring electrocardiogram (ECG) data, which can improve the accuracy and stability of monitoring driver ECG data and enhance the reliability of the driver's target ECG data.

[0082] Please refer to Figure 4. An embodiment of this application provides an electrocardiogram (ECG) data monitoring device 400, which includes:

[0083] The first data acquisition unit 410 is used to acquire the steering wheel angle signal of the vehicle and acquire a target image through an image acquisition device in response to a data acquisition command when the vehicle is in dynamic driving. The target image is an image of the driver holding the steering wheel with both hands. Multiple electrocardiogram monitoring sensors are arranged at intervals in the steering wheel.

[0084] In one manner, the first data acquisition unit 410 is specifically used to, in response to a data acquisition command, identify whether the driver's hands are sliding on the steering wheel while the vehicle is in dynamic driving; if the driver's hands are not sliding on the steering wheel, acquire the vehicle's steering wheel angle signal and acquire a target image through an image acquisition device.

[0085] In another manner, the first data acquisition unit 410 is specifically used to acquire the steering wheel angle signal in real time and acquire the target image in real time through the image acquisition device if the driver's hands slide on the steering wheel within a preset time.

[0086] The first determining unit 420 is used to determine a first sensor group and a second sensor group from the plurality of electrocardiogram (ECG) monitoring sensors based on the steering wheel angle signal and the target image, wherein the first sensor group includes at least two ECG monitoring sensors with coverage greater than a coverage threshold, and the second sensor group includes at least two ECG monitoring sensors with coverage less than the coverage threshold.

[0087] In one approach, the first determining unit 420 is specifically used to input the target image into a pre-trained image recognition model, obtain the image recognition result output by the image recognition model, the image recognition result including the planar coordinate points of the driver's left and right hands on the steering wheel; based on the image recognition result and the steering wheel angle signal, determine the landing position area of ​​the driver's left and right hands on the steering wheel; based on the landing position area of ​​the driver's left and right hands on the steering wheel, determine the coverage of each of the plurality of ECG monitoring sensors; based on the coverage of each of the plurality of ECG monitoring sensors, determine the first sensor group and the second sensor group from the plurality of ECG monitoring sensors.

[0088] Furthermore, the first determining unit 420 is specifically used to determine a plurality of target ECG monitoring sensors from the plurality of ECG monitoring sensors based on the coverage of each of the plurality of ECG monitoring sensors, wherein the plurality of target ECG monitoring sensors are ECG monitoring sensors with a coverage greater than zero among the plurality of ECG monitoring sensors; determine the target ECG monitoring sensors with a coverage greater than the coverage threshold among the plurality of target ECG monitoring sensors as a first sensor group; and determine the target ECG monitoring sensors with a coverage less than the coverage threshold among the plurality of target ECG monitoring sensors as a second sensor group.

[0089] Alternatively, the first determining unit 420 is specifically used to determine the first sensor group and the second sensor group from the plurality of electrocardiogram monitoring sensors in real time based on the real-time acquired steering wheel signal and the real-time acquired target image.

[0090] The second data acquisition unit 430 is used to acquire the driver's first electrocardiogram data through the first sensor group and to acquire the driver's second electrocardiogram data through the second sensor group.

[0091] In one manner, the second data acquisition unit 430 is specifically used to acquire the driver's first electrocardiogram data in real time through a first sensor group determined in real time, and to acquire the driver's second electrocardiogram data in real time through a second sensor group determined in real time.

[0092] The second determining unit 440 is used to determine the target electrocardiogram (ECG) data of the driver based on the first ECG data, the second ECG data, and preset ECG data. The preset ECG data is obtained by analyzing the driver's basic ECG data collected by the ECG acquisition module when the vehicle is stationary.

[0093] In one manner, the second determining unit 440 is specifically configured to: if both the first ECG data and the second ECG data are within a threshold range, then use the first ECG data as the target ECG data for the driver; if neither the first ECG data nor the second ECG data are within the threshold range, then use the preset ECG data as the target ECG data for the driver; if either the first ECG data or the second ECG data is within the threshold range, then use the ECG data within the threshold range as the target ECG data for the driver.

[0094] Alternatively, the second determining unit 440 is specifically used to determine the driver's target electrocardiogram data in real time based on the first and second electrocardiogram data acquired in real time and the preset electrocardiogram data.

[0095] Optionally, the second determining unit 440 is specifically used to interrupt real-time ECG data acquisition if the preset time is exceeded.

[0096] It should be noted that the device embodiments in this application correspond to the aforementioned method embodiments. The specific principles in the device embodiments can be found in the content of the aforementioned method embodiments, and will not be repeated here.

[0097] The following description, in conjunction with Figure 5, will illustrate one type of vehicle provided in this application.

[0098] Referring to Figure 5, based on the above-described ECG data monitoring method and apparatus, this application embodiment also provides another vehicle 800 capable of executing the aforementioned ECG data monitoring method. The vehicle 800 includes one or more (only one shown in the figure) processors 802, a memory 804, and a network module 806 coupled together. The memory 804 stores programs capable of executing the contents of the aforementioned embodiments, and the processor 802 can execute the programs stored in the memory 804.

[0099] The processor 802 may include one or more processing cores. The processor 802 connects to various parts of the vehicle 800 via various interfaces and lines, and performs various functions and processes data of the vehicle 800 by running or executing instructions, programs, code sets, or instruction sets stored in the memory 804, and by calling data stored in the memory 804. Optionally, the processor 802 may be implemented using at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), or Programmable Logic Array (PLA). The processor 802 may integrate one or a combination of several of the following: Central Processing Unit (CPU), Graphics Processing Unit (GPU), and modem. The CPU primarily handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the displayed content; and the modem handles wireless communication. It is understood that the modem may also not be integrated into the processor 802 and may be implemented separately through a communication chip.

[0100] The memory 804 may include random access memory (RAM) or read-only memory (ROM). The memory 804 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 804 may include a program storage area and a data storage area. The program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as touch functionality, sound playback functionality, image playback functionality, etc.), and instructions for implementing the various method embodiments described below. The data storage area may also store data created by the vehicle 800 during use (such as phonebooks, audio and video data, chat log data, etc.).

[0101] The network module 806 is used to receive and transmit electromagnetic waves, realizing the mutual conversion between electromagnetic waves and electrical signals, thereby communicating with communication networks or other devices, such as communicating with vehicles. The network module 806 may include various existing circuit elements for performing these functions, such as antennas, radio frequency transceivers, digital signal processors, encryption / decryption chips, user identity modules (SIM cards), memory, etc. The network module 806 can communicate with various networks such as the Internet, corporate intranets, and wireless networks, or communicate with other devices through wireless networks. The aforementioned wireless networks may include cellular telephone networks, wireless local area networks (WLANs), or metropolitan area networks (MANs). For example, the network module 806 can interact with base stations.

[0102] Please refer to Figure 6, which shows a structural block diagram of a computer-readable storage medium provided in an embodiment of this application. The computer-readable storage medium 900 stores program code that can be called by a processor to execute the methods described in the above method embodiments.

[0103] The computer-readable storage medium 900 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read-Only Memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium 900 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 900 has storage space for program code 910 that performs any of the method steps described above. This program code can be read from or written to one or more computer program products. The program code 910 may be compressed, for example, in a suitable form.

[0104] This application provides a method, device, vehicle, and storage medium for monitoring electrocardiogram (ECG) data. During vehicle operation, in response to a data acquisition command, the system acquires the steering wheel angle signal and a target image (image of the driver holding the steering wheel with both hands) via an image acquisition device. Multiple ECG monitoring sensors are spaced apart on the steering wheel. Based on the steering wheel angle signal and the target image, a first sensor group and a second sensor group are determined from the multiple ECG monitoring sensors. The first sensor group includes at least two ECG monitoring sensors with coverage greater than a coverage threshold, and the second sensor group includes at least two ECG monitoring sensors with coverage less than the coverage threshold. First ECG data of the driver is acquired through the first sensor group, and second ECG data is acquired through the second sensor group. Finally, based on the first ECG data, the second ECG data, and preset ECG data, target ECG data of the driver is determined. The preset ECG data is obtained by analyzing the driver's basic ECG data acquired by the ECG acquisition module when the vehicle is stationary. This method improves the accuracy and stability of ECG data monitoring and enhances the reliability of the driver's target ECG data.

[0105] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. A method for monitoring electrocardiogram (ECG) data, characterized in that, The method includes: During the dynamic driving process of the vehicle, in response to the data acquisition command, the steering wheel angle signal of the vehicle is acquired and the target image is acquired through the image acquisition device. The target image is an image of the driver holding the steering wheel with both hands. Multiple electrocardiogram monitoring sensors are arranged at intervals in the steering wheel. Based on the steering wheel angle signal and the target image, a first sensor group and a second sensor group are determined from the plurality of electrocardiogram (ECG) monitoring sensors, wherein the first sensor group includes at least two ECG monitoring sensors with coverage greater than a coverage threshold, and the second sensor group includes at least two ECG monitoring sensors with coverage less than the coverage threshold. The driver's first electrocardiogram (ECG) data is acquired through the first sensor group, and the driver's second ECG data is acquired through the second sensor group. Based on the first ECG data, the second ECG data, and the preset ECG data, the target ECG data of the driver is determined. The preset ECG data is obtained by analyzing the basic ECG data of the driver collected by the ECG acquisition module when the vehicle is stationary.

2. The method according to claim 1, characterized in that, The step of determining the first sensor group and the second sensor group from the plurality of electrocardiogram monitoring sensors based on the steering wheel angle signal and the target image includes: The target image is input into a pre-trained image recognition model to obtain the image recognition result output by the image recognition model. The image recognition result includes the planar coordinate points of the driver's left and right hands on the steering wheel. Based on the image recognition results and the steering wheel angle signal, the location areas of the driver's left and right hands on the steering wheel are determined; The coverage of each of the plurality of electrocardiogram monitoring sensors is determined based on the location of the driver's left and right hands on the steering wheel. Based on the coverage of each of the plurality of ECG monitoring sensors, a first sensor group and a second sensor group are determined from the plurality of ECG monitoring sensors.

3. The method according to claim 2, characterized in that, The step of determining a first sensor group and a second sensor group from the plurality of ECG monitoring sensors based on their respective coverage includes: Based on the coverage of each of the plurality of ECG monitoring sensors, a plurality of target ECG monitoring sensors are determined from the plurality of ECG monitoring sensors, wherein the plurality of target ECG monitoring sensors are ECG monitoring sensors with a coverage greater than zero among the plurality of ECG monitoring sensors; Among the plurality of target ECG monitoring sensors, the target ECG monitoring sensors with a coverage greater than the coverage threshold are determined as the first sensor group; Among the plurality of target ECG monitoring sensors, the target ECG monitoring sensors with a coverage less than the coverage threshold are identified as the second sensor group.

4. The method according to claim 1, characterized in that, The step of determining the driver's target ECG data based on the first ECG data, the second ECG data, and preset ECG data includes: If both the first ECG data and the second ECG data are within the threshold range, then the first ECG data will be used as the target ECG data for the driver. If neither the first ECG data nor the second ECG data is within the threshold range, then the preset ECG data will be used as the driver's target ECG data. If either the first ECG data or the second ECG data falls within the threshold range, the ECG data within the threshold range will be used as the target ECG data for the driver.

5. The method according to claim 1, characterized in that, During the dynamic driving process of the vehicle, in response to a data acquisition command, the process of acquiring the vehicle's steering wheel angle signal and acquiring a target image via an image acquisition device includes: While the vehicle is in dynamic driving, in response to a data acquisition command, it is determined whether the driver's hands are sliding on the steering wheel; If the driver's hands are not sliding on the steering wheel, the steering wheel angle signal of the vehicle is acquired and the target image is acquired through the image acquisition device.

6. The method according to claim 5, characterized in that, The method further includes: If the driver's hands slide on the steering wheel, the steering wheel angle signal is acquired in real time within a preset time, and the target image is acquired in real time through the image acquisition device. The step of determining the first sensor group and the second sensor group from the plurality of electrocardiogram monitoring sensors based on the steering wheel angle signal and the target image includes: Based on the real-time acquired steering wheel signal and the real-time acquired target image, the first sensor group and the second sensor group are determined in real time from the multiple electrocardiogram monitoring sensors; The step of acquiring the driver's first electrocardiogram (ECG) data through the first sensor group and acquiring the driver's second ECG data through the second sensor group includes: The driver's first electrocardiogram (ECG) data is acquired in real time by a first sensor group determined in real time, and the driver's second ECG data is acquired in real time by a second sensor group determined in real time. The step of determining the driver's target ECG data based on the first ECG data, the second ECG data, and preset ECG data includes: Based on the real-time acquired first and second electrocardiogram (ECG) data and the preset ECG data, the driver's target ECG data is determined in real time.

7. The method according to claim 6, characterized in that, The method further includes: If the preset time is exceeded, real-time ECG data acquisition will be interrupted.

8. An electrocardiogram (ECG) data monitoring device, characterized in that, The device includes: The first data acquisition unit is used to acquire the steering wheel angle signal of the vehicle and acquire the target image through the image acquisition device in response to the data acquisition command when the vehicle is in dynamic driving. The target image is an image of the driver holding the steering wheel with both hands. Multiple electrocardiogram monitoring sensors are arranged at intervals in the steering wheel. The first determining unit is configured to determine a first sensor group and a second sensor group from the plurality of electrocardiogram (ECG) monitoring sensors based on the steering wheel angle signal and the target image, wherein the first sensor group includes at least two ECG monitoring sensors with coverage greater than a coverage threshold, and the second sensor group includes at least two ECG monitoring sensors with coverage less than the coverage threshold. The second data acquisition unit is used to acquire the driver's first electrocardiogram data through the first sensor group and to acquire the driver's second electrocardiogram data through the second sensor group. The second determining unit is used to determine the target electrocardiogram (ECG) data of the driver based on the first ECG data, the second ECG data, and preset ECG data. The preset ECG data is obtained by analyzing the driver's basic ECG data collected by the ECG acquisition module when the vehicle is stationary.

9. A vehicle, characterized in that, It includes one or more processors; one or more programs are stored in the memory and configured to be executed by the one or more processors according to any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores program code, wherein the program code, when executed by a processor, performs the method according to any one of claims 1-7.

Images