Electrocardiogram data monitoring method and device, vehicle and storage medium

Abstract

Embodiments of the present application disclose an electrocardio data monitoring method and device, a vehicle and a storage medium. The method comprises: in a dynamic driving process of a vehicle, in response to a data acquisition instruction, acquiring a steering wheel angle signal of the vehicle and collecting a target image through an image acquisition device, the target image being an image of a driver holding the steering wheel with both hands, and a plurality of electrocardio monitoring sensors being arranged in the steering wheel; determining a first sensor group and a second sensor group from the plurality of electrocardio monitoring sensors based on the steering wheel angle signal and the target image; acquiring first electrocardio data of the driver through the first sensor group and acquiring second electrocardio data of the driver through the second sensor group; and determining target electrocardio data of the driver based on the first electrocardio data, the second electrocardio data and preset electrocardio data. Through the above method, the reliability of the target electrocardio data of the driver can be improved.

Description

TECHNICAL FIELD

[0001] The application belongs to the technical field of vehicles, and particularly relates to an electrocardiogram data monitoring method and device, a vehicle and a storage medium. BACKGROUND

[0002] With the continuous growth of the vehicle population in China, road traffic safety problems are becoming increasingly serious. Data shows that most traffic accidents are caused by the driver himself. In particular, accidents caused by sudden cardiovascular disease of the driver occur from time to time. Therefore, it is necessary to monitor the vital signs of the driver in order to timely understand the driving state and physical condition of the driver and effectively improve the driving safety of the driver. The monitoring of the electrocardiogram (ECG) of the driver is particularly important. The related electrocardiogram monitoring method will lead to the credibility of the collected electrocardiogram data of the driver to be improved due to the hand movement of the driver in the process of dynamically driving the vehicle. SUMMARY

[0003] In view of the above problems, the application provides an electrocardiogram data monitoring method, device, vehicle and storage medium to improve the above problems.

[0004] In a first aspect, an electrocardiogram data monitoring method is provided, which comprises: in a process of dynamic driving of a vehicle, in response to a data acquisition instruction, acquiring a steering wheel angle signal of the vehicle and collecting a target image through an image acquisition device, the target image being an image of a driver holding a steering wheel with both hands, and a plurality of electrocardiogram monitoring sensors being arranged in the middle of the steering wheel; determining a first sensor group and a second sensor group from the plurality of electrocardiogram monitoring sensors based on the steering wheel angle signal and the target image, wherein the first sensor group includes at least two electrocardiogram monitoring sensors with a coverage greater than a coverage threshold, and the second sensor group includes at least two electrocardiogram monitoring sensors with a coverage less than the coverage threshold; acquiring first electrocardiogram data of the driver through the first sensor group and acquiring second electrocardiogram data of the driver through the second sensor group; determining target electrocardiogram data of the driver based on the first electrocardiogram data, the second electrocardiogram data and preset electrocardiogram data, the preset electrocardiogram data being obtained by analyzing basic electrocardiogram data of the driver collected by an electrocardiogram acquisition module when the vehicle is in a static state.

[0005] In a second aspect, an ECG data monitoring device is provided. The device comprises: a first data acquisition unit configured to acquire a steering wheel angle signal of a vehicle and a target image of a driver holding a steering wheel in a dynamic driving process of the vehicle in response to a data acquisition instruction, the target image being an image of the driver holding the steering wheel, and the steering wheel being provided with a plurality of ECG monitoring sensors; a first determination unit configured to determine a first sensor group and a second sensor group from the plurality of ECG monitoring sensors based on the steering wheel angle signal and the target image, wherein the first sensor group comprises at least two ECG monitoring sensors with a coverage greater than a coverage threshold, and the second sensor group comprises at least two ECG monitoring sensors with a coverage less than the coverage threshold; a second data acquisition unit configured to acquire first ECG data of the driver through the first sensor group and second ECG data of the driver through the second sensor group; and a second determination unit configured to determine target ECG data of the driver based on the first ECG data, the second ECG data, and preset ECG data, the preset ECG data being obtained by analyzing basic ECG data of the driver collected by an ECG collection module when the vehicle is in a stationary state.

[0006] In a third aspect, a vehicle is provided. The vehicle comprises one or more processors and a memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to perform the method described above.

[0007] In a fourth aspect, a computer readable storage medium is provided. The computer readable storage medium stores program code, and the program code performs the method described above when executed.

[0008] The embodiment of the present application provides a kind of electrocardiogram data monitoring method, device, vehicle and storage medium.In the process of dynamic driving of vehicle, in response to data acquisition instruction, the steering wheel corner signal of vehicle is acquired, and target image is collected by image acquisition device, the target image is the image that driver holds the steering wheel, the steering wheel is provided with a plurality of electrocardiogram monitoring sensors in the middle, then based on steering wheel corner signal and target image, first sensor group and second sensor group are determined from a plurality of electrocardiogram monitoring sensors, wherein the first sensor group includes at least two electrocardiogram monitoring sensors with coverage greater than coverage threshold, and the second sensor group includes at least two electrocardiogram monitoring sensors with coverage less than the coverage threshold, then the first electrocardiogram data of driver is acquired by first sensor group, the second electrocardiogram data of driver is acquired by second sensor group, and finally, based on the first electrocardiogram data, the second electrocardiogram data and the preset electrocardiogram data, the target electrocardiogram data of driver is determined, and the preset electrocardiogram data is the basic electrocardiogram data of driver collected by electrocardiogram acquisition module when the vehicle is in a stationary state. Through the above method, the accuracy and stability of electrocardiogram data monitoring of driver can be improved, and the credibility of target electrocardiogram data of driver is improved. BRIEF DESCRIPTION OF DRAWINGS

[0009] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0010] Figure 1 A flow chart of an electrocardiogram data monitoring method according to an embodiment of the present application is shown;

[0011] Figure 2 A flow chart of an electrocardiogram data monitoring method according to another embodiment of the present application is shown;

[0012] Figure 3 A flow chart of an electrocardiogram data monitoring method according to another embodiment of the present application is shown;

[0013] Figure 4 A structural block diagram of an electrocardiogram data monitoring device according to an embodiment of the present application is shown;

[0014] Figure 5 A structural block diagram of a vehicle for executing the electrocardiogram data monitoring method according to an embodiment of the present application is shown in the embodiment of the present application;

[0015] Figure 6The storage unit for storing or carrying program codes for implementing the electrocardio data monitoring method according to the embodiments of the present application is shown. DETAILED DESCRIPTION

[0016] The technical solutions in the embodiments of the present application will be clearly and completely described in combination with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work fall within the scope of protection of the present application.

[0017] The embodiments of the present application provide an electrocardio data monitoring method and device, a vehicle and a storage medium. In a dynamic driving process of a vehicle, a steering wheel angle signal of the vehicle is acquired in response to a data acquisition instruction, and a target image is acquired by an image acquisition device, the target image being an image of a driver holding the steering wheel with both hands, a plurality of electrocardio monitoring sensors being arranged in the steering wheel at intervals, then a first sensor group and a second sensor group are determined from the plurality of electrocardio monitoring sensors based on the steering wheel angle signal and the target image, wherein the first sensor group includes at least two electrocardio monitoring sensors with a coverage greater than a coverage threshold, and the second sensor group includes at least two electrocardio monitoring sensors with a coverage less than the coverage threshold, first electrocardio data of the driver is acquired by the first sensor group, second electrocardio data of the driver is acquired by the second sensor group, and finally target electrocardio data of the driver is determined based on the first electrocardio data, the second electrocardio data and preset electrocardio data, the preset electrocardio data being obtained by analyzing basic electrocardio data of the driver acquired by an electrocardio acquisition module when the vehicle is in a static state. Through the above method, the accuracy and stability of electrocardio data monitoring of the driver can be improved, and the credibility of the target electrocardio data of the driver is improved.

[0018] The embodiments of the present application will be described in detail below in combination with the drawings.

[0019] Please refer to Figure 1 The electrocardio data monitoring method provided by the embodiments of the present application comprises the following steps.

[0020] Step S110: In a dynamic driving process of a vehicle, a steering wheel angle signal of the vehicle is acquired in response to a data acquisition instruction, and a target image is acquired by an image acquisition device, the target image being an image of a driver holding the steering wheel with both hands, a plurality of electrocardio monitoring sensors being arranged in the steering wheel at intervals.

[0021] In the embodiment of the present application, the data acquisition instruction is an instruction indicating to start the electrocardiogram data acquisition. The data acquisition instruction can be triggered when a specified operation on a specified control in the vehicle is detected. The specified control in the vehicle can be a control for controlling the intelligent health detection function. When a specified operation on the control for controlling the intelligent health detection function is detected, it can be determined that the data acquisition instruction is triggered. The specified operation can be an operation indicating that the intelligent health detection function is turned on, such as a click operation or a sliding operation, which is not limited here.

[0022] As a way, before detecting whether there is a specified operation on the specified control, it can be detected whether the driver is the vehicle owner. If the driver is the vehicle owner, it is further detected whether there is a specified operation on the specified control.

[0023] When detecting whether the driver is the vehicle owner, the image of the driver can be collected by the image collection device, and the collected image of the driver is compared with the pre-set image to verify whether the driver is the vehicle owner. Specifically, if the similarity between the collected image of the driver and the pre-set image is greater than or equal to the preset similarity, it can be determined that the driver is the vehicle owner; otherwise, if the similarity between the collected image of the driver and the pre-set image is less than the preset similarity, it can be determined that the driver is not the vehicle owner. The image collection device can be a DMS (Driver Monitoring System, driver monitoring system) / OMS (Occupancy Monitoring System, vehicle passenger monitoring system) camera; the pre-set image can be the image of the vehicle owner. The pre-set image can include multiple images of the vehicle owner, which is not limited here; and the preset similarity is the minimum similarity pre-set to represent that the driver corresponding to the image is the vehicle owner.

[0024] Further, when the driver powers on the vehicle, the DMS / OMS system can verify the vehicle owner information by comparing the collected image of the driver with the pre-set image, and return the verification result to the T-Box module, and the T-Box module further sends the verification result to the IVI (In-Vehicle Infotainment, information entertainment system) end; if the verification result indicates that the driver is the vehicle owner, the intelligent health detection system function can be further activated.

[0025] When the vehicle is in dynamic driving process, after detecting that the intelligent health detection function is activated, it can be determined that the data acquisition instruction is triggered, and the steering wheel angle signal of the vehicle at the current time and the target image at the current time collected by the image collection device are acquired.

[0026] The current steering wheel angle signal represents the angle of the steering wheel rotation and can be acquired by a steering wheel angle sensor. Simultaneously, an image of the target is acquired by an image acquisition device.

[0027] The target image is the image of the driver's hands gripping the steering wheel at the moment the steering wheel angle signal is acquired. That is, the target image includes at least the driver's hands and the steering wheel.

[0028] In this embodiment, a plurality of electrocardiogram (ECG) monitoring sensors are spaced apart on the steering wheel of the vehicle. The spacing between any two adjacent ECG monitoring sensors is equal. Furthermore, the multiple ECG monitoring sensors spaced apart on the steering wheel ensure that at least two ECG monitoring sensors are covered / partially covered when a normal person holds one side of the steering wheel. The ECG monitoring sensors can be conductive leather or electrode pads, and no specific limitation is made herein.

[0029] Step S120: Based on the steering wheel angle signal and the target image, determine a first sensor group and a second sensor group from the plurality of ECG monitoring sensors, wherein the first sensor group includes at least two ECG monitoring sensors with coverage greater than a coverage threshold, and the second sensor group includes at least two ECG monitoring sensors with coverage less than the coverage threshold.

[0030] In this embodiment, the coverage threshold can be a pre-set coverage value that divides multiple ECG monitoring sensors with coverage greater than zero at the current time into two equal sensor groups. The first sensor group may include at least two ECG monitoring sensors, which can be the two ECG monitoring sensors with the highest coverage among the multiple ECG monitoring sensors with coverage greater than zero at the current time. The second sensor group may also include at least two ECG monitoring sensors, which can be the remaining ECG monitoring sensors among the multiple ECG monitoring sensors with coverage greater than zero at the current time, excluding the ECG monitoring sensors in the first sensor group. The number of sensors included in the first sensor group is the same as the number of sensors included in the second sensor group.

[0031] After obtaining the steering wheel angle signal at the current moment and the target image, two sensor groups with different confidence levels can be determined from the plurality of electrocardio monitoring sensors based on the steering wheel angle signal at the current moment and the target image. The confidence level refers to the confidence level of the electrocardio data collected by the two sensor groups. The coverage of the electrocardio monitoring sensors in the first sensor group is greater than the coverage of the electrocardio monitoring sensors in the second sensor group. Therefore, it can be considered that the confidence level of the electrocardio data collected by the first sensor group is greater than the confidence level of the electrocardio data collected by the second sensor group, that is, the confidence level of the first sensor group is greater than the confidence level of the second sensor group.

[0032] Step S130: acquiring first electrocardio data of the driver through the first sensor group and acquiring second electrocardio data of the driver through the second sensor group.

[0033] In the embodiments of the present application, after the first sensor group and the second sensor group are determined, the electrocardio data of the driver can be collected through the first sensor group and the second sensor group respectively. When the first electrocardio data of the driver is collected through the first sensor group, at least two electrocardio monitoring sensors included in the first sensor group can be connected in parallel, and the first electrocardio data of the driver is collected through the parallel first sensor group. Similarly, when the second electrocardio data of the driver is collected through the second sensor group, at least two electrocardio monitoring sensors included in the second sensor group can be connected in parallel, and the second electrocardio data of the driver is collected through the parallel second sensor group.

[0034] Step S140: determining target electrocardio data of the driver based on the first electrocardio data, the second electrocardio data and preset electrocardio data, the preset electrocardio data being obtained by analyzing the basic electrocardio data of the driver collected by the electrocardio collection module when the vehicle is in a stationary state.

[0035] In the embodiments of the present application, the preset electrocardio data is obtained by analyzing the basic electrocardio data of the driver collected by the electrocardio collection module when the vehicle is in a stationary state. At this time, the vehicle is in a stationary state, the driver holds the steering wheel with both hands, the electrocardio collection module monitors / collects the basic electrocardio data of the driver in real time, and analyzes the stable electrocardio waveform data to obtain the preset electrocardio data with high reliability. The electrocardio collection module refers to a module composed of a plurality of electrocardio monitoring sensors arranged in the steering wheel. Optionally, the preset electrocardio data can be dynamically updated based on the combination and analysis of the current driver's multiple static test data or dynamic driving monitoring data.

[0036] As a manner, when the preset electrocardio data is determined, when the vehicle is in a static state, the driver holds the steering wheel with both hands, at this time, the landing position interval of the left hand / right hand of the driver on the steering wheel can be recognized and judged by the DMS / OMS camera, so that the first sensor group and the second sensor group can be determined from the plurality of electrocardio monitoring sensors based on the landing position interval of the left hand / right hand of the driver on the steering wheel, the electrocardio data collected by the first sensor group and the second sensor group for a long time, so that the electrocardio data collected by the first sensor group and the second sensor group for a long time can be input into the pre-trained prediction model, so that the prediction model can output the predicted electrocardio data of the driver, that is, the preset electrocardio data.

[0037] In the embodiment of the present application, after obtaining the first electrocardio data and the second electrocardio data at the current time, the target electrocardio data of the driver can be determined based on the first electrocardio data, the second electrocardio data and the preset electrocardio data. The target electrocardio data refers to the electrocardio data of the driver displayed in the mobile terminal.

[0038] When the target electrocardio data of the driver is determined based on the first electrocardio data, the second electrocardio data and the preset electrocardio data, the determination method of the target electrocardio data of the driver will be determined according to whether the first electrocardio data and the second electrocardio data are within the threshold interval. The threshold interval is the threshold interval of the electrocardio data of a normal person.

[0039] As a manner, if the first electrocardio data and the second electrocardio data are both within the threshold interval, the first electrocardio data is taken as the target electrocardio data of the driver; if the first electrocardio data and the second electrocardio data are both not within the threshold interval, the preset electrocardio data is taken as the target electrocardio data of the driver; if one of the first electrocardio data and the second electrocardio data is within the threshold interval, the electrocardio data within the threshold interval is taken as the target electrocardio data of the driver.

[0040] Specifically, the first electrocardio data and the second electrocardio data are compared with two critical values of a threshold interval in sequence, so as to determine whether the first electrocardio data and the second electrocardio data are in the threshold interval. The two critical values include a first critical value and a second critical value, the first critical value is smaller than the second critical value, the first critical value is the minimum electrocardio data in the threshold interval, and the second critical value is the maximum electrocardio data in the threshold interval. If the first electrocardio data is greater than or equal to the first critical value and less than or equal to the second critical value, it can be determined that the first electrocardio data is in the threshold interval, otherwise, if the first electrocardio data is less than the first critical value or greater than the second critical value, it can be determined that the first electrocardio data is not in the threshold interval. Similarly, if the second electrocardio data is greater than or equal to the first critical value and less than or equal to the second critical value, it can be determined that the second electrocardio data is in the threshold interval, otherwise, if the second electrocardio data is less than the first critical value or greater than the second critical value, it can be determined that the second electrocardio data is not in the threshold interval.

[0041] In the above manner, if it is determined that the first electrocardio data and the second electrocardio data are in the threshold interval, the first electrocardio data with higher confidence can be selected as the target electrocardio data of the driver; if it is determined that the first electrocardio data and the second electrocardio data are not in the threshold interval, the preset electrocardio data can be directly selected as the target electrocardio data of the driver; if the first electrocardio data is in the threshold interval and the second electrocardio data is not in the threshold interval, the first electrocardio data can be selected as the target electrocardio data of the driver; if the first electrocardio data is not in the threshold interval and the second electrocardio data is in the threshold interval, the second electrocardio data can be selected as the target electrocardio data of the driver. When the preset electrocardio data is determined as the target electrocardio data of the driver, the time for selecting the preset electrocardio data as the target electrocardio data of the driver is limited, and at this time, the parameters of the plurality of electrocardio monitoring sensors arranged in the middle of the steering wheel can be adjusted, so that the electrocardio monitoring sensors after adjustment can collect electrocardio data with high reliability.

[0042] The electrocardio data monitoring method provided in the application can improve the accuracy and stability of the electrocardio data monitoring of the driver and improve the reliability of the target electrocardio data of the driver.

[0043] Please refer to Figure 2 The electrocardio data monitoring method provided in the application includes:

[0044] In step S210, in response to a data acquisition instruction, it is determined whether the driver's hands are sliding on the steering wheel when the vehicle is in dynamic driving.

[0045] In the embodiment of the present application, when it is detected that the vehicle is in the dynamic driving process, if the data acquisition instruction is detected, it is necessary to first identify whether the driver's hands are sliding on the steering wheel through the DMS / OMS camera. Specifically, a plurality of images can be continuously collected through the DMS / OMS camera, and whether the landing position of the driver's hands on the steering wheel changes is identified according to the plurality of continuously collected images, so as to determine whether the driver's hands are sliding on the steering wheel.

[0046] Step S220: If the driver's hands are not sliding on the steering wheel, the steering wheel angle signal of the vehicle is acquired, and the target image is collected through the image collection device.

[0047] In the embodiment of the present application, when it is determined whether the driver's hands are sliding on the steering wheel through the above-mentioned manner, whether the landing position of the driver's hands on the steering wheel changes can be identified according to the plurality of continuously collected images. If yes, it can be determined that the driver's hands are sliding on the steering wheel, otherwise, it can be determined that the driver's hands are not sliding on the steering wheel.

[0048] When it is determined that the driver's hands are not sliding on the steering wheel, the steering wheel angle signal of the vehicle at the current time can be acquired, and the target image at the current time can be collected through the image collection device.

[0049] Step S230: The target image is input into the pre-trained image recognition model, and an image recognition result output by the image recognition model is acquired, the image recognition result including the planar coordinate points of the driver's left and right hands on the steering wheel.

[0050] In the embodiment of the present application, the image recognition model is a pre-trained model for identifying the planar coordinate points of the driver's hands on the steering wheel. After the target image at the current time is acquired, the target image can be input into the pre-trained image recognition model, and the image recognition result corresponding to the target image output by the image recognition model is acquired.

[0051] Before the target image is input into the pre-trained image recognition model, a training data set is acquired, the training data set including a plurality of training images, and the planar coordinate points of the driver's hands on the steering wheel are labeled in each training image. The training data set is input into a to-be-trained model, and the to-be-trained model is iteratively trained until a training end condition is met, so as to obtain the image recognition model. The training end condition can be set as that the number of iterations reaches a preset number, or the training end condition can be set as that the loss value reaches a preset loss value and no longer decreases.

[0052] In the embodiments of the present application, the planar coordinate points of the left hand and the right hand of the driver on the steering wheel can be used to represent the positions of the left hand and the right hand of the driver on the steering wheel.

[0053] Step S240: determining the landing position area of the left hand and the right hand of the driver on the steering wheel based on the image recognition result and the steering wheel rotation angle signal.

[0054] In the embodiments of the present application, after obtaining the image recognition result of the target image through the image recognition model, the image recognition result and the steering wheel rotation angle signal at the current moment can be combined to determine the landing position area of the left hand and the right hand of the driver on the steering wheel relative to the 0 rotation angle at the current moment. The landing position area of the left hand and the right hand of the driver on the steering wheel can be determined by the boundary coordinate points of the left hand and the boundary coordinate points of the right hand of the driver.

[0055] Step S250: determining the coverage of each of the plurality of electrocardio monitoring sensors based on the landing position area of the left hand and the right hand of the driver on the steering wheel.

[0056] In the embodiments of the present application, after determining the landing position area of the left hand and the right hand of the driver on the steering wheel, the electrocardio monitoring sensors covered by the left hand can be determined according to the landing position area of the left hand of the driver, and the electrocardio monitoring sensors covered by the right hand can be determined according to the landing position area of the right hand of the driver. At this time, since the positions of the electrocardio sensors arranged in the steering wheel are known to the vehicle, and the size of the electrocardio monitoring sensors is fixed, after determining the electrocardio monitoring sensors covered by the left hand of the driver and the electrocardio monitoring sensors covered by the right hand of the driver, the coverage of each of the electrocardio monitoring sensors covered by the left hand of the driver can be further determined according to the landing position area of the left hand of the driver, the coverage of each of the electrocardio monitoring sensors covered by the right hand of the driver can be further determined according to the landing position area of the right hand of the driver, and the coverage of each of the remaining electrocardio monitoring sensors in the steering wheel is 0. The coverage can be understood as the contact area of the left hand and the right hand of the driver with the electrocardio monitoring sensors. The greater the coverage, the greater the contact area of the left hand and the right hand of the driver with the electrocardio monitoring sensors, and vice versa.

[0057] It can be known that the greater the contact area, the more stable the electrocardio data collected by the electrocardio monitoring sensor and the higher the fault tolerance.

[0058] Step S260: determining a first sensor group and a second sensor group from the plurality of electrocardio monitoring sensors based on the coverage of each of the plurality of electrocardio monitoring sensors.

[0059] In the embodiments of the present application, after obtaining the coverage of each of the plurality of electrocardio monitoring sensors in the above manner, the first sensor group and the second sensor group can be determined from the plurality of electrocardio monitoring sensors according to the coverage of each of the plurality of electrocardio monitoring sensors.

[0060] As one way, a plurality of target electrocardio monitoring sensors are determined from the plurality of electrocardio monitoring sensors based on the coverage of each of the plurality of electrocardio monitoring sensors, the plurality of target electrocardio monitoring sensors being the electrocardio monitoring sensors with coverage greater than zero among the plurality of electrocardio monitoring sensors; the target electrocardio monitoring sensors with coverage greater than the coverage threshold among the plurality of target electrocardio monitoring sensors are determined as the first sensor group; and the target electrocardio monitoring sensors with coverage less than the coverage threshold among the plurality of target electrocardio monitoring sensors are determined as the second sensor group.

[0061] Specifically, the electrocardio monitoring sensors with coverage greater than 0 and coverage greater than the coverage threshold among the plurality of electrocardio monitoring sensors are determined as the first sensor group; and the electrocardio monitoring sensors with coverage greater than 0 and coverage less than the coverage threshold among the plurality of electrocardio monitoring sensors are determined as the second sensor group.

[0062] As another way, after obtaining the coverage of each of the plurality of electrocardio monitoring sensors, the plurality of electrocardio monitoring sensors can be sorted in order from high to low or from low to high according to the coverage to obtain the plurality of electrocardio monitoring sensors after sorting; the electrocardio monitoring sensors at a first specified position among the plurality of electrocardio monitoring sensors after sorting are determined as the first sensor group; and the electrocardio monitoring sensors at a second specified position among the plurality of electrocardio monitoring sensors after sorting are determined as the second sensor group. If the sorting is in order from high to low according to the coverage, the first specified position is before the second specified position, for example, the first specified position is at the first 2 positions, and the second specified position is at the 3rd position and the 4th position; otherwise, the first specified position is after the second specified position.

[0063] Step S270: acquiring first electrocardio data of the driver through the first sensor group and acquiring second electrocardio data of the driver through the second sensor group.

[0064] Step S280: determining target electrocardio data of the driver based on the first electrocardio data, the second electrocardio data, and preset electrocardio data, the preset electrocardio data being obtained by analyzing the basic electrocardio data of the driver collected by the electrocardio collection module when the vehicle is in a stationary state.

[0065] In the embodiment of the present application, after obtaining the target electrocardio data, a more comprehensive driver health system can be generated based on the target electrocardio data. Optionally, the target electrocardio data of the driver can be uploaded to the cloud, so that the driver can view the target electrocardio data in real time on the mobile terminal.

[0066] The electrocardio data monitoring method provided in the present application can improve the accuracy and stability of the electrocardio data monitoring of the driver, and improve the reliability of the target electrocardio data of the driver.

[0067] Please refer to Figure 3 The electrocardio data monitoring method provided in the embodiment of the present application comprises:

[0068] Step S310: In the process of dynamic driving of the vehicle, in response to a data acquisition instruction, it is identified whether the hands of the driver are sliding on the steering wheel.

[0069] Step S320: If the hands of the driver are sliding on the steering wheel, the steering wheel rotation angle signal is acquired in real time within a preset time, and the target image is acquired in real time by the image acquisition device.

[0070] In the embodiment of the present application, whether the landing position of the hands of the driver on the steering wheel changes can be identified according to the plurality of images acquired in succession. If there is a change, it is determined that the hands of the driver are sliding on the steering wheel, otherwise, it is determined that the hands of the driver are not sliding on the steering wheel.

[0071] If it is determined that the hands of the driver are sliding on the steering wheel (steering wheel scene) by the above method, the sensor contacted by the left hand / right hand of the driver will be in a switching state all the time. At this time, the steering wheel rotation angle signal and the target image can be acquired in real time within a preset time.

[0072] Step S330: Based on the real-time acquired steering wheel signal and the real-time acquired target image, the first sensor group and the second sensor group are determined in real time from the plurality of electrocardio monitoring sensors.

[0073] In the embodiment of the present application, the first sensor group and the second sensor group can be determined in real time based on the real-time acquired steering wheel rotation angle signal and the target image.

[0074] Step S340: The first electrocardio data of the driver is acquired in real time by the first sensor group determined in real time, and the second electrocardio data of the driver is acquired in real time by the second sensor group determined in real time.

[0075] Step S350: Based on the real-time acquired first electrocardio data and second electrocardio data and the preset electrocardio data, the target electrocardio data of the driver is determined in real time.

[0076] In the embodiment of the present application, the real-time acquisition of electrocardio data can be performed by the first sensor group and the second sensor group determined in real time. The real-time acquired electrocardio data is fused based on the first electrocardio data, the second electrocardio data and the preset electrocardio data to automatically generate a segment of temporary target electrocardio data with high reliability for display, so as to ensure uninterrupted electrocardio data acquisition. The fusion of the first electrocardio data, the second electrocardio data and the preset electrocardio data refers to the fusion process as described in step S140.

[0077] Step S360: If the preset time is exceeded, the real-time electrocardio data acquisition is interrupted.

[0078] In the embodiment of the present application, when the first sensor group and the second sensor group start to acquire electrocardio data, the timing starts. When the timing exceeds the preset time, the real-time electrocardio data acquisition is interrupted.

[0079] The electrocardio data monitoring method provided by the present application can improve the accuracy and stability of the electrocardio data monitoring of the driver, and improve the reliability of the target electrocardio data of the driver.

[0080] Please refer to Figure 4 The electrocardio data monitoring device 400 provided by the embodiment of the present application comprises:

[0081] The first data acquisition unit 410 is configured to, in response to a data acquisition instruction, acquire a steering wheel angle signal of the vehicle and acquire a target image through an image acquisition device when the vehicle is in dynamic driving, the target image being an image of the driver holding the steering wheel with both hands, and the steering wheel being provided with a plurality of electrocardio monitoring sensors in the middle.

[0082] As a way, the first data acquisition unit 410 is specifically configured to, in response to a data acquisition instruction, identify whether the driver's hands are sliding on the steering wheel when the vehicle is in dynamic driving; if the driver's hands are not sliding on the steering wheel, acquire a steering wheel angle signal of the vehicle and acquire a target image through an image acquisition device.

[0083] As another way, the first data acquisition unit 410 is specifically configured to, if the driver's hands are sliding on the steering wheel, acquire a steering wheel angle signal in real time and acquire a target image in real time through the image acquisition device within a preset time.

[0084] The first determining unit 420 is configured to determine a first sensor group and a second sensor group from the plurality of electrocardio monitoring sensors based on the steering wheel angle signal and the target image, wherein the first sensor group includes at least two electrocardio monitoring sensors with a coverage greater than a coverage threshold, and the second sensor group includes at least two electrocardio monitoring sensors with a coverage less than the coverage threshold.

[0085] As a manner, the first determining unit 420 is specifically configured to input the target image into a pre-trained image recognition model, obtain an image recognition result output by the image recognition model, the image recognition result including planar coordinate points of the left hand and the right hand of the driver on the steering wheel; determine a landing position area of the left hand and the right hand of the driver on the steering wheel based on the image recognition result and the steering wheel angle signal; determine respective coverages of the plurality of electrocardio monitoring sensors based on the landing position area of the left hand and the right hand of the driver on the steering wheel; and determine the first sensor group and the second sensor group from the plurality of electrocardio monitoring sensors based on the respective coverages of the plurality of electrocardio monitoring sensors.

[0086] Further, the first determining unit 420 is specifically configured to determine a plurality of target electrocardio monitoring sensors from the plurality of electrocardio monitoring sensors based on the respective coverages of the plurality of electrocardio monitoring sensors, the plurality of target electrocardio monitoring sensors being electrocardio monitoring sensors with a coverage greater than zero in the plurality of electrocardio monitoring sensors; determine target electrocardio monitoring sensors with a coverage greater than the coverage threshold in the plurality of target electrocardio monitoring sensors as the first sensor group; and determine target electrocardio monitoring sensors with a coverage less than the coverage threshold in the plurality of target electrocardio monitoring sensors as the second sensor group.

[0087] As another manner, the first determining unit 420 is specifically configured to determine the first sensor group and the second sensor group from the plurality of electrocardio monitoring sensors in real time based on a real-time acquired steering wheel signal and a real-time acquired target image.

[0088] The second data acquiring unit 430 is configured to acquire first electrocardio data of the driver through the first sensor group and acquire second electrocardio data of the driver through the second sensor group.

[0089] As a manner, the second data acquiring unit 430 is specifically configured to acquire the first electrocardio data of the driver in real time through the first sensor group determined in real time and acquire the second electrocardio data of the driver in real time through the second sensor group determined in real time.

[0090] The second determining unit 440 is configured to determine target electrocardio data of the driver based on the first electrocardio data, the second electrocardio data and preset electrocardio data. The preset electrocardio data is obtained by analyzing basic electrocardio data of the driver collected by the electrocardio collection module when the vehicle is in a stationary state.

[0091] As a manner, the second determining unit 440 is specifically configured to: if the first electrocardio data and the second electrocardio data are both in a threshold interval, take the first electrocardio data as the target electrocardio data of the driver; if the first electrocardio data and the second electrocardio data are both not in the threshold interval, take the preset electrocardio data as the target electrocardio data of the driver; if one of the first electrocardio data and the second electrocardio data is in the threshold interval, take the electrocardio data in the threshold interval as the target electrocardio data of the driver.

[0092] As another manner, the second determining unit 440 is specifically configured to determine the target electrocardio data of the driver in real time based on the first electrocardio data and the second electrocardio data acquired in real time and the preset electrocardio data.

[0093] Optionally, the second determining unit 440 is specifically configured to interrupt the collection of the real-time electrocardio data if the preset time is exceeded.

[0094] It should be noted that the device embodiments in the present application correspond to the foregoing method embodiments, and the specific principles of the device embodiments can be referred to the content in the foregoing method embodiments, which will not be described herein.

[0095] The following will be described in combination with Figure 5 A vehicle is described in the present application.

[0096] Please refer to Figure 5 Based on the foregoing electrocardio data monitoring method and device, the present application further provides another vehicle 800 which can execute the foregoing electrocardio data monitoring method. The vehicle 800 comprises one or more (only one is shown in the figure) processors 802, a memory 804 and a network module 806 which are coupled with each other. The memory 804 stores programs which can execute the content in the foregoing embodiments, and the processor 802 can execute the programs stored in the memory 804.

[0097] The processor 802 can include one or more processing cores. The processor 802 connects various parts within the vehicle 800 through various interfaces and lines, performs various functions of the vehicle 800 and processes data by running or executing instructions, programs, code sets or instruction sets stored in the memory 804, and calling data stored in the memory 804. Alternatively, the processor 802 can be implemented in at least one of a hardware form of a digital signal processing (DSP), a field-programmable gate array (FPGA), and a programmable logic array (PLA). The processor 802 can integrate one or several combinations of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes operating systems, user interfaces, and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used for processing wireless communication. It can be understood that the above-mentioned modem can also not be integrated into the processor 802, but be implemented by a separate communication chip.

[0098] The memory 804 can include a random access memory (RAM) and can also include a read-only memory (ROM). The memory 804 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 804 can include a program storage area and a data storage area, wherein the program storage area can store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing each of the following method embodiments, etc. The data storage area can also store data created by the vehicle 800 in use (such as a phone book, audio and video data, chat record data, etc.).

[0099] The network module 806 is configured to receive and send electromagnetic waves, and to convert electromagnetic waves and electrical signals to each other, so as to communicate with a communication network or other devices, for example, a vehicle. The network module 806 can include various existing circuit elements for performing these functions, for example, an antenna, a radio frequency transceiver, a digital signal processor, an encryption / decryption chip, a subscriber identity module (SIM) card, a memory, and the like. The network module 806 can communicate with various networks such as the Internet, an intranet, a wireless network, or other devices through the wireless network. The wireless network can include a cellular telephone network, a wireless local area network or metropolitan area network. For example, the network module 806 can interact with a base station.

[0100] Reference is made to Figure 6 which shows a structural block diagram of a computer readable storage medium provided by an embodiment of the present application. The computer readable storage medium 900 stores program codes therein, which can be invoked by a processor to execute the methods described in the above method embodiments.

[0101] The computer readable storage medium 900 can be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk or a ROM. Alternatively, the computer readable storage medium 900 includes a non-transitory computer readable medium. The computer readable storage medium 900 has a storage space for program codes 910 for executing any of the method steps described above. These program codes can be read from or written to one or more computer program products. The program codes 910 can be compressed in an appropriate form, for example.

[0102] The application provides an electrocardio data monitoring method and device, a vehicle and a storage medium. In a dynamic driving process of the vehicle, a steering wheel angle signal of the vehicle is acquired in response to a data acquisition instruction, and a target image is acquired by an image acquisition device, the target image being an image of a driver holding the steering wheel, a plurality of electrocardio monitoring sensors are arranged in the steering wheel, a first sensor group and a second sensor group are determined from the plurality of electrocardio monitoring sensors based on the steering wheel angle signal and the target image, the first sensor group including at least two electrocardio monitoring sensors with a coverage greater than a coverage threshold, and the second sensor group including at least two electrocardio monitoring sensors with a coverage less than the coverage threshold, first electrocardio data of the driver is acquired by the first sensor group, second electrocardio data of the driver is acquired by the second sensor group, and target electrocardio data of the driver is determined based on the first electrocardio data, the second electrocardio data and preset electrocardio data, the preset electrocardio data being obtained by analyzing basic electrocardio data of the driver acquired by an electrocardio acquisition module when the vehicle is in a stationary state. By the above method, the accuracy and stability of electrocardio data monitoring of the driver can be improved, and the reliability of the target electrocardio data of the driver is improved.

[0103] The embodiments of the application are described above with reference to the drawings; however, the application is not limited to the specific embodiments described above, and the specific embodiments described above are only illustrative rather than limiting, and a person of ordinary skill in the art can make many forms under the inspiration of the application without departing from the purpose of the application and the scope protected by the claims.

Claims

1. A method of monitoring electrocardiographic data, characterized by, The method comprises: acquiring a steering wheel angle signal of the vehicle and collecting a target image through an image acquisition device in response to a data acquisition instruction while the vehicle is in dynamic driving, the target image being an image of the driver holding the steering wheel with both hands, and a plurality of ECG monitoring sensors being arranged in the middle of the steering wheel; determining a first sensor group and a second sensor group from the plurality of ECG monitoring sensors based on the steering wheel angle signal and the target image, wherein the first sensor group includes at least two ECG monitoring sensors with a coverage greater than a coverage threshold, and the second sensor group includes at least two ECG monitoring sensors with a coverage less than the coverage threshold; the coverage is the contact area of the driver's left and right hands with the ECG monitoring sensors, the greater the coverage, the greater the contact area of the driver's left and right hands with the ECG monitoring sensors, and vice versa, the smaller the coverage, the smaller the contact area of the driver's left and right hands with the ECG monitoring sensors; the coverage threshold is a coverage value preset to divide the plurality of ECG monitoring sensors with a coverage greater than zero at the current time into two sensor groups of equal number; acquiring first ECG data of the driver through the first sensor group and acquiring second ECG data of the driver through the second sensor group; determining target ECG data of the driver based on the first ECG data, the second ECG data, and preset ECG data, the preset ECG data being obtained by analyzing the basic ECG data of the driver collected by the ECG collection module when the vehicle is in a stationary state.

2. The method of claim 1, wherein, The method comprises: inputting the target image into a pre-trained image recognition model to obtain an image recognition result output by the image recognition model, the image recognition result including the planar coordinate points of the driver's left and right hands on the steering wheel; determining the landing position area of the driver's left and right hands on the steering wheel based on the image recognition result and the steering wheel angle signal; determining the coverage of each of the plurality of ECG monitoring sensors based on the landing position area of the driver's left and right hands on the steering wheel; determining a first sensor group and a second sensor group from the plurality of ECG monitoring sensors based on the coverage of each of the plurality of ECG monitoring sensors.

3. The method of claim 2, wherein, The method comprises: determining a plurality of target ECG monitoring sensors from the plurality of ECG monitoring sensors based on the coverage of each of the plurality of ECG monitoring sensors, the plurality of target ECG monitoring sensors being the ECG monitoring sensors in the plurality of ECG monitoring sensors with a coverage greater than zero; determining the target ECG monitoring sensors with a coverage greater than the coverage threshold in the plurality of target ECG monitoring sensors as the first sensor group; The target electrocardio monitoring sensor with a coverage less than the coverage threshold is determined as a second sensor group.

4. The method of claim 1, wherein, The target electrocardio data of the driver is determined based on the first electrocardio data, the second electrocardio data and preset electrocardio data, including: If the first electrocardio data and the second electrocardio data are both in a threshold interval, the first electrocardio data is taken as the target electrocardio data of the driver; If the first electrocardio data and the second electrocardio data are both not in the threshold interval, the preset electrocardio data is taken as the target electrocardio data of the driver; If one of the first electrocardio data and the second electrocardio data is in the threshold interval, the electrocardio data in the threshold interval is taken as the target electrocardio data of the driver.

5. The method of claim 1, wherein, The method further includes: If the driver's hands are not sliding on the steering wheel, the steering wheel angle signal of the vehicle is acquired and the target image is acquired through the image acquisition device. The method further includes:

6. The method of claim 5, wherein, If the driver's hands are sliding on the steering wheel, the steering wheel angle signal is acquired in real time and the target image is acquired in real time through the image acquisition device; The first sensor group and the second sensor group are determined from the plurality of electrocardio monitoring sensors based on the real-time acquired steering wheel angle signal and the real-time acquired target image, including: The first sensor group and the second sensor group are determined from the plurality of electrocardio monitoring sensors in real time based on the real-time acquired steering wheel angle signal and the real-time acquired target image; The first electrocardio data of the driver is acquired through the first sensor group, and the second electrocardio data of the driver is acquired through the second sensor group, including: The first electrocardio data of the driver is acquired in real time through the real-time determined first sensor group, and the second electrocardio data of the driver is acquired in real time through the real-time determined second sensor group; The target electrocardio data of the driver is determined based on the first electrocardio data, the second electrocardio data and preset electrocardio data, including: The target electrocardio data of the driver is determined in real time based on the real-time acquired first electrocardio data and second electrocardio data and the preset electrocardio data. The method further includes:

7. The method of claim 6, wherein, If the preset time is exceeded, the real-time electrocardio data acquisition is interrupted. The device includes:

8. An electrocardiographic data monitoring device, characterized by A first data acquisition unit is configured to acquire the steering wheel angle signal of the vehicle and acquire the target image through the image acquisition device in response to a data acquisition instruction when the vehicle is in a dynamic driving process, the target image being an image of the driver's hands holding the steering wheel, and the steering wheel being provided with a plurality of electrocardio monitoring sensors. ​ The first determining unit is configured to determine a first sensor group and a second sensor group from the plurality of electrocardio monitoring sensors based on the steering wheel angle signal and the target image, wherein the first sensor group comprises at least two electrocardio monitoring sensors with coverage greater than a coverage threshold, and the second sensor group comprises at least two electrocardio monitoring sensors with coverage less than the coverage threshold; the coverage is the contact area of the left and right hands of the driver with the electrocardio monitoring sensors, the greater the coverage, the greater the contact area of the left and right hands of the driver with the electrocardio monitoring sensors, and vice versa, the smaller the coverage, the smaller the contact area of the left and right hands of the driver with the electrocardio monitoring sensors; the coverage threshold is a coverage value preset for dividing the plurality of electrocardio monitoring sensors with coverage greater than zero at the current time into two sensor groups with equal number of sensors; The second data acquisition unit is configured to acquire first electrocardio data of the driver through the first sensor group and second electrocardio data of the driver through the second sensor group; The second determining unit is configured to determine target electrocardio data of the driver based on the first electrocardio data, the second electrocardio data, and preset electrocardio data, wherein the preset electrocardio data is obtained by analyzing the basic electrocardio data of the driver collected by the electrocardio collection module when the vehicle is in a stationary state.

9. A vehicle characterized by comprising: The one or more programs are stored in the memory and configured to be executed by the one or more processors to perform the method of any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, The computer readable storage medium stores program code, wherein the program code is executed by a processor to perform the method of any one of claims 1-7.

Images