Driver health supervision method, device and system and electronic equipment

Abstract

The invention provides a driver health supervision method, device and system and electronic equipment, and belongs to the field of data processing, and the method comprises the steps: carrying out the sampling of each detector installed in a vehicle, and obtaining the numerical values of a plurality of human body features of a vehicle driver at the current moment; obtaining the current health state of the vehicle driver according to the numerical value of the at least one human body feature; when the health state belongs to the dangerous type, determining an improved replenishment of the health state from replenishment currently stored in the replenishment device; and according to the improved replenishment product, sending a replenishment instruction to a replenishment device in the carrier to instruct the replenishment device to push out the improved replenishment product. Therefore, based on the real-time human body characteristic numerical value of the vehicle driver, the improvement supplies matched with the current health state influencing the driving safety are timely distributed to the driver through the supply device, so that the driver can timely intake energy to relieve the health state, thereby effectively preventing or reducing driving accidents, and greatly improving the driving safety and comfort.

Description

Technical Field

[0001] The present invention relates to the field of data processing, and in particular to a driver health monitoring method, device, system and electronic equipment. Background Art

[0002] With the rapid development of automobile technology, the popularity of family cars is increasing, and driving safety has received more and more attention. Among them, the health status of drivers has a profound impact on driving safety. With the acceleration of the pace of modern life and the increase of traffic pressure, the health status of drivers has received more and more attention. During driving, drivers need to maintain a high degree of alertness and quick response ability to deal with various emergencies. However, factors such as fatigue, illness, drug side effects, and mood swings may affect the driver's driving performance, thereby increasing the risk of traffic accidents.

[0003] At present, in order to improve the impact of health problems such as driver fatigue, hypoglycemia or dehydration on driving safety, a driver health monitoring system is usually used to monitor the driver's health status. However, these driver health monitoring systems can only monitor fatigue status, resulting in a large number of safety accidents caused by the driver's health status. Summary of the invention

[0004] In view of this, the purpose of the present invention is to provide a driver health monitoring method, device, system and electronic equipment to comprehensively monitor the driver's physical health and provide an intelligent replenishment system to ensure the driver's health and alertness during long-term driving, thereby improving driving safety and reducing the incidence of safety accidents.

[0005] In order to achieve the above object, the technical solution adopted by the present invention is as follows:

[0006] In a first aspect, the present invention provides a driver health monitoring method, which is applied to a processing device in a vehicle, wherein a supply device and a plurality of detectors are provided in the vehicle, and the processing device is communicatively connected with the supply device and the detector respectively, and the method comprises:

[0007] Sampling each of the detectors to obtain the status monitoring data of the vehicle driver at the current moment; wherein the status monitoring data includes the values ​​of multiple human body characteristics;

[0008] Obtaining the current health status of the vehicle driver according to the value of at least one of the human body characteristics;

[0009] When the health status is of a dangerous type, determining a supply that improves the health status from the supplies currently stored in the supply device;

[0010] Based on the improved supplies, a supply instruction is sent to the supply device; wherein the supply instruction is used to instruct the supply device to push out the improved supplies.

[0011] Optionally, the step of obtaining the current health status of the vehicle driver based on the value of at least one of the human body characteristics includes:

[0012] Based on the standard range of various human body characteristics and the state monitoring data at the current moment, obtaining abnormal characteristics;

[0013] A preset health analysis model is input for each of the abnormal features, and the health status of the vehicle driver is generated using the health analysis model; wherein the health analysis model is a model that learns the relationship between abnormal features of the human body and the health status.

[0014] Optionally, the step of acquiring abnormal features based on the standard range of various human body features and the state monitoring data at the current moment includes:

[0015] For each of the human body features, determining whether the value of the human body feature at the current moment is within the corresponding standard range;

[0016] If not, determine whether the human characteristics belong to long-term monitoring items;

[0017] If the human body feature belongs to a long-term monitoring item, multiple continuous values ​​of the human body feature before the current moment are retrieved, and if none of the multiple continuous values ​​are within the corresponding standard range, the human body feature is regarded as an abnormal feature;

[0018] If the human body feature does not belong to the long-term monitoring item, the human body feature is regarded as an abnormal feature.

[0019] Optionally, the replenishing device comprises a plurality of material storage sub-boxes, a material pushing mechanism disposed in the material storage sub-boxes, and a driving member of the material pushing mechanism, and the processing equipment is communicatively connected with the driving member;

[0020] The step of sending a replenishment instruction to the replenishment device according to the improved replenishment product comprises:

[0021] The storage sub-box storing the improved supplies is used as a target box, and the driving member corresponding to the target box is used as a target control member;

[0022] Output a replenishment instruction to the target control member; wherein the replenishment instruction is used to instruct the driving member to drive the pushing mechanism of the target box to operate.

[0023] Optionally, a central console is further provided on the vehicle, and the processing device is communicatively connected with the central console;

[0024] After the step of determining the health-improving supplement from the supplement currently stored in the supplement device, and before the step of sending a supplement instruction to the supplement device based on the health-improving supplement, the method further includes:

[0025] According to the health status and the improvement supplies, a supply inquiry box is displayed on the center console to ask the vehicle driver whether to refill;

[0026] When the central console receives the replenishment instruction, the step of sending a replenishment instruction to the replenishment device according to the improved supply is executed.

[0027] Optionally, the step of determining the health-improving supplement from the supplements currently stored in the supplement device comprises:

[0028] Recommended substances for improving the health status are found, and from the supplies currently stored in the supply device, supplies belonging to the recommended substances are selected as the supplies for improving the health status.

[0029] Optionally, a detection element is also provided in the storage sub-box;

[0030] After the step of outputting the supply instruction to the target control element, the method further includes:

[0031] Acquire detection data of the detection member, and when the detection data indicates that the vehicle driver has taken out the improvement supply, record supply information on a supply success table according to the health status and the improvement supply;

[0032] After the step of determining the health-improving supplement from the supplement currently stored in the supplement device, and before the step of sending a supplement instruction to the supplement device based on the health-improving supplement, the method further includes:

[0033] Query the replenishment success table to determine whether the replenishment of the improved supplies has been performed within a preset period before the current moment;

[0034] If not, the step of sending a replenishment instruction to the replenishment device according to the improved supply is executed.

[0035] In a second aspect, the present invention provides a driver health monitoring device, which is applied to a processing device installed on a vehicle, wherein a supply device and a plurality of detectors are provided in the vehicle, wherein the processing device is respectively connected to the supply device and the detector for communication, and wherein the driver health monitoring device comprises a monitoring module, a health analysis module, a supply determination module and a supply module;

[0036] The monitoring module is used to sample each of the detectors to obtain the status monitoring data of the vehicle driver at the current moment; wherein the status monitoring data includes the values ​​of multiple human body characteristics;

[0037] The health analysis module is used to obtain the current health status of the vehicle driver according to the value of at least one of the human body characteristics;

[0038] The supply determination module is used to determine the supply that improves the health status from the supplies currently stored in the supply device when the health status belongs to the dangerous type;

[0039] The supply module is used to send a supply instruction to the supply device according to the improved supply; wherein the supply instruction is used to instruct the supply device to push out the improved supply.

[0040] In a third aspect, the present invention provides a driver health monitoring system, comprising a processing device disposed in a vehicle, wherein a supply device and a plurality of detectors are also disposed in the vehicle, wherein the processing device is communicatively connected with the supply device and the detector respectively;

[0041] The detector is used to collect the value of a human body characteristic of the vehicle driver in real time;

[0042] The processing device is used to implement the driver health supervision method as described in the first aspect, so as to send a refueling instruction to the refueling device when the current health status of the vehicle driver belongs to a dangerous type;

[0043] The replenishment device is used to respond to the replenishment instruction and push out the improved supply specified by the replenishment instruction.

[0044] In a fourth aspect, the present invention provides an electronic device, comprising a processor and a memory, wherein the memory stores a computer program that can be executed by the processor, and the processor can execute the computer program to implement the driver health monitoring method as described in the first aspect.

[0045] In a fifth aspect, the present invention provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the driver health monitoring method as described in the first aspect is implemented.

[0046] The driver health monitoring method, device, system and electronic device provided by the embodiment of the present invention include: sampling each detector installed in the vehicle to obtain the status monitoring data of the vehicle driver at the current moment, and the status monitoring data includes the values ​​of multiple human characteristics; according to the value of at least one human characteristic, the current health status of the vehicle driver is obtained; when the health status belongs to the dangerous type, the health status improvement supplies are determined from the supplies currently stored in the supply device; according to the improvement supplies, a supply instruction is sent to the supply device in the vehicle to instruct the supply device to push out the improvement supplies. In this way, the driver's various health states are judged in real time according to the human characteristic values ​​of the vehicle driver, and the improvement supplies that are adapted to the current health state that affects driving safety are distributed to the driver in a timely manner through the supply device, so that the driver can take the improvement supplies in time to alleviate the health condition, thereby effectively preventing or reducing driving accidents caused by health problems, and greatly improving driving safety and comfort.

[0047] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments are briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.

[0049] Figure 1 A schematic diagram of the system architecture of a driver health monitoring system provided by an embodiment of the present invention is shown.

[0050] Figure 2 A schematic structural diagram of a replenishing device provided in an embodiment of the present invention is shown.

[0051] Figure 3 A schematic diagram of a module architecture of an electronic device provided by an embodiment of the present invention is shown.

[0052] Figure 4 One of the flow charts of the driver health monitoring method provided in an embodiment of the present invention is shown.

[0053] Figure 5 Shows Figure 4 Schematic diagram of the process flow of some sub-steps of step 13.

[0054] Figure 6 Shows Figure 5 A flowchart of some sub-steps of step 131 in FIG.

[0055] Figure 7 Shows Figure 4 Schematic diagram of the process of some sub-steps of step 17.

[0056] Figure 8 The second flowchart of the driver health monitoring method provided in the embodiment of the present invention is shown.

[0057] Fig. 9 The third flowchart of the driver health monitoring method provided in the embodiment of the present invention is shown.

[0058] Fig.10 A schematic diagram of the module architecture of a driver health monitoring device provided in an embodiment of the present invention is shown.

[0059] Explanation of the accompanying drawings: 10-driver health monitoring system; 110-processing equipment; 120-supply device; 121-storage sub-box; 122-pushing mechanism; 123-driving member; 130-detector; 140-central console; 20-electronic equipment; 210-memory; 220-processor; 230-communication module; 30-driver health monitoring device; 310-monitoring module; 320-health analysis module; 330-supply determination module; 340-supply module. DETAILED DESCRIPTION

[0060] The following will be combined with the accompanying drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Generally, the components of the embodiments of the present invention described and shown in the drawings here can be arranged and designed in various different configurations.

[0061] Therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the invention claimed for protection, but merely represents selected embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making creative work are within the scope of protection of the present invention.

[0062] It should be noted that relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0063] In order to improve the current driving health detection system that can only monitor fatigue status, which leads to many safety accidents caused by the driver's health status, please refer to Figure 1 An embodiment of the present invention provides a driver health monitoring system 10, including a processing device 110 arranged in a vehicle, and a supply device 120 and a plurality of detectors 130 are also arranged in the vehicle. The processing device 110 can be respectively connected to the supply device 120 and the detector 130 by means of a data cable, Bluetooth, WiFi, etc.

[0064] The vehicle may be, but is not limited to, a car, a truck, a bus, a ship or any other vehicle.

[0065] The detector 130 is used to collect the value of a body characteristic of the vehicle driver in real time.

[0066] For example, the detector 130 includes a heart rate sensor, a blood oxygen sensor, a blood glucose sensor, a fatigue monitoring camera, a body temperature sensor, and a humidity sensor, etc. The heart rate sensor, blood oxygen sensor, blood glucose sensor, and humidity sensor are embedded in the steering wheel of the vehicle, the fatigue monitoring camera is installed on the top of the cockpit, and the body temperature sensor is set on the seat or embedded in the steering wheel. The heart rate sensor collects the heart rate value of the vehicle driver in real time, the blood oxygen sensor collects the blood oxygen saturation of the vehicle driver in real time, the humidity sensor and the body temperature sensor collect the humidity and temperature of the vehicle driver in real time, the blood glucose sensor collects the blood glucose value of the vehicle driver in real time, and the fatigue monitoring camera collects the image of the vehicle driver and identifies the eye closure frequency.

[0067] The processing device 110 is used to implement the driver health monitoring method provided in the embodiment of the present invention, so as to send a replenishment instruction to the replenishment device 120 when the current health status of the vehicle driver belongs to a dangerous type.

[0068] Among them, the types of danger include fatigue, high heart rate, low blood sugar, thirst or slight dehydration, dizziness or malnutrition, excessive stress, long-term driving, low physical strength or any other condition that affects driving safety.

[0069] The supply device 120 is used to respond to the supply instruction and push out the improved supply specified by the supply instruction.

[0070] In order to facilitate the driver to take the improved supplies actively pushed out by the supply device 120 from the supply device 120, the supply device 120 can be set in the armrest area next to the driver's seat of the vehicle or behind the seat. Figure 2 The replenishment device 120 may include a plurality of storage sub-boxes 121, a material pushing mechanism 122 disposed in the storage sub-boxes 121, and a driving member 123 of the material pushing mechanism 122, and the processing device 110 is in communication connection with the driving member 123. The plurality of storage sub-boxes 121 may be integrated in one box body or may be independent of each other, and each storage sub-box 121 may store a kind of replenishment.

[0071] The material pushing mechanism 122 may include a stopper and a movable plate slidably disposed in the material storage sub-box 121. The stopper may be a spring, a rubber band or any other elastic object, one end of the stopper is disposed at the bottom of the box, and the other end is disposed on the movable plate. When the opening of the box is facing upward, the movable plate may move in the height direction of the material storage sub-box 121, and when the opening of the box is perpendicular to the ground, the movable plate may move in the horizontal ground direction.

[0072] The driving member 123 may be an electric cylinder, a pneumatic cylinder, etc. In this case, the output shaft of the electric cylinder or the pneumatic cylinder is connected to the moving plate. The driving member 123 may also be composed of a motor and a push rod, one end of the push rod is matched with the motor gear, and the other end is arranged on the moving plate. The structure of the driving member 123 is only an example, and its specific structure is not limited.

[0073] In this way, after the driving member 123 on the storage sub-box 121 starts working, the movable plate can be driven to move to push out the supplies, or drive the supplies back into the storage sub-box 121. In this process, the limiter ensures that the dispenser moves stably during the replenishment process to avoid excessive or erroneous distribution.

[0074] In addition, in order to facilitate the driver to intervene in control or view relevant data, please continue to refer to Figure 1The driver health monitoring system 10 may further include a central console 140, which may be connected to the processing device 110 via a data line. The central console 140 may be configured with a touch screen and a voice assistant so that the driver can view health data or manually control replenishment by speaking or touching and clicking. The health data includes the raw data collected by each detector 130, and may also include health status, etc.

[0075] It should be noted that the processing device 110 may be a microcontroller unit (MCU) in the vehicle system, or a newly added device. Similarly, the center console 140 may be a center console 140 in the vehicle system, or a newly added device.

[0076] Please refer to Figure 3 , is a block diagram of an electronic device 20. The electronic device 20 includes a memory 210, a processor 220, and a communication module 230. The memory 210, the processor 220, and the communication module 230 are electrically connected to each other directly or indirectly to achieve data transmission or interaction. For example, these components can be electrically connected to each other via one or more communication buses or signal lines.

[0077] The memory 210 is used to store programs or data. The memory 210 may be, but is not limited to, a random access memory (RAM), a read only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), etc.

[0078] The processor 220 is used to read / write data or programs stored in the memory 210 and execute corresponding functions. For example, Figure 1 In the driver health monitoring system 10 shown, the processor 220 of the processing device 110 reads the computer program stored in the memory 210 to implement the driver health monitoring method provided by the embodiment of the present invention.

[0079] The communication module 230 is used to establish a communication connection between the electronic device 20 and other communication terminals, and to send and receive data. Figure 1In the driver health monitoring system 10 shown, the processing device 110 can transmit and receive data with the replenishing device 120 and each detector 130 respectively.

[0080] It should be understood that Figure 3 The structure shown is only a schematic diagram of the structure of the electronic device 20. The electronic device 20 may also include Figure 3 More or fewer components as shown, or with Figure 3 Different configurations are shown. Figure 3 Each component shown in the figure can be implemented by hardware, software or a combination thereof.

[0081] Please refer to Figure 4 , the embodiment of the present invention provides a driver health monitoring method, comprising steps 11 to 17. Figure 1 In the driver health monitoring system 10 shown in FIG. Figure 3 The structure shown implements step 11 to step 17 when the processor 220 executes the computer program stored in the memory 210.

[0082] Step 11, sampling each detector to obtain the status monitoring data of the vehicle driver at the current moment.

[0083] Among them, the status monitoring data includes the numerical values ​​of multiple human characteristics, for example, heart rate value, blood sugar value, blood oxygen saturation, body temperature value, skin humidity, eye closure frequency and any other human characteristic values.

[0084] Step 13, obtaining the current health status of the vehicle driver based on the value of at least one human body characteristic.

[0085] Step 15, when the health status belongs to the dangerous type, determine the supplies that improve the health status from the supplies currently stored in the supply device.

[0086] Step 17, sending a replenishment instruction to the replenishment device based on the improved supplies.

[0087] Among them, the supply instruction is used to instruct the supply device to push out the improved supply.

[0088] For example, in combination Figure 1 In the driver health monitoring system 10 shown, after the vehicle starts and the driver enters the driving mode, each detector 130 obtains the current values ​​of various human characteristics of the vehicle driver in real time, such as heart rate value, blood sugar value, blood oxygen saturation, body temperature value, skin humidity, eyeball closure frequency, and any other human characteristic values. The processing device 110 can continuously sample each detector 130 according to a preset sampling period to obtain the status monitoring data of the vehicle driver at the current moment (i.e., the values ​​of various human characteristics of the vehicle driver at the current moment).

[0089] Thus, the processing device 110 determines the current health status of the vehicle driver (e.g., no problem, fatigued state, high heart rate, hypoglycemia, thirsty or slightly dehydrated state, dizzy or malnourished state, excessive stress, long-term driving state, low physical strength, etc.) based on the value of at least one human characteristic in the status monitoring data. When the health status belongs to any of the dangerous types, the processing device 110 determines the improvement supplies for the health status from the supplies currently stored in the supply device 120, and then sends a supply instruction to the supply device 120 based on the improvement supplies, and the supply instruction specifies the improvement supplies that need to be actively distributed. After receiving the supply instruction, the supply device 120 pushes the improvement supplies out of the supply device 120 based on the improvement supplies specified in the supply instruction for the driver to take out and ingest.

[0090] For example, when a hypoglycemia state is detected, sugary foods are used as supplements to automatically provide sugary foods to prevent the driver from driving safely due to insufficient energy. When fatigue is detected, coffee, green tea, energy drinks, high-protein snacks or dark chocolate are used as supplements to help improve alertness and avoid fatigue driving. When thirst or mild dehydration is detected, mineral water, sports drinks or low-sugar drinks are used as supplements to replenish water and electrolytes to maintain the driver's normal physical fitness and cognitive function.

[0091] When excessive stress or high heart rate is detected, mints, dark chocolate, bananas or caffeinated tea are used as supplements to help relax the nerves and relieve the driver's tension. When it is detected that the driver is driving for a long time, whole wheat bread, oatmeal cookies, nuts, dried fruits, low-fat yogurt or oatmeal bars are used as supplements to help maintain a continuous energy supply and avoid driving fatigue by supplementing foods rich in fiber and protein.

[0092] When the driver is detected to be mildly dizzy or malnourished, multivitamin drinks or juices, low-sugar energy drinks, instant oatmeal or vitamin snacks are used as supplements to replenish vitamins and minerals for the driver, helping the driver to regain sobriety and normal driving state. When the driver's physical strength is detected to be reduced, sports drinks or electrolyte-rich drinks, frozen juice popsicles, salty crackers or cheese sticks are used as supplements to replenish sodium-containing drinks and electrolytes, which helps maintain balance in the body and prevent fatigue caused by dehydration. When driving in cold weather or low temperature environments is detected, hot drinks, high-calorie snacks or carbohydrate-rich foods are used as supplements to provide the driver with more calories to maintain body temperature.

[0093] Compared with the traditional driving health monitoring system, the driver health supervision method provided by the embodiment of the present invention can judge the driver's various health conditions such as no problem, fatigue, high heart rate, hypoglycemia, thirst or mild dehydration, dizziness or malnutrition, excessive stress, long-term driving, low physical strength, etc. according to the vehicle driver's human body characteristic values ​​in real time, and when the current health state is determined to be a dangerous type that affects driving, the supply device promptly distributes improvement supplies that are adapted to the current health state that affects driving safety to the driver, so that the driver can take the improvement supplies in time to alleviate the health condition, thereby effectively preventing or reducing driving accidents caused by health problems and greatly improving driving safety and comfort.

[0094] Among them, the method of determining the current health status of the vehicle driver in step 13 can be flexibly set. For example, the processing device 110 in the driver health monitoring system 10 can be pre-deployed with a health status table, which records the human body characteristics corresponding to various health statuses, so that the processing device 110 can match the current status monitoring data with the health status table, and use the most matching health status as the current health status of the vehicle driver. Alternatively, the status monitoring data is input into a generative large language model, and the generative large language model is used to generate the current health status of the vehicle driver. The above two methods are only examples, and their implementation methods are not limited.

[0095] In order to improve the accuracy and speed of determining the health status, in step 13, the abnormal characteristics are first determined, and then the health analysis model is used to perform a multi-dimensional comprehensive analysis to obtain the concept of the health status. Figure 5 The process of obtaining the health status in step 13 includes steps 131 to 133.

[0096] Step 131, based on the standard range of various human body characteristics and the current state monitoring data, obtain abnormal characteristics.

[0097] Step 133, input each abnormal feature into a preset health analysis model, and use the health analysis model to generate the health status of the vehicle driver.

[0098] Among them, the health analysis model is a model that learns the relationship between abnormal human characteristics and health status, that is, a pre-trained neural network model. During its training, multiple groups of sample data are first obtained, each group of sample data includes multiple abnormal human characteristics, and each group of sample data corresponds to a health state that threatens driving safety. Each group of sample data is labeled with the corresponding health state to obtain a sample set. Using the sample set, the initial neural network model is iteratively trained to obtain a health analysis model with the highest accuracy of prediction results or that meets the requirements.

[0099] By using the pre-trained health analysis model to comprehensively analyze various abnormal features to determine the health status, the accuracy of the analysis results (i.e. health status) can be ensured, while improving the speed of data analysis, thereby ensuring that timely and effective replenishment responses can be made when the driver's current state is dangerous, further improving safety. In addition, when a single indicator exceeds the standard range, it is not immediately judged as a health abnormality. Instead, the above-mentioned multiple abnormal features are comprehensively cross-validated to determine the health status with the support of multiple data, avoiding misjudgment of a single data, greatly improving the accuracy of the health status.

[0100] For example, if the heart rate is too high but the blood sugar and blood oxygen are normal, it may be caused by the driver's nervousness or temporary acceleration, and the system will continue to monitor. If low blood sugar is detected but the heart rate is normal, the system will immediately issue a prompt and provide drinks or food according to the urgency of hypoglycemia. If frequent eye closure (a sign of fatigue) and a low heart rate are detected, the system will infer that the driver is at risk of fatigue and remind him to rest.

[0101] It should be noted that in the above step 131, whether the human body feature is abnormal can be determined based on whether the value of the human body feature at the current moment is within the standard range (i.e., the normal range) of the human body feature. It can also be determined based on whether the values ​​of the human body feature in a preset period before the current moment are all within the standard range (i.e., the normal range). The above methods are all examples, and their implementation methods are not limited.

[0102] In order to more accurately determine whether each human feature is abnormal, a concept of determining whether it is abnormal based on the feature characteristics and the corresponding abnormality determination rules is introduced in step 131. Figure 6 , step 131 may include steps 1311 to 1319.

[0103] Step 1311, for each human body feature, determine whether the value of the human body feature at the current moment is within the corresponding standard range. If yes, execute step 1319, if not, execute step 1313.

[0104] Step 1313, determine whether the human body feature belongs to the long-term monitoring item. If the human body feature belongs to the long-term monitoring item, execute step 1315, if the human body feature does not belong to the long-term monitoring item, execute step 1317.

[0105] Among them, the processing device 110 in the driver health monitoring system 10 can pre-store a human characteristic attribute table. According to the abnormal risk of each human characteristic, the human characteristic attribute table records whether each human characteristic belongs to a long-term monitoring item. That is, human characteristics with high abnormal risk are not long-term monitoring items. As long as the value jumps out of the standard range for a moment, it means that driving danger is very likely to occur, for example, the frequency of eye closure is too high. Human characteristics with lower abnormal risk are long-term monitoring items, such as heart rate, which may be caused by the driver's nervousness or temporary acceleration.

[0106] Step 1315, retrieve multiple continuous values ​​of the human body feature before the current moment, and when the multiple continuous values ​​are not within the corresponding standard range, the human body feature is regarded as an abnormal feature.

[0107] Step 1317, taking the human body features as abnormal features.

[0108] Step 1319, determine whether the human body feature is an abnormal feature.

[0109] Through the above steps 1311 to 1319, for human body features with high abnormal risk, whether they are abnormal features is determined based on the instantaneous value, and for human body features with low abnormal risk, whether they are abnormal features is determined based on the value over a period of time, thereby achieving risk-based and situation-based discrimination, which can not only promptly and effectively respond to possible risks caused by high-risk features, but also make more accurate discriminations on low-risk features, thereby helping to further improve driving safety.

[0110] After the vehicle driver's current health status is determined in the above manner, in step 15, recommended items for improving the health status are queried, and supplies that are recommended are selected from the supplies currently stored in the supply device 120 as supplies for improving the health status.

[0111] Here, a problem description can be generated based on the health status, such as "When the driver is in XXX health status, what supplies are needed?", and the problem description is input into the generative large language model, that is, the generative large language model is queried, and the generative large language model is used to generate recommendations. It is also possible to query the recommended items that improve the current health status of the vehicle driver from the state-supply relationship table that records the relationship between the health status and the supplies. The above method of obtaining the recommended items is only an example, and its implementation method is not limited.

[0112] After the recommended items for improving health status are found, when there are multiple recommended items in the replenishment device 120, one of them can be randomly selected as the improvement supply. In order to improve personalization and user experience, the multiple recommended items can also be displayed on the central console 140 in a variety of ways such as text display and voice broadcast to send a selection query to the driver, such as "You need to replenish, please select one of the following supplies: A; B; C", and after the driver selects, the supply selected by the driver is used as the improvement supply.

[0113] In order to quickly improve the health status of the vehicle driver and enhance safety, the supplement with the highest recommendation degree (i.e., the improvement effect on the health status) among the multiple supplements that are recommended can also be used as the improvement supplement. In this way, the improvement supplement with the strongest improvement effect is preferentially selected to help the vehicle driver quickly improve the current dangerous state.

[0114] It should be noted that the above-mentioned method of determining the improved supplies is only an example, and its implementation method is not limited.

[0115] After determining to improve the supply, in order to avoid misoperation of the supply, the concept of one-to-one precise correspondence between the supply signal and the supply dispensing drive 123 is introduced in step 17. Figure 1 and Figure 2 ,exist Figure 1 In the driver health monitoring system 10 shown in the figure, the supply device 120 includes a plurality of storage boxes 121, a pushing mechanism 122 disposed in the storage box 121, and a driving member 123 of the pushing mechanism 122. The processing device 110 is connected to the driving member 123 of each storage box 121 through an independent port. Figure 7 The process of sending the replenishment instruction in step 17 includes steps 171 to 173.

[0116] Step 171, taking the storage sub-box storing the improved supplies as the target box, and taking the driving component corresponding to the target box as the target control component.

[0117] Step 173, outputting a replenishment instruction to the target control component.

[0118] The replenishment instruction is used to instruct the driving member to drive the pushing mechanism of the target box to move.

[0119] Through the above steps 171 to 173, the driving component 123 of the storage sub-box 121 storing the improved supplies is used as the target control component, so that the processing setting sends the supply instruction directly to the target control component through the connection interface between the processing equipment 110 and the target control component, so as to avoid the supply instruction being mistakenly sent to other driving components 123, thereby ensuring accurate supply.

[0120] When a signal forwarding board is further provided between the processing device 110 and each driving component 123, each driving component 123 may have a unique identifier, and the replenishment instruction may include the identifier of the target control component, so that the signal forwarding board may parse the identifier in the replenishment instruction and forward the replenishment instruction to the driving component 123 corresponding to the identifier, thereby avoiding incorrect replenishment.

[0121] In order to improve the flexibility and humanization of replenishment, a step of asking the driver's opinion before distributing supplies is introduced into the driver health supervision method provided in the embodiment of the present invention. Figure 8 The driver health supervision method also includes step 16A, which is performed after step 15 and before step 17.

[0122] Step 16A, based on the health status and the improvement supplies, a supply inquiry box is displayed on the center console to ask the vehicle driver whether to refuel.

[0123] After the replenishment inquiry box is displayed, if the central console 140 detects that the driver sends a confirmation voice, the driver clicks the confirmation button in the replenishment inquiry box, or there is no response after the waiting time, it is determined that the replenishment instruction is received, and step 17 is executed. If it is detected that the driver sends a non-replenishment instruction, or the driver clicks the non-replenishment button in the replenishment inquiry box, step 17 is not executed.

[0124] Through the above step 16A, the driver's opinion is taken as the basis before replenishment, thereby improving the humanity and flexibility of replenishment.

[0125] In order to avoid repeated replenishment, or re-replenishment before the reaction time, in step 17, the replenishment success information is recorded after each successful replenishment, and the idea of ​​checking whether to re-replenish in a short period of time before each replenishment is considered. Figure 1 In the driver health monitoring system 10 shown in the figure, each storage sub-box 121 is also provided with a detection element which is in communication connection with the processing device 110. On this basis, please continue to refer to Figure 7 , after step 173, further comprising step 175, referring to Fig. 9 , step 16B is also included between step 15 and step 17, and step 16B can be performed after step 16A.

[0126] Step 175, obtaining the inspection data of the inspection piece, when the inspection data indicates that the vehicle driver has taken out the improvement supplies, the supply information is recorded in the supply success table according to the health status and the improvement supplies.

[0127] When the detection member is a pressure sensor arranged on the movable plate, the processing device 110 samples and obtains the pressure value of the pressure sensor in real time. If a pressure value changes at a certain moment after the supply instruction is sent, and the pressure value becomes smaller after this moment, it means that the vehicle driver has taken out the improvement supplies.

[0128] When the detection part is a laser detector arranged at the exit of the storage sub-box 121 and facing the bottom of the storage sub-box 121, the processing device 110 samples and obtains the distance value collected by the laser detector in real time. If the distance value changes at a certain moment after the replenishment instruction is sent, and the distance value increases after this moment, it means that the vehicle driver has taken out the improvement supplies.

[0129] The above two methods of detecting whether the vehicle driver has taken out the improvement supplies are merely examples, and in other embodiments, they may be replaced with any sensor that can detect changes in the quantity of supplies, and are not limited here.

[0130] When it is detected that the vehicle driver has taken out the improvement supplies, the supply information is recorded in the supply success table based on the health status and the improvement supplies. The supply information may include the supply time (the supply time may be the time when the supply instruction is sent), the health status and the improvement supplies, and the three may be recorded in an indexed manner.

[0131] Step 16B, query the replenishment success table to determine whether the replenishment of the improved supplies has been performed within the preset period before the current moment. If not, execute step 17, and if so, execute step 19.

[0132] Step 19, no resupply.

[0133] Through the above method, a replenishment feedback mechanism is added, that is, feedback on the replenishment situation is realized. After the replenishment device 120 performs the replenishment action, a feedback signal is sent to the processing device 110, so that the processing device 110 records the replenishment success information, ensures the replenishment is successfully executed, and avoids repeated replenishment or replenishment again in a short period of time. Therefore, it can avoid over-replenishment and improve safety, and can reduce excessive waste of supplies.

[0134] In addition, the above-mentioned driver health monitoring system 10 and method may also include a function in which the driver actively operates the refueling.

[0135] For example, after the central console 140 detects that the driver clicks the replenishment function on the screen, it displays the currently selectable supplies in the replenishment device 120. When the driver selects one of the supplies, the processing device 110 sends a replenishment instruction to the drive member 123 of the storage sub-box 121 storing the supply, so that the replenishment device 120 actively pushes out the supply.

[0136] Alternatively, after the central console 140 detects that the driver clicks on the health status on the screen, the processing device 110 determines the improvement supplies corresponding to the health status and sends a replenishment instruction to the driving member 123 of the storage subbox 121 storing the improvement supplies, so that the replenishment device 120 actively pushes out the improvement supplies.

[0137] Based on the same concept as the above driver health supervision method, refer to Fig.10 The embodiment of the present invention also provides a driver health monitoring device 30, which can be applied to Figure 1 The processing device 110 in the driver health monitoring system 10 shown includes a monitoring module 310 , a health analysis module 320 , a supply determination module 330 and a supply module 340 .

[0138] The monitoring module 310 is used to sample each detector to obtain the status monitoring data of the vehicle driver at the current moment.

[0139] Among them, the status monitoring data includes the numerical values ​​of multiple human body characteristics.

[0140] The health analysis module 320 is used to obtain the current health status of the vehicle driver based on the value of at least one human body characteristic.

[0141] The supply determination module 330 is used to determine supplies that improve the health status from the supplies currently stored in the supply device when the health status belongs to the dangerous type.

[0142] The supply module 340 is used to send a supply instruction to the supply device according to the improved supply, wherein the supply instruction is used to instruct the supply device to push out the improved supply.

[0143] Furthermore, the driver health monitoring device 30 may also include a supply inquiry module and a supply query module.

[0144] The supply inquiry module is used to display a supply inquiry box on the center console according to the health status and the improved supplies to ask the vehicle driver whether to refuel. If so, the supply module 340 is instructed to send a supply instruction to the supply device according to the improved supplies.

[0145] The replenishment query module is used to query the replenishment success table to determine whether the replenishment of the improved supplies has been performed within the preset period before the current moment. If so, the replenishment module 340 is instructed to send a replenishment instruction to the replenishment device based on the improved supplies.

[0146] The above-mentioned driver health monitoring device 30, under the coordinated action of the monitoring module 310, the health analysis module 320, the supply determination module 330 and the supply module 340, determines the driver's various health conditions such as no problem, fatigue state, high heart rate, hypoglycemia, thirst or slight dehydration, dizziness or malnutrition, excessive stress, long-term driving state, low physical strength state, etc. according to the vehicle driver's human body characteristic values ​​in real time, and when it is determined that the current health state is a dangerous type that affects driving, the supply device promptly distributes improvement supplies that are adapted to the current health state that affects driving safety to the driver, so that the driver can take the improvement supplies in time to alleviate the health condition, thereby effectively preventing or reducing driving accidents caused by health problems and greatly improving driving safety and comfort.

[0147] For the specific implementation and effect of the driver health monitoring device 30, please refer to the description of the implementation of the driver health monitoring method above, such as, for the specific implementation and effect of the monitoring module 310, please refer to the description of the relevant content of step 11 above, for the specific implementation and effect of the health analysis module 320, please refer to the description of the relevant content of step 13 above, for the specific implementation and effect of the supply determination module 330, please refer to the description of the relevant content of step 15 above, and for the specific implementation and effect of the supply module 340, please refer to the description of the relevant content of step 17 above, which will not be repeated here.

[0148] In addition, each module of the driver health monitoring device 30 can be implemented in whole or in part by software, hardware, or a combination thereof. Each module can be embedded in or independent of the processor 220 in the electronic device 20 in the form of hardware, or can be stored in the memory 210 of the electronic device 20 in the form of software, so that the processor 220 can call and execute the operations corresponding to each module to implement the driver health monitoring method provided above.

[0149] An embodiment of the present invention also provides an electronic device 20, including a processor 220 and a memory 210, wherein the memory 210 stores a computer program that can be executed by the processor 220, and the processor 220 can execute the computer program to implement the driver health monitoring method proposed in the embodiment of the present invention.

[0150] The embodiment of the present invention further provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by the processor 220, the driver health monitoring method proposed in the embodiment of the present invention is implemented.

[0151] In summary, the driver monitoring and supervision method, device, system and electronic device provided by the embodiments of the present invention have at least the following beneficial effects:

[0152] (1) By integrating multiple sensor technologies and intelligent algorithms, it can not only monitor the driver's health status, but also provide accurate energy and nutritional supplements in real time to help the driver maintain the best driving condition;

[0153] (2) It can not only detect the driver's fatigue state, but also analyze the driver's overall health status in real time through multi-dimensional health data such as heart rate and blood sugar. Compared with the existing technology that only relies on cameras to monitor fatigue, this solution is more comprehensive and accurate;

[0154] (3) Provide appropriate supplies based on the driver's needs through real-time feedback from status monitoring data to prevent the driver from affecting driving safety due to insufficient energy;

[0155] (4) Provide personalized replenishment plans based on the health conditions of different drivers to ensure the timeliness and effectiveness of replenishment;

[0156] (5) Through the combination of health monitoring and replenishment functions, driving accidents caused by health problems can be effectively prevented, thereby greatly improving driving safety and comfort.

[0157] In several embodiments provided by the present invention, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the devices, methods and computer program products according to multiple embodiments of the present invention. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the module, a program segment or a part of a code contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0158] In addition, the functional modules in the various embodiments of the present invention may be integrated together to form an independent part, or each module may exist independently, or two or more modules may be integrated to form an independent part.

[0159] If the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk or an optical disk.

[0160] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A driver health supervision method, characterized in that: A processing device applied to a vehicle, wherein a supply device and a plurality of detectors are provided in the vehicle, wherein the processing device is communicatively connected with the supply device and the detectors respectively, and the method comprises: Sampling each of the detectors to obtain the status monitoring data of the vehicle driver at the current moment; wherein the status monitoring data includes the values ​​of multiple human body characteristics; Obtaining the current health status of the vehicle driver according to the value of at least one of the human body characteristics; When the health status is of a dangerous type, determining a supply that improves the health status from the supplies currently stored in the supply device; Based on the improved supplies, a supply instruction is sent to the supply device; wherein the supply instruction is used to instruct the supply device to push out the improved supplies.

2. The driver health monitoring method according to claim 1, characterized in that: The step of obtaining the current health status of the vehicle driver based on the value of at least one of the human body characteristics includes: Based on the standard range of various human body characteristics and the state monitoring data at the current moment, obtaining abnormal characteristics; A preset health analysis model is input for each of the abnormal features, and the health status of the vehicle driver is generated using the health analysis model; wherein the health analysis model is a model that learns the relationship between abnormal features of the human body and the health status.

3. The driver health monitoring method according to claim 2, characterized in that: The step of obtaining abnormal characteristics based on the standard range of various human body characteristics and the state monitoring data at the current moment includes: For each of the human body features, determining whether the value of the human body feature at the current moment is within the corresponding standard range; If not, determine whether the human characteristics belong to long-term monitoring items; If the human body feature belongs to a long-term monitoring item, multiple continuous values ​​of the human body feature before the current moment are retrieved, and if none of the multiple continuous values ​​are within the corresponding standard range, the human body feature is regarded as an abnormal feature; If the human body feature does not belong to the long-term monitoring item, the human body feature is regarded as an abnormal feature.

4. The driver health monitoring method according to any one of claims 1 to 3, characterized in that: The replenishing device comprises a plurality of material storage sub-boxes, a material pushing mechanism disposed in the material storage sub-boxes, and a driving member of the material pushing mechanism, and the processing equipment is communicatively connected with the driving member; The step of sending a replenishment instruction to the replenishment device according to the improved replenishment product comprises: The storage sub-box storing the improved supplies is used as a target box, and the driving member corresponding to the target box is used as a target control member; Output a replenishment instruction to the target control member; wherein the replenishment instruction is used to instruct the driving member to drive the pushing mechanism of the target box to operate.

5. The driver health monitoring method according to any one of claims 1 to 3, characterized in that: The carrier is also provided with a central console, and the processing device is communicatively connected with the central console; After the step of determining the health-improving supplement from the supplement currently stored in the supplement device, and before the step of sending a supplement instruction to the supplement device based on the health-improving supplement, the method further includes: According to the health status and the improvement supplies, a supply inquiry box is displayed on the center console to ask the vehicle driver whether to refill; When the central console receives the replenishment instruction, the step of sending a replenishment instruction to the replenishment device according to the improved supply is executed.

6. The driver health monitoring method according to any one of claims 1 to 3, characterized in that: The step of determining the health-improving supplement from the supplements currently stored in the supplement device comprises: Recommended substances for improving the health status are found, and from the supplies currently stored in the supply device, supplies belonging to the recommended substances are selected as the supplies for improving the health status.

7. The driver health monitoring method according to claim 4, characterized in that: A detection element is also provided in the material storage sub-box; After the step of outputting the supply instruction to the target control element, the method further includes: Acquire detection data of the detection member, and when the detection data indicates that the vehicle driver has taken out the improvement supply, record supply information on a supply success table according to the health status and the improvement supply; After the step of determining the health-improving supplement from the supplement currently stored in the supplement device, and before the step of sending a supplement instruction to the supplement device based on the health-improving supplement, the method further includes: Query the replenishment success table to determine whether the replenishment of the improved supplies has been performed within a preset period before the current moment; If not, the step of sending a replenishment instruction to the replenishment device according to the improved supply is executed.

8. A driver health monitoring device, characterized in that: A processing device applied to be installed on a vehicle, wherein a supply device and a plurality of detectors are provided in the vehicle, wherein the processing device is respectively connected to the supply device and the detector for communication, and wherein the driver health monitoring device comprises a monitoring module, a health analysis module, a supply determination module and a supply module; The monitoring module is used to sample each of the detectors to obtain the status monitoring data of the vehicle driver at the current moment; wherein the status monitoring data includes the values ​​of multiple human body characteristics; The health analysis module is used to obtain the current health status of the vehicle driver according to the value of at least one of the human body characteristics; The supply determination module is used to determine the supply that improves the health status from the supplies currently stored in the supply device when the health status belongs to the dangerous type; The supply module is used to send a supply instruction to the supply device according to the improved supply; wherein the supply instruction is used to instruct the supply device to push out the improved supply.

9. A driver health monitoring system, characterized in that: The vehicle comprises a processing device disposed in the carrier, wherein a supply device and a plurality of detectors are also disposed in the carrier, and the processing device is respectively connected to the supply device and the detector for communication; The detector is used to collect the value of a human body characteristic of the vehicle driver in real time; The processing device is used to implement the driver health supervision method according to any one of claims 1 to 7, so as to send a recharging instruction to the recharging device when the current health status of the vehicle driver belongs to a dangerous type; The replenishment device is used to respond to the replenishment instruction and push out the improved supply specified by the replenishment instruction.

10. An electronic device, characterized in that: The invention comprises a processor and a memory, wherein the memory stores a computer program executable by the processor, and the processor can execute the computer program to implement the driver health monitoring method according to any one of claims 1 to 7.

Images