In-vehicle person health monitoring method, device and equipment and storage medium

Abstract

The invention provides an in-vehicle personnel health monitoring method, device and equipment and a storage medium, and the method comprises the steps: obtaining the number of in-vehicle personnel and the passenger state data, determining the health recognition state level of each in-vehicle personnel according to the passenger state data, and if at least one health recognition state level is greater than or equal to a preset abnormal level threshold, determining the abnormal state of each in-vehicle personnel; if yes, calling for help and warning according to an abnormity warning strategy matched with the number of people whose health identification state levels are greater than or equal to a preset abnormity level threshold value and the number of people in the vehicle; according to the method, the health condition of the person in the vehicle is evaluated, the distress warning process can be triggered in time according to the health recognition state level, the delay of sending the distress signal is shortened, the monitoring abnormity warning strategy is matched according to different abnormal person numbers and the total number of the person in the vehicle, an adaptive warning mode can be adopted, and the safety of the vehicle is improved. And people in the vehicle can be timely rescued and treated when the health crisis suddenly occurs.

Description

Technical Field

[0001] The present application relates to the field of intelligent cockpits, and particularly to a method, device, equipment and storage medium for monitoring the health of in-vehicle personnel. Background Technique

[0002] With the booming development of the economy, the popularity of vehicles has been increasing day by day. Whether it is for daily commuting, shopping trips, long-distance travel, or business trips, vehicles have provided great convenience to people. People spend more and more time in the vehicle. In the current situation where the contact time is continuously extended, the safety guarantee problem that the vehicle can give users has always been the key direction of scientific research and industrial development. For a long time, significant progress has been made in the technological innovation and development in aspects such as in-vehicle personnel collision protection and driving stability, which can provide driving safety protection for in-vehicle users in real-time during the vehicle driving state. However, the key area of in-vehicle personnel health guarantee in the static environment has long been on the fringe of technological development.

[0003] Although the current vehicle health monitoring system is equipped with some basic safety devices, it has obvious shortcomings. It is difficult to deeply and accurately insight into the health status of in-vehicle personnel, and the coverage of the monitoring scenario is narrow, mostly only applicable to the vehicle driving stage, seriously ignoring the health risks that occupants may encounter in other scenarios such as vehicle parking. When an in-vehicle personnel has a sudden health crisis, the existing system can neither detect and accurately judge the condition in time, nor quickly and effectively activate the emergency rescue mechanism, nor can it provide comprehensive and key health information for the rescue force, resulting in the delay of the rescue opportunity and the limitation of the rescue effect. Summary of the Invention

[0004] The purpose of the embodiments of the present invention is to provide a method, device, equipment and storage medium for monitoring the health of in-vehicle personnel to solve the above technical problems.

[0005] The present invention provides a method for monitoring the health of in-vehicle personnel. The method for monitoring the health of in-vehicle personnel includes: obtaining the number of in-vehicle personnel and the occupant status data of each person in the vehicle; determining the health identification status level of each person in the vehicle according to the respective occupant status data, where the health identification status level is used to represent the abnormal degree of the health status of in-vehicle personnel; if there is at least one person in the vehicle whose health identification status level is greater than or equal to a preset abnormal level threshold, then a distress warning is given according to the number of people whose health identification status level is greater than or equal to the preset abnormal level threshold and an abnormal warning strategy matching the number of in-vehicle personnel.

[0006] In an embodiment of the present invention, performing a distress warning according to an abnormal warning strategy in which the number of people with a health recognition status level greater than or equal to a preset abnormal level threshold matches the number of people in the vehicle includes: if the number of people with a health recognition status level greater than or equal to the preset abnormal level threshold is equal to the number of people in the vehicle, execute a first abnormal warning strategy; if the number of people with a health recognition status level greater than or equal to the preset abnormal level threshold is less than the number of people in the vehicle, execute a second abnormal warning strategy.

[0007] In an embodiment of the present invention, executing the first abnormal warning strategy includes: generating a control instruction based on preset rescue interaction information and sending it to the in-vehicle computer, so that the in-vehicle computer makes a notification according to the control instruction and starts timing from the moment the notification is sent; if a feedback from the people in the vehicle is received within a preset emergency distress time range, execute a distress inquiry process to obtain occupant distress inquiry information, and perform a distress warning according to the occupant distress inquiry information. The distress inquiry process includes at least one set of distress inquiry instructions for display on the in-vehicle computer. The occupant distress inquiry information includes distress warning method information and reported content information. The distress warning method information includes remote distress and local distress; if no feedback from the people in the vehicle is received within the preset emergency distress time range, obtain the current vehicle position information, and perform a distress warning through both remote distress and local distress based on the respective occupant status data and the current vehicle position information.

[0008] In an embodiment of the present invention, executing the second abnormal warning strategy includes: generating a control instruction based on preset rescue interaction information and sending it to the in-vehicle computer, so that the in-vehicle computer makes a notification according to the control instruction and starts timing from the moment the notification is sent; if a feedback from the people in the vehicle is received within a preset emergency distress time range, execute a help inquiry process to obtain occupant help inquiry information, and perform a distress warning according to the occupant help inquiry information. The help inquiry process includes at least one set of help inquiry instructions for display on the in-vehicle computer. The occupant help inquiry information includes remote distress demand information; if no feedback from the people in the vehicle is received within the preset emergency distress time range, perform a distress warning on the occupant status data of the people with a health recognition status level greater than or equal to the preset abnormal level threshold through local distress.

[0009] In an embodiment of the present invention, after performing a distress warning on the occupant status data of the people with a health recognition status level greater than or equal to the preset abnormal level threshold through local distress, the method for monitoring the health of the people in the vehicle further includes: starting timing from the start moment of the local distress; if no distress response feedback is received within a preset distress determination time threshold range, obtain the current vehicle position information, and perform a distress warning through remote distress based on the respective occupant status data and the current vehicle position information.

[0010] In an embodiment of the present invention, the occupant status data includes physiological data, behavioral data, environmental data, and medical history data. Determining the health identification status level of each person in the vehicle according to each occupant status data includes: matching the current monitoring index information in a preset medical monitoring index library according to the environmental data, and determining a health status determination coefficient according to the medical history data, where the medical history data represents historical record data of the hospital diagnosis results when the occupant seeks medical treatment; adjusting the parameters of a preset health assessment model according to the current monitoring index information and the health status determination coefficient to obtain a target health assessment model; inputting the physiological data and behavioral data into the target health assessment model to obtain a health identification assessment score; and determining the health identification status level based on the preset health status level division rule information and the health identification assessment score.

[0011] In an embodiment of the present invention, the remote call for help includes encapsulating each occupant status data and the current vehicle position information into a call for help data packet, and sending the call for help data packet to a preset emergency rescue communication terminal; the local call for help includes unlocking the vehicle, adjusting the in-vehicle environment control parameters, and waking up the vehicle machine for sound and light alarms.

[0012] An embodiment of the present invention further provides an in-vehicle personnel health monitoring device, including: a multi-source data acquisition module, configured to acquire the number of in-vehicle personnel and the occupant status data of each person in the vehicle; a data processing and analysis module, configured to determine the health identification status level of each person in the vehicle according to each occupant status data, where the health identification status level is used to represent the abnormal degree of the health status of the in-vehicle personnel, and the health identification status level increases as the abnormal degree of the health status of the in-vehicle personnel increases; and an emergency call for help execution module, configured to, if there is at least one person in the vehicle whose health identification status level is greater than or equal to a preset abnormal level threshold, perform a call for help warning according to an abnormal warning strategy that matches the number of people whose health identification status level is greater than or equal to the preset abnormal level threshold and the number of in-vehicle personnel.

[0013] An embodiment of the present invention further provides an electronic device, including: one or more processors; a storage device, configured to store one or more programs, and when the one or more programs are executed by the one or more processors, enable the electronic device to implement the in-vehicle personnel health monitoring method according to any one of the above embodiments.

[0014] An embodiment of the present invention further provides a computer-readable storage medium, on which computer-readable instructions are stored, and when the computer-readable instructions are executed by a processor of a computer, enable the computer to execute the in-vehicle personnel health monitoring method according to any one of the above embodiments.

[0015] A method, device, equipment and storage medium for monitoring the health of vehicle occupants provided by the present invention obtain the number of vehicle occupants and the occupant status data of each occupant in the vehicle, determine the health identification status level of each person in the vehicle according to the occupant status data, and if there is at least one person in the vehicle whose health identification status level is greater than or equal to the preset abnormal level threshold, a distress warning is given according to the abnormal warning strategy that matches the number of people whose health identification status level is greater than or equal to the preset abnormal level threshold and the number of vehicle occupants; this application accurately evaluates the health status of vehicle occupants through the health identification status level, and can quickly trigger the distress warning process according to the health identification status level, shortening the time from the occurrence of a health crisis to the sending of a distress signal, winning more sufficient time for rescue, and giving a distress warning according to the abnormal warning strategy that matches the number of different abnormal people and the total number of vehicle occupants, and can adopt an appropriate warning method according to the specific situation to ensure that vehicle occupants receive timely rescue and treatment in the event of a sudden health crisis, reducing the life risks and injuries caused by health problems.

[0016] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit this application. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The drawings here are incorporated into the specification and constitute a part of this specification, showing the embodiments in line with this application, and are used together with the specification to explain the principles of this application. Obviously, the drawings in the following description are only some embodiments of this application, and those of ordinary skill in the art can obtain other drawings according to these drawings without creative efforts. In the drawings:

[0018] Figure 1 is a schematic diagram of an exemplary system architecture shown in an exemplary embodiment of this application;

[0019] Figure 2 is a flowchart of a method for monitoring the health of vehicle occupants shown in an exemplary embodiment of this application;

[0020] Figure 3 is a schematic diagram of a device for monitoring the health of vehicle occupants shown in an exemplary embodiment of this application;

[0021] Figure 4 is a schematic diagram of the structure of a computer system of an electronic device shown in an exemplary embodiment of this application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0022] The embodiments of the present invention will be described below with reference to the accompanying drawings and specific embodiments. Those skilled in the art can easily understand the other advantages and effects of the present invention from the content disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments. The details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of the present invention. It should be understood that the preferred embodiments are only for explaining the present invention, rather than for limiting the protection scope of the present invention.

[0023] It should be noted that the diagrams provided in the following embodiments only illustrate the basic concept of the present invention in a schematic manner. Therefore, only the components related to the present invention are shown in the diagrams, rather than being drawn according to the number, shape, and size of the components in actual implementation. The type, quantity, and ratio of each component in actual implementation can be arbitrarily changed, and the component layout type may also be more complex.

[0024] In the following description, a large number of details are explored to provide a more thorough explanation of the embodiments of the present invention. However, it is obvious to those skilled in the art that the embodiments of the present invention can be implemented without these specific details. In other embodiments, well-known structures and devices are shown in the form of block diagrams rather than in detail to avoid making the embodiments of the present invention difficult to understand.

[0025] The "and / or" mentioned in this application describes the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after.

[0026] Figure 1 is a schematic diagram of an exemplary system architecture shown in an exemplary embodiment of this application.

[0027] Refer to Figure 1As shown, the system architecture may include a vehicle 110 and a computer device 120. Among them, the computer device 120 obtains the number of people in the vehicle and the occupant status data of each person in the vehicle through the vehicle 110, determines the health identification status level of each person in the vehicle according to the respective occupant status data. If there is at least one person in the vehicle whose health identification status level is greater than or equal to the preset abnormal level threshold, a distress warning is given according to the abnormal warning strategy that matches the number of people whose health identification status level is greater than or equal to the preset abnormal level threshold and the number of people in the vehicle. The above computer device 120 refers to a program implementation environment for carrying out the method for monitoring the health of people in the vehicle, which is set inside the vehicle or remotely connected and communicated with the in-vehicle computer. It includes, but is not limited to, a microcomputer, an embedded computer, an industrial control computer, and a cloud virtual machine, etc.; the above vehicle 110 at least includes a biosensor for collecting the physiological data of people in the vehicle, an in-vehicle camera for collecting the behavioral image data of people in the vehicle, and an Internet of Things connection module for connecting with the peripheral health monitoring devices carried by users. In addition, it also includes an in-vehicle computer, a positioning device, and an audible and visual alarm device.

[0028] Schematically, the computer device 120 obtains the number of people in the vehicle and the occupant status data of each person in the vehicle through the vehicle 110, determines the health identification status level of each person in the vehicle according to the respective occupant status data. If there is at least one person in the vehicle whose health identification status level is greater than or equal to the preset abnormal level threshold, a distress warning is given according to the abnormal warning strategy that matches the number of people whose health identification status level is greater than or equal to the preset abnormal level threshold and the number of people in the vehicle. Through the health identification status level, the present application accurately evaluates the health status of people in the vehicle, and can quickly trigger the distress warning process according to the health identification status level, shortening the time from the occurrence of a health crisis to the sending of a distress signal, and winning more sufficient time for rescue. Moreover, a distress warning is given according to the abnormal warning strategy that matches the number of different abnormal people and the total number of people in the vehicle, and an appropriate warning method can be adopted according to the specific situation, ensuring that people in the vehicle can receive timely rescue and treatment in case of a sudden health crisis, and reducing the life risks and injuries caused by health problems.

[0029] Figure 2 is a flowchart of a method for monitoring the health of people in a vehicle shown in an exemplary embodiment of the present application. This method for monitoring the health of people in a vehicle can be executed in Figure 1 the implementation environment of, and can also be implemented in other implementation environments. The above implementation environment is not specifically limited herein. Referring to Figure 2 as shown, the flowchart of this method for monitoring the health of people in a vehicle at least includes steps S210 to S230, which are introduced in detail as follows:

[0030] In step S210, the number of vehicle occupants and the occupant status data of each occupant in the vehicle are obtained.

[0031] In an embodiment of the present application, the above-mentioned occupant status data includes physiological data, behavioral data, environmental data, and medical history data. The medical history data represents the historical record data of the hospital diagnosis results when the occupant seeks medical treatment. The hardware devices for implementing the above steps include, but are not limited to, in-vehicle cameras, biosensors, environmental sensors, and Internet of Things connection modules.

[0032] The above-mentioned in-vehicle camera is preferably installed in the center of the vehicle roof or below the rearview mirror. In the preferred implementation process, multiple in-vehicle cameras can be set to provide more accurate image data. In some implementable environments, the above-mentioned in-vehicle camera can be a high-definition wide-angle camera with infrared night vision function, which is used to overcome the technical problem of missing image acquisition at night and ensure a wider implementation environment for in-vehicle personnel health monitoring.

[0033] The above-mentioned biosensors are arranged on the seat backrest, seat cushion, headrest, armrest, and steering wheel where the passengers sit. Under some preferred implementation conditions, a heart rate sensor is built into the seat backrest to monitor the heart rate data in real time by contacting the human back; a pressure sensor is embedded in the seat cushion to sense whether there is someone on the seat and the weight distribution of the human body; a respiratory sensor is installed on the headrest to measure the respiratory rate; skin conductance response sensors are equipped on the steering wheel and armrests, which can sense the change in the conductivity of the driver's palm skin, thereby indirectly reflecting the driver's mood and physiological state.

[0034] The above-mentioned Internet of Things connection module is used to wirelessly connect with the smart wearable devices (such as smart watches and bracelets) carried by the vehicle occupants to obtain the health data recorded by these devices, such as the acquisition data of peripheral devices such as exercise data and blood pressure data.

[0035] In an embodiment of the present application, after the vehicle is started, when the vehicle pressure sensor detects a pressure change, it is determined that there is a person sitting on the corresponding seat. By counting the triggering situations of the pressure sensors of each seat, the number of people in the vehicle is determined. The biosensor collects the physiological data of the people in the vehicle at a preset sampling frequency and transmits and stores it through the CAN bus inside the vehicle. The collected data includes, but is not limited to, heart rate, blood pressure, respiratory rate, body temperature, and blood oxygen data. The in-vehicle camera continuously captures the images of the people in the vehicle and analyzes the behaviors of the people in the images to identify behavioral characteristics. For example, by identifying the limb movements, facial expressions, and sitting postures of the people, the relevant behavioral characteristic data is extracted. The Internet of Things connection module searches for and requests to connect to the smart wearable devices of the people in the vehicle. After the connection is successful, according to the preset protocol, it regularly collects the data of peripheral devices such as exercise data and blood pressure data from the smart wearable devices. The environmental data is collected by means of environmental sensors such as temperature sensors and humidity sensors, including data such as the temperature, humidity, and air quality (such as the concentration of harmful gases such as carbon dioxide, carbon monoxide, and formaldehyde) inside the vehicle.

[0036] In an embodiment of the present application, the data from the pressure sensor, the in-vehicle camera, the biosensor, and the Internet of Things connection module are integrated to create an independent data record file for each person in the vehicle, including the seat number where each person is located, the various physiological data, behavioral data, and external device data obtained, which is convenient for accurate health identification and confirmation of abnormal warning strategies.

[0037] In step S220, the health identification status levels of each person in the vehicle are determined according to the status data of each occupant.

[0038] In an embodiment of the present application, the above-mentioned health identification status level is used to characterize the degree of abnormality of the health status of the people in the vehicle, and the above-mentioned health identification status level increases as the degree of abnormality of the health status of the people in the vehicle increases.

[0039] In an embodiment of the present application, the current monitoring index information is matched in the preset medical monitoring index library according to the environmental data, and the health status determination coefficient is determined according to the medical history data. The medical history data represents the historical record data of the hospital diagnosis results when the occupant seeks medical treatment, including, but not limited to, disease types, incidence frequencies, severity levels, etc.

[0040] In a specific embodiment, the current monitored index information is matched in a preset medical monitoring index library according to environmental data such as temperature, humidity, air quality, etc. (this library contains the normal ranges and abnormal thresholds corresponding to various environmental factors and is constructed based on a large amount of medical research and clinical data). For example, when the temperature in the vehicle exceeds 35°C and the humidity is high, people are prone to heatstroke symptoms; when the carbon dioxide concentration is too high, it will cause symptoms such as dizziness and fatigue in people, and the index information is confirmed and matched. At the same time, according to the medical history data (such as disease type, incidence frequency, severity, etc.), the health status determination coefficient is determined according to the following rules: for cases of chronic diseases with frequent attacks, the determination coefficient is 0.8; for chronic diseases with occasional attacks, the determination coefficient is 0.6; for those with a minor medical history and already cured, the determination coefficient is 0.4; for those without an obvious medical history, the determination coefficient is 0.2. If there is no medical history data, the above health status determination coefficient is defaulted to 0.4. It should be noted that the specific values of the above health status determination coefficients are only numerical examples in a specific embodiment of this application, and can also be actually adjusted according to user-defined and actual application parameter references. The specific values of the health status determination coefficients are not limited here.

[0041] In an embodiment of the present application, the preset health assessment model is adjusted according to the current monitored index information and the health status determination coefficient to obtain a target health assessment model.

[0042] In a preferred embodiment of the present application, a preset health assessment model selects a multi-layer perceptron model to construct an in-vehicle personnel health assessment model. Its pre-construction process includes obtaining the original data of multiple samples and performing data preprocessing on the original data to obtain a sample data set. The preprocessed sample data set is divided into a training set, a validation set, and a test set according to a certain ratio (such as 70% training set, 15% validation set, 15% test set). Construct the network structure of the multi-layer perceptron model. The number of neurons in the input layer is determined by the dimension of the input features, and the input features are used to represent the input feature data for health assessment, such as feature data of heart rate, blood pressure, respiratory rate, body temperature, in-vehicle temperature, humidity, etc. Then, the input layer constructs neurons equivalent to the number of input features; set the adjusted number of hidden layers to ensure the evaluation accuracy and prevent overfitting; the number of neurons in the output layer is determined according to specific evaluation criteria. For example, if there are 10 categories in the health status assessment items, then there are 10 neurons in the output layer. Among them, the ReLU activation function is used in the hidden layer and the output layer to introduce non-linear factors and enhance the expression ability of the model; in the output layer, for classification tasks, the Softmax function can be used to convert the output into a probability distribution, and for regression tasks, the activation function may not be used or a linear activation function may be used. In model training, the loss function is defined according to the evaluation detail and differentiation degree of the actual application, such as the mean square error loss function, and the loss is optimized according to the Adam algorithm and executed in a loop until the loss function converges or reaches the preset number of training rounds. The trained model is evaluated using the validation set and the test set, and the multi-layer perceptron model after the evaluation is determined as the preset health assessment model.

[0043] Adjust the neurons of the preset health assessment model according to the current monitoring index information, and determine the target health assessment model by adjusting the weight parameters of the preset health assessment model through the health status determination coefficient in the loss function.

[0044] It should be noted that in some other preferred embodiments of the above-mentioned embodiment, the preset health assessment model can also be constructed according to requirements by selecting evaluation model architectures such as convolutional neural networks and recurrent neural networks. The multi-layer perceptron model here is only an implementable manner of the present application, and the model information of the preset health assessment model is not specifically limited here.

[0045] In an embodiment of the present application, physiological data and behavioral data are input into the target health assessment model to obtain a health recognition assessment score. Before inputting the physiological data and behavioral data into the target health assessment model, it also includes preliminary processing of the original data of the collected physiological data and behavioral data, removing noise and outliers in the data, and performing normalization processing to facilitate the evaluation accuracy and effectiveness of the data.

[0046] In an embodiment of the present application, a health recognition status level is determined based on preset health status level division rule information and a health recognition evaluation score. One of the implementable rules of the preset health status level division rule information includes: Level 1 (healthy) means that the model output value is between 0.8 and 1, indicating that the health condition of the vehicle occupants is good, such as normal blood pressure and natural behavior; Level 2 (slightly abnormal) means that the model output value is between 0.6 and 0.8, such as a slightly increased heart rate and a slightly increased breathing rate; Level 3 (moderately abnormal) means that the model output value is between 0.4 and 0.6, such as the heart rate, blood pressure, etc. exceeding the safety threshold; Level 4 (severely abnormal) means that the model output value is between 0.2 and 0.4, such as arrhythmia, a sharp drop in blood pressure, and twitching in behavior; Level 5 (extremely dangerous) means that the model output value is between 0 and 0.2, such as unconsciousness and weak vital signs. The above-mentioned preset health status level division rule information can also be more finely divided or more generally summarized according to application requirements in some other preferred embodiments. The example of the preset health status level division rule information here is only an implementable manner of the present application, and the setting content of the preset health status level division rule information is not specifically limited herein.

[0047] In step S230, if the health recognition status level of at least one vehicle occupant is greater than or equal to the preset abnormal level threshold, a distress warning is issued according to the abnormal warning strategy that matches the number of people whose health recognition status level is greater than or equal to the preset abnormal level threshold and the number of vehicle occupants.

[0048] In an embodiment of the present application, if the health recognition status levels of all vehicle occupants are less than the preset abnormal level threshold, the process of determining the health recognition status level continues.

[0049] In an embodiment of the present application, if the number of people whose health recognition status level is greater than or equal to the preset abnormal level threshold is equal to the number of vehicle occupants, the first abnormal warning strategy is executed.

[0050] Specifically, executing the first abnormal warning strategy includes generating a control instruction based on preset rescue interaction information and sending it to the in-vehicle computer, so that the in-vehicle computer makes a notification according to the control instruction and starts timing from the moment the notification is issued. For example, the in-vehicle computer system plays a preset voice prompt message through the in-vehicle speaker, "It is detected that the user's health condition is abnormal. Do you need help?" At the same time, corresponding text prompts and warning icons are displayed on the in-vehicle computer screen.

[0051] If feedback from the vehicle occupants is received within the preset emergency call time range, the call inquiry process is executed to obtain the occupant call inquiry information, and a call warning is issued based on the occupant call inquiry information. The call inquiry process includes at least one set of call inquiry instructions for display on the in-vehicle computer. The occupant call inquiry information includes the warning method information and the reported content information for the call warning. The warning method information includes remote call and local call. For example, assume the preset emergency call time range is 15 seconds. If feedback from the vehicle occupants is received within 15 seconds, the in-vehicle computer conducts a call inquiry based on the preset call inquiry instructions, such as "Do you need to immediately call the emergency center?", "Do you need to notify your emergency contact?", "Do you want to initiate a local call?", "Do you have any significant symptoms?", "Do you need to report your abnormal health data?", etc. The vehicle occupants can provide feedback by touching the option buttons on the display screen or by voice reply. Based on the feedback from the vehicle occupants, the occupant call inquiry information is sorted out. For example, after sorting, the warning method information is determined to be remote call and local call, and the reported content information is that one person in the vehicle feels severe chest pain and attaches the current abnormal health data.

[0052] If feedback from the vehicle occupants is not received within the preset emergency call time range, the current vehicle position information is obtained, and a call warning is issued simultaneously through remote call and local call based on the respective occupant status data and the current vehicle position information. For example, assume the preset emergency call time range is 15 seconds. If feedback from the vehicle occupants is not received within 15 seconds, the GPS positioning module of the vehicle obtains the longitude and latitude coordinates of the vehicle in real time, and simultaneously initiates a remote call and a local call. A detailed call message is sent to the emergency center through the communication module, including the occupant status data of all vehicle occupants and the current vehicle position information, and a similar call message is sent to the preset emergency contact to seek help. At the same time, the in-vehicle computer system continuously emits a loud alarm sound for local call to seek help from the surrounding people.

[0053] In an embodiment of the present application, if the number of people with a health recognition status level greater than or equal to the preset abnormal level threshold is less than the number of vehicle occupants, a second abnormal warning strategy is executed.

[0054] Specifically, executing the second abnormal warning strategy includes generating a control instruction based on the preset rescue interaction information and sending it to the in-vehicle computer, so that the in-vehicle computer makes a notification according to the control instruction and starts timing with the moment of sending the notification as the starting point.

[0055] If feedback from the vehicle occupants is received within the preset emergency call time range, the assistance inquiry process is executed to obtain occupant assistance inquiry information, and a distress warning is issued based on the occupant assistance inquiry information. The assistance inquiry process includes at least one set of assistance inquiry instructions for display on the in-vehicle unit. The occupant assistance inquiry information includes remote distress call requirement information. Starting from the moment the notice is issued, for example, if the preset emergency call time range is set to 15 seconds and feedback from the vehicle occupants is received within 15 seconds, the in-vehicle unit conducts an assistance inquiry based on the preset assistance inquiry instructions, such as: "Do you need to call the emergency center?" "Do you need to contact your emergency contact?" "Do you have any other special requirements (such as specific medications, etc.)?" The vehicle occupants can respond to the inquiry by touching the options on the display screen or by voice reply.

[0056] If feedback from the vehicle occupants is not received within the preset emergency call time range, a distress warning is issued for the occupant status data of those whose health identification status level is greater than or equal to the preset abnormal level threshold through local distress call. Starting from the moment the notice is issued, for example, if the preset emergency call time range is set to 15 seconds and feedback from the vehicle occupants is not received within 15 seconds, the control executes a local distress call.

[0057] After a distress warning is issued for the occupant status data of those whose health identification status level is greater than or equal to the preset abnormal level threshold through local distress call, starting from the start time of the local distress call, if no distress response feedback is received within the preset distress determination time threshold, the current vehicle position information is obtained, and a distress warning is issued through remote distress call based on the respective occupant status data and the current vehicle position information.

[0058] In an embodiment of the present application, the current vehicle position information in the above embodiments includes obtaining accurate longitude, latitude, altitude information of the vehicle, as well as geographical location information such as roads and streets, and detailed vehicle identification information, such as license plate number, vehicle model, vehicle color, etc. The emergency contact list in the above embodiments covers multiple types of rescue-related parties such as family members, friends, nearby hospital emergency centers, professional rescue agencies, and traffic management departments, and can be flexibly edited and determined by the user.

[0059] In an embodiment of the present application, remote distress call includes encapsulating the respective occupant status data and the current vehicle position information into a distress call data packet and sending the distress call data packet to a preset emergency rescue communication terminal. Specifically, according to the preset data packet format, the collected respective occupant status data and vehicle position information are integrated and encapsulated. To ensure data security, data encryption can also be selected in some implementable environments. The preset emergency rescue communication terminal includes, but is not limited to, the medical rescue center platform where the vehicle is located, the emergency contact terminal designated by the user, etc.

[0060] Local emergency calls include unlocking the vehicle, adjusting in-vehicle environmental control parameters, and waking up the in-vehicle computer for audible and visual alarms. In a specific embodiment, it includes controlling the activation of the vehicle's hazard warning lights system; sending an unlocking command to the door lock system to unlock the vehicle, facilitating the rapid entry of rescue personnel into the vehicle after arrival; adjusting the in-vehicle environment based on the data feedback from in-vehicle environmental sensors and preset comfortable environment standards, such as adjusting the temperature, turning on the ventilation fan, adjusting the humidity, etc.; driving the vehicle's external speaker system to play a preset high-volume and highly recognizable distress voice message, such as "There is someone in the vehicle suffering from a sudden emergency illness. Requesting emergency assistance from surrounding people!", to attract the attention of people around.

[0061] A method, device, equipment, and storage medium for monitoring the health of in-vehicle personnel provided by the present invention obtain the number of in-vehicle personnel and the occupant status data of each in-vehicle personnel, determine the health recognition status level of each in-vehicle personnel based on the respective occupant status data. If there is at least one in-vehicle personnel whose health recognition status level is greater than or equal to a preset abnormal level threshold, a distress warning is given according to the abnormal warning strategy that matches the number of personnel with a health recognition status level greater than or equal to the preset abnormal level threshold and the number of in-vehicle personnel; this application accurately evaluates the health status of in-vehicle personnel through the health recognition status level, and can quickly trigger the distress warning process according to the health recognition status level, shortening the time from the occurrence of a health crisis to the sending of a distress signal, gaining more sufficient time for rescue, and giving a distress warning according to the abnormal warning strategy that matches the number of different abnormal personnel and the total number of in-vehicle personnel, and can adopt an appropriate warning method according to the specific situation, ensuring that in-vehicle personnel receive timely rescue and treatment in the event of a sudden health crisis, and reducing the life risks and injuries caused by health problems.

[0062] The following introduces the device embodiments of the present application, which can be used to execute the method for monitoring the health of in-vehicle personnel in the above embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the embodiments of the method for monitoring the health of in-vehicle personnel in the above of the present application.

[0063] Figure 3 It is a schematic diagram of a device for monitoring the health of in-vehicle personnel shown in an exemplary embodiment of the present application. This device can be applied to Figure 2 the implementation process of the method shown, and this device can be executed based on Figure 1 the implementation environment shown, and can also be applicable to other exemplary implementation environments, and is specifically configured in other devices. This embodiment does not limit the implementation environment applicable to this device.

[0064] As Figure 3 shown, this exemplary device for monitoring the health of in-vehicle personnel includes: a multi-source data acquisition module 301, a data processing and analysis module 302, and an emergency call execution module 303.

[0065] Among them, the multi-source data acquisition module 301 is used to obtain the number of people in the vehicle and the occupant status data of each person in the vehicle; the data processing and analysis module 302 is used to determine the health identification status level of each person in the vehicle according to the respective occupant status data, and the health identification status level is used to characterize the degree of abnormality of the health status of the people in the vehicle; the emergency call execution module 303 is used to, if there is at least one person in the vehicle whose health identification status level is greater than or equal to the preset abnormal level threshold, perform a distress warning according to the abnormal warning strategy matching the number of people whose health identification status level is greater than or equal to the preset abnormal level threshold and the number of people in the vehicle.

[0066] Among them, the emergency call execution module 303 further includes a remote call unit and a local call unit. The remote call unit is used to encapsulate the respective occupant status data and the current vehicle position information into a distress data packet and send the distress data packet to a preset emergency rescue communication terminal; the local call unit is used to unlock the vehicle, adjust the in-vehicle environment control parameters, and wake up the vehicle computer for audible and visual alarms.

[0067] An embodiment of the present application also provides an electronic device, including: one or more processors; a storage device for storing one or more programs, and when the one or more programs are executed by the one or more processors, the electronic device implements the in-vehicle personnel health monitoring method provided in the above respective embodiments.

[0068] Figure 4 It is a schematic structural diagram of a computer system of an electronic device shown in an exemplary embodiment of the present application. It should be noted that Figure 4 The computer system 400 of the electronic device shown is only an example and should not bring any limitations to the functions and usage scopes of the embodiments of the present application.

[0069] As Figure 4 shown, the computer system 400 includes a central processing unit (CPU) 401, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 402 or the program loaded from the storage part into the random access memory (RAM) 403, such as executing the method in the above embodiments. In the RAM 403, various programs and data required for system operation are also stored. The CPU 401, ROM 402, and RAM 403 are connected to each other through a bus. The I / O interface 405 is also connected to the bus 404, where the I / O interface 405 refers to an input / output (Input / Output) interface.

[0070] The following components are connected to the I / O interface 405: an input section 406 including a keyboard, a mouse, etc.; an output section 407 including, for example, a cathode ray tube (CRT), a liquid crystal display (LCD), etc. and a speaker, etc.; a storage section 408 including a hard disk, etc.; and a communication section 409 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section performs communication processing via a network such as the Internet. A drive is also connected to the I / O interface 405 as required. A removable medium 411 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc. is mounted on the drive 410 as required so that a computer program read therefrom is installed into the storage section 408 as required.

[0071] Specifically, according to an embodiment of the present application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, an embodiment of the present application includes a computer program product including a computer program carried on a computer-readable medium, the computer program including a computer program for performing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via the communication section 409, and / or installed from the removable medium 411. When the computer program is executed by a central processing unit (CPU) 401, various functions defined in the system of the present application are executed.

[0072] It should be noted that the computer-readable medium shown in the embodiments of the present application may be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable computer program. Such a propagated data signal may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The computer program contained on the computer-readable medium may be transmitted by any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0073] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present application. Among them, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code, and the above module, program segment, or part of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram or flowchart, and the combination of blocks in the block diagram or flowchart, may be implemented by a dedicated hardware-based system for performing the specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions.

[0074] In the corresponding drawings of the above embodiments, the connection lines may represent the connection relationships between various components, to represent more constituent signal paths and / or one or more ends of some lines have arrows to represent the main information flow direction. The connection lines, as a kind of identification, are not a limitation to the solution itself, but using these lines in combination with one or more exemplary embodiments helps to more easily connect circuits or logic units. Any represented signal (determined by design requirements or preferences) may actually include one or more signals that can be transmitted in any one direction and can be implemented in any appropriate type of signal scheme.

[0075] The units involved in the embodiments described in this application can be implemented in software or in hardware. The described units can also be provided in a processor. Among them, the names of these units do not constitute a limitation to the unit itself in some cases.

[0076] Another aspect of this application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements the method as described above. The computer-readable storage medium can be included in the electronic device described in the above embodiments, or can exist separately without being assembled into the electronic device.

[0077] The embodiments of this application also provide a computer program product, including a computer program. When the computer program is executed by a processor, it implements the in-vehicle occupant health monitoring method in any one of the above embodiments.

[0078] It should be noted that although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of this application, the features and functions of the two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0079] Through the description of the above embodiments, those skilled in the art can easily understand that the exemplary embodiments described here can be implemented by software or by a combination of software and necessary hardware. Therefore, the technical solutions according to the embodiments of this application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (such as a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the embodiments of this application.

[0080] Note that the present application can be used in numerous general-purpose or special-purpose computing system environments or configurations. For example: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, and so on.

[0081] Those skilled in the art will readily conceive of other embodiments of the present application after considering the specification and practicing the embodiments disclosed herein. The present application is intended to cover any variations, uses, or adaptations of the present application that follow the general principles of the present application and include known common knowledge or conventional technical means in the technical field not disclosed in the present application.

[0082] It should be understood that the above content of the present application is only a preferred exemplary embodiment of the present application and is not used to limit the embodiments of the present application. Those of ordinary skill in the art can easily make corresponding modifications or alterations according to the main concept and spirit of the present application. Therefore, the protection scope of the present application should be the protection scope required by the claims.

Claims

1. A method for monitoring the health of people in a vehicle, characterized in that: The in-vehicle personnel health monitoring method comprises: Obtain the number of people in the car and the occupant status data of each person in the car; Determine the health status level of each person in the vehicle according to the status data of each occupant, wherein the health status level is used to characterize the abnormality of the health status of the person in the vehicle; If there is at least one person in the car whose health identification status level is greater than or equal to the preset abnormal level threshold, a distress alert is issued according to an abnormal alert strategy that matches the number of people whose health identification status level is greater than or equal to the preset abnormal level threshold and the number of people in the car.

2. The method for monitoring the health of people in a vehicle according to claim 1, characterized in that: The abnormal warning strategy for calling for help according to the number of people whose health recognition status level is greater than or equal to the preset abnormal level threshold and the number of people in the vehicle matches includes: If the number of people whose health recognition status level is greater than or equal to the preset abnormal level threshold is equal to the number of people in the vehicle, the first abnormal warning strategy is executed; If the number of people whose health recognition status level is greater than or equal to the preset abnormal level threshold is less than the number of people in the vehicle, the second abnormal warning strategy is executed.

3. The method for monitoring the health of people in a vehicle according to claim 2, characterized in that: Executing the first abnormal warning strategy includes: Generate a control instruction based on the preset rescue interaction information and send it to the vehicle computer, so that the vehicle computer notifies according to the control instruction and counts the time with the notification being issued as the starting point; If feedback from the occupant is received within the preset emergency call time range, a call inquiry process is executed to obtain the occupant call inquiry information, and a call for help warning is issued according to the occupant call inquiry information. The call for help inquiry process includes at least one set of call for help inquiry instructions for display on the vehicle computer. The occupant call for help inquiry information includes warning method information and reporting content information of the call for help warning. The warning method information includes remote call for help and local call for help. If no feedback is received from the occupants within the preset emergency call time range, the current vehicle location information is obtained, and based on the occupant status data and the current vehicle location information, a distress warning is issued through both remote and local calls.

4. The method for monitoring the health of people in a vehicle according to claim 2, characterized in that: Executing the second abnormal warning strategy includes: Generate a control instruction based on the preset rescue interaction information and send it to the vehicle computer, so that the vehicle computer notifies according to the control instruction and counts the time with the notification being issued as the starting point; If feedback from the occupant is received within the preset emergency call time range, a help inquiry process is executed to obtain occupant help inquiry information, and a help alarm is issued according to the occupant help inquiry information. The help inquiry process includes at least one set of help inquiry instructions for display on the vehicle computer, and the occupant help inquiry information includes remote help demand information; If no feedback is received from the occupants of the vehicle within the preset emergency call time range, a local call for help will be used to issue a help alert to the occupant status data of persons whose health identification status level is greater than or equal to the preset abnormal level threshold.

5. The method for monitoring the health of people in a vehicle according to claim 4, characterized in that: After calling for help and alerting the occupant status data of a person whose health recognition status level is greater than or equal to a preset abnormal level threshold through a local call for help, the in-vehicle occupant health monitoring method further includes: The timing is based on the start time of the local distress call; If no distress response feedback is received within the preset distress determination time threshold, the current vehicle position information is obtained, and a distress warning is issued through a remote distress call based on the occupant status data and the current vehicle position information.

6. The method for monitoring the health of people in a vehicle according to claim 1, characterized in that: The occupant status data includes physiological data, behavioral data, environmental data and medical history data. The health recognition status level of each person in the vehicle is determined based on each occupant status data, including: Matching current monitoring index information in a preset medical monitoring index library according to the environmental data, and determining a health status determination coefficient according to medical history data, wherein the medical history data represents historical record data of hospital diagnosis results when the occupant seeks medical treatment; Adjust the parameters of the preset health assessment model according to the current monitoring indicator information and the health status determination coefficient to obtain the target health assessment model; Inputting the physiological data and behavioral data into a target health assessment model to obtain a health recognition assessment score; The health recognition status level is determined based on preset health status level classification rule information and the health recognition evaluation score.

7. The method for monitoring the health of a person in a vehicle according to any one of claims 1 to 6, characterized in that: The remote rescue call includes encapsulating each occupant status data and current vehicle location information into a rescue data packet, and sending the rescue data packet to a preset emergency rescue communication terminal; The local call for help includes unlocking the vehicle, adjusting the in-vehicle environment control parameters, and waking up the vehicle computer to sound and light alarms.

8. A device for monitoring the health of people in a vehicle, characterized in that: The in-vehicle personnel health monitoring device comprises: A multi-source data acquisition module is used to obtain the number of people in the car and the occupant status data of each person in the car; A data processing and analysis module, used to determine the health recognition status level of each person in the vehicle according to the status data of each occupant, wherein the health recognition status level is used to characterize the degree of abnormality of the health status of the occupants in the vehicle; The emergency call execution module is used to issue a distress call alert based on an abnormal alert strategy that matches the number of people whose health identification status level is greater than or equal to the preset abnormal level threshold and the number of people in the car if there is at least one person in the car whose health identification status level is greater than or equal to the preset abnormal level threshold.

9. An electronic device, characterized in that: It comprises a processor, a memory and a communication bus; the communication bus is used to connect the processor and the memory; the processor is used to execute a computer program stored in the memory to implement the in-vehicle occupant health monitoring method as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and the computer program is used to enable a computer to execute the method for monitoring the health of occupants in a vehicle as described in any one of claims 1-7.

Images