Vehicle warning method, device, equipment, storage medium and program product

Abstract

The application relates to a vehicle early warning method, device, equipment, storage medium and program product, and relates to the technical field of artificial intelligence. The method is executed by a vehicle, the vehicle contains at least two space regions, each space region is configured with at least two vital sign sensors, the method comprises the following steps: acquiring position and posture information of a target person inside the vehicle; positioning a target space region based on the position and posture information of the target person; performing detection on the target person by at least two target sensors to obtain vital sign information corresponding to the at least two target sensors respectively; performing a weighted average operation on the vital sign information corresponding to the at least two target sensors respectively to obtain data after the weighted average operation as target sensing data; inputting the target sensing data into an intelligent early warning system in the vehicle to obtain an output result of the intelligent early warning system; and performing a vehicle early warning operation based on the output result of the intelligent early warning system. The above scheme can improve the efficiency of vehicle early warning.

Description

Technical Field

[0001] This application relates to the field of artificial intelligence technology, and in particular to a vehicle warning method, device, equipment, storage medium, and program product. Background Technology

[0002] With the rapid development of intelligent connected vehicle technology, vehicle safety and personnel health monitoring have become important research directions.

[0003] In related technologies, vehicles can transmit signals between a non-contact life detection module and a central processing unit, establish data communication with a cloud server through the central processing unit, and establish a call through a voice communication module. If the vehicle is parked and there are still signs of life inside the vehicle, the owner will be notified to prevent children or pets left in the vehicle from being forgotten.

[0004] However, most of the vital signs recognition systems in the above-mentioned schemes are used to detect whether there are living beings in the car after the car is locked or after the driver has temporarily left the car. The application scenarios are relatively simple and the limitations are large. The monitoring effect of vital signs in the car is poor, which makes the vehicle warning efficiency low. Summary of the Invention

[0005] This application provides a vehicle warning method, device, equipment, storage medium, and program product, which can improve the efficiency of vehicle warning. The technical solution is as follows:

[0006] On one hand, a vehicle warning method is provided, the method being executed by a vehicle, the vehicle containing at least two spatial regions, each spatial region being equipped with at least two vital sign sensors, the method comprising:

[0007] Acquire the position and attitude information of the target person inside the vehicle; the position and attitude information is used to indicate the position and attitude of the target person.

[0008] Based on the location and posture information of the target person, a target spatial region is located, wherein the target spatial region is the spatial region where the target person is located among the at least two spatial regions;

[0009] The target person is detected by at least two target sensors to obtain vital sign information corresponding to each of the at least two target sensors; the at least two target sensors are at least two vital sign sensors corresponding to the target spatial region; the vital sign information is used to indicate the vital signs of the target person; the vital sign information includes at least body temperature, blood saturation, heart rate, and respiratory rate;

[0010] Perform a weighted average operation on the vital sign information corresponding to the at least two target sensors respectively, and obtain the weighted average data as target sensing data;

[0011] The target sensing data is input into the intelligent warning system in the vehicle to obtain the output result of the intelligent warning system.

[0012] Based on the output of the intelligent early warning system, a vehicle early warning operation is performed.

[0013] On the other hand, a vehicle warning device is provided, the device comprising:

[0014] The position and attitude information acquisition module is used to acquire the position and attitude information of the target person inside the vehicle; the position and attitude information is used to indicate the position and attitude of the target person.

[0015] The target spatial region positioning module is used to locate a target spatial region based on the position and posture information of the target person, wherein the target spatial region is the spatial region where the target person is located among the at least two spatial regions;

[0016] A vital signs information acquisition module is used to perform detection on the target person through at least two target sensors to obtain vital signs information corresponding to the at least two target sensors respectively; the at least two target sensors are at least two vital signs sensors corresponding to the target spatial region; the vital signs information is used to indicate the vital signs of the target person; the vital signs information includes at least body temperature, blood saturation, heart rate, and respiratory rate;

[0017] The target sensing data acquisition module is used to perform a weighted average operation on the vital sign information corresponding to the at least two target sensors respectively, and obtain the weighted average data as target sensing data.

[0018] The intelligent early warning detection module inputs the target sensing data into the intelligent early warning system in the vehicle and obtains the output result of the intelligent early warning system.

[0019] The early warning operation execution module is used to execute vehicle early warning operations based on the output results of the intelligent early warning system.

[0020] In some embodiments, the early warning operation execution module is used to input the target sensing data into the intelligent early warning system and obtain the vital sign recognition result through the intelligent early warning system; the vital sign recognition result is used to indicate the vital sign status of the target person.

[0021] Based on the vital signs recognition results, an early warning operation is executed.

[0022] In some embodiments, the early warning operation execution module is used to determine whether the vital signs of the target person are abnormal based on the vital sign recognition result;

[0023] In the event of abnormal vital signs of the target person, determine the warning level of the vital sign identification result;

[0024] Based on the warning level, execute the warning operation corresponding to the warning level.

[0025] In some embodiments, the apparatus further includes:

[0026] The weight determination module is used to determine the weight of the vital signs information in the weighted averaging operation based on the posture of the target person and the position of the at least two target sensors relative to the target spatial region before performing a weighted averaging operation on the vital signs information corresponding to the at least two target sensors respectively and obtaining the weighted averaged data as target sensing data.

[0027] In some embodiments, the apparatus further includes:

[0028] The vital signs information acquisition module is used to generate vital signs information data thresholds based on historical vital signs information; the historical vital signs information is the vital signs information acquired by the at least two target sensors before acquiring the vital signs information of the target person in this acquisition.

[0029] The vital signs warning information issuing module is used to issue a vital signs warning information when the data of vital signs information corresponding to at least two target sensors exceed the vital signs information data threshold; the vital signs warning information is used to indicate that the vital signs of the target person are abnormal.

[0030] In some embodiments, the apparatus further includes:

[0031] The distress message sending module is used to send a distress message to the emergency services department through the vehicle's vehicle networking platform when the difference between the vital sign information data corresponding to at least two target sensors and the vital sign information data threshold reaches a specified value; the distress message includes the vehicle's location information and the vital sign information of the target person.

[0032] In another aspect, a computer device is provided, the computer device comprising a processor and a memory, the memory storing at least one instruction, at least one program, code set or instruction set, the at least one instruction, the at least one program, the code set or instruction set being loaded and executed by the processor to implement the vehicle warning method as described above.

[0033] In another aspect, a computer-readable storage medium is provided, wherein at least one instruction, at least one program, code set, or instruction set is stored therein, wherein the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by a processor to implement the vehicle warning method described above.

[0034] In another aspect, a computer program product is provided, comprising a computer program stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium and executes the computer program, causing the computer device to perform the vehicle warning method provided in the various optional implementations described above.

[0035] The technical solution provided in this application may include the following beneficial effects:

[0036] In this embodiment, at least two vital sign sensors are configured in each space area inside the vehicle to ensure comprehensive coverage of the vital sign information of target personnel in different locations inside the vehicle. While ensuring the comprehensiveness of the vital sign information collection, the vehicle further performs a weighted average operation on the vital sign information. This weighted average operation integrates data from at least two target sensors, reducing the error impact that may be caused by a single target sensor and improving the reliability of the early warning system. The weighted average target sensor data is input into the intelligent early warning system, which quickly and accurately analyzes the changing trends of the vital sign data, promptly identifies abnormal situations, and triggers corresponding early warning measures. This effectively avoids the lag and false alarms that may exist in traditional early warning systems, significantly improving the efficiency of vehicle early warning.

[0037] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description

[0038] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0039] Figure 1 This is a system configuration diagram of a vehicle warning method according to one embodiment of this application;

[0040] Figure 2 This is a flowchart of a vehicle warning method provided in one embodiment of this application;

[0041] Figure 3 This is a flowchart of a vehicle warning method provided in one embodiment of this application;

[0042] Figure 4This is a flowchart of a vital signs detection and early warning method provided in one embodiment of this application;

[0043] Figure 5 This is a block diagram of a vehicle warning device provided in an exemplary embodiment of this application;

[0044] Figure 6 This is a schematic diagram of the structure of a computer device provided in an exemplary embodiment of this application. Detailed Implementation

[0045] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application.

[0046] Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0047] Figure 1 This is a system configuration diagram of a vehicle warning method according to one embodiment of this application. Figure 1 As shown, the method is executed by a vehicle 100, which contains at least two spatial regions, each equipped with at least two vital sign sensors. The vehicle 100 acquires the position and attitude information of the target person 10 inside; based on the position and attitude information of the target person 10, it locates the spatial region where the target person 10 is located within the at least two spatial regions, designating it as the target spatial region; it performs detection on the target person 10 using at least two target sensors, obtaining vital sign information corresponding to each of the at least two target sensors, used to indicate the vital sign information of the target person 10; the vital sign information includes at least body temperature, blood saturation, heart rate, and respiratory rate; it performs a weighted average operation on the vital sign information corresponding to each of the at least two target sensors, obtaining the weighted averaged data as target sensing data; it inputs the target sensing data into the intelligent warning system in the vehicle 100, obtaining the output result of the intelligent warning system; and based on the output result of the intelligent warning system, it executes a warning operation in the vehicle 100.

[0048] Figure 2 This is a flowchart illustrating a vehicle warning method according to an embodiment of this application. The vehicle warning method can be executed by a vehicle; for example, the vehicle may be the one described above. Figure 1 The vehicle 100 shown above. The aforementioned vehicle warning method is executed by the vehicle, which contains at least two spatial areas, each equipped with at least two vital signs sensors.

[0049] In this embodiment, the vehicle interior is divided into at least two spatial areas, each of which can correspond to a seat, with different seats corresponding to different spatial areas. For example, the driver's seat corresponds to one spatial area, and the front passenger seat corresponds to another spatial area.

[0050] Among them, the aforementioned vital sign sensors are sensors capable of collecting vital sign information, including but not limited to cameras, infrared sensors, and ultrasonic sensors.

[0051] In this embodiment of the application, each spatial area is equipped with at least two vital sign sensors, and the vehicle obtains vital sign information of the spatial area through the at least two vital sign sensors in each spatial area.

[0052] The method may include steps 210, 220, 230, 240, 250, and 260, and is specifically implemented as follows:

[0053] Step 210: Obtain the position and attitude information of the target personnel inside the vehicle; the position and attitude information is used to indicate the position and attitude of the target personnel.

[0054] The location of the target person refers to the specific position of the target person inside the vehicle, such as the driver's seat, the front passenger seat, or the back seat.

[0055] The posture of the target personnel mentioned above refers to the body posture of the target personnel inside the vehicle, such as sitting, lying down, or other atypical postures.

[0056] In this embodiment of the application, the vehicle can construct a three-dimensional model of the target person through the vehicle's onboard camera and depth sensor, thereby more accurately determining its position and posture.

[0057] In some embodiments, the vehicle acquires images or videos of target personnel inside the vehicle through an onboard camera, and obtains the position and posture information of the target personnel inside the vehicle based on a deep learning model; the position and posture information is used to indicate the position and posture of the target personnel; the deep learning model is a machine learning model that has the ability to identify the position and posture features of living beings in images or videos based on images or videos.

[0058] In the above embodiments, the vehicle can use its built-in vehicle camera to collect images or videos of the target person inside the vehicle from multiple angles. After preprocessing the collected images (e.g., noise reduction, contrast enhancement, and brightness correction), the images are input into a trained deep learning model to obtain the position and pose information output by the deep learning model as the position and pose information of the target person.

[0059] Step 220: Locate the target spatial region based on the position and posture information of the target personnel. The target spatial region is the spatial region where the target personnel are located among at least two spatial regions.

[0060] In this embodiment of the application, a three-dimensional coordinate system can be set inside the vehicle, and each spatial region corresponds to a three-dimensional coordinate range. When the vehicle obtains the location information of the target person, the three-dimensional coordinate range of the target person inside the vehicle is extracted from the location information. The three-dimensional coordinate range of the target person's location is paired with the preset three-dimensional coordinate range, and the spatial region corresponding to the three-dimensional coordinate range that is closest to or completely contains the target person's location is obtained as the target spatial region.

[0061] Step 230: Perform detection on the target personnel using at least two target sensors to obtain vital sign information corresponding to the at least two target sensors respectively; the at least two target sensors are at least two vital sign sensors corresponding to the target spatial area; the vital sign information is used to indicate the vital signs of the target personnel; the vital sign information includes at least body temperature, blood saturation, heart rate, and respiratory rate.

[0062] In this embodiment of the application, after the vehicle locates the target space area where the target person is located, it activates at least two vital sign sensors within the target area to perform detection on the target person and obtain the target person's vital sign information.

[0063] Among them, the aforementioned target sensors include, but are not limited to: a body temperature sensor (for acquiring the body temperature of the target person), a blood oxygen saturation sensor (for acquiring the blood saturation of the target person), a heart rate sensor (for acquiring the heart rate of the target person), and a respiratory rate sensor (for acquiring the respiratory rate of the target person).

[0064] Step 240: Perform a weighted average operation on the vital sign information corresponding to at least two target sensors respectively, and obtain the weighted average data as target sensing data.

[0065] The aforementioned weighted averaging operation refers to the process of assigning different weight values ​​to data obtained from at least two target sensors and then calculating the weighted average of the data. This weighted averaging is used to integrate vital sign information from at least two target sensors to obtain more reliable target sensing data.

[0066] In this embodiment, after the vehicle acquires vital sign information corresponding to at least two target sensors, it determines the corresponding weight based on the quality of the data obtained by each sensor. For example, if the data obtained by a certain sensor has higher accuracy, the data corresponding to that sensor is given a higher weight. After assigning weights to the data obtained by each sensor, the data obtained by all sensors are multiplied by their corresponding weights, and the sum is calculated. Finally, the sum of all weights is divided to obtain the weighted average target sensing data.

[0067] Step 250: Input the target sensor data into the intelligent warning system in the vehicle and obtain the output results of the intelligent warning system.

[0068] The aforementioned intelligent early warning system is a system in the vehicle that can receive and process vital sign data.

[0069] In this embodiment of the application, after the vehicle obtains the target sensing data, it can transmit the target sensing data to the intelligent warning system through the in-vehicle network. After receiving the target sensing data, the intelligent warning system judges the target sensing data and obtains the output result. The output result can be a prompt (such as an audible alarm or visual warning) or an action command (such as suggesting rest, contacting emergency services, or automatically slowing down and stopping).

[0070] Step 260: Based on the output of the intelligent early warning system, execute the vehicle early warning operation.

[0071] Among them, the aforementioned vehicle warning operation is a preventive and protective measure executed by the intelligent warning system based on the output results obtained after analyzing the target sensor data.

[0072] In this embodiment, at least two vital sign sensors are configured in each space area inside the vehicle to ensure comprehensive coverage of the vital sign information of target personnel in different locations inside the vehicle. While ensuring the comprehensiveness of the vital sign information collection, the vehicle further performs a weighted average operation on the vital sign information. This weighted average operation integrates data from at least two target sensors, reducing the error impact that may be caused by a single target sensor and improving the reliability of the early warning system. The weighted average target sensor data is input into the intelligent early warning system, which quickly and accurately analyzes the changing trends of the vital sign data, promptly identifies abnormal situations, and triggers corresponding early warning measures. This effectively avoids the lag and false alarms that may exist in traditional early warning systems, significantly improving the efficiency of vehicle early warning.

[0073] based on Figure 2 Please refer to Figure 3 , Figure 3 This is a flowchart of a vehicle warning method provided in one embodiment of this application. Figure 2 Step 250 can be implemented as steps 250a and 250b, as detailed below:

[0074] Step 250a: Input the target sensing data into the intelligent early warning system and obtain the vital signs identification results through the intelligent early warning system; the vital signs identification results are used to indicate the vital signs status of the target personnel.

[0075] In this embodiment of the application, after receiving target sensing data, the intelligent early warning system can analyze the target sensing data through a built-in machine learning model to obtain the vital sign recognition results corresponding to the target sensing data. The built-in machine learning model in the intelligent early warning system is a deep neural network with the ability to judge the vital sign status of the target person based on the target sensing data.

[0076] Step 250b: Based on the vital signs recognition results, execute the early warning operation.

[0077] In this embodiment of the application, after the vehicle obtains the vital signs recognition result through the intelligent warning system, it executes the warning operation corresponding to the vital signs recognition result.

[0078] In this embodiment of the application, the vital sign recognition results obtained by the intelligent early warning system can directly reflect the vital sign status of the target person. Based on the vital sign status of the target person, the vehicle performs corresponding early warning operations, which makes the early warning operations more targeted and effectively improves the efficiency of vehicle early warning.

[0079] Based on the solutions shown in any one or more of the above embodiments, in some embodiments, step 250b can be implemented as follows: determining whether the vital signs of the target person are abnormal based on the vital sign recognition results; determining the warning level of the vital sign recognition results if the vital signs of the target person are abnormal; and performing the warning operation corresponding to the warning level based on the warning level.

[0080] In this embodiment of the application, the vital sign recognition result can be text or numbers used to indicate the degree of abnormality of the target person's vital signs.

[0081] In some embodiments, when the vital signs recognition result is text, the result can directly indicate the degree of abnormality in the vital signs of the target person. For example, the text content could be "slight abnormality," "moderate abnormality," or "severe abnormality." The vehicle determines the warning level based on the text. In this embodiment, each text corresponds to a warning level, and different texts correspond to different warning levels. The vehicle maintains a database containing text pairs of different texts and their corresponding warning levels. After obtaining the vital signs recognition result, the vehicle queries the database based on the text to obtain the warning level corresponding to that text, which is then used as the warning level for the vital signs recognition result.

[0082] In some embodiments, when the vital signs identification result is a number, it can be a percentage value indicating the degree of abnormality in the target person's vital signs. A larger percentage value indicates a more severe abnormality, such as "20%", "50%", or "60%". In this embodiment, each number corresponds to a warning level, and different numbers correspond to different warning levels. The vehicle maintains a database containing pairs of different numbers and their corresponding warning levels. After the vehicle receives the vital signs identification result, it queries the database based on the number to obtain the corresponding warning level, which is then used as the warning level for the vital signs identification result. Optionally, the vehicle maintains a database containing pairs of different number ranges and their corresponding warning levels. After the vehicle receives the vital signs identification result, it queries the database based on the number to obtain the number range to which the number belongs, traverses the database, and obtains the warning level corresponding to that number range, which is then used as the warning level for the vital signs identification result.

[0083] In this embodiment, each warning level can correspond to at least one warning operation, and different warning levels correspond to different warning operations. After determining the warning level, the vehicle executes at least one warning operation corresponding to that warning level.

[0084] In this embodiment of the application, the above-mentioned scheme can perform different early warning operations according to the different severity of the vital signs of the target personnel through a hierarchical early warning mechanism, thereby improving the pertinence and effectiveness of the early warning operations and thus effectively improving the efficiency of vehicle early warning.

[0085] Based on the schemes shown in any one or more of the above embodiments, in some embodiments, prior to step 240 above, the vehicle determines the weights of the vital signs information in the weighted average operation according to the posture of the target person and the positions of at least two target sensors relative to the target spatial region.

[0086] In this embodiment of the application, the vehicle determines the weight of vital signs information in the weighted average operation based on the posture of the target person and the distance between the target person and at least two target sensors in the target space area.

[0087] In some embodiments, the distance between the target sensor and the target person within the target space region is inversely proportional to the weight of vital sign information in the weighted averaging operation. The closer the target sensor is to the target person, the higher the accuracy of the data obtained by the target sensor, and the greater the weight assigned to the data obtained by the target sensor. Conversely, the farther the target sensor is from the target person, the lower the accuracy of the data obtained by the target sensor, and the smaller the weight assigned to the data obtained by the target sensor.

[0088] For example, if the target person is in a seated position, the target sensor located near the seat back or seat belt is closest to the target person and closer to their heart, so the heart rate detected by the target sensor is given a higher weight.

[0089] Optionally, the vehicle determines the facial orientation of the target person based on their posture, and determines the weight of vital sign information in the weighted average operation based on the facial orientation of the target person and the relative directions of at least two target sensors to the target person; wherein the aforementioned relative directions are the directions corresponding to the lines connecting at least two target sensors to the face of the target person.

[0090] In some embodiments, the vehicle determines the weights of vital sign information in a weighted averaging operation based on the facial orientation of the target person and the angles between at least two target sensors and the target person's face. The angles between the target sensors and the target person's face are inversely proportional to the weights of the vital sign information in the weighted averaging operation; the larger the angle between the target sensors and the target person's face, the smaller the weight assigned to the data obtained by that target sensor, and vice versa.

[0091] For example, target sensor A, which is directly in front of the target person, has an angle of almost 0 degrees with the target person's face, while target sensor B, which is to the left front of the target person, has an angle of 45 degrees with the target person's face. The data obtained by target sensor A is assigned a greater weight than the data obtained by target sensor B.

[0092] It should be noted that, in this embodiment of the application, the vehicle dynamically adjusts the weight of the data obtained by each target sensor in real time according to the direction of the target person's head rotation.

[0093] In this embodiment, the vehicle determines the weight of vital signs information in the weighted averaging operation based on the posture of the target person and the specific positions of at least two target sensors in the target space area. This reduces the impact of low-quality data and improves the accuracy of the weighted averaging operation results.

[0094] Based on the solutions shown in any one or more of the above embodiments, in some embodiments, the vehicle generates a vital sign information data threshold based on historical vital sign information; the historical vital sign information is the vital sign information acquired by at least two target sensors before the current acquisition of the vital sign information of the target person; when the data of the vital sign information corresponding to at least two target sensors exceeds the vital sign information data threshold, a vital sign warning message is issued; the vital sign warning message is used to indicate that the vital signs of the target person are abnormal.

[0095] The aforementioned historical vital sign information refers to the vital sign data of the target person acquired by at least two target sensors within a specified time period in the past. For example, the aforementioned historical vital sign information could be the vital sign data of the target person acquired by at least two target sensors within the past week.

[0096] Among them, the aforementioned vital sign information data threshold is a reference standard generated by the vehicle based on historical vital sign information, used to determine whether the vital signs of the currently monitored target personnel are abnormal.

[0097] The aforementioned vital signs warning information is an alarm or prompt message issued by the vehicle when the vital signs detected by at least two target sensors exceed a set data threshold.

[0098] The aforementioned vital sign warning information can be issued through any of the following methods: visual warning (such as a warning light on the dashboard), audible alarm (such as a voice prompt played by the vehicle's speakers), or automatically sending a distress message to emergency services.

[0099] In this embodiment of the application, after the vehicle obtains the vital signs information of the target person through at least two target sensors, it compares the information with a pre-set vital signs information data threshold. If the vital signs information of the target person obtained by at least two target sensors exceeds the pre-set vital signs information data threshold, a vital signs warning message is issued.

[0100] In this embodiment, the vital sign information data threshold set based on historical vital sign information can indicate the vital sign information of the target person in a normal state. When the vital sign information detected by all target sensors exceeds the vital sign information data threshold, a warning message is issued, which can effectively ensure the accuracy of vehicle warning.

[0101] Based on the solutions shown in any one or more of the above embodiments, in some embodiments, when the difference between the vital signs information data corresponding to at least two target sensors and the vital signs information data threshold reaches a specified value, the vehicle sends a request for help to the emergency service department through the vehicle's vehicle network platform; the request for help includes the vehicle's location information and the vital signs information of the target person.

[0102] The difference between the aforementioned vital sign information data and the vital sign information data threshold refers to the difference between the vital sign information currently acquired by at least two target sensors and the pre-set vital sign information data threshold. In this embodiment, when the difference between the vital sign information data corresponding to at least two target sensors and the vital sign information data threshold reaches a specified value, it indicates that the vital signs of the target person have shown obvious abnormalities, and the vehicle needs emergency intervention.

[0103] The aforementioned vehicle-to-everything (V2X) platform is a communication platform that connects vehicles with the outside world (such as the Internet). Based on the V2X platform, vehicles can send help requests to emergency service departments via the network.

[0104] In this embodiment, the vehicle acquires the vital signs information of the target person in real time through at least two target sensors. For each acquired vital sign information, the data is compared with a vital sign data threshold. If the vital sign data is less than the threshold and the difference between the vital sign data and the threshold meets a specified value, the vehicle acquires its current location information and the latest vital sign data of the target person, generates a distress request containing both the vehicle's current location information and the latest vital sign data of the target person, and sends the distress request to emergency services via a wireless network. Optionally, if the vital sign data is greater than the threshold and the difference between the vital sign data and the threshold meets a specified value, the vehicle acquires its current location information and the latest vital sign data of the target person, generates a distress request containing both the vehicle's current location information and the latest vital sign data of the target person, and sends the distress request to emergency services via a wireless network.

[0105] For example, if the heart rate threshold is 80 beats / minute and the specified value is a heart rate difference of 20 beats / minute, and the target sensor obtains a heart rate reading of 95 beats / minute with a difference of 15 beats / minute, the vehicle obtains its current location information and the latest vital signs data of the target person, generates a distress message: "Vehicle with license plate number XXXX is located at latitude and longitude XX, XX, driver's heart rate is 95 beats / minute, please dispatch an ambulance immediately.", and sends this distress message to the emergency services department.

[0106] In some embodiments, after the vehicle sends a distress request to the emergency services through the vehicle's vehicle-to-everything (V2X) platform, if the difference between the vital signs data corresponding to at least two target sensors and the vital signs data threshold continues to increase, the vehicle continues to update the distress request and immediately sends it to the emergency services through the vehicle's V2X platform.

[0107] In this embodiment, when the difference between the vital signs information detected by at least two target sensors and the vital signs information data threshold reaches a specified value, it indicates that the target person may have a serious adverse physical condition. The vehicle triggers an automatic distress signal mechanism, sending a distress signal containing the vehicle's location and detailed vital signs data. This enables precise early warning and immediate assistance, improving the efficiency of vehicle early warning.

[0108] Based on the above Figure 2 and Figure 3 The embodiments of this application illustrate an in-vehicle non-contact vital sign detection and intelligent early warning system and method based on multimodal perception technology.

[0109] For example, please refer to Figure 4 , Figure 4 This is a flowchart of a vital signs detection and early warning method provided in one embodiment of this application. The method includes three modules: an information acquisition module 401, a data processing and analysis module 402, and an intelligent early warning system 403.

[0110] 1. Information acquisition module 401: In this embodiment, the vehicle uses multimodal sensors to collect the vital signs information of passengers inside the vehicle. The body temperature, blood oxygen saturation, heart rate and respiratory rate of passengers inside the vehicle can be collected by infrared thermal imaging, near-infrared spectral sensors and millimeter-wave radar sensors, respectively.

[0111] Infrared thermal imaging: Using infrared thermal imaging technology, the heat distribution of passengers' faces and bodies is captured by an onboard camera to assess body temperature and blood circulation.

[0112] Near-infrared spectroscopy sensor: used to monitor blood oxygen content and heart rate. It monitors the oxygenation level of hemoglobin in the blood through the skin surface of passengers in the vehicle and calculates blood oxygen saturation and heart rate.

[0113] Millimeter-wave radar: It uses low-power millimeter waves to monitor minute movements of the chest cavity through microwave reflection and accurately measures breathing rate through the clothing of passengers inside the vehicle.

[0114] 2. Data processing and analysis module 402: In this embodiment, the vehicle can use deep learning algorithms to extract features and recognize patterns from the collected images and radar signals, and perform real-time analysis.

[0115] In this embodiment, the vehicle can automatically identify passenger positions and postures using computer vision and deep learning technologies. Even in dynamic vehicle environments, when seats are moving, or when multiple passengers are riding together, it can accurately match each vital sign signal to the corresponding passenger. Deep learning algorithms are applied to perform real-time analysis of collected multi-source data, extracting features and recognizing patterns from acquired images and radar signals to improve the accuracy of vital sign recognition. Furthermore, multimodal data fusion is achieved, and weighted averaging of data from various sensors enhances monitoring stability and accuracy.

[0116] 3. Intelligent early warning system 403: In this embodiment, the vehicle interior includes a health benchmark model, which is used to immediately initiate an early warning process when abnormalities are detected among passengers in the vehicle.

[0117] In this embodiment, a health baseline model is established inside the vehicle to compare with real-time monitoring data. Once an abnormality is detected, an early warning process is immediately initiated. Based on the level of abnormality of the vital signs of the passengers inside the vehicle, different levels of response strategies are adopted. For example, if the body temperature of the passengers inside the vehicle is detected to be too high or too low, a warning is issued to the driver through the vehicle information system, and the temperature inside the vehicle is adjusted to a temperature suitable for the current body temperature of the passengers. When a life-threatening situation is detected, such as cardiac arrest or severe hypoxia, the vehicle immediately activates the in-vehicle warning system and sends a request for help to the emergency services department through the vehicle networking platform. This request includes key information such as the vehicle's GPS (Global Positioning System) coordinates and the status of the occupants. Furthermore, throughout the entire data transmission process, encrypted transmission and anonymization technologies are introduced, and end-to-end encryption technology is used to ensure the security of data transmission and to ensure the security and privacy protection of all physiological data during storage and transmission.

[0118] This embodiment provides an in-vehicle vital signs recognition system and method based on multimodal perception technology. The system integrates non-contact biosensors, advanced image processing technology, artificial intelligence algorithms, and emergency response mechanisms. Under various driving conditions, it can achieve real-time and continuous monitoring of key vital signs such as heart rate, respiratory rate, and body temperature of occupants by fusing multiple non-invasive sensing technologies and intelligent algorithms. It can also automatically trigger rescue measures in abnormal situations. Under various driving conditions, it can monitor key vital signs such as heart rate, respiratory rate, and blood oxygen saturation of occupants without being obstructed and can respond quickly to abnormal situations, effectively improving the accuracy of vital sign detection and the efficiency of vehicle early warning.

[0119] The above is merely one embodiment of this application and should not be considered as a limitation thereof. Those skilled in the art will understand that various modifications and variations can be made to the embodiments to adapt to different application requirements. Therefore, the scope of this application should be defined by the claims appended to the claims.

[0120] Please refer to Figure 5 The diagram illustrates a block diagram of a vehicle warning device provided in an exemplary embodiment of this application. The data processing device can be implemented as all or part of a computer device through hardware or a combination of hardware and software, to achieve the above-described... Figure 2 and Figure 3 All or part of the steps in the illustrated embodiments. For example... Figure 5 As shown, the vehicle warning device includes:

[0121] The position and attitude information acquisition module 501 is used to acquire the position and attitude information of the target personnel inside the vehicle; the position and attitude information is used to indicate the position and attitude of the target personnel.

[0122] The target spatial region positioning module 502 is used to locate the target spatial region based on the position and posture information of the target person. The target spatial region is the spatial region where the target person is located among at least two spatial regions.

[0123] The vital signs information acquisition module 503 is used to perform detection on the target person through at least two target sensors and obtain vital signs information corresponding to the at least two target sensors respectively; the at least two target sensors are at least two vital signs sensors corresponding to the target space area; the vital signs information is used to indicate the vital signs of the target person; the vital signs information includes at least body temperature, blood saturation, heart rate and respiratory rate;

[0124] The target sensing data acquisition module 504 is used to perform a weighted average operation on the vital sign information corresponding to at least two target sensors respectively, and obtain the weighted average data as target sensing data.

[0125] The intelligent early warning detection module 505 inputs target sensing data into the intelligent early warning system in the vehicle and obtains the output results of the intelligent early warning system.

[0126] The early warning operation execution module 506 is used to execute vehicle early warning operations based on the output results of the intelligent early warning system.

[0127] In some embodiments, the early warning operation execution module 506 is used to input target sensing data into the intelligent early warning system and obtain vital sign recognition results through the intelligent early warning system; the vital sign recognition results are used to indicate the vital sign status of the target personnel.

[0128] Based on the vital signs recognition results, an early warning operation is executed.

[0129] In some embodiments, the early warning operation execution module 506 is used to determine whether the vital signs of the target person are abnormal based on the vital sign recognition results;

[0130] In cases where the vital signs of a target person are abnormal, determine the warning level of the vital sign identification results;

[0131] Based on the warning level, execute the warning operation corresponding to the warning level.

[0132] In some embodiments, the apparatus further includes:

[0133] The weight determination module is used to determine the weight of the vital signs information in the weighted averaging operation based on the posture of the target person and the position of the at least two target sensors relative to the target spatial region before performing a weighted averaging operation on the vital signs information corresponding to at least two target sensors respectively and obtaining the weighted averaged data as target sensing data.

[0134] In some embodiments, the apparatus further includes:

[0135] The vital signs information acquisition module is used to generate vital signs information data thresholds based on historical vital signs information; historical vital signs information refers to the vital signs information acquired by at least two target sensors before the current acquisition of vital signs information of the target person.

[0136] The vital signs warning information issuing module is used to issue a vital signs warning information when the vital signs information corresponding to at least two target sensors exceeds the vital signs information data threshold; the vital signs warning information is used to indicate that the vital signs of the target personnel are abnormal.

[0137] In some embodiments, the apparatus further includes:

[0138] The distress message sending module is used to send a distress message to the emergency services department through the vehicle's vehicle-to-everything (V2X) platform when the difference between the vital signs data corresponding to at least two target sensors and the vital signs data threshold reaches a specified value; the distress message includes the vehicle's location information and the vital signs information of the target person.

[0139] Please refer to Figure 6 , Figure 6This is a schematic diagram of the structure of a computer device provided in an exemplary embodiment of this application. The computer device 600 includes a Central Processing Unit (CPU) 601, a system memory 604 including Random Access Memory (RAM) 602 and Read-Only Memory (ROM) 603, and a system bus 605 connecting the system memory 604 and the CPU 601. The computer device 600 also includes a Basic Input / Output System (I / O System) 606 that facilitates the transfer of information between various devices within the computer, and a mass storage device 607 for storing the operating system 613, application programs 614, and other program modules 615.

[0140] The basic input / output system 606 includes a display 608 for displaying information and an input device 609 for user input, such as a mouse or keyboard. Both the display 608 and the input device 609 are connected to the central processing unit 601 via an input / output controller 610 connected to the system bus 605. The basic input / output system 606 may also include the input / output controller 610 for receiving and processing input from multiple other devices such as a keyboard, mouse, or electronic stylus. Similarly, the input / output controller 610 also provides output to a display screen, printer, or other types of output devices.

[0141] Mass storage device 607 is connected to central processing unit 601 via a mass storage controller (not shown) connected to system bus 605. Mass storage device 607 and its associated computer-readable media provide non-volatile storage for computer device 600. That is, mass storage device 607 may include computer-readable media (not shown) such as hard disk or CD-ROM (Compact Disc Read-Only Memory) drive.

[0142] Without loss of generality, computer-readable media can include computer storage media and communication media. Computer storage media includes volatile and non-volatile, removable and non-removable media implemented using any method or technology for storing information such as computer-readable instructions, data structures, program modules, or other data. Computer storage media include RAM (Random Access Memory), ROM (Read-Only Memory), EPROM (Erasable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), flash memory or other solid-state storage technologies, CD-ROM, DVD (Digital Video Disc) or other optical storage, magnetic tape cassettes, magnetic tape, disk storage, or other magnetic storage devices. Of course, those skilled in the art will recognize that computer storage media are not limited to the above-mentioned types. The system memory 604 and mass storage device 607 described above can be collectively referred to as memory.

[0143] Computer device 600 can be connected to the Internet or other network devices via network interface unit 611 connected to system bus 605.

[0144] The memory also includes one or more programs, which are stored in the memory. The central processing unit 601 implements these programs by executing them. Figure 2 and Figure 3 All or some of the steps in the method shown.

[0145] In an exemplary embodiment, a chip is also provided, the chip including programmable logic circuitry and / or program instructions, which, when the chip is run on a computer device, are used to implement all or part of the steps of the methods shown in the above embodiments of this application.

[0146] In an exemplary embodiment, a computer program product is also provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions to implement all or part of the steps of the methods shown in the above embodiments of this application.

[0147] In an exemplary embodiment, a computer-readable storage medium is also provided, which stores a computer program that is loaded and executed by a processor to implement all or part of the steps of the methods shown in the above embodiments of this application.

[0148] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0149] Those skilled in the art will recognize that the functions described in the embodiments of this application in one or more of the above examples can be implemented using hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any medium that facilitates the transfer of a computer program from one place to another. Storage media can be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0150] The above are merely optional embodiments of this application and are not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A vehicle early warning method, characterized in that, The method is performed by a vehicle, the vehicle containing at least two spatial regions, each spatial region being equipped with at least two vital sign sensors, the method comprising: Acquire the position and attitude information of the target person inside the vehicle; the position and attitude information is used to indicate the position and attitude of the target person. Based on the location and posture information of the target person, a target spatial region is located, wherein the target spatial region is the spatial region where the target person is located among the at least two spatial regions; The target person is detected by at least two target sensors to obtain vital sign information corresponding to each of the at least two target sensors; the at least two target sensors are at least two vital sign sensors corresponding to the target spatial region; the vital sign information is used to indicate the vital signs of the target person; the vital sign information includes at least body temperature, blood saturation, heart rate, and respiratory rate; The weights of the vital signs information in the weighted averaging operation are determined based on the posture of the target person and the distance between the at least two target sensors and the target person within the target space area. Perform the weighted averaging operation on the vital sign information corresponding to the at least two target sensors respectively, and obtain the weighted averaged data as target sensing data; The target sensing data is input into the intelligent warning system in the vehicle to obtain the output result of the intelligent warning system. Based on the output of the intelligent early warning system, a vehicle early warning operation is performed.

2. The method according to claim 1, characterized in that, The step of inputting the target sensing data into the intelligent early warning system and executing vehicle early warning operations based on the output of the intelligent early warning system includes: The target sensing data is input into the intelligent early warning system, and the vital signs recognition results are obtained through the intelligent early warning system; the vital signs recognition results are used to indicate the vital signs status of the target person. Based on the vital signs recognition results, an early warning operation is executed.

3. The method according to claim 2, characterized in that, The step of performing an early warning operation based on the vital sign recognition results includes: Based on the vital sign recognition results, it is determined whether the vital signs of the target person are abnormal; In the event of abnormal vital signs of the target person, determine the warning level of the vital sign identification result; Based on the warning level, execute the warning operation corresponding to the warning level.

4. The method according to claim 1, characterized in that, The method further includes: A threshold for vital sign information data is generated based on historical vital sign information; the historical vital sign information is the vital sign information acquired by the at least two target sensors before acquiring the vital sign information of the target person in this acquisition. When the vital signs data corresponding to at least two target sensors exceed the vital signs data threshold, a vital signs warning message is issued; the vital signs warning message is used to indicate that the vital signs of the target person are abnormal.

5. The method according to claim 4, characterized in that, The method further includes: When the difference between the vital signs data corresponding to at least two target sensors and the vital signs data threshold reaches a specified value, a request for help is sent to the emergency services department through the vehicle's vehicle-to-everything (V2X) platform; the request for help includes the vehicle's location information and the vital signs information of the target person.

6. A vehicle warning device, characterized in that, The device includes: The position and attitude information acquisition module is used to acquire the position and attitude information of the target person inside the vehicle; the position and attitude information is used to indicate the position and attitude of the target person. The target spatial region positioning module is used to locate a target spatial region based on the position and posture information of the target person. The target spatial region is the spatial region where the target person is located among at least two spatial regions. A vital signs information acquisition module is used to perform detection on the target person through at least two target sensors to obtain vital signs information corresponding to the at least two target sensors respectively; the at least two target sensors are at least two vital signs sensors corresponding to the target spatial region; the vital signs information is used to indicate the vital signs of the target person; the vital signs information includes at least body temperature, blood saturation, heart rate, and respiratory rate; The weight determination module is used to determine the weights of the vital signs information in the weighted averaging operation based on the posture of the target person and the distances between the at least two target sensors and the target person in the target space area. The target sensing data acquisition module is used to perform the weighted average operation on the vital sign information corresponding to the at least two target sensors respectively, and obtain the weighted average data as target sensing data. The intelligent early warning detection module inputs the target sensing data into the intelligent early warning system in the vehicle and obtains the output result of the intelligent early warning system. The early warning operation execution module is used to execute vehicle early warning operations based on the output results of the intelligent early warning system.

7. A computer device, characterized in that, The computer device includes a processor and a memory, the memory storing instructions which are executed by the processor to implement the vehicle warning method as described in any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that, The storage medium stores instructions that are executed by a processor of a computer device to implement the vehicle warning method as described in any one of claims 1 to 5.

9. A computer program product, characterized in that, The computer program product includes computer instructions stored in a computer-readable storage medium; the computer instructions are read and executed by a processor of a computer device to implement the vehicle warning method as described in any one of claims 1 to 5.

Images