In-vehicle vital sign recognition and gesture control method and system

Abstract

This application relates to a method and system for in-vehicle vital sign recognition and gesture control. The control method includes the following steps: determining a reference point, and determining a first boundary and a second boundary based on the reference point, wherein the distance from the first boundary to the reference point is not less than the distance from the second boundary to the reference point; acquiring a dynamic target and determining the positional relationship between the dynamic target and the first and second boundaries; performing vital sign recognition when the dynamic target is outside the first boundary; performing gesture recognition when the dynamic target is between the first and second boundaries; and not performing recognition when the dynamic target is inside the second boundary. This achieves the detection of moving objects within the vehicle cabin area; on the one hand, it is used for vital sign detection to detect the presence of children; on the other hand, it is used for gesture detection to achieve gesture control; and it enables switching between the two functions.

Description

Technical Field

[0001] This application relates to the field of intelligent vehicles, and in particular to a method and system for in-vehicle vital sign recognition and gesture control. Background Technology

[0002] With social development and the improvement of people's living standards, the ownership rate of automobiles continues to rise. As a result, driving safety has become a growing concern.

[0003] Meanwhile, with the development of electronic technology and Internet of Things technology, more and more car manufacturers will equip their cars with functions such as driver fatigue detection, child forgetting reminders, gesture recognition, facial recognition, and voice recognition.

[0004] Typically, these multiple functions require separate detection using different sensors, which increases the cost of the vehicle. Summary of the Invention

[0005] In order to achieve child forgetting reminders and to realize gesture recognition based on the same sensor, thereby improving product value, this application provides an in-vehicle vital signs recognition and gesture control method and system.

[0006] Firstly, this application provides a method for in-vehicle vital sign recognition and gesture control, employing the following technical solution:

[0007] A method for in-vehicle vital sign recognition and gesture control includes the following steps:

[0008] Determine a reference point, and determine a first boundary and a second boundary based on the reference point, wherein the distance from the first boundary to the reference point is not less than the distance from the second boundary to the reference point;

[0009] Acquire the dynamic target and determine the positional relationship between the dynamic target and the first and second boundaries;

[0010] When the dynamic target is located outside the first boundary, vital signs are identified;

[0011] Gesture recognition is performed when the dynamic target is located between the first and second boundaries;

[0012] If the dynamic target is located within the second boundary, no identification is performed.

[0013] By adopting the above technical solution, the detection of moving objects in the vehicle cabin area can be achieved; on the one hand, it can be used for vital sign detection to detect the presence of children; on the other hand, it can be used for gesture detection to achieve gesture control; and the switching between the two functions can be realized.

[0014] Preferably, the following steps are also included:

[0015] A first range, a second range, and a third range are determined based on a benchmark point, wherein the distance from the first range to the benchmark point is not less than the distance from the second range to the benchmark point and not less than the distance from the third range to the benchmark point;

[0016] When performing vital sign recognition, the first boundary is controlled to be within the second range;

[0017] When performing gesture recognition, the first boundary is controlled to be located within a first range, and the second boundary is located within a third range;

[0018] Without identification, the second boundary is controlled to be located within the second range.

[0019] By adopting the above technical solution, the first and second boundaries (the size of the detection area) are dynamically adjusted when switching between vital sign detection and gesture detection functions. Specifically, when performing vital sign recognition, the area outside the first boundary is increased; when performing gesture recognition, the area between the first and second boundaries is increased. This improves the user experience.

[0020] Preferably, the following steps are also included:

[0021] Based on the positional relationship between the dynamic target and the first, second, and third ranges, and the preset control mechanism, the first boundary is controlled to be located in the first or second range, and the second boundary is controlled to be located in the second or third range.

[0022] By adopting the above technical solution, the positional relationship between the dynamic target and the first, second, and third ranges is determined to identify the vital signs or gestures of the dynamic target, and then the first and second boundaries are dynamically adjusted.

[0023] Preferably, during the process of the dynamic target approaching the reference point, the control mechanism includes:

[0024] If the dynamic target is located outside the far boundary of the first range, control the first boundary to be located in the second range;

[0025] When the dynamic target is located between the far and near boundaries of the first range, the first boundary is controlled to be located in the second range;

[0026] When a dynamic target is located between the near boundary of a first range and the far boundary of a second range, the first boundary is controlled to be located within the first range and the second boundary is controlled to be located within the third range.

[0027] When a dynamic target is located between the far boundary of the second range and the near boundary of the third range, the first boundary is controlled to be located within the first range and the second boundary is controlled to be located within the third range.

[0028] When the dynamic target is located within the near boundary of the third range, the control second boundary is located within the second range.

[0029] Preferably, during the process of the dynamic target moving away from the reference point, the control mechanism includes:

[0030] If the dynamic target is located within the near boundary of the third range, the control second boundary is located within the second range;

[0031] When a dynamic target is located between the near boundary of the third range and the far boundary of the second range, the control second boundary is located within the second range;

[0032] When a dynamic target is located between the far boundary of the second range and the near boundary of the first range, the first boundary is controlled to be located within the first range, and the second boundary is controlled to be located within the third range.

[0033] When a dynamic target is located between the near and far boundaries of a first range, the first boundary is controlled to be within the first range, and the second boundary is controlled to be within the third range.

[0034] When the dynamic target is located outside the far boundary of the first range, the control first boundary is located in the second range.

[0035] Preferably, the following steps are also included:

[0036] Based on the identification result of the presence of a living being in the vehicle, which is obtained through vital sign recognition, vehicle data is acquired to determine whether the vehicle is powered off.

[0037] If the vehicle is found to be powered down, a warning message will be output.

[0038] By adopting the above technical solution, if a living being inside the vehicle poses a safety hazard when the vehicle is powered off, a warning message will be output to remind the user to pay attention.

[0039] Preferably, the step of outputting a warning message when the vehicle is determined to be powered down includes the following steps:

[0040] If the vehicle is found to be powered off, prompt the occupants to perform a designated hand gesture or turn on the air conditioning.

[0041] Gesture recognition is performed to determine if the gesture operation is correct, and vehicle data is acquired to determine whether the air conditioning is turned on;

[0042] When the gesture operation is successful or the air conditioner is turned on, a prompt message will be displayed.

[0043] If the gesture operation is incorrect and the air conditioner is not turned on, a warning message will be output.

[0044] By adopting the above technical solution, if the air conditioner is on, the safety risk to living beings inside the vehicle is determined to be low; if the people inside the vehicle perform a specified gesture, it is determined that the people inside the vehicle have the capacity to act; and a normal-level prompt message is output to remind the user to pay attention.

[0045] If the air conditioning is off, the system determines that there is a high safety risk to any living beings inside the vehicle; if the occupants cannot perform the specified hand gestures, the system determines that the occupants lack the capacity to act; and it outputs a warning message of high importance to remind the user to pay attention.

[0046] Preferably, the following steps are also included:

[0047] If the vehicle is determined to be powered on, turn on the air conditioning and display a notification message.

[0048] By adopting the above technical solutions, turning on the air conditioner helps maintain a comfortable environment inside the vehicle, thereby reducing the safety risks to living beings inside the vehicle.

[0049] Preferably, the steps of turning on the air conditioner and outputting a prompt message when it is determined that the vehicle is not powered off include the following steps:

[0050] If the vehicle is determined to be not powered off, vehicle data is obtained to determine if the vehicle is in a non-driving state.

[0051] When the vehicle is not in motion, vital signs detection is used to determine whether there is a living being in the driver's seat.

[0052] If there is no living being in the driver's seat, turn on the air conditioning and output a notification message.

[0053] By adopting the above technical solution, there is a possibility that the driver may forget to turn off the engine and leave. In this case, the above solution will provide a reminder.

[0054] Secondly, this application provides an in-vehicle vital signs recognition and gesture control system, which adopts the following technical solution:

[0055] An in-vehicle vital signs recognition and gesture control system includes a control module, a detection module, and a processing module;

[0056] The control module has buttons; the detection module is connected to the control module;

[0057] The reference point is determined based on the position of the detection module, and the first boundary and the second boundary are determined based on the reference point;

[0058] The detection module is used to acquire dynamic targets;

[0059] The processing module determines the positional relationship between the dynamic target and the first and second boundaries;

[0060] When the dynamic target is located outside the first boundary, the processing module performs vital sign recognition;

[0061] When the dynamic target is located between the first boundary and the second boundary, the processing module performs gesture recognition;

[0062] If the dynamic target is located within the second boundary, the processing module will not perform identification.

[0063] By adopting the above technical solution, the detection of moving objects in the vehicle cabin area can be achieved; on the one hand, it can be used for vital sign detection to detect the presence of children; on the other hand, it can be used for gesture detection to achieve gesture control; and the switching between the two functions can be realized.

[0064] In summary, this application includes at least one of the following beneficial technical effects:

[0065] 1. Detect vital signs inside the vehicle (if children are present) to prevent children from being forgotten in the vehicle, in accordance with the requirements of the China New Vehicle Evaluation 2025 regulations;

[0066] 2. Gesture detection enables the control of some functions, allowing for hands-free operation and helping drivers to operate some in-vehicle functions without looking.

[0067] 3. For the two functions mentioned above, a solution is provided that enables reasonable switching between functions; and a dynamic range mechanism is introduced to improve the user experience.

[0068] 4. For products with functions that detect the presence of children in the car, gesture detection has been added to the software using the same sensors, bringing higher added value to the product. Attached Figure Description

[0069] Figure 1 This is a structural block diagram of the in-vehicle vital signs recognition and gesture control system.

[0070] Figure 2 This is a structural diagram of the control module and the detection module.

[0071] Figure 3 This is a flowchart of the in-vehicle vital sign recognition and gesture control method.

[0072] Figure 4 This is a flowchart for acquiring single-frame and multi-frame data.

[0073] Figure 5 It is a schematic diagram of the reference point, the first range, the second range, and the third range.

[0074] Figure 6 This is a schematic diagram of the control mechanism.

[0075] Figure 7 This is a flowchart for vital sign detection.

[0076] Figure 8 This is a flowchart of the output of vital sign detection results.

[0077] Figure 9 This is a flowchart for gesture detection.

[0078] Explanation of reference numerals in the attached diagram: 1. Control module; 2. Detection module; 3. Processing module; 4. Communication module. Detailed Implementation

[0079] The following is in conjunction with the appendix Figure 1-9 This application will be described in further detail.

[0080] Reference Figure 1 This application discloses an in-vehicle vital signs recognition and gesture control system, including a control module 1, a detection module 2, a processing module 3, and a communication module 4.

[0081] Control module 1 has buttons for controlling in-vehicle functions (such as: interior reading light switch, sunroof switch, window switch, etc.). The buttons can be physical buttons or virtual buttons (such as: touch buttons).

[0082] In one embodiment, the control module 1 is located in the roof of the vehicle.

[0083] The detection module 2 is used to detect moving objects in the vehicle cabin area, to detect the presence of children by detecting vital signs, and to detect gestures to achieve gesture control.

[0084] In one embodiment, the detection module 2 employs a millimeter-wave radar sensor; and refers to Figure 2 The millimeter-wave radar sensor is installed at control module 1.

[0085] Processing module 3 is used for data processing.

[0086] The communication module 4 is used to communicate with the cloud server, and it is also used to communicate with the vehicle ECU to obtain vehicle data.

[0087] This application provides a complete system for signal transmission and reception, signal processing and judgment required for vital sign detection and gesture detection based on millimeter-wave radar, and communicates with the vehicle body to obtain the necessary information of the vehicle body and send the judgment results.

[0088] The implementation of the control method will be explained in detail below, taking into account the in-vehicle vital signs recognition and gesture control system.

[0089] Reference Figure 3This application also discloses an in-vehicle vital sign recognition and gesture control method, including:

[0090] S100 acquires and records single-frame and multi-frame data.

[0091] Reference Figure 4 The radar data is processed to obtain single-frame data: data of each dynamic target, multi-frame data and the motion vectors of each dynamic target calculated therefrom.

[0092] S200, dead zone & gesture detection zone range dynamically determined.

[0093] Step S200 includes:

[0094] S210, determine the reference point, and determine the first boundary and the second boundary based on the reference point, wherein the distance from the first boundary to the reference point is not less than the distance from the second boundary to the reference point.

[0095] Specifically, the location of the millimeter-wave radar sensor is used as the reference point; the area between the first and second boundaries is the gesture detection zone; and the area inside the second boundary is the dead zone.

[0096] Step S210 includes:

[0097] Reference Figure 5 S211, a first range, a second range and a third range are determined based on a reference point, wherein the distance from the first range to the reference point is not less than the distance from the second range to the reference point and the distance from the third range to the reference point is not less than the distance from the third range to the reference point.

[0098] In this embodiment, the distances from the first range to the reference point, the second range to the reference point, and the third range to the reference point are all fixed values, and these values ​​can be configured by technicians. In this embodiment, the distance from the first range to the reference point is greater than the distance from the second range to the reference point, which is greater than the distance from the third range to the reference point.

[0099] S212, based on the positional relationship between the dynamic target and the first range, the second range, and the third range, and the preset control mechanism, to control the first boundary to be located in the first range or the second range, and the second boundary to be located in the second range or the third range.

[0100] Specifically, refer to Figure 6 The control mechanisms include:

[0101] State ①: When the dynamic target is located outside the far boundary of the first range, both the first boundary and the second boundary are controlled to be located within the second range.

[0102] State ②: When the dynamic target is located between the far and near boundaries of the first range, control both the first and second boundaries to be located within the second range.

[0103] State ③: When the dynamic target is located between the near boundary of the first range and the far boundary of the second range, control the first boundary to be located in the first range and the second boundary to be located in the third range.

[0104] State ④: When the dynamic target is located between the far boundary of the second range and the near boundary of the third range, control the first boundary to be located in the first range and the second boundary to be located in the third range.

[0105] In state ⑤, when the dynamic target is located within the near boundary of the third range, both the first and second boundaries are controlled to be located within the second range;

[0106] In state ⑥, when the dynamic target is located between the near boundary of the third range and the far boundary of the second range, the first boundary and the second boundary are both located in the second range.

[0107] State ⑦: When the dynamic target is located between the near and far boundaries of the first range, control the first boundary to be located within the first range and the second boundary to be located within the third range.

[0108] If the motion vector of the dynamic target radially enters the far boundary of the first range without reaching the near boundary of the first range, then the control switches from state ① to state ②.

[0109] If the motion vector of the dynamic target radially enters the near boundary of the first range without reaching the far boundary of the second range in path B1, then the control switches from state ② to state ③.

[0110] If the motion vector of the dynamic target radially enters the far boundary of the second range without reaching the near boundary of the third range, then the control switches from state ③ to state ④.

[0111] If the motion vector of the dynamic target radially enters the near boundary of the third range via path D1, then the control switches from state ④ to state ⑤.

[0112] If the motion vector of the dynamic target moves radially away from the near boundary of the third range but does not reach the far boundary of the second range, then the control switches from state ⑤ to state ⑥.

[0113] If the motion vector of the dynamic target moves radially away from the far boundary of the second range but does not reach the near boundary of the first range, then the control switches from state ⑥ to state ③.

[0114] If the motion vector of the dynamic target moves radially away from the near boundary of the first range but does not reach the far boundary of the first range, then the control switches from state ③ to state ⑦.

[0115] If the motion vector of the dynamic target moves radially away from the far boundary of the first range in path G1, then the control switches from state ⑦ to state ①.

[0116] If the motion vector of the dynamic target moves radially away from the far boundary of the first range in path B2, then the control switches from state ② to state ①.

[0117] If the motion vector of the dynamic target moves radially away from the far boundary of the second range but does not reach the near boundary of the first range, then the control switches from state ④ to state ③.

[0118] If the motion vector of the dynamic target radially enters the near boundary of the third range via path F2, then the control switches from state ⑥ to state ⑤.

[0119] If the motion vector of the dynamic target enters the near boundary of the first range radially along path G2, but does not reach the far boundary of the second range, then the control switches from state ⑦ to state ③.

[0120] S220: Acquire the dynamic target, and based on the positional relationship between the dynamic target and the first boundary and the second boundary, control whether to perform vital sign recognition, gesture recognition, or not to perform recognition.

[0121] Specifically:

[0122] When the dynamic target is located outside the first boundary (the dynamic target is located outside the gesture detection area), vital signs recognition is performed.

[0123] Gesture recognition is performed when the dynamic target is located between the first and second boundaries (the dynamic target is not located outside the gesture detection area, and the dynamic target is located outside the dead zone).

[0124] If the dynamic target is within the second boundary, no recognition is performed. This is to avoid false sensing when the user intends to touch a button on control module 1.

[0125] Define the detection area and its changing conditions to reduce the false trigger rate of device function switching. Address potential gesture misrecognition when the user touches the control module 1 buttons (expand the "dead zone" and shrink the "gesture detection area"); and expand the gesture detection range (shrink the "dead zone" and expand the "gesture detection area") when the user intends to make a gesture; thereby improving the user's operating experience.

[0126] If the determination result is yes, indicating that the dynamic target is outside the gesture detection area, the following steps are also included:

[0127] S310, Vital signs detection.

[0128] Reference Figure 7The radar continuously acquires multiple frames of data, which are then converted into a range-azimuth heatmap. The constant false alarm rate (CFAR) is used to obtain the two-dimensional planar orientation of moving targets inside the vehicle and the angle of arrival is estimated to generate a three-dimensional point cloud of the moving targets sensed inside the vehicle. Clustering is then performed, and the clusters are judged to determine whether they possess the characteristics of living beings (such as the number and intensity of points).

[0129] S320, output of vital signs detection results.

[0130] Based on the situation inside the vehicle, a judgment is made and a signal is sent to the vehicle body.

[0131] Reference Figure 8 Step S320 includes:

[0132] S321, after obtaining the identification result of the presence of a living being in the vehicle based on vital sign recognition, acquire vehicle data to determine whether the vehicle is powered off.

[0133] Communication module 4 is connected to the vehicle ECU to obtain vehicle data. For example, if the engine is off and the doors are locked, it is determined that the vehicle is in a power-off state.

[0134] S322, when it is determined that the vehicle is powered off, prompts the occupants to perform a specified hand gesture or turn on the air conditioning.

[0135] S323 performs gesture recognition to determine if the gesture operation is correct and obtains vehicle data to determine if the air conditioning is on.

[0136] S324, outputs a prompt message when gesture operation is performed or air conditioning is turned on.

[0137] S325 outputs a warning message if the gesture operation is incorrect and the air conditioner is not turned on.

[0138] S326: If it is determined that the vehicle is not powered off, vehicle data is retrieved to determine that the vehicle is in a non-driving state.

[0139] S327, when the vehicle is not in motion, determines whether there is a living being in the driver's seat based on vital signs detection.

[0140] S328: If no living being is present in the driver's seat for more than n seconds, turn on the air conditioning and output a prompt message.

[0141] The signal levels output to the vehicle are divided into two levels. "Ordinary level" is "prompt", indicating a low level of urgency. It means there are people in the vehicle who have some ability to act or the driver may be temporarily away. The "prompt" can be sent by the vehicle to the owner's mobile phone. "Important level" is "warning", indicating a high level of urgency. It means there may be people in the vehicle who do not have the ability to act or other living beings. The "warning" can be sent by the owner's mobile phone, escalating to a text message or phone call from the vehicle manufacturer's service center, or even the vehicle horn and flashing lights, a voice warning from the vehicle's external speaker, or even an ambulance, depending on the length of time the living beings have been in the vehicle.

[0142] Based on the previously obtained information regarding the presence and location of living beings, the system first determines whether the vehicle is powered on or off. If the vehicle is powered off, the occupants will be asked to perform a specified hand gesture or manually turn on the air conditioning. If they fail to respond correctly, a "warning" will be issued; if they respond correctly, a "prompt" will be issued. If the vehicle is powered on and the driver's seat remains unoccupied for a certain period, the air conditioning will be forcibly turned on to ensure the safety of any living beings inside the vehicle, and a "prompt" will be issued.

[0143] In cases where the dynamic target is not located outside the gesture detection area, but is located outside the outer area, the function also includes: gesture detection and outputting the gesture result.

[0144] Reference Figure 9 Based on the detection of reasonable hand movement targets using multi-frame data, a distance-Doppler heatmap is generated, and the features of the gesture are extracted and compared with the built-in / recorded model to derive the feature classification results. Finally, the gesture type is determined by confidence level.

[0145] This application provides a vital sign detection method to address the evaluation requirements for detecting the presence of children in vehicles in future Chinese new car evaluation procedures. Based on this, a gesture control detection method and a method for determining the switching between the two detection functions are added.

[0146] This application embodiment provides a device in the vehicle that embeds a millimeter-wave radar sensor in the control module 1, and uses it to detect moving objects in the vehicle cabin area. It can be used for vital sign detection to detect the presence of children; or for gesture detection to detect gestures in the air; and a judgment process is provided to switch the device between these two functions.

[0147] The above are all preferred embodiments of this application, and are not intended to limit the scope of protection of this application. Therefore, all equivalent changes made in accordance with the structure, shape and principle of this application should be covered within the scope of protection of this application.

Claims

1. A method for in-vehicle vital sign recognition and gesture control, characterized in that, Includes the following steps: A reference point is determined, and a first boundary and a second boundary are determined based on the reference point, wherein the distance from the first boundary to the reference point is not less than the distance from the second boundary to the reference point; Acquire a dynamic target and determine the positional relationship between the dynamic target and the first boundary and the second boundary; When the dynamic target is located outside the first boundary, vital signs are identified. Gesture recognition is performed when the dynamic target is located between the first boundary and the second boundary; If the dynamic target is located within the second boundary, no identification is performed; A first range, a second range, and a third range are determined based on the reference point, wherein the distance from the first range to the reference point is not less than the distance from the second range to the reference point, and the distance from the second range to the reference point is not less than the distance from the third range to the reference point; When performing the vital sign recognition, the first boundary is controlled to be located within the second range; When performing the gesture recognition, the first boundary is controlled to be located within the first range, and the second boundary is controlled to be located within the third range; Without identification, the second boundary is controlled to be within the second range.

2. The in-vehicle vital sign recognition and gesture control method according to claim 1, characterized by, It also includes the following steps: Based on the positional relationship between the dynamic target and the first range, the second range, and the third range, and a preset control mechanism, the first boundary is controlled to be located in the first range or the second range, and the second boundary is located in the second range or the third range.

3. The in-vehicle vital sign recognition and gesture control method according to claim 2, characterized in that, As the dynamic target approaches the reference point, the control mechanism includes: If the dynamic target is located outside the far boundary of the first range, the first boundary is controlled to be located within the second range; When the dynamic target is located between the far and near boundaries of the first range, the first boundary is controlled to be located within the second range; When the dynamic target is located between the near boundary of the first range and the far boundary of the second range, the first boundary is controlled to be located within the first range, and the second boundary is controlled to be located within the third range. When the dynamic target is located between the far boundary of the second range and the near boundary of the third range, the first boundary is controlled to be located within the first range, and the second boundary is controlled to be located within the third range. When the dynamic target is located within the near boundary of the third range, the second boundary is controlled to be located within the second range.

4. The in-vehicle vital sign recognition and gesture control method of claim 2, wherein, As the dynamic target moves away from the reference point, the control mechanism includes: If the dynamic target is located within the near boundary of the third range, the second boundary is controlled to be located within the second range; When the dynamic target is located between the near boundary of the third range and the far boundary of the second range, the second boundary is controlled to be located within the second range; When the dynamic target is located between the far boundary of the second range and the near boundary of the first range, the first boundary is controlled to be located within the first range, and the second boundary is controlled to be located within the third range. When the dynamic target is located between the near and far boundaries of the first range, the first boundary is controlled to be located within the first range, and the second boundary is controlled to be located within the third range; If the dynamic target is located outside the far boundary of the first range, the first boundary is controlled to be located within the second range.

5. The in-vehicle vital signs recognition and gesture control method according to claim 1, characterized in that, It also includes the following steps: Based on the identification result of the presence of a living being in the vehicle, which is obtained through vital sign recognition, vehicle data is acquired to determine whether the vehicle is powered off. If the vehicle is found to be powered down, a warning message will be output.

6. The in-vehicle vital signs recognition and gesture control method according to claim 5, characterized in that, When the vehicle is determined to be powered down, the warning message output includes the following steps: If the vehicle is found to be powered off, prompt the occupants to perform a designated hand gesture or turn on the air conditioning. Perform gesture recognition to determine if the gesture operation is appropriate, and acquire vehicle data to determine if the air conditioner is turned on; When the gesture operation is performed or the air conditioner is turned on, a prompt message is output; If the gesture operation is incorrect and the air conditioner is not turned on, a warning message will be output.

7. The in-vehicle vital signs recognition and gesture control method according to claim 5, characterized in that, It also includes the following steps: If the vehicle is determined to be powered on, turn on the air conditioning and display a notification message.

8. The in-vehicle vital signs recognition and gesture control method according to claim 7, characterized in that, If the vehicle is determined to be powered on, the steps to turn on the air conditioning and output a prompt message include the following: If the vehicle is determined to be not powered off, vehicle data is obtained to determine if the vehicle is in a non-driving state. When the vehicle is not in motion, vital signs detection is used to determine whether there is a living being in the driver's seat. If there is no living being in the driver's seat, turn on the air conditioning and output a notification message.

Images