Vehicle control methods, devices, vehicles and storage media

Abstract

This application discloses a vehicle control method, device, vehicle, and storage medium, belonging to the field of vehicle technology. The method includes: acquiring a vehicle liveness detection function signal and a vehicle status signal. The liveness detection function signal indicates whether the vehicle's liveness detection function is activated, and the vehicle status signal indicates whether the vehicle is locked, whether all doors are closed, and the vehicle's power status. If the liveness detection function signal indicates that the vehicle's liveness detection function is activated, and the vehicle status signal meets a first condition or a second condition, then a liveness detection is performed inside the vehicle to determine whether there is a living being inside. If there is a living being inside the vehicle, a first warning operation is performed to alert adults that there is a living being inside. This application, by performing liveness detection inside the vehicle and performing corresponding warning operations when a living being is detected, can promptly remind adults to remove children from the vehicle.

Description

Technical Field

[0001] This application relates to the field of vehicle technology, and in particular to a vehicle control method, device, vehicle, and storage medium. Background Technology

[0002] With the development of technology, vehicles are becoming increasingly intelligent. At the same time, people's demands for vehicles are no longer limited to driving performance; safety is also receiving more and more attention. In some situations, such as prolonged exposure to direct sunlight, the interior temperature of a vehicle can rise significantly. If a child is forgotten or trapped inside, serious consequences may occur. Therefore, there is an urgent need for a vehicle control method to reduce the occurrence of such dangerous situations. Summary of the Invention

[0003] This application provides a vehicle control method, device, vehicle, and storage medium, which can perform corresponding warning operations when a living person is detected inside the vehicle, promptly prompting adults to remove children from the vehicle. The technical solution is as follows:

[0004] On the one hand, a vehicle control method is provided, the method comprising:

[0005] The system acquires the liveness detection function signal and the vehicle status signal of the vehicle. The liveness detection function signal is used to indicate whether the liveness detection function of the vehicle is turned on, and the vehicle status signal indicates whether the vehicle is locked, whether all doors are closed, and the power status of the vehicle.

[0006] If the liveness detection function signal indicates that the liveness detection function of the vehicle has been activated, and the vehicle status signal meets the first condition or the second condition, then liveness detection is performed inside the vehicle to determine whether there is a living being inside the vehicle. The first condition is used to indicate that the vehicle is locked, all doors are closed, and the vehicle's power is off. The second condition is used to indicate that the vehicle is unlocked, all doors are closed, and the vehicle's power is off.

[0007] If there are living beings inside the vehicle, a first warning operation will be performed to indicate that there are living beings inside the vehicle.

[0008] Optionally, after performing the first warning operation, the method further includes:

[0009] If the first warning operation is interrupted before it ends, or if the first warning operation is not interrupted and ends, then a timer is started and the vehicle status signal is reacquired after a first timer duration.

[0010] If the reacquired vehicle status signal indicates that all vehicle doors are closed and the vehicle's power is not fully on, then a liveness detection will be performed on the vehicle interior again to determine whether there are any living beings inside the vehicle.

[0011] If there are living beings inside the vehicle, a second warning operation is performed, and the warning level of the second warning operation is higher than that of the first warning operation.

[0012] Optionally, after performing the second warning operation, the method further includes:

[0013] If the second warning operation is interrupted before it ends, a timer is started and the vehicle status signal is reacquired after the second timer duration.

[0014] If the reacquired vehicle status signal indicates that the vehicle is locked, all doors are closed, and the vehicle's power is not fully on, then a liveness detection will be performed on the vehicle interior again to determine whether there are any living beings inside the vehicle.

[0015] If there are living beings inside the vehicle, the second warning operation will be performed again.

[0016] Optionally, the method further includes:

[0017] If the second warning operation is interrupted before it ends, or if the second warning operation is not interrupted and ends, then the timer starts and the vehicle status signal is reacquired after the third timer duration.

[0018] If the reacquired vehicle status signal indicates that all vehicle doors are closed and the vehicle's power is not fully on, then a liveness detection will be performed on the vehicle interior again to determine whether there are any living beings inside the vehicle.

[0019] If there are living beings inside the vehicle, a third warning operation is performed and the vehicle's air conditioning is turned on. The warning level of the third warning operation is higher than that of the second warning operation.

[0020] Optionally, if the liveness detection function signal indicates that the liveness detection function of the vehicle is enabled, and the vehicle status signal meets the first condition or the second condition, then performing liveness detection inside the vehicle includes:

[0021] If the liveness detection function signal indicates that the liveness detection function of the vehicle has been activated, and the vehicle status signal meets the first condition or the second condition, then the delayed warning function signal of the vehicle is obtained. The delayed warning function signal is used to indicate whether the function of delayed detection of living beings inside the vehicle has been activated.

[0022] If the delay warning function signal indicates that the function of delay detection of living beings inside the vehicle has been enabled, then the timing will start and the detection of living beings inside the vehicle will be performed after the target delay time.

[0023] Optionally, the liveness detection inside the vehicle includes:

[0024] Multiple electromagnetic wave signals are sequentially transmitted into the vehicle using millimeter-wave radar.

[0025] The echo signals returned after the multiple electromagnetic wave signals are reflected and scattered inside the vehicle are received, and multiple echo signals are obtained.

[0026] Generate point clouds corresponding to the multiple echo signals respectively to obtain multiple point clouds;

[0027] The multiple point clouds are analyzed to determine whether the differences between the multiple point clouds satisfy the fluctuation pattern generated by the respiration of a living organism or the fluctuation pattern generated by the heartbeat.

[0028] If the differences between the multiple point clouds satisfy the fluctuation pattern produced by the breathing of a living organism or the fluctuation pattern produced by the heartbeat, then it is determined that there is a living organism inside the vehicle.

[0029] Optionally, if there are living beings inside the vehicle, and before performing the first, second, or third warning operation, the method further includes:

[0030] The vehicle interior is captured by a camera inside the vehicle, which captures images of areas where living beings exist.

[0031] The images inside the vehicle are analyzed to determine the age range of the living organism.

[0032] If it is determined, based on the age range of the living being, that there are children and no adults inside the vehicle, then the subsequent first warning operation, second warning operation, or third warning operation will be executed.

[0033] On the other hand, a vehicle control device is provided, the device comprising:

[0034] The acquisition module is used to acquire the liveness detection function signal and the vehicle status signal of the vehicle. The liveness detection function signal is used to indicate whether the liveness detection function of the vehicle is turned on, and the vehicle status signal indicates whether the vehicle is locked, whether all doors are closed, and the power status of the vehicle.

[0035] The first liveness detection module is used to perform liveness detection inside the vehicle if the liveness detection function signal indicates that the liveness detection function of the vehicle has been turned on, and the vehicle status signal meets the first condition or the second condition, in order to determine whether there is a living being inside the vehicle. The first condition is used to indicate that the vehicle is locked, all doors are closed, and the power of the vehicle is turned off. The second condition is used to indicate that the vehicle is unlocked, all doors are closed, and the power of the vehicle is turned off.

[0036] The first warning module is used to perform a first warning operation if there is a living being inside the vehicle, so as to indicate that there is a living being inside the vehicle.

[0037] Optionally, the device further includes:

[0038] The first timing module is used to start timing and reacquire the vehicle status signal after a first timing duration if the first warning operation is interrupted before it ends, or if the first warning operation is not interrupted and ends.

[0039] The second liveness detection module is used to perform liveness detection on the vehicle interior again if the reacquired vehicle status signal indicates that all the vehicle doors are closed and the vehicle power is not fully turned on, in order to determine whether there are living beings inside the vehicle.

[0040] The second warning module is used to perform a second warning operation if there is a living being inside the vehicle. The warning level of the second warning operation is higher than that of the first warning operation.

[0041] Optionally, the device further includes:

[0042] The second timing module is used to start timing and reacquire the vehicle status signal after the second timing duration if the second warning operation is interrupted before it ends.

[0043] The third liveness detection module is used to perform liveness detection on the vehicle interior again if the reacquired vehicle status signal indicates that the vehicle is locked, all doors are closed, and the vehicle's power is not fully on, in order to determine whether there are living beings inside the vehicle.

[0044] The third warning module is used to perform the second warning operation again if there are living beings inside the vehicle.

[0045] Optionally, the device further includes:

[0046] The third timing module is used to start timing and reacquire the vehicle status signal after a third timing duration if the second warning operation is interrupted before it ends, or if the second warning operation is not interrupted and ends.

[0047] The fourth liveness detection module is used to perform liveness detection on the vehicle interior again if the reacquired vehicle status signal indicates that all the vehicle doors are closed and the vehicle power is not fully turned on, in order to determine whether there are living beings inside the vehicle.

[0048] The fourth warning module is used to perform a third warning operation and turn on the vehicle's air conditioning if there are living beings inside the vehicle. The warning level of the third warning operation is higher than that of the second warning operation.

[0049] Optionally, the first liveness detection module includes:

[0050] The acquisition submodule is used to acquire the vehicle's delayed warning function signal if the liveness detection function signal indicates that the vehicle's liveness detection function has been enabled, and the vehicle status signal meets the first condition or the second condition. The delayed warning function signal is used to indicate whether the function of delayed detection of living beings inside the vehicle has been enabled.

[0051] The timing submodule is used to start timing and perform liveness detection inside the vehicle after a target delay duration if the delay warning function signal indicates that the function of delay detection of living beings inside the vehicle has been enabled.

[0052] Optionally, the first liveness detection module is specifically used for:

[0053] Multiple electromagnetic wave signals are sequentially transmitted into the vehicle using millimeter-wave radar.

[0054] The echo signals returned after the multiple electromagnetic wave signals are reflected and scattered inside the vehicle are received, and multiple echo signals are obtained.

[0055] Generate point clouds corresponding to the multiple echo signals respectively to obtain multiple point clouds;

[0056] The multiple point clouds are analyzed to determine whether the differences between the multiple point clouds satisfy the fluctuation pattern generated by the respiration of a living organism or the fluctuation pattern generated by the heartbeat.

[0057] If the differences between the multiple point clouds satisfy the fluctuation pattern produced by the breathing of a living organism or the fluctuation pattern produced by the heartbeat, then it is determined that there is a living organism inside the vehicle.

[0058] Optionally, the device further includes:

[0059] The imaging module is used to capture images of the areas inside the vehicle where living beings exist using a camera inside the vehicle, thereby obtaining images of the vehicle interior.

[0060] The analysis module is used to analyze the images inside the vehicle to determine the age range of the living organism.

[0061] The triggering module is used to execute a first warning operation, a second warning operation, or a third warning operation if it is determined based on the age range of the living person that there is a child and no adult inside the vehicle.

[0062] On the other hand, a vehicle is provided, the vehicle including a memory and a processor, the memory for storing a computer program, and the processor for executing the computer program stored in the memory to implement the steps of the vehicle control method described above.

[0063] On the other hand, a computer-readable storage medium is provided, wherein a computer program is stored therein, and when the computer program is executed by a processor, it implements the steps of the vehicle control method described above.

[0064] On the other hand, a computer program product containing instructions is provided, which, when executed on a computer, cause the computer to perform the steps of the vehicle control method described above.

[0065] The technical solution provided in this application can bring at least the following beneficial effects:

[0066] When the liveness detection function signal indicates that the vehicle's liveness detection function is activated, and the vehicle status signal meets the first or second condition, liveness detection is performed. If there is a living being inside the vehicle, the first warning operation is performed. In this way, if only a child is left inside the vehicle, the adult can be promptly reminded to take the child out of the vehicle to prevent the child from being in danger. Attached Figure Description

[0067] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0068] Figure 1 This is a schematic diagram of the structure of an implementation environment provided in an embodiment of this application;

[0069] Figure 2 This is a schematic diagram of another implementation environment provided in this application embodiment;

[0070] Figure 3 This is a flowchart of a vehicle control method provided in an embodiment of this application;

[0071] Figure 4 This is a flowchart of a vehicle control method provided in an embodiment of this application;

[0072] Figure 5 This is a flowchart of a vehicle control method provided in an embodiment of this application;

[0073] Figure 6 This is a flowchart of a vehicle control method provided in an embodiment of this application;

[0074] Figure 7 This is a schematic diagram of the structure of a vehicle control device provided in an embodiment of this application;

[0075] Figure 8 This is a schematic diagram of the structure of a vehicle provided in an embodiment of this application. Detailed Implementation

[0076] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0077] Before providing a detailed explanation of the vehicle control method provided in the embodiments of this application, the application scenarios and implementation environment involved in the embodiments of this application will be introduced first.

[0078] With the development of technology, vehicles are becoming increasingly intelligent. At the same time, people's demands for vehicles are no longer limited to driving performance; safety is also receiving more and more attention. During the summer, vehicles exposed to direct sunlight for extended periods often experience high interior temperatures, potentially reaching 70 degrees Celsius or higher. If a child is forgotten inside the vehicle, or if a child enters an unlocked car unnoticed and becomes trapped, it could lead to unconsciousness or even more serious safety issues.

[0079] Based on this, the present application provides a vehicle control method that can perform corresponding warning operations based on vehicle status information. That is, it can determine whether a child has been accidentally forgotten in the vehicle or intentionally forgotten in the vehicle, or whether the child has entered an unlocked vehicle and is unable to get out, based on the vehicle status information, and perform corresponding warning operations according to the above three situations to remind that there is a child inside the vehicle and ensure the child's safety.

[0080] Please refer to Figure 1 , Figure 1This is a schematic diagram illustrating an implementation environment according to an exemplary embodiment. The implementation environment includes a liveness detection unit 101 and a controller 102, wherein the liveness detection unit 101 can communicate with the controller 102. This communication connection can be wired or wireless, and this embodiment does not limit the specific connection.

[0081] The liveness detection unit 101 is used to acquire the vehicle's liveness detection function signal and vehicle status signal. If the liveness detection function signal indicates that the vehicle's liveness detection function is activated, and the vehicle status signal meets either the first or second condition, then liveness detection is performed inside the vehicle. Figure 2 As shown, the liveness detection unit 101 may include a radar and a camera. The radar is used to acquire the liveness detection function signal and the vehicle status signal of the vehicle. If the liveness detection function signal indicates that the liveness detection function of the vehicle has been activated, and the vehicle status signal meets the first condition or the second condition, it detects whether there is a living being inside the vehicle. After detecting that there is a living being inside the vehicle, it sends a corresponding signal to the controller 102. The radar may be a millimeter-wave radar. The camera is used to determine the age range of the living being inside the vehicle after the radar detects that there is a living being inside the vehicle.

[0082] In some embodiments, the liveness detection signal is obtained by the liveness detection unit 101 to determine whether its own liveness detection function is enabled. That is, if the liveness detection function of the liveness detection unit 101 is enabled, the obtained liveness detection signal indicates that the liveness detection function is enabled; if the liveness detection function of the liveness detection unit 101 is disabled, the obtained liveness detection signal indicates that the liveness detection function is disabled.

[0083] In some embodiments, such as Figure 1 As shown, the implementation environment also includes a signal configuration unit 103, which can communicate with the liveness detection unit 101. This communication connection can be wired or wireless, and this embodiment does not limit this. The signal configuration unit is used to enable or disable the vehicle's liveness detection function and notify the liveness detection unit 101. For example, as... Figure 2 As shown, the signal configuration unit 103 includes an ICC (Infotainment Computing Center), which is used to display a liveness detection function configuration interface, which is used to enable or disable the vehicle's liveness detection function.

[0084] Optionally, the liveness detection function of the liveness detection unit 101 can also be delayed. In this case, the signal configuration unit 103 can also enable or disable the vehicle's delayed warning function and notify the liveness detection unit 101. Thus, before the liveness detection unit 101 performs liveness detection, it obtains the delayed warning function signal by checking whether its own liveness detection function's delayed function is enabled. If the delayed warning function signal indicates that the delayed detection function for living beings inside the vehicle is enabled, then liveness detection inside the vehicle is performed after a certain extended time. For example, such as... Figure 2 As shown, the signal configuration unit 103 includes an ICC, which is used to display a delay detection function configuration interface, which is used to enable or disable the vehicle's delay warning function.

[0085] In some embodiments, the controller 102 may determine a vehicle status signal and send the vehicle status signal to the liveness detection unit 101. For example, such as... Figure 2 As shown, the controller 102 includes a ZCU (Zone Coder Unit), which is used to acquire vehicle status signals and send the vehicle status signals to the liveness detection unit 101.

[0086] The controller 102 is also used to perform appropriate warning operations when there are living beings inside the vehicle. For example, such as... Figure 2 As shown, in addition to the ZCU, the controller 102 may also include a T-BOX (Telematics BOX). The T-BOX is used to send information to the client, and the ZCU is used to control the vehicle to perform corresponding warning operations based on the received signals. For example, the ZCU can control the vehicle to sound its horn or flash its lights, call the VCU (Vehicle Control Unit) to power on the vehicle, and call the TMS (Thermal Management System) to turn on the air conditioning.

[0087] In some embodiments, such as Figure 1 As shown, the implementation environment may also include an information display unit 104, which can communicate with the liveness detection unit 101. The communication connection can be wired or wireless, and this application embodiment does not limit this.

[0088] The information display unit 104 is used to receive and display signals sent by the liveness detection unit 101, such as liveness detection function signals and delayed warning function signals, so that the user can be informed of relevant information in a timely manner. For example, such as... Figure 2As shown, the information display unit 104 may include an ICM (Ignition Control Module).

[0089] Those skilled in the art should understand that the above-described liveness detection unit 101, controller 102, signal configuration unit 103, and information display unit 104 are merely examples. Other existing or future liveness detection units, controllers, signal configuration units, and information display units that are applicable to the embodiments of this application should also be included within the scope of protection of the embodiments of this application, and are hereby incorporated by reference.

[0090] It should be noted that the application scenarios and implementation environments described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided in the embodiments of this application. As those skilled in the art will know, with the emergence of new application scenarios and the evolution of implementation environments, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0091] The following is a detailed explanation of a vehicle control method provided in the embodiments of this application.

[0092] Figure 3 This is a flowchart of the first vehicle control method provided in this application embodiment. Please refer to it. Figure 3 The method includes the following steps.

[0093] Step 301: Obtain the vehicle's liveness detection function signal and vehicle status signal. The liveness detection function signal is used to indicate whether the vehicle's liveness detection function is enabled, and the vehicle status signal indicates whether the vehicle is locked, whether all doors are closed, and the vehicle's power status.

[0094] In some embodiments, the vehicle can obtain a liveness detection signal based on whether the liveness detection function is enabled. Whether the liveness detection function is enabled can be determined during the configuration phase.

[0095] For example, the vehicle displays a liveness detection function configuration interface, where the user can choose whether to enable or disable the liveness detection function. That is, if a liveness detection disabling operation is detected through the configuration interface, the liveness detection function is disabled; if a liveness detection enabling operation is detected through the configuration interface, the liveness detection function is enabled.

[0096] In some embodiments, the vehicle includes an ICC (Intelligent Control Center) and a radar. The ICC displays a liveness detection function configuration interface, through which the user can select whether to enable or disable the liveness detection function. After the user selects to enable or disable the liveness detection function, the ICC can send the user's operation to the radar, causing the radar to enable or disable the liveness detection function. Thus, the radar can subsequently obtain a liveness detection signal based on whether the liveness detection function is enabled.

[0097] In some embodiments, after the radar turns the liveness detection function on or off, it can also send a first feedback signal to the ICC. The first feedback signal is used to indicate whether the liveness detection function has been successfully turned on or off, so that the ICC can display the relevant information of the first feedback signal, thereby letting the user know whether the liveness detection function is currently on or off.

[0098] In addition, in some embodiments, the user's selection to enable or disable the liveness detection function in the liveness detection function configuration interface is not remembered after the vehicle is powered off. Therefore, the liveness detection function can be enabled by default after the vehicle is powered on again.

[0099] The vehicle status signal can be used to indicate whether the vehicle is locked, whether all doors are closed, and the vehicle's power status, which includes fully open, partially open, and fully closed states.

[0100] In some embodiments, the vehicle includes a ZUC (Zero-Use Controller) and a radar. The ZUC can acquire vehicle status signals in real time and record the acquired vehicle status signals sequentially according to time. If the currently recorded vehicle status signal is different from the previously recorded vehicle status signal, the ZUC can send the currently recorded vehicle status signal to the radar so that the radar can acquire the vehicle status signal. In other words, when the vehicle status signal changes, the ZUC can send the vehicle status signal to the radar.

[0101] It should be noted that the above description assumes that the ZUC sends the corresponding vehicle status signal to the radar when the vehicle status signal changes. In practical applications, the ZUC could also send the vehicle status signal to the radar every time it acquires it, meaning the radar could also acquire the vehicle status signal in real time. Alternatively, the ZUC could acquire and record the vehicle status signal in real time, and when the radar needs to acquire the vehicle status signal, it sends a status acquisition request to the ZUC, causing the ZUC to send the last recorded vehicle status signal to the radar. In other words, this application does not limit the frequency and method of the radar acquiring the vehicle status signal.

[0102] In some embodiments, the liveness detection signal is also used to indicate whether the liveness detection function has malfunctioned. In this case, the vehicle can also perform a self-test and obtain a self-test signal, which indicates whether the liveness detection function has malfunctioned. Furthermore, the vehicle can display self-test prompts, thereby promptly reminding the user to perform maintenance when the liveness detection function malfunctions.

[0103] For example, the vehicle includes radar and an ICM (Integrated Circuit Management) system. After the radar performs a self-test, the ICM can display information indicating a malfunction in the liveness detection signal. As another example, to remind the user that the liveness detection function is disabled when it is not activated, the ICM can also display a message indicating that the liveness detection function is not enabled.

[0104] As another example, in order to inform users in a timely manner that the liveness detection function for the vehicle has been turned off, the ICM can also receive and display a prompt message indicating that the liveness detection function has been turned off.

[0105] It should be noted that the above description uses the liveness detection function signal to indicate whether the vehicle's liveness detection function is enabled and whether the vehicle's liveness detection function has malfunctioned, and the vehicle status signal to indicate whether the vehicle is locked, whether the doors are closed, and the vehicle's power status. Of course, in practical applications, the vehicle's liveness detection function signal and vehicle status signal can also be used to indicate other aspects, and this application embodiment does not limit this.

[0106] Step 302: If the liveness detection function signal indicates that the liveness detection function of the vehicle has been turned on, and the vehicle status signal meets the first condition or the second condition, then liveness detection is performed inside the vehicle to determine whether there is a living being inside the vehicle. The first condition is used to indicate that the vehicle is locked, all doors are closed, and the vehicle's power is off. The second condition is used to indicate that the vehicle is unlocked, all doors are closed, and the vehicle's power is off.

[0107] As described above, the vehicle can obtain a liveness detection signal based on whether the liveness detection function is enabled. Thus, the vehicle can determine whether the liveness detection function is enabled based on the obtained liveness detection signal. Furthermore, the vehicle can obtain its own vehicle status information, so the vehicle can also determine whether the vehicle status signal meets the first condition or the second condition.

[0108] In some embodiments, if the liveness detection function signal indicates that the liveness detection function is activated, and the vehicle status signal meets the first condition—that is, the vehicle is locked, all doors are closed, and the vehicle's power is off—it indicates that the vehicle is currently completely stationary, and there should be no living beings inside the vehicle. Therefore, when the vehicle status signal meets the first condition, liveness detection can be performed inside the vehicle to determine whether there are any living beings inside. This allows for the determination of whether an adult has mistakenly left a child inside the vehicle.

[0109] In some embodiments, if the liveness detection signal indicates that the liveness detection function is activated, and the vehicle status signal meets the second condition—that is, the vehicle is unlocked, all doors are closed, and the vehicle's power is off—it indicates that the vehicle may currently be parked but unlocked, and there may be living beings inside the vehicle. Therefore, to determine whether there are living beings inside the vehicle, when the vehicle status signal meets the second condition, liveness detection can be performed inside the vehicle to determine whether there are living beings inside. In this way, it can be determined whether a child has entered the vehicle without the adult's knowledge and is trapped inside when the vehicle is parked.

[0110] In some embodiments, if the liveness detection function signal indicates that the liveness detection function has been enabled, and the vehicle status signal meets the first condition or the second condition, the process of performing liveness detection inside the vehicle includes: if the liveness detection function signal indicates that the vehicle's liveness detection function has been enabled, and the vehicle status signal meets the first condition or the second condition, then acquiring the vehicle's delayed warning function signal, which is used to indicate whether the function of delayed detection of living beings inside the vehicle has been enabled; if the delayed warning function signal indicates that the function of delayed detection of living beings inside the vehicle has been enabled, then starting a timer and performing liveness detection inside the vehicle after a target delay duration.

[0111] Since liveness detection inside the vehicle is not required during temporary parking, the vehicle can also obtain a delayed warning signal based on whether the function of delayed detection of living beings inside the vehicle is enabled.

[0112] For example, the vehicle displays a time-delay detection function configuration interface, where the user can select whether to enable or disable the function of time-delay detection of living beings inside the vehicle. In other words, if the time-delay detection function is detected as disabled through the configuration interface, the function is disabled; conversely, if the time-delay detection function is detected as enabled, the function is enabled.

[0113] In some embodiments, the vehicle includes an ICC (Intelligent Control Center) and a radar. The ICC displays a delay detection function configuration interface, where the user can select whether to enable or disable the delay detection function for living beings inside the vehicle. After the user selects to enable or disable the delay detection function, the ICC can send the user's operation to the radar, causing the radar to enable or disable the delay detection function. Thus, the radar can subsequently obtain a delay warning signal based on whether the delay detection function for living beings inside the vehicle is enabled.

[0114] In some embodiments, after the radar turns on or off the function of delaying the detection of living beings inside the vehicle, it can also send a second feedback signal to the ICC. The second feedback signal is used to indicate whether the function of delaying the detection of living beings inside the vehicle has been successfully turned on or off, so that the ICC can display relevant information about the second feedback signal, so that the user can know whether the function of delaying the detection of living beings inside the vehicle is currently on or off.

[0115] Optionally, the vehicle may also include an ICM, which can receive and display a prompt message indicating that the function of delayed detection of living beings inside the vehicle has been turned off, so that the user can be promptly informed that the function has been turned off.

[0116] Continuing the description above, if the delayed warning function signal indicates that the function for delayed detection of living beings inside the vehicle is enabled, then a timer begins, and liveness detection is performed inside the vehicle after the target delay duration. In other words, if the function for delayed detection of living beings inside the vehicle is enabled, liveness detection can be performed after the target delay duration, avoiding liveness detection during temporary parking. Therefore, it can be concluded that once the liveness detection function signal indicates that the vehicle's liveness detection function is enabled, and the duration for which the vehicle status signal meets the first or second condition exceeds the target delay duration, the vehicle is considered to be in a completely stopped state. At this time, there should be no living beings inside the vehicle.

[0117] For example, suppose the liveness detection function signal indicates that the vehicle's liveness detection function is enabled, the vehicle status signal meets the first condition or the second condition, and the function of delaying the detection of living beings inside the vehicle is enabled, with a target delay duration of X. In this way, liveness detection can be performed inside the vehicle after the vehicle status signal meets the first condition or the second condition for a duration of X.

[0118] It should be noted that the target delay duration can be set according to the actual situation, and this application embodiment does not limit it.

[0119] In addition, in some embodiments, after the vehicle is powered off, the user's operation of selecting to enable or disable the function of delay detection of living beings inside the vehicle in the delay detection function configuration interface is not remembered. Therefore, the delay warning function can be turned off by default after the vehicle is powered on again.

[0120] In some embodiments, the process of detecting a living being inside a vehicle is as follows: multiple electromagnetic wave signals are sequentially emitted into the vehicle interior using a millimeter-wave radar; the echo signals returned after reflection and scattering of the multiple electromagnetic wave signals inside the vehicle are received, resulting in multiple echo signals; point clouds corresponding to the multiple echo signals are generated, resulting in multiple point clouds; the multiple point clouds are analyzed to determine whether the differences between the multiple point clouds satisfy the fluctuation pattern produced by the breathing of a living being or the fluctuation pattern produced by the heartbeat; if the differences between the multiple point clouds satisfy the fluctuation pattern produced by the breathing of a living being or the fluctuation pattern produced by the heartbeat, then it is determined that there is a living being inside the vehicle.

[0121] In the case where the vehicle includes millimeter-wave radar, since the millimeter-wave radar has a transmitter, the millimeter-wave radar can generate multiple electromagnetic wave signals through the transmitter and transmit these multiple electromagnetic wave signals into the vehicle at certain time intervals. In this way, multiple echo signals can be received after the multiple electromagnetic wave signals are reflected and scattered inside the vehicle.

[0122] A point cloud refers to multiple reflection points of a living organism detected by a high-resolution millimeter-wave radar sensor. In other words, a point cloud includes multiple reflection points, and an echo signal includes multiple measurement results. Each of these multiple measurement results indicates a reflection point of the living organism. Therefore, multiple point clouds corresponding to the living organism inside the vehicle can be generated based on these multiple echo signals.

[0123] In some embodiments, each reflection point in the point cloud includes information such as radial distance, azimuth angle, and radial velocity. Since each point cloud is generated based on multiple reflection points, these multiple point clouds will have certain differences. Furthermore, the breathing or heartbeat of a living organism produces fluctuations. Therefore, by analyzing the differences in distances between the reflection points in the multiple point clouds and whether these differences are periodic, it can be determined whether the differences and periods of the reflection points conform to the fluctuation patterns produced by the breathing or heartbeat of a living organism, thereby determining whether there is a living organism inside the vehicle. In other words, if the differences in distances between the reflection points in the multiple point clouds and the period of these differences conform to the fluctuation patterns produced by the breathing or heartbeat of a living organism, then it is determined that there is a living organism inside the vehicle.

[0124] For example, suppose there are point clouds 1, 2, 3, and 4. The interval between the generation of these four point clouds corresponds to the interval of breathing or heartbeat of a living organism. Point cloud 1 includes reflection point 1, point cloud 2 includes reflection point 2, point cloud 3 includes reflection point 3, and point cloud 4 includes reflection point 4. The radial distance of reflection point 1 is X1, the radial distance of reflection point 2 is X2, the radial distance of reflection point 3 is X1, and the radial distance of reflection point 4 is X2. The difference between X1 and X2 satisfies the fluctuation distance generated during breathing or heartbeat of a living organism. Therefore, the difference in distance between the reflection points in the four point clouds satisfies the fluctuation distance generated during breathing or heartbeat of a living organism, and the period also satisfies the pattern of breathing or heartbeat of a living organism. Thus, it can be determined that there is a living organism inside the vehicle.

[0125] The above method uses a single reflection point to determine whether the differences between multiple point clouds satisfy the fluctuation patterns produced by the breathing or heartbeat of a living organism. Of course, in practical applications, in order to improve the accuracy of determining the existence of a living organism, the difference between multiple point clouds can also be determined based on the reflection area in the point cloud. This reflection area includes multiple reflection points and is the chest or abdomen of the living organism.

[0126] In some embodiments, millimeter-wave radar can determine whether the reflection area is the chest or abdomen of a living being through deep learning, or it can also determine whether the reflection area is the chest or abdomen of a living being through a camera.

[0127] It should be noted that the above description is based on the vehicle using millimeter-wave radar for liveness detection. In practical applications, other methods can also be used for liveness detection, and this application does not limit this method.

[0128] Step 303: If there are living beings inside the vehicle, perform the first warning operation to indicate that there are living beings inside the vehicle.

[0129] As described above, the vehicle can perform liveness detection. If a living being is detected inside the vehicle, the vehicle can issue a first warning to alert people around the vehicle so that the living being can be removed from the vehicle as soon as possible. If no living being is detected inside the vehicle, the vehicle does not need to issue a first warning.

[0130] In some embodiments, the vehicle includes a ZCU, which can send a command to perform a first warning operation after detecting a living being inside the vehicle. After receiving the command, the ZCU controls the vehicle to perform the first warning operation.

[0131] For example, if the first warning action is for the vehicle to honk its horn and flash its lights, after the ZCU receives the instruction to perform the first warning action, it controls the vehicle to honk its horn and flash its lights continuously for 5 seconds to alert nearby personnel that there is a living being inside the vehicle. Since the first warning action is for the vehicle to honk its horn and flash its lights continuously for 5 seconds, even if a living being is mistakenly detected inside the vehicle, it will not cause significant disturbance to nearby personnel.

[0132] It should be noted that the above description uses the first warning operation as the vehicle continuously sounding its horn and flashing its lights for 5 seconds. Alternatively, the first warning operation can be other operations, and this application embodiment does not limit this. In addition, the duration for controlling the vehicle to sound its horn and flash its lights can be 5 seconds or other times. That is to say, this time can be configured in advance and can also be adjusted according to actual needs.

[0133] In some embodiments, if millimeter-wave radar detects no living beings inside the vehicle, to avoid false detections, a period of liveness detection can be continued, during which the presence of living beings inside the vehicle is periodically determined. If no living beings are detected inside the vehicle during this period, the millimeter-wave radar will enter a dormant state; if living beings are detected inside the vehicle during this period, the vehicle can perform a first warning operation to indicate the presence of living beings inside the vehicle.

[0134] For example, if the millimeter-wave radar previously detected no living beings inside the vehicle, it can continue to perform liveness detection for 3 minutes. During these 3 minutes, the millimeter-wave radar can determine whether there are living beings inside the vehicle every 30 seconds. If the millimeter-wave radar detects no living beings inside the vehicle within these 3 minutes, it will enter a dormant state. If the millimeter-wave radar detects living beings inside the vehicle within these 3 minutes, the vehicle will perform the first warning operation to indicate that there are living beings inside the vehicle.

[0135] In some embodiments, after the vehicle performs a first warning operation, the method further includes: if the first warning operation is interrupted before it ends, or if the first warning operation is not interrupted and ends, then start timing and reacquire the vehicle status signal after a first timing duration; if the reacquired vehicle status signal indicates that all vehicle doors are closed and the vehicle's power is not fully on, then perform a liveness detection inside the vehicle again to determine whether there is a living being inside the vehicle; if there is a living being inside the vehicle, then perform a second warning operation, the warning level of the second warning operation being higher than the warning level of the first warning operation.

[0136] When performing the first warning operation, if the vehicle is locked, the operation may be interrupted by unlocking the vehicle. If the vehicle is unlocked, the operation may be interrupted by opening the door. If the vehicle is unlocked or the door is opened, it indicates that the user may have received a notification that there is a living being inside the vehicle, and thus unlock the vehicle or open the door to remove the living being from the vehicle.

[0137] To ensure that the user has removed any living beings from the vehicle after the first warning operation is interrupted, the vehicle can start timing from the moment the first warning operation is interrupted. After the first duration of timing, the vehicle status signal is acquired again. Opening a door within the first duration will not interrupt the timing. If the vehicle status signal acquired again indicates that all vehicle doors are closed and the vehicle's power is not fully on, that is, if the vehicle status signal indicates that all vehicle doors are closed and the vehicle's power is fully off or partially on, it means that the user has left the vehicle. At this time, the vehicle can perform a liveness detection again to determine whether the user has removed any living beings from the vehicle.

[0138] If there are living beings inside the vehicle, it means that the user did not take the living beings out of the vehicle. In this case, the vehicle can take a second warning action with a higher warning level than the first warning action.

[0139] In some embodiments, the vehicle includes a ZCU and a T-BOX. After the millimeter-wave radar detects a living being inside the vehicle, it can send instructions to the ZCU and T-BOX to perform a second warning operation. After receiving the instructions, the ZCU and T-BOX control the vehicle to perform the second warning operation.

[0140] For example, if the second warning operation is for the vehicle to flash its lights and send a message to the client, after the ZCU receives the instruction to perform the second warning operation, it controls the vehicle to flash its lights; after the T-BOX receives the instruction to perform the second warning operation, it sends a prompt message to the client, thereby alerting people around the vehicle and users that there are living beings inside the vehicle.

[0141] It should be noted that the above description is based on the second warning operation, which involves controlling the vehicle to flash its lights and sending information to the client. Of course, in practical applications, the second warning operation can also be other operations, and this application embodiment does not limit this.

[0142] In some embodiments, after the vehicle performs the second warning operation, the method further includes: if the second warning operation is interrupted before it ends, starting a timer and reacquiring the vehicle status signal after a second timeout; if the reacquired vehicle status signal indicates that the vehicle is locked, all doors are closed, and the vehicle's power is not fully on, then performing a liveness detection inside the vehicle again to determine whether there is a living being inside the vehicle; if there is a living being inside the vehicle, then performing the second warning operation again.

[0143] In some embodiments, the second warning operation may be interrupted before it ends due to vehicle unlocking or door opening. If the second warning operation is interrupted, it indicates that the user may have received a notification that there is a living being inside the vehicle, and thus unlock the vehicle or open the door to take out the living being inside the vehicle.

[0144] To ensure that the user has removed any living beings from the vehicle after the second warning operation is interrupted, a timer can be started from the moment the second warning operation is interrupted. After a second duration, the vehicle can reacquire the vehicle status signal, and opening a door within this second duration will not interrupt the timer. If the reacquired vehicle status signal indicates that all doors are closed and the vehicle's power is not fully on (i.e., the vehicle status signal indicates that all doors are closed and the vehicle's power is either fully off or partially on), it means the user has left the vehicle. In this case, a liveness detection test can be performed again inside the vehicle to determine if the user has removed any living beings. If living beings are still present inside the vehicle, it indicates that the user may have intentionally left living beings inside. In this case, the vehicle can trigger the second warning operation again.

[0145] In some embodiments, if the second warning operation is interrupted before it ends, or if the second warning operation is not interrupted and ends, a timer is started and the vehicle status signal is reacquired after a third timer duration. If the reacquired vehicle status signal indicates that all vehicle doors are closed and the vehicle's power is not fully on, a liveness detection is performed on the vehicle interior again to determine whether there is a living being inside the vehicle. If there is a living being inside the vehicle, a third warning operation is performed and the vehicle's air conditioning is turned on. The warning level of the third warning operation is higher than that of the second warning operation.

[0146] As described above, the second warning operation may be interrupted by vehicle unlocking or door opening. To ensure that the user has removed any living beings from the vehicle after the second warning operation is interrupted, a timer can be started from the moment the second warning operation is interrupted. After a third time interval, the vehicle can reacquire the vehicle status signal. If the reacquired vehicle status signal indicates that all vehicle doors are closed and the vehicle's power is not fully on, that is, if the vehicle status signal indicates that all vehicle doors are closed and the vehicle's power is either fully off or partially on, it means that the user has left the vehicle. At this point, a liveness detection can be performed again inside the vehicle to determine whether the user has removed any living beings from the vehicle.

[0147] If there are living beings inside the vehicle, it means that the user has left living beings inside the vehicle. In this case, a third warning action with a higher warning level than the second warning action can be taken.

[0148] In some embodiments, the vehicle includes a ZCU and a T-BOX. After the millimeter-wave radar detects a living being inside the vehicle, it can send instructions to the ZCU and T-BOX to perform a third warning operation. After receiving the instructions, the ZCU and T-BOX control the vehicle to perform the third warning operation.

[0149] Optionally, the vehicle also includes a VCU and a TMS. Assuming the third warning operation is to control the vehicle to flash its lights, send a message to the client, and power on the vehicle, after the ZCU receives the instruction to perform the third warning operation, it controls the vehicle to flash its lights and calls the VCU to power on the vehicle, thereby enabling the ZCU to call the TMS to turn on the air conditioning. After the T-BOX receives the instruction to perform the third warning operation, it sends a message to the client, thereby ensuring the safety of the living beings inside the vehicle while alerting people around the vehicle and the user that there are living beings inside the vehicle.

[0150] In addition, in some embodiments, if there are living beings inside the vehicle, and the vehicle's air conditioning is turned on for a period of time exceeding a time threshold, that is, the active intervention time exceeds the time threshold, the vehicle's state will be restored to the initial state.

[0151] It should be noted that the above description is based on the third warning operation, which is controlling the vehicle to flash its lights, sending information to the client, and powering on the vehicle's high voltage. Of course, in practical applications, the third warning operation can also be other operations; the time threshold can be set according to the actual situation, and this application embodiment does not limit it in this regard.

[0152] In some embodiments, if there is a living being inside the vehicle, and before performing the first, second, or third warning operation, the method further includes: taking a picture of the area inside the vehicle where the living being exists using a camera inside the vehicle to obtain an image of the vehicle interior; analyzing the image of the vehicle interior to determine the age range of the living being; and if it is determined based on the age range of the living being that there is a child and no adult inside the vehicle, then performing the subsequent first, second, or third warning operation.

[0153] To ensure the presence of living beings inside the vehicle and prevent false detections, the vehicle can also use cameras inside the vehicle to capture images of areas where living beings may be present. Point clouds can be used to determine the areas where living beings may be present inside the vehicle.

[0154] In other words, after millimeter-wave radar determines the presence of a living being inside a vehicle based on the differences between multiple point clouds, it can determine the area inside the vehicle containing that living being based on any one of those point clouds. For example, the millimeter-wave radar can determine multiple three-dimensional coordinates of the living being inside the vehicle based on the point clouds, and then send these coordinates to a camera. The camera then uses these coordinates to steer and capture images of the area inside the vehicle where the living being is located.

[0155] After capturing images of an area containing a living being using a camera, an image of the vehicle's interior can be obtained. The age range of the living being can then be determined based on this image. For example, the height, body shape, facial features, and clothing of the living being in the vehicle's interior image captured by the camera can be used to determine the age range. Taking height as an example, if the living being's height is greater than 100 cm but less than 130 cm, the age range can be determined to be 5-10 years old, meaning the living being is a child; if the living being's height is greater than 160 cm, the age range can be determined to be 16 years or older, meaning the living being is a teenager or an adult.

[0156] In some embodiments, to improve the accuracy of determining the age range of the living being, multiple attributes in the body, body shape, facial features, and clothing can be combined to determine the age range.

[0157] Continuing the description above, after determining the age range of at least one living being in the vehicle's interior image, it can be determined whether that living being is a child or an adult, obtaining relevant information about the living being, and thus determining whether subsequent first, second, or third warning actions are necessary. In other words, if at least one living being is a child, it indicates a possible situation where a living being has been forgotten or is trapped inside the vehicle, and the vehicle will execute the subsequent first, second, or third warning actions; if at least one living being is an adult, it indicates that the child is accompanied by an adult, and the vehicle does not need to execute the subsequent first, second, or third warning actions.

[0158] The following three scenarios will be used as examples to provide an overall introduction to the vehicle control method provided in the embodiments of this application.

[0159] Scenario 1: Please refer to Figure 4 , Figure 4 This is a flowchart of a vehicle control method provided in an embodiment of this application. Figure 4As can be seen, the vehicle's liveness detection function is activated, and the vehicle status signal meets the first condition. The vehicle's delayed warning function signal can be acquired first to determine if the delayed detection function for living beings inside the vehicle is activated. If the delayed detection function is activated, liveness detection inside the vehicle is performed after the target delay time. If the delayed detection function is not activated, liveness detection inside the vehicle begins directly. If a living being is found inside the vehicle, a first warning operation is performed. If no living being is found, detection can continue for a period of time, periodically checking for the presence of a living being. If a living being is detected during this period, a first warning operation is performed. If no living being is detected during this period, the vehicle can enter a sleep state. If the first warning operation is interrupted before its end, or if the first warning operation is not interrupted and ends, the vehicle status signal can be acquired again after the first timeout period. If the reacquired vehicle status signal indicates that all vehicle doors are closed and the vehicle's power is not fully on, liveness detection inside the vehicle is performed again. If a living being is detected inside the vehicle, a second alert is triggered. If no living being is detected, detection continues for a period of time, periodically checking for the presence of a living being. If a living being is detected within this period, a second alert is triggered. If no living being is detected within this period, the vehicle enters a dormant state. If the second alert is interrupted before it ends, or if the second alert is not interrupted and ends, the vehicle status signal is reacquired after a third timeout. If the reacquired vehicle status signal indicates that all vehicle doors are closed and the vehicle's power is not fully on, a liveness detection is performed again. If a living being is detected, a third alert is triggered. If no living being is detected, detection continues for a period of time, periodically checking for the presence of a living being. If a living being is detected within this period, a third alert is triggered. If no living being is detected within this period, the vehicle enters a dormant state. The process terminates after the active intervention time exceeds a time threshold.

[0160] For example, if the vehicle's delayed detection function is enabled, a 10-second liveness detection will be performed inside the vehicle 9 minutes and 50 seconds after the vehicle status signal meets the first condition. In other words, it can only be determined whether there is a living being inside the vehicle 10 minutes after the vehicle status information meets the first condition. If the delayed detection function is not enabled, a 10-second liveness detection will be performed directly inside the vehicle. This means that it can be determined whether there is a living being inside the vehicle 10 seconds after the vehicle status information meets the first condition. If there is a living being inside the vehicle, the vehicle will sound its horn and flash its lights for 5 seconds. If there is no living being inside the vehicle, a 3-minute liveness detection will continue, with 30-second intervals for each instance. If a living being is detected within these 3 minutes, the vehicle will sound its horn and flash its lights for 5 seconds. If no living being is detected within these 10 minutes, the millimeter-wave radar and camera can enter sleep mode. If the 5-second horn and flashing lights are interrupted before the end, or if the 5-second horn and flashing lights are not interrupted and end, the vehicle status information can be reacquired after 85 seconds. If the reacquired vehicle status signal indicates that all vehicle doors are closed and the vehicle's power is not fully on, then a liveness detection will be performed on the vehicle interior again.

[0161] If a living being is detected inside the vehicle, the vehicle will flash its lights for 60 seconds and send a message to the client. If no living being is detected inside the vehicle, a 10-minute liveness detection process will continue, with checks every 30 seconds. If a living being is detected inside the vehicle within these 10 minutes, the vehicle will flash its lights for 60 seconds and send a message to the client. If no living being is detected inside the vehicle within these 10 minutes, the millimeter-wave radar and camera can enter sleep mode. If the 60-second flashing lights are interrupted before the end, or if the 60-second flashing lights are not interrupted and end, the vehicle status signal is reacquired after 5 minutes. If the reacquired vehicle status signal indicates that all vehicle doors are closed and the vehicle's power is not fully on, a liveness detection is performed on the vehicle interior again. If a living being is detected inside the vehicle, the vehicle flashes its lights for 60 seconds, sends a notification message to the client, and powers the vehicle to turn on the air conditioning. If no living being is detected inside the vehicle, a 10-minute liveness detection process continues, with 30-second intervals between checks for the presence of a living being inside. If a living being is detected within these 10 minutes, the vehicle flashes its lights for 60 seconds, sends a message to the client, and powers the vehicle to turn on the air conditioning. If no living being is detected within these 10 minutes, the millimeter-wave radar and camera can enter sleep mode. The process ends after more than 20 minutes of active intervention.

[0162] In the scenario described above, the system can provide warnings when a child is accidentally left in the car, enabling adults to quickly remove the child from the vehicle and prevent any danger to the child.

[0163] Scenario 2: Please refer to Figure 5 , Figure 5 This is a flowchart of a vehicle control method provided in an embodiment of this application. Figure 5 As can be seen, the vehicle's liveness detection function has been activated, and the vehicle status signal meets the second condition. The subsequent process in Scenario 2 is the same as that in Scenario 1, and will not be repeated here. Please refer to the above content.

[0164] In the second scenario described above, when a child enters an unlocked vehicle without the adult's knowledge and becomes trapped inside, a warning system can be activated to allow the adult to quickly remove the child from the vehicle and prevent any danger to the child.

[0165] Scenario 3: Please refer to Figure 6 , Figure 6 This is a flowchart of a vehicle control method provided in an embodiment of this application. Figure 6As can be seen, if the second warning operation is interrupted before it ends, the vehicle status signal is reacquired after the second timeout period. If the reacquired vehicle status signal indicates that the vehicle is locked, all doors are closed, and the vehicle's power is not fully on, then a liveness detection is performed on the vehicle interior again. If there is a living being inside the vehicle, the second warning operation is performed again. If no living being is detected inside the vehicle, the detection can continue for a period of time, and the system can periodically determine whether there is a living being inside the vehicle. If a living being is detected inside the vehicle during this period, the second warning operation is performed. If no living being is detected inside the vehicle during this period, the system can enter a dormant state. If the second warning operation is interrupted before it ends, or if the second warning operation is not interrupted and ends, the vehicle status signal is reacquired after the third timeout period. If the reacquired vehicle status signal indicates that all vehicle doors are closed and the vehicle's power is not fully on, then a liveness detection is performed on the vehicle interior again. If a living being is detected inside the vehicle, the third warning operation is performed. If no living being is detected inside the vehicle, the detection can continue for a period of time, and the presence of a living being inside the vehicle can be periodically determined. If a living being is detected inside the vehicle during this period, the third warning operation is performed. If no living being is detected inside the vehicle during this period, the vehicle can enter a dormant state. The process ends after the active intervention time exceeds the time threshold.

[0166] For example, if a vehicle's 60-second flashing lights are interrupted, the vehicle status signal is reacquired 90 seconds after the interruption. If the reacquired vehicle status signal indicates that the vehicle is locked, all doors are closed, and the vehicle's power is not fully on, a 90-second liveness detection is performed on the vehicle's interior again. This means that after 90 seconds, it can be determined whether there is a living being inside the vehicle. If a living being is detected, the vehicle flashes its lights for another 60 seconds and sends a message to the client. If no living being is detected, a 3-minute liveness detection process continues, checking for a living being at 30-second intervals. If a living being is detected within these 3 minutes, the vehicle flashes its lights for another 60 seconds and sends a message to the client. If no living being is detected within these 3 minutes, the millimeter-wave radar and camera can enter sleep mode. If the 60-second flashing lights are interrupted before the end, or if the 60-second flashing lights are not interrupted and end, the vehicle status signal is reacquired after 5 minutes. If the reacquired vehicle status signal indicates that all vehicle doors are closed and the vehicle's power is not fully on, a liveness detection is performed on the vehicle interior again. If a living being is detected inside the vehicle, the vehicle is controlled to flash its lights for 60 seconds, send a message to the client, and power on the vehicle to turn on the air conditioning. If no living being is detected inside the vehicle, a liveness detection can continue for 3 minutes, with 30-second intervals to check for the presence of a living being inside the vehicle. If a living being is detected inside the vehicle within these 3 minutes, the vehicle is controlled to flash its lights for 60 seconds, send a message to the client, and power on the vehicle to turn on the air conditioning. If no living being is detected inside the vehicle within these 10 minutes, the millimeter-wave radar and camera can enter sleep mode. The process ends after more than 20 minutes of active intervention.

[0167] In the above scenario three, the system can perform corresponding warning actions when a child is deliberately left in the car, so that adults can take the child out of the vehicle as soon as possible and prevent the child from being in danger.

[0168] In this embodiment, when the liveness detection function signal indicates that the vehicle's liveness detection function is activated, and the vehicle status signal meets either the first or second condition, liveness detection is performed. If a living being is found inside the vehicle, a first warning operation is initiated. This ensures that if only a child remains inside the vehicle, an adult can be promptly alerted to remove the child, preventing potential danger. Furthermore, a second warning operation with a higher warning level than the first warning operation, or a third warning operation with a higher warning level than the second warning operation, can be initiated under different circumstances, ensuring the child's safety while promptly alerting the adult to remove the child from the vehicle. Additionally, millimeter-wave radar and cameras can be combined to perform liveness detection inside the vehicle, thereby improving the accuracy of liveness detection.

[0169] Figure 7 This is a schematic diagram of the structure of a vehicle control device provided in an embodiment of this application. Please refer to it. Figure 7 The device includes: an acquisition module 701, a first liveness detection module 702, and a first warning module 703.

[0170] The acquisition module 701 is used to acquire the vehicle's liveness detection function signal and vehicle status signal. The liveness detection function signal is used to indicate whether the vehicle's liveness detection function is turned on, and the vehicle status signal indicates whether the vehicle is locked, whether all doors are closed, and the vehicle's power status.

[0171] The first liveness detection module 702 is used to perform liveness detection inside the vehicle if the liveness detection function signal indicates that the liveness detection function of the vehicle has been turned on, and the vehicle status signal meets the first condition or the second condition, so as to determine whether there is a living being inside the vehicle. The first condition is used to indicate that the vehicle is locked, all doors are closed and the vehicle power is turned off, and the second condition is used to indicate that the vehicle is unlocked, all doors are closed and the vehicle power is turned off.

[0172] The first warning module 703 is used to perform a first warning operation if there is a living being inside the vehicle, so as to indicate that there is a living being inside the vehicle.

[0173] Optionally, the device further includes:

[0174] The first timing module is used to start timing and reacquire the vehicle status signal after the first timing duration if the first warning operation is interrupted before it ends, or if the first warning operation is not interrupted and ends.

[0175] The second liveness detection module is used to perform liveness detection on the vehicle interior again if the reacquired vehicle status signal indicates that all vehicle doors are closed and the vehicle power is not fully turned on, in order to determine whether there are living beings inside the vehicle.

[0176] The second warning module is used to issue a second warning if there are living beings inside the vehicle. The warning level of the second warning is higher than that of the first warning.

[0177] Optionally, the device further includes:

[0178] The second timing module is used to start timing and reacquire the vehicle status signal after the second timing duration if the second warning operation is interrupted before it ends.

[0179] The third liveness detection module is used to perform liveness detection on the vehicle interior again if the reacquired vehicle status signal indicates that the vehicle is locked, all doors are closed, and the vehicle's power is not fully on, in order to determine whether there are living beings inside the vehicle.

[0180] The third warning module is used to trigger a second warning operation if there are living beings inside the vehicle.

[0181] Optionally, the device further includes:

[0182] The third timing module is used to start timing and reacquire the vehicle status signal after the third timing duration if the second warning operation is interrupted before it ends, or if the second warning operation is not interrupted and ends.

[0183] The fourth liveness detection module is used to perform liveness detection on the vehicle interior again if the reacquired vehicle status signal indicates that all vehicle doors are closed and the vehicle power is not fully turned on, in order to determine whether there are living beings inside the vehicle.

[0184] The fourth warning module is used to trigger the third warning operation and turn on the vehicle's air conditioning if there are living beings inside the vehicle. The warning level of the third warning operation is higher than that of the second warning operation.

[0185] Optionally, the first liveness detection module 702 includes:

[0186] The acquisition submodule is used to acquire the vehicle's delayed warning function signal if the liveness detection function signal indicates that the vehicle's liveness detection function has been enabled and the vehicle status signal meets the first condition or the second condition. The delayed warning function signal is used to indicate whether the function of delayed detection of living beings inside the vehicle has been enabled.

[0187] The timing submodule is used to start timing and perform liveness detection inside the vehicle after the target delay time if the delay warning function signal indicates that the function of delay detection of living beings inside the vehicle has been enabled.

[0188] Optionally, the first liveness detection module 702 is specifically used for:

[0189] Multiple electromagnetic wave signals are sequentially transmitted into the vehicle using millimeter-wave radar.

[0190] The echo signals returned after the multiple electromagnetic wave signals are reflected and scattered inside the vehicle are received, and multiple echo signals are obtained.

[0191] Generate point clouds corresponding to the multiple echo signals to obtain multiple point clouds;

[0192] The multiple point clouds were analyzed to determine whether the differences between them conformed to the fluctuation patterns generated by the respiration of a living organism or the fluctuation patterns generated by the heartbeat.

[0193] If the differences between these multiple point clouds satisfy the fluctuation pattern produced by the breathing of a living organism or the fluctuation pattern produced by the heartbeat, then it is determined that there is a living organism inside the vehicle.

[0194] Optionally, the device further includes:

[0195] The imaging module is used to capture images of the interior of the vehicle by using a camera inside the vehicle to photograph areas where living beings may be present.

[0196] The analysis module is used to analyze images inside the vehicle to determine the age range of living beings.

[0197] The trigger module is used to execute a first warning operation, a second warning operation, or a third warning operation if it is determined that there is a child and no adult inside the vehicle based on the age range of the living person.

[0198] In this embodiment, when the liveness detection function signal indicates that the vehicle's liveness detection function is activated, and the vehicle status signal meets either the first or second condition, liveness detection is performed. If a living being is found inside the vehicle, a first warning operation is initiated. This ensures that if only a child remains inside the vehicle, an adult can be promptly alerted to remove the child, preventing potential danger. Furthermore, a second warning operation with a higher warning level than the first warning operation, or a third warning operation with a higher warning level than the second warning operation, can be initiated under different circumstances, ensuring the child's safety while promptly alerting the adult to remove the child from the vehicle. Additionally, millimeter-wave radar and cameras can be combined to perform liveness detection inside the vehicle, thereby improving the accuracy of liveness detection.

[0199] It should be noted that the vehicle control device provided in the above embodiments, when performing liveness detection and warning operations, is only illustrated by the division of the above functional modules. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. Furthermore, the vehicle control device and the vehicle control method embodiments provided in the above embodiments belong to the same concept, and their specific implementation process is detailed in the method embodiments, which will not be repeated here.

[0200] Figure 8 This is a structural block diagram of a vehicle 800 provided in an embodiment of this application. Typically, the vehicle 800 includes a processor 801 and a memory 802.

[0201] Processor 801 may include one or more processing cores, such as a quad-core processor, an octa-core processor, etc. Processor 801 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), and PLA (Programmable Logic Array). Processor 801 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 801 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, processor 801 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0202] The memory 802 may include one or more computer-readable storage media, which may be non-transitory. The memory 802 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 802 are used to store at least one instruction, which is executed by the processor 801 to implement the vehicle control method provided in the method embodiments of this application.

[0203] In some embodiments, the vehicle 800 may also optionally include a peripheral device interface 803 and at least one peripheral device. The processor 801, memory 802, and peripheral device interface 803 can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface 803 via a bus, signal line, or circuit board. Specifically, the peripheral device includes at least one of the following: a radio frequency circuit 804, a display screen 805, a camera assembly 806, an audio circuit 807, a positioning assembly 808, and a power supply 809.

[0204] Peripheral device interface 803 can be used to connect at least one I / O (Input / Output) related peripheral device to processor 801 and memory 802. In some embodiments, processor 801, memory 802 and peripheral device interface 803 are integrated on the same chip or circuit board; in some other embodiments, any one or two of processor 801, memory 802 and peripheral device interface 803 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0205] The radio frequency (RF) circuit 804 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 804 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 804 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. Optionally, the RF circuit 804 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit 804 can communicate with other vehicles via at least one wireless communication protocol. This wireless communication protocol includes, but is not limited to: the World Wide Web, metropolitan area networks, intranets, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 804 may also include circuitry related to NFC (Near Field Communication), which is not limited in this application embodiment.

[0206] Display screen 805 is used to display a UI (User Interface). This UI may include graphics, text, icons, videos, and any combination thereof. When display screen 805 is a touch display screen, it also has the ability to collect touch signals on or above its surface. These touch signals can be input as control signals to processor 801 for processing. In this case, display screen 805 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one display screen 805, located on the front panel of vehicle 800; in other embodiments, there may be at least two display screens, respectively located on different surfaces of vehicle 800 or in a folded design; in still other embodiments, display screen 805 may be a flexible display screen, located on a curved or folded surface of vehicle 800. Furthermore, display screen 805 may be configured as a non-rectangular, irregular shape, i.e., a non-rectangular screen. Display screen 805 may be made of materials such as LCD (Liquid Crystal Display) or OLED (Organic Light-Emitting Diode).

[0207] The camera assembly 806 is used to acquire images or videos. Optionally, the camera assembly 806 includes a front-facing camera and a rear-facing camera. Typically, the front-facing camera is located on the front panel of the vehicle, and the rear-facing camera is located at the rear of the vehicle. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, a wide-angle camera, and a telephoto camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, panoramic shooting by fusion of the main camera and the wide-angle camera, VR (Virtual Reality) shooting, or other fusion shooting functions. In some embodiments, the camera assembly 806 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm-light flash and a cool-light flash, which can be used for light compensation at different color temperatures.

[0208] The audio circuit 807 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, converting the sound waves into electrical signals that are input to the processor 801 for processing, or input to the radio frequency circuit 804 for voice communication. For stereo sound acquisition or noise reduction purposes, multiple microphones may be used, positioned at different locations within the vehicle 800. The microphone may also be an array microphone or an omnidirectional microphone. The speaker is used to convert the electrical signals from the processor 801 or the radio frequency circuit 804 into sound waves. The speaker may be a conventional diaphragm speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, the audio circuit 807 may also include a headphone jack.

[0209] The positioning component 808 is used to locate the current geographical location of the vehicle 800 in order to enable navigation or LBS (Location Based Service). The positioning component 808 can be a positioning component of GPS (Global Positioning System), BeiDou system or Galileo system.

[0210] Power source 809 is used to supply power to various components in vehicle 800. Power source 809 can be AC ​​power, DC power, a disposable battery, or a rechargeable battery. When power source 809 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged via a wired line, while a wireless rechargeable battery is a battery that is charged via a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0211] In some embodiments, a computer-readable storage medium is also provided, which stores a computer program that, when executed by a processor, implements the steps of the vehicle control method described above. For example, the computer-readable storage medium may be a ROM, RAM, CD-ROM, magnetic tape, floppy disk, or optical data storage device.

[0212] It is worth noting that the computer-readable storage medium mentioned in the embodiments of this application can be a non-volatile storage medium, in other words, it can be a non-transient storage medium.

[0213] It should be understood that all or part of the steps of the above embodiments can be implemented by software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented wholly or partially in the form of a computer program product. The computer program product includes one or more computer instructions. The computer instructions can be stored in the above-described computer-readable storage medium.

[0214] That is, in some embodiments, a computer program product containing instructions is also provided, which, when run on a computer, causes the computer to perform the steps of the vehicle control method described above.

[0215] It should be understood that "at least one" as mentioned herein refers to one or more, and "multiple" refers to two or more. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. In addition, in order to clearly describe the technical solutions of the embodiments of this application, the terms "first," "second," etc., are used in the embodiments of this application to distinguish identical or similar items with substantially the same function and effect. Those skilled in the art will understand that the terms "first," "second," etc., do not limit the quantity or execution order, and the terms "first," "second," etc., are not necessarily different.

[0216] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, data stored, data displayed, etc.) and signals involved in the embodiments of this application are all authorized by the user or fully authorized by all parties, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0217] The above descriptions are embodiments provided in this application and are not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A method for controlling a vehicle, characterized in that, The method includes: The system acquires the liveness detection function signal and the vehicle status signal of the vehicle. The liveness detection function signal is used to indicate whether the liveness detection function of the vehicle is turned on, and the vehicle status signal indicates whether the vehicle is locked, whether all doors are closed, and the power status of the vehicle. If the liveness detection function signal indicates that the liveness detection function of the vehicle has been activated, and the vehicle status signal meets the first condition or the second condition, then liveness detection is performed inside the vehicle to determine whether there is a living being inside the vehicle. The first condition is used to indicate that the vehicle is locked, all doors are closed, and the vehicle's power is off. The second condition is used to indicate that the vehicle is unlocked, all doors are closed, and the vehicle's power is off. If there are living beings inside the vehicle, a first warning operation will be performed to indicate that there are living beings inside the vehicle. If the first warning operation is interrupted before it ends, or if the first warning operation is not interrupted and ends, then a timer is started and the vehicle status signal is reacquired after a first timer duration. If the reacquired vehicle status signal indicates that all vehicle doors are closed and the vehicle's power is not fully on, then a liveness detection will be performed on the vehicle interior again to determine whether there are any living beings inside the vehicle. If there are living beings inside the vehicle, a second warning operation is performed, and the warning level of the second warning operation is higher than that of the first warning operation.

2. The method as described in claim 1, characterized in that, After performing the second warning operation, the method further includes: If the second warning operation is interrupted before it ends, a timer is started and the vehicle status signal is reacquired after the second timer duration. If the reacquired vehicle status signal indicates that the vehicle is locked, all doors are closed, and the vehicle's power is not fully on, then a liveness detection will be performed on the vehicle interior again to determine whether there are any living beings inside the vehicle. If there are living beings inside the vehicle, the second warning operation will be performed again.

3. The method as described in claim 1, characterized in that, The method further includes: If the second warning operation is interrupted before it ends, or if the second warning operation is not interrupted and ends, then the timer starts and the vehicle status signal is reacquired after the third timer duration. If the reacquired vehicle status signal indicates that all vehicle doors are closed and the vehicle's power is not fully on, then a liveness detection will be performed on the vehicle interior again to determine whether there are any living beings inside the vehicle. If there are living beings inside the vehicle, a third warning operation is performed and the vehicle's air conditioning is turned on. The warning level of the third warning operation is higher than that of the second warning operation.

4. The method as described in claim 1, characterized in that, If the liveness detection function signal indicates that the vehicle's liveness detection function is enabled, and the vehicle status signal meets either the first or second condition, then liveness detection is performed inside the vehicle, including: If the liveness detection function signal indicates that the liveness detection function of the vehicle has been activated, and the vehicle status signal meets the first condition or the second condition, then the delayed warning function signal of the vehicle is obtained. The delayed warning function signal is used to indicate whether the function of delayed detection of living beings inside the vehicle has been activated. If the delay warning function signal indicates that the function of delay detection of living beings inside the vehicle has been enabled, then the timing will start and the detection of living beings inside the vehicle will be performed after the target delay time.

5. The method according to any one of claims 1-4, characterized in that, The liveness detection inside the vehicle includes: Multiple electromagnetic wave signals are sequentially transmitted into the vehicle using millimeter-wave radar. The echo signals returned after the multiple electromagnetic wave signals are reflected and scattered inside the vehicle are received, and multiple echo signals are obtained. Generate point clouds corresponding to the multiple echo signals respectively to obtain multiple point clouds; The multiple point clouds are analyzed to determine whether the differences between the multiple point clouds satisfy the fluctuation pattern generated by the respiration of a living organism or the fluctuation pattern generated by the heartbeat. If the differences between the multiple point clouds satisfy the fluctuation pattern produced by the breathing of a living organism or the fluctuation pattern produced by the heartbeat, then it is determined that there is a living organism inside the vehicle.

6. The method as described in claim 3, characterized in that, If there are living beings inside the vehicle, and before performing the first, second, or third warning operation, the method further includes: The vehicle interior is captured by a camera inside the vehicle, which captures images of areas where living beings exist. The images inside the vehicle are analyzed to determine the age range of the living organism. If it is determined, based on the age range of the living being, that there are children and no adults inside the vehicle, then the subsequent first warning operation, second warning operation, or third warning operation will be executed.

7. A vehicle control device, characterized in that, The device includes: The acquisition module is used to acquire the liveness detection function signal and the vehicle status signal of the vehicle. The liveness detection function signal is used to indicate whether the liveness detection function of the vehicle is turned on, and the vehicle status signal indicates whether the vehicle is locked, whether all doors are closed, and the power status of the vehicle. The first liveness detection module is used to perform liveness detection inside the vehicle if the liveness detection function signal indicates that the liveness detection function of the vehicle has been turned on, and the vehicle status signal meets the first condition or the second condition, in order to determine whether there is a living being inside the vehicle. The first condition is used to indicate that the vehicle is locked, all doors are closed, and the power of the vehicle is turned off. The second condition is used to indicate that the vehicle is unlocked, all doors are closed, and the power of the vehicle is turned off. The first warning module is used to perform a first warning operation if there are living beings inside the vehicle, so as to indicate that there are living beings inside the vehicle. The first timing module is used to start timing and reacquire the vehicle status signal after a first timing duration if the first warning operation is interrupted before it ends, or if the first warning operation is not interrupted and ends. The second liveness detection module is used to perform liveness detection on the vehicle interior again if the reacquired vehicle status signal indicates that all the vehicle doors are closed and the vehicle power is not fully turned on, in order to determine whether there are living beings inside the vehicle. The second warning module is used to perform a second warning operation if there is a living being inside the vehicle. The warning level of the second warning operation is higher than that of the first warning operation.

8. A vehicle, characterized in that, The vehicle includes a memory and a processor, the memory being used to store a computer program, and the processor being used to execute the computer program stored in the memory to implement the steps of the method according to any one of claims 1-6.

9. A computer-readable storage medium, characterized in that, The storage medium stores a computer program, which, when executed by a processor, implements the steps of the method described in any one of claims 1-6.

Images