In-vehicle personnel risk detection method, medium, vehicle and product

Abstract

The embodiment of the invention discloses an in-vehicle personnel risk detection method, a medium, a vehicle and a product, and the method comprises the steps: obtaining the state data of a locked person and the environment data in the vehicle when it is detected that the person is locked in the vehicle; based on the state data and the environment data, the risk of the locked person in the vehicle is evaluated, and a risk evaluation result is obtained; and under the condition that the risk assessment result shows that the locked person is dangerous, determining an alarm measure, and executing an alarm operation according to the alarm measure. According to the technical scheme provided by the embodiment of the invention, the alarm operation is executed according to the determined alarm measure under the condition that danger exists, so that the interference on the activity of a driver caused by alarming as long as a locked person is detected is avoided, the safety and the flexibility of vehicle use are improved, and unnecessary resource consumption can be reduced.

Description

Technical Field

[0001] This application relates to the field of automotive safety technology, specifically to a method, medium, vehicle, and product for detecting risks to occupants in a vehicle. Background Technology

[0002] Currently, cars have become an indispensable means of transportation for people. While cars bring convenience, they also bring many dangers, with accidents involving children left in cars occurring frequently.

[0003] In related technologies, an alarm is triggered and alarm measures are executed immediately upon detecting someone left inside the vehicle. However, in cases of temporary parking, drivers may briefly leave children or other individuals inside the vehicle. In such situations, directly triggering the alarm would frequently disrupt the driver's normal activities and result in unnecessary waste of resources. Summary of the Invention

[0004] In view of this, the embodiments of this application aim to provide a method, medium, vehicle and product for detecting the risk of occupants in a vehicle, so as to improve the safety and flexibility of vehicle use and reduce unnecessary resource consumption.

[0005] In a first aspect, one embodiment of this application provides a method for detecting the risk of people inside a vehicle, comprising: when a person is detected to be locked inside the vehicle, acquiring the status data of the locked person and the environmental data inside the vehicle; based on the status data and the environmental data, assessing the risk of the locked person inside the vehicle and obtaining a risk assessment result; and when the risk assessment result indicates that the locked person is in danger, determining alarm measures and executing alarm operations according to the alarm measures.

[0006] When a person is detected locked inside a vehicle, this application embodiment effectively assesses whether the person is in danger based on the person's status data and the vehicle's environmental data, thus achieving dynamic assessment of the danger posed by the person. Only when danger is detected will an alarm be triggered according to the established alarm measures, thereby avoiding alarms that would interfere with the driver's activities whenever a person is detected. This improves the safety and flexibility of vehicle use and reduces unnecessary resource consumption.

[0007] In conjunction with the first aspect, in some implementations of the first aspect, the risks posed by the locked person in the vehicle are assessed based on state data and environmental data to obtain risk assessment results. This includes: identifying the locked person's emotions in the vehicle based on state data to determine the locked person's emotional state; determining the degree of physiological impact of the vehicle environment on the locked person based on environmental data; and assessing the risks posed by the locked person in the vehicle based on the emotional state and the degree of physiological impact to obtain risk assessment results.

[0008] This application embodiment combines the emotional state of the locked-in person with the degree of physiological impact of the in-vehicle environment, which can more comprehensively and accurately reflect the actual risks faced by the locked-in person. Risk assessment based on emotional state and degree of physiological impact, that is, risk assessment by combining two dimensions, avoids misjudgment that may be caused by a single factor, and effectively improves the accuracy and reliability of risk assessment results.

[0009] In conjunction with the first aspect, in some implementations of the first aspect, the risk to the locked person inside the vehicle is assessed based on emotional state and the degree of physiological impact, resulting in a risk assessment. This includes comparing the emotional state with a stable state and performing numerical analysis on the degree of physiological impact with the target impact range. If the emotional state is stable and the degree of physiological impact does not exceed the target impact range, the risk assessment result for the locked person inside the vehicle is determined to be no danger. If the emotional state is unstable or the degree of physiological impact exceeds the target impact range, the risk assessment result for the locked person inside the vehicle is determined to be dangerous.

[0010] This application's embodiments compare emotional states with stable states and perform numerical analysis on the degree of physiological impact and the target impact range. When the locked-up person's emotions are stable and the degree of physiological impact is tolerable, it is determined that the locked-up person is not in danger, ensuring the safety of the locked-up person in both physiological and emotional aspects. Furthermore, the risk assessment results can be quickly determined through simple comparison without complicated calculation processes, improving the efficiency of risk assessment and enabling rapid response when the locked-up person faces danger.

[0011] In conjunction with the first aspect, in some implementations of the first aspect, an alarm operation is performed according to the alarm measures, including: if the emotional state is not stable, then an alarm operation is performed according to the first measure in the alarm measures used to adjust the emotions of the locked person; if the degree of physiological impact exceeds the target impact range, then the environmental factors causing the degree of physiological impact are identified, and an alarm operation is performed according to the second measure in the alarm measures used to adjust the environmental factors.

[0012] In this embodiment, when a locked-up person is emotionally unstable, a first measure is taken to soothe their emotions and prevent danger caused by emotional outbursts. When in-vehicle environmental factors have an impact on the locked-up person's physiology beyond their tolerance, a second measure is taken to specifically adjust the environmental factors, quickly improving the in-vehicle environment and reducing its harm to the locked-up person. By employing different alarm measures based on different dangerous situations, the alarm operation becomes more targeted, ensuring the safety of the locked-up person while avoiding unnecessary resource consumption, thus improving the practicality and reliability of the entire alarm mechanism.

[0013] In conjunction with the first aspect, in some implementations of the first aspect, alarm measures are determined, including: determining the risk level of the locked person inside the vehicle based on status data and environmental data; and identifying the measure corresponding to the risk level from multiple measures as the alarm measure.

[0014] This application embodiment dynamically matches corresponding alarm measures according to different risk levels, so that the alarm measures meet the needs of the actual dangerous situation, avoiding situations where excessive measures are taken, resulting in waste of resources and interference, or where mismatched measures lead to an inability to effectively deal with risks. It can effectively determine alarm measures and take into account the differences in the actual dangerous situation of locked personnel, thereby improving the accuracy and effectiveness of risk response.

[0015] In conjunction with the first aspect, in certain implementations of the first aspect, the measures include at least one of vehicle control measures, user terminal interaction measures, and remote measures; vehicle control measures include at least one of activating air purification mode, turning on the air conditioner, recording the vehicle environment, playing target video, adjusting the windows, activating the vehicle's audible and visual alarms, and controlling the multimedia system to display self-rescue methods; user terminal interaction measures include at least one of sending warning information, sending in-vehicle and out-of-vehicle audio-visual information, establishing a call with the user terminal, sending broadcast messages, and performing remote vehicle unlocking operations; remote measures include sending vehicle information and / or information of the locked person to the target; the target includes the mobile terminal of the rescue platform and / or emergency contact.

[0016] This application provides a multi-dimensional approach encompassing vehicle self-control, user terminal interaction, and remote assistance to ensure the safety of locked-in individuals from various perspectives. Vehicle control measures directly affect the vehicle itself, quickly responding to and mitigating danger by adjusting in-vehicle environmental parameters, activating audible and visual alarms, or providing self-rescue guidance. User terminal interaction establishes communication between the locked-in individual and the driver, ensuring the user can promptly understand the situation inside the vehicle and perform remote unlocking operations. Furthermore, remote measures are provided to prevent alarms from being sent to remote targets when local measures fail to provide effective control, comprehensively ensuring the safety of locked-in individuals.

[0017] In conjunction with the first aspect, in some implementations of the first aspect, the state data includes at least one of the image data and point cloud data of the locked-in person; the environmental data includes at least one of the temperature data, humidity data, and carbon dioxide content inside the vehicle; based on the state data and environmental data, an assessment of the risks posed by the locked-in person inside the vehicle is performed to obtain a risk assessment result, including: performing motion feature analysis on the point cloud data, and determining the vital signs data of the locked-in person based on the results of the motion feature analysis; performing facial feature analysis on the image data, and determining the facial feature data of the locked-in person based on the results of the facial feature analysis; and assessing the risks posed by the locked-in person inside the vehicle based on the vital signs data, facial feature data, and environmental data to obtain a risk assessment result.

[0018] This application embodiment uses the vital signs data and facial feature data of the locked person to more accurately and comprehensively reflect the physical state of the locked person and their specific reactions inside the vehicle. Furthermore, by combining vital signs data, facial feature data and environmental data, and taking into account the impact of the actual conditions inside the vehicle on the locked person, the risk faced by the locked person is assessed by combining multiple factors, effectively avoiding the judgment errors that may occur when relying on only a single data dimension for assessment, thereby improving the accuracy and comprehensiveness of the risk assessment results.

[0019] Secondly, this application provides a vehicle occupant risk detection device, comprising: a data acquisition module, used to acquire the status data of the locked person and the environmental data inside the vehicle when a person is detected locked inside the vehicle; a risk assessment module, used to assess the risk posed by the locked person inside the vehicle based on the status data and environmental data, and obtain a risk assessment result; and a measure determination module, used to determine alarm measures and execute alarm operations according to the alarm measures when the risk assessment result indicates that the locked person is in danger.

[0020] Thirdly, one embodiment of this application provides a computer-readable storage medium storing a computer program for performing the method in the first aspect or any possible implementation of the first aspect.

[0021] Fourthly, one embodiment of this application provides a vehicle, the vehicle comprising: a processor; a memory for storing processor-executable instructions; the processor being configured to execute the method in the first aspect or any possible implementation thereof.

[0022] Fifthly, one embodiment of this application provides a computer program product including instructions that, when executed on a vehicle, cause the vehicle to implement the method in the first aspect or any possible implementation of the first aspect.

[0023] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this application, nor is it intended to limit the scope of this application. Other features of this application will become readily apparent from the following description. Attached Figure Description

[0024] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0025] Figure 1 The diagram shown is a flowchart of a vehicle occupant risk detection method provided in an embodiment of this application.

[0026] Figure 2 The diagram shown is a structural schematic of a vehicle occupant risk detection device provided in an embodiment of this application.

[0027] Figure 3 The diagram shown is a structural schematic of a vehicle provided in an embodiment of this application. Detailed Implementation

[0028] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0029] The terminology used in the embodiments of this application is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. The singular forms "a," "the," and "the" as used in the embodiments of this application and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise.

[0030] It should be understood that the term "and / or" used in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Furthermore, the character " / " in this document generally indicates that the preceding and following related objects have an "or" relationship. Additionally, the term "based on" used in this document is not limited to relying solely on one object. For example, determining B based on A can mean: determining B based solely on A, or determining B partially based on A.

[0031] It should be noted that the collection, gathering, updating, analysis, processing, use, transmission, and storage of user personal information involved in the technical solution of this application all comply with the provisions of relevant laws and regulations, are used for legitimate purposes, and do not violate public order and good morals. Necessary measures are taken to prevent unauthorized access to user personal information data and to safeguard user personal information security and network security.

[0032] In related technologies, upon detecting someone left inside the vehicle, an alarm is directly triggered, and alarm measures are executed. For example, when the vehicle is turned off and the doors are locked, if a child is detected locked alone inside, an audible and visual alarm is activated, and the windows are lowered for ventilation. Simultaneously, an alarm distress text message is sent to the driver's or parent's mobile phone, alerting them that a child has been locked inside the vehicle and they should immediately return to take emergency measures.

[0033] However, the above methods have obvious drawbacks. In scenarios where the driver briefly leaves the vehicle, such as when temporarily parking to pick up a package or shopping for a short time, if the person locked inside the vehicle is able to move independently and is emotionally stable, or if the environment inside the vehicle is within a safe range, directly triggering the alarm will cause unnecessary disturbance to the driver. The vehicle's audible and visual alarm may cause panic among surrounding vehicles, and it will also consume vehicle energy due to operations such as opening windows and starting the air conditioner.

[0034] In other words, the relevant technology fails to differentiate between the actual state of the locked person and the actual conditions inside the vehicle, resulting in a lack of flexibility and accuracy in the alarm mechanism. This leads to frequent disruptions to the driver's normal activities and unnecessary waste of resources.

[0035] To address the aforementioned issues, the vehicle occupant risk detection method provided in this application embodiment achieves dynamic risk assessment by comprehensively analyzing the status data of the locked occupants and the environmental data inside the vehicle. This allows for the execution of corresponding measures only when an alarm is truly needed, thereby improving the safety and flexibility of vehicle use, reducing disturbance to the driver, and avoiding unnecessary waste of resources.

[0036] The following is combined Figure 1 The method for detecting the risk of occupants inside a vehicle provided in the embodiments of this application will be described in detail. Figure 1 The diagram shown is a flowchart illustrating a method for detecting the risk of occupants inside a vehicle, according to an embodiment of this application. Figure 1 As shown, the method includes the following steps.

[0037] Step S110: If someone is detected to be locked inside the vehicle, acquire the status data of the locked person and the environmental data inside the vehicle.

[0038] The status data reflects at least one of the following: the locked-up person's facial features, limbs, voice, and vital signs. For example, status data includes the locked-up person's limb movements, facial expressions, body temperature, and voice. Environmental data includes the vehicle's interior temperature, humidity, carbon dioxide concentration, air quality index, and light intensity.

[0039] In practice, if the vehicle doors are detected as locked and the vehicle is turned off, a detection system to check for occupants is triggered. Detection methods include using in-vehicle cameras (such as surround-view cameras or cockpit cameras) to collect in-vehicle image data, using millimeter-wave radar to collect biosignals, or using seat pressure sensors to detect occupants. If human silhouettes are detected in the image data, vital signs are detected by the millimeter-wave radar, or the pressure value from the seat pressure sensor exceeds a preset threshold, it is determined that someone is locked inside the vehicle. Conversely, if no human silhouettes are detected, it is determined that no one is inside the vehicle.

[0040] When someone is detected locked inside the vehicle, image data of the locked person is captured via a camera, point cloud data is acquired via millimeter-wave radar, and audio data of the locked person is captured via a microphone equipped in the vehicle. The locked person's status data consists of at least one of the image data, point cloud data, and audio data.

[0041] Furthermore, temperature, humidity, carbon dioxide, and particulate matter sensors installed inside the vehicle collect real-time data on temperature, humidity, carbon dioxide levels, and air quality. The in-vehicle environmental data comprises at least one of these data.

[0042] Step S120: Based on status data and environmental data, assess the risks to the locked personnel inside the vehicle and obtain the risk assessment results.

[0043] The risk assessment results are used to reflect the degree of danger to the locked-up personnel. For example, the risk assessment results include whether there is danger or not; the situation where there is danger can be further divided into different levels such as early warning, high risk and emergency.

[0044] In some embodiments, a pre-built risk assessment model can be used to fuse and analyze state data and environmental data, and output a risk assessment result based on the analysis results. This risk assessment model can be a machine learning-based classification model.

[0045] Step S130: If the risk assessment results indicate that the locked-in personnel are in danger, determine the alarm measures and execute the alarm operation according to the alarm measures.

[0046] The alarm measures are specific operational plans for responding to dangerous situations involving locked-in personnel. For example, the alarm measures may include control plans for various actuators inside the vehicle, linkage plans for external traffic facilities, interaction plans with user terminals, and collaborative processing plans with remote rescue platforms.

[0047] In some embodiments, alarm measures can be determined based on factors such as the person being locked out, the current time, the vehicle status, and the surrounding environment. For example, if the person being locked out is a child or an elderly person, mild alarm measures can be prioritized, such as turning on the air conditioner to a comfortable temperature, playing soothing music or animated videos that children like to calm them down; if it is nighttime and the vehicle is in a remote area, the vehicle's audible and visual alarm can be activated simultaneously to attract the attention of people nearby, and a warning message containing the vehicle's real-time location can be sent to emergency contacts; if the vehicle's battery is low, low-energy operations should be prioritized when executing alarm measures, such as only sending a warning message without activating high-power equipment, to avoid the vehicle running out of power and hindering subsequent rescue efforts.

[0048] In other embodiments, the driver can pre-set a hazard handling plan, and when a danger is detected to the locked person, the alarm measures will be determined according to the hazard handling plan. This customization allows the alarm measures to be more closely aligned with the driver's actual needs.

[0049] Once the alarm measures are determined, each operation can be executed sequentially based on the pre-set priority of the measures. For example, if the alarm measures are "turn on the air conditioning to 24°C, send a warning message to the emergency contact, and unlock the vehicle," the air conditioning can be turned on to 24°C first, then a warning message can be sent to the emergency contact; if no feedback is received from the emergency contact, then the vehicle can be unlocked. By setting the priority of the measures, conflicts or safety issues that may arise from executing multiple measures simultaneously can be avoided.

[0050] When a person is detected locked inside a vehicle, this application embodiment effectively assesses whether the person is in danger based on the person's status data and the vehicle's environmental data, thus achieving dynamic assessment of the danger posed by the person. Only when danger is detected will an alarm be triggered according to the established alarm measures, thereby avoiding alarms that would interfere with the driver's activities whenever a person is detected. This improves the safety and flexibility of vehicle use and reduces unnecessary resource consumption.

[0051] In some embodiments, in order to improve the accuracy of risk assessment results, this application provides an optional embodiment that determines the risk assessment results by combining the emotional state of the locked person and the degree of physiological impact of the environment on the locked person. The specific implementation is as follows.

[0052] Optionally, based on state data and environmental data, the risks posed by the locked person in the vehicle are assessed to obtain risk assessment results, including: identifying the locked person's emotions in the vehicle based on state data to determine the locked person's emotional state; determining the degree of physiological impact of the vehicle environment on the locked person based on environmental data; and assessing the risks posed by the locked person in the vehicle based on the emotional state and the degree of physiological impact to obtain risk assessment results.

[0053] Among them, emotional state includes happiness, calmness, tension, anxiety, fear, etc.; the degree of physiological impact is used to quantify the degree of impact of in-vehicle environmental factors on the body of locked personnel, for example, it can be divided into no significant impact, slight impact, moderate impact and severe impact.

[0054] In some embodiments, facial and / or vocal features of the locked-up person are extracted from their state data. By analyzing these features, the emotional state of the locked-up person is determined. For example, if features such as a furrowed brow, downturned lips, and wide eyes are detected, the emotional state of the locked-up person can be preliminarily determined to be "tense." Simultaneously, by analyzing the vocal data, if continuous crying, screaming, or rapid breathing is detected, the emotional state of the locked-up person can be definitively determined to be "tense."

[0055] In other embodiments, the emotional state of a locked-up person can be determined by their behavioral characteristics. For example, state data is input into a behavior recognition model to identify the behavioral characteristics of the locked-up person. These behavioral characteristics are compared with a pre-defined database of emotion-related behaviors. If the behavioral characteristics are "crying" or "banging on the car door," the emotional state is determined to be "fear"; if the behavioral characteristics are "sitting quietly" or "sleeping comfortably," the emotional state is determined to be "calm." The behavior recognition model includes the YOLO (You Only Look Once) model.

[0056] In this embodiment, the physiological impact of the in-vehicle environment on locked occupants can be quantified by combining environmental data with human physiological tolerance threshold ranges. Specifically, the environmental data can consist of several types of data, including temperature, humidity, carbon dioxide concentration, air quality index, and light intensity. For each type of data, a corresponding range of human physiological tolerance thresholds is set. The actual collected environmental data of that type is compared with this range, and the degree to which it exceeds the threshold is used to determine the physiological impact of that type of environmental data on the locked occupants. Thus, a physiological impact level can be determined for each type of environmental data.

[0057] For example, if the environmental data includes an interior temperature of 32°C and a carbon dioxide concentration of 1500 ppm, the range of the human physiological tolerance threshold for temperature is set to 22°C-28°C. Since 32°C exceeds the upper limit by 4°C, 4°C is used as the environmental data for this type of temperature, representing the degree of physiological impact on the locked-in person. Similarly, the range of the human physiological tolerance threshold for carbon dioxide concentration is set to 800 ppm-1200 ppm. Since 1500 ppm exceeds the upper limit by 300 ppm, 300 ppm is used as the environmental data for this type of carbon dioxide, representing the degree of physiological impact on the locked-in person.

[0058] After determining the emotional state and the degree of physiological impact, the current risk level of the locked-up person can be determined according to the preset correspondence between the emotional state, the degree of physiological impact and the risk level, and this risk level can be used as the risk assessment result.

[0059] This application embodiment combines the emotional state of the locked-in person with the degree of physiological impact of the in-vehicle environment, which can more comprehensively and accurately reflect the actual risks faced by the locked-in person. Risk assessment based on emotional state and degree of physiological impact, that is, risk assessment by combining two dimensions, avoids misjudgment that may be caused by a single factor, and effectively improves the accuracy and reliability of risk assessment results.

[0060] In order to more easily determine whether a locked-up person is in danger, this application provides an optional embodiment that describes the risk assessment process for locked-up persons based on their emotional state and the degree of physiological impact. The specific implementation is as follows.

[0061] In some embodiments, the risk to the locked person inside the vehicle is assessed based on emotional state and the degree of physiological impact, resulting in a risk assessment. This includes comparing the emotional state with a stable state and performing numerical analysis on the degree of physiological impact and the target impact range. If the emotional state is stable and the degree of physiological impact does not exceed the target impact range, the risk assessment result for the locked person inside the vehicle is determined to be no danger. If the emotional state is unstable or the degree of physiological impact exceeds the target impact range, the risk assessment result for the locked person inside the vehicle is determined to be dangerous.

[0062] The system allows setting the corresponding emotions for stable states based on actual application. For example, calm and happy states can be set as stable states. The target influence range is the physiologically tolerable range of environmental influences for the locked-in individual. It should be noted that a corresponding target influence range can be set for each type of environmental data.

[0063] In practice, the emotional state of the locked-up person can be compared with a stable state. If they match, it indicates that the locked-up person is currently emotionally stable; otherwise, it indicates that the locked-up person is emotionally unstable. Simultaneously, for each type of environmental data, the physiological impact corresponding to that type of environmental data is compared with the target impact range corresponding to that type. If it does not exceed the target impact range, it indicates that the physiological impact of that type of environmental data on the locked-up person is within an acceptable range; otherwise, it indicates that the environmental data has had a physiological impact on the locked-up person that exceeds the acceptable range.

[0064] Furthermore, after analyzing the emotional state and physiological impact of the locked-up person, the risk assessment result of the locked-up person in the vehicle is determined to be no danger only when the emotional state of the locked-up person is stable and the physiological impact does not exceed the target impact range that the locked-up person can tolerate; if either of these conditions is not met, i.e. the emotional state is not stable or the physiological impact exceeds the target impact range, then the locked-up person is determined to be in danger in the vehicle.

[0065] Furthermore, when a locked-up person is in danger, the type of danger they face can be further determined. For example, the type of danger includes personal condition danger and environmental danger. Environmental dangers include high temperature danger, high humidity danger, excessive carbon dioxide concentration danger, and deteriorating air quality danger. For instance, if the locked-up person's emotional state is "fear" accompanied by screaming, and the temperature inside the vehicle is 35°C, exceeding the target's influence range, then the danger type can be determined as a combination of personal condition danger and high temperature danger; if only the carbon dioxide concentration inside the vehicle reaches 2000 ppm, exceeding the target's influence range, and the locked-up person's emotional state is calm, then the danger type is determined as excessive carbon dioxide concentration danger within the environmental danger category.

[0066] This application's embodiments compare emotional states with stable states and perform numerical analysis on the degree of physiological impact and the target impact range. When the locked-up person's emotions are stable and the degree of physiological impact is tolerable, it is determined that the locked-up person is not in danger, ensuring the safety of the locked-up person in both physiological and emotional aspects. Furthermore, the risk assessment results can be quickly determined through simple comparison without complicated calculation processes, improving the efficiency of risk assessment and enabling rapid response when the locked-up person faces danger.

[0067] In performing alarm procedures, this application fully considers the type of danger posed to the locked-in personnel to ensure that the alarm procedures meet their actual needs and avoid ineffective operations. The following details how to perform the alarm procedures.

[0068] In some embodiments, performing an alarm operation according to alarm measures includes: if the emotional state is not stable, performing an alarm operation according to the first measure in the alarm measures for adjusting the emotions of the locked person; if the degree of physiological impact exceeds the target impact range, identifying the environmental factors causing the degree of physiological impact, and performing an alarm operation according to the second measure in the alarm measures for adjusting the environmental factors.

[0069] The alarm measures include a first measure to calm the locked-in person and a second measure to adjust environmental factors. For example, the first measure may include playing reassuring voice messages, videos, and communicating with emergency contacts. The reassuring voice messages may be soothing music or recorded voice messages from emergency contacts. Videos may be family photos or cartoons. The second measure includes turning on the air conditioning to adjust the temperature, activating the air purification mode, and opening the windows for ventilation.

[0070] In practice, if the emotional state is unstable but the physiological impact does not exceed the target range, the first alarm measure can be retrieved and executed accordingly. If the emotional state is stable but the physiological impact exceeds the target range, the second alarm measure can be retrieved. If the physiological impact of all types of environmental data exceeds the target range, all alarm operations in the second measure are executed. For example, the second measure includes turning on the air conditioner, activating the air purification mode, and opening the sunroof. If the physiological impact of all types of environmental data exceeds the target range, the operations of turning on the air conditioner, activating the air purification mode, and opening the sunroof are executed one by one.

[0071] Furthermore, if the physiological impact of only some types of environmental data exceeds the target impact range, executing all alarm operations in the second measure would be a waste of resources. In this case, the type of environmental data whose physiological impact exceeds the target impact range can be identified, and a third measure matching that type can be selected from the second measures. The alarm operation can then be executed according to the third measure. For example, if the physiological impact corresponding to temperature exceeds the target impact range, a third measure related to temperature regulation, such as turning on the air conditioner, can be selected from the second measures. Accordingly, the alarm operation executed is to turn on the air conditioner to the preset temperature.

[0072] In this embodiment, when a locked-up person is emotionally unstable, a first measure is taken to soothe their emotions and prevent danger caused by emotional outbursts. When in-vehicle environmental factors have an impact on the locked-up person's physiology beyond their tolerance, a second measure is taken to specifically adjust the environmental factors, quickly improving the in-vehicle environment and reducing its harm to the locked-up person. By employing different alarm measures based on different dangerous situations, the alarm operation becomes more targeted, ensuring the safety of the locked-up person while avoiding unnecessary resource consumption, thus improving the practicality and reliability of the entire alarm mechanism.

[0073] In practical applications, the actual situations faced by locked-in personnel are complex and diverse. A single alarm system is insufficient to meet the different needs of all scenarios, resulting in wasted resources or poor risk response.

[0074] To this end, this application further provides a scheme for dynamically adjusting alarm measures based on risk levels. Specifically, determining the specific implementation method of the alarm measures includes: determining the risk level of the locked person inside the vehicle based on status data and environmental data; and identifying the measure corresponding to the risk level from multiple measures as the alarm measure.

[0075] In practice, risk levels can be determined in several ways. For example, the emotional state of the locked-in person can be determined based on status data, and the degree of physiological impact of the vehicle's environment on the locked-in person can be determined through environmental data. The risk level of the locked-in person can then be determined based on the correlation between emotional state, degree of physiological impact, and risk level. Alternatively, the risk level can be calculated directly based on status and environmental data using a pre-set risk assessment model. This model can comprehensively consider both status and environmental data, perform quantitative scoring, and ultimately map the results to different risk level ranges. Risk levels can include warning, high risk, and emergency.

[0076] In some embodiments, a mapping relationship between different measures and risk levels can be pre-established, meaning different risk levels correspond to different measures. Based on this mapping relationship, the measure corresponding to the current risk level of the locked-in person is determined and used as an alarm measure.

[0077] For example, the mapping relationship between different measures and risk levels can be as follows: when the risk level is warning, the corresponding measure is to send a warning message to the driver's in-vehicle terminal to remind that there may be someone left in the vehicle; when the risk level is high risk, the corresponding measures may include sending a warning message to the driver's user terminal and establishing a call with the user terminal so that the locked person can communicate directly with the driver and alleviate the locked person's emotions; when the risk level is emergency, the corresponding measures may include sending a warning message to the driver's user terminal, establishing a call with the user terminal, and sounding the horn as an alarm.

[0078] This application embodiment dynamically matches corresponding alarm measures according to different risk levels, so that the alarm measures meet the needs of the actual dangerous situation, avoiding situations where excessive measures are taken, resulting in waste of resources and interference, or where mismatched measures lead to an inability to effectively deal with risks. It can effectively determine alarm measures and take into account the differences in the actual dangerous situation of locked personnel, thereby improving the accuracy and effectiveness of risk response.

[0079] To enhance the comprehensiveness and reliability of alarm measures, this application also discloses the specific content of the measures. Optionally, the measures include at least one of vehicle control measures, user terminal interaction measures, and remote measures; vehicle control measures include at least one of activating air purification mode, turning on the air conditioner, recording the vehicle environment, playing target video, adjusting the windows, activating the vehicle's audio and visual alarm, and controlling the multimedia system to display self-rescue methods; user terminal interaction measures include at least one of sending warning information, sending in-vehicle and out-of-vehicle audio and video information, establishing a call with the user terminal, sending broadcast messages, and performing remote vehicle unlocking operations; remote measures include sending vehicle information and / or information of the locked person to the target; the target includes the mobile terminal of the rescue platform and / or emergency contact.

[0080] Among these measures, vehicle control measures directly operate equipment deployed in vehicles to quickly improve the in-vehicle environment or establish interaction with locked-in personnel. User terminal interaction measures control user terminals to provide timely feedback on the locked-in personnel's situation. Remote measures can seek assistance from external targets when local measures are insufficient to effectively resolve the danger.

[0081] In vehicle control measures, the target video can be calming content such as familiar family images or favorite cartoon clips, played on the in-vehicle display screen to help alleviate the locked-in person's anxiety. Adjusting the windows allows for ventilation by choosing to open all windows, some windows, or only the sunroof, ensuring air circulation while avoiding safety hazards caused by fully open windows. Recording the vehicle environment uses an in-vehicle camera to record the locked-in person's status and surroundings in real time. Playing the target video and recording the vehicle environment can be done simultaneously, calming the locked-in person while ensuring dynamic monitoring of the vehicle's interior. Activating the vehicle's audible and visual alarms attracts attention through flashing lights and a horn, facilitating timely rescue. When controlling the multimedia system to demonstrate self-rescue methods, it can use text, images, or animations to demonstrate the steps to unlock a child safety seat and the location of emergency escape switches, helping locked-in persons with some mobility attempt to escape on their own.

[0082] In user terminal interaction measures, the warning information can include a description of the locked person's current emotional state, specific numerical values ​​of in-vehicle environmental data, and the degree of physiological impact. In-vehicle audio-visual information can include real-time footage from the in-vehicle camera, sound collected by the microphone, and images of the external environment, allowing the driver to intuitively understand the locked person's actual situation. Broadcast messages can be requests for help; for example, when the vehicle is in a relatively enclosed area such as a residential community or parking lot with a broadcast system coverage, a request for help can be sent to the broadcast system in that area to expand the scope of assistance. Remote vehicle unlocking is used in emergencies, allowing the driver to remotely control the vehicle unlocking via the user terminal, enabling the locked person to leave on their own or for external personnel to enter and provide assistance.

[0083] In remote measures, vehicle information sent to the rescue platform may include real-time vehicle location, model, color, and license plate number. Information about the locked-in person may include estimated age, gender, emotional state, and degree of physiological impact. When sending information to the emergency contact's mobile terminal, the alert information sent to the driver's user terminal can also be sent to the emergency contact's mobile terminal, so that the emergency contact can be informed of the locked-in person's situation.

[0084] It should be noted that when executing alarm operations corresponding to vehicle control measures, control commands can be sent to the vehicle's electronic control unit via the CAN (Controller Area Network) bus to achieve precise control of devices such as the air conditioning, windows, and multimedia system. When executing alarm operations corresponding to user terminal interaction measures, the monitoring screen can be pushed to the driver's user terminal in real time via the vehicle's built-in fourth-generation mobile communication technology and / or fifth-generation mobile communication technology communication module. Furthermore, for situations requiring real-time interaction with the user terminal, the WebRTC (WebReal-Time Communication) protocol can be used.

[0085] This application provides a multi-dimensional approach encompassing vehicle self-control, user terminal interaction, and remote assistance to ensure the safety of locked-in individuals from various perspectives. Vehicle control measures directly affect the vehicle itself, quickly responding to and mitigating danger by adjusting in-vehicle environmental parameters, activating audible and visual alarms, or providing self-rescue guidance. User terminal interaction establishes communication between the locked-in individual and the driver, ensuring the user can promptly understand the situation inside the vehicle and perform remote unlocking operations. Furthermore, remote measures are provided to prevent alarms from being sent to remote targets when local measures fail to provide effective control, comprehensively ensuring the safety of locked-in individuals.

[0086] In some embodiments, to comprehensively understand the locked-in person and improve the accuracy of risk assessment, this application provides a method for assessing the risk posed by the locked-in person within a vehicle based on state data and environmental data. Optionally, the state data includes at least one of image data and point cloud data of the locked-in person; the environmental data includes at least one of temperature data, humidity data, and carbon dioxide content within the vehicle; based on the state data and environmental data, assessing the risk posed by the locked-in person within the vehicle to obtain a risk assessment result includes: performing motion feature analysis on the point cloud data, and determining the locked-in person's vital signs data based on the results of the motion feature analysis; performing facial feature analysis on the image data, and determining the locked-in person's facial feature data based on the results of the facial feature analysis; and assessing the risk posed by the locked-in person within the vehicle based on the vital signs data, facial feature data, and environmental data to obtain a risk assessment result.

[0087] Vital signs data include heart rate and respiratory rate. Facial feature data includes facial expression features, eye condition, and skin color.

[0088] In practice, point cloud data of the locked person can be collected using an in-vehicle lidar system. This point cloud data can then be used to determine the positional changes of the locked person's chest and limbs, and based on these positional changes, the frequency and amplitude of the locked person's movements can be determined. Based on the frequency and amplitude of these movements, the locked person's vital signs can be determined. For example, the respiratory rate can be calculated by determining the frequency and amplitude of the chest region's fluctuations in the point cloud data.

[0089] In this embodiment, image recognition technology can also be used to analyze facial features in the image data to determine the facial feature data of the locked person. For example, a face detection algorithm can be used to extract facial data from the image data. Key point localization is performed on the facial data to obtain the coordinate information of key areas such as the eyes, eyebrows, and mouth. Based on the coordinate information of these key areas, the eye state and facial expression features of the locked person are determined, combined with facial feature data such as skin color.

[0090] Furthermore, after identifying vital signs and facial feature data, these are fused with environmental data in a multi-dimensional analysis to determine whether there is any danger to the locked person inside the vehicle based on the fused data.

[0091] For example, if facial feature data detects that the locked person exhibits painful or anxious facial expressions such as continuous crying and furrowed brows, and their eye condition shows frequent blinking or abnormal eye movement, while their vital signs data show a heart rate significantly higher than the normal heart rate range for their age group, combined with environmental data showing that the vehicle interior temperature exceeds 35°C and the carbon dioxide concentration exceeds 1500 ppm, then it is determined that the locked person is emotionally stressed and experiencing heat stress, thus confirming that the locked person is in danger.

[0092] This application embodiment uses the vital signs data and facial feature data of the locked person to more accurately and comprehensively reflect the physical state of the locked person and their specific reactions inside the vehicle. Furthermore, by combining vital signs data, facial feature data and environmental data, and taking into account the impact of the actual conditions inside the vehicle on the locked person, the risk faced by the locked person is assessed by combining multiple factors, effectively avoiding the judgment errors that may occur when relying on only a single data dimension for assessment, thereby improving the accuracy and comprehensiveness of the risk assessment results.

[0093] The embodiments of the vehicle occupant risk detection method have been described in detail above. In order to enable those skilled in the art to further understand the technical solution of this method, specific application scenarios are given below.

[0094] In practice, the system initiates a occupant detection process when the vehicle is detected to be off-roaded and the key has been removed from the vehicle for a preset distance and duration. First, cameras installed inside the vehicle capture image data, and radar collects point cloud data. Simultaneously, in-vehicle sensors begin real-time monitoring and collection of environmental data such as temperature, humidity, and carbon dioxide concentration.

[0095] Next, the collected image data is analyzed, and a face detection algorithm is used to identify whether a face is inside the vehicle. If no face is detected, it is determined that no one is left inside the vehicle, and the detection process ends. If a face is detected, the actual presence of the person is further confirmed by combining point cloud data, eliminating false identifications caused by seat creases, toys, or other objects, and detecting whether the locked person is a child.

[0096] If it is determined that a child is locked inside the vehicle, the risk assessment phase begins. During this phase, based on point cloud and image data, the emotional state of the locked child is determined; environmental data is used to determine the degree of physiological impact of the vehicle's environment on the locked child. If the emotional state is stable and the physiological impact does not exceed the target range, the locked child is deemed safe; otherwise, the locked child is deemed to be in danger, and the risk level is further determined. According to the pre-defined mapping between risk levels and corresponding measures, alarm measures for the currently locked child are determined.

[0097] For example, if the risk level is warning, it indicates a potential safety hazard, but no substantial impact has yet occurred. If, during a warning risk period, situations arise such as excessively high ambient temperature, oxygen deficiency, or the approach of dangerous individuals, vehicle control measures may include activating air purification mode, turning on the air conditioning, and recording the vehicle's environment. If agitation or other emotional instability occurs, vehicle control actions may include activating multimedia intelligent playback to play preset animations or allow interaction with an AI character. User terminal interaction measures may include sending warning messages, sending in-vehicle and out-of-vehicle audio-visual information, and interacting with the locked-in person through the multimedia system, thereby establishing communication between parents and locked-in children to soothe the child's emotions.

[0098] If the risk level is high, it indicates a significant risk requiring immediate action. In cases of excessively high ambient temperature, severe oxygen deficiency, or unauthorized vehicle entry, vehicle control measures include activating air purification mode, turning on the air conditioning, recording the vehicle's environment, slightly lowering windows, and raising the sunroof. In cases of children crying or severe heatstroke, vehicle control measures include activating multimedia intelligent playback to play preset animations, pre-recorded comforting videos from parents, and interaction with an AI-powered character. User terminal interaction measures may include sending warning messages, sending audio-visual information from inside and outside the vehicle, interacting with the locked occupants through the multimedia system, and broadcasting assistance to nearby vehicles. Furthermore, remote measures are employed to send the location and a brief description of the high-risk situation to pre-set emergency contacts.

[0099] If the risk level is "emergency," it indicates a threat to personal safety. In cases of natural disasters, major accidents, children falling into a coma, losing consciousness, or becoming unresponsive, the vehicle control measures include audible and visual alarms and multimedia prompts for self-rescue. User terminal interaction measures include automatically dialing parents' numbers to proactively report the vehicle's location and a brief description of the emergency, responding to remote unlocking operations to unlock the doors, and activating autonomous driving mode. Remote measures include automatically sending the location and a brief description of the high-risk situation to preset emergency contacts; and dialing preset emergency numbers.

[0100] This application embodiment realizes closed-loop control between environmental perception, risk assessment and actuator linkage. It can dynamically analyze the environmental data and the status data of locked personnel collected in real time, and automatically trigger corresponding vehicle control measures, user terminal interaction measures and remote measures according to the determined risk level. It can automatically and accurately alarm the risk of personnel in the vehicle, and provide timely and comprehensive safety protection for locked personnel in the vehicle.

[0101] The above text combined Figure 1 This paper describes in detail the embodiments of the vehicle occupant risk detection method of this application. The following is a combination of... Figure 2This application provides a detailed description of embodiments of the vehicle occupant risk detection device. It should be understood that the descriptions of the vehicle occupant risk detection method embodiments correspond to the descriptions of the vehicle occupant risk detection device embodiments; therefore, any parts not described in detail can be found in the preceding method embodiments.

[0102] Figure 2 The diagram shown is a structural schematic of a vehicle occupant risk detection device according to an embodiment of this application. Figure 2 As shown, the vehicle control device 20 provided in this application embodiment includes: The data acquisition module 210 is used to acquire the status data of the locked person and the environmental data inside the vehicle when it is detected that someone is locked inside the vehicle; The risk assessment module 220 is used to assess the risks to locked personnel in the vehicle based on status data and environmental data, and obtain risk assessment results. The measure determination module 230 is used to determine alarm measures and execute alarm operations in accordance with the alarm measures when the risk assessment results indicate that there is a danger to the locked personnel.

[0103] In one embodiment of this application, the risk assessment module 220 is further configured to: identify the emotions of the locked person in the vehicle based on state data to determine the emotional state of the locked person; determine the degree of physiological impact of the vehicle environment on the locked person based on environmental data; and assess the risks existing in the vehicle based on the emotional state and the degree of physiological impact to obtain a risk assessment result.

[0104] In one embodiment of this application, the risk assessment module 220 is further configured to compare the emotional state with the stable state, and to perform numerical analysis on the degree of physiological impact and the target impact range; if the emotional state is stable and the degree of physiological impact does not exceed the target impact range, the risk assessment result of the locked person in the vehicle is determined to be no danger; if the emotional state is not stable, or the degree of physiological impact exceeds the target impact range, the risk assessment result of the locked person in the vehicle is determined to be dangerous.

[0105] In one embodiment of this application, the measure determination module 230 is further configured to: if the emotional state is not stable, execute an alarm operation according to the first measure in the alarm measures for adjusting the emotions of the locked person; if the degree of physiological impact exceeds the target impact range, determine the environmental factors that cause the degree of physiological impact, and execute an alarm operation according to the second measure in the alarm measures for adjusting the environmental factors.

[0106] In one embodiment of this application, the measure determination module 230 is further configured to determine the risk level of the locked person inside the vehicle based on status data and environmental data; and to determine the measure corresponding to the risk level from multiple measures as an alarm measure.

[0107] In one embodiment of this application, the measures include at least one of vehicle control measures, user terminal interaction measures, and remote measures; the vehicle control measures include at least one of activating air purification mode, turning on the air conditioner, recording the vehicle environment, playing a target video, adjusting the windows, activating the vehicle's audio and visual alarm, and controlling the multimedia system to display self-rescue methods; the user terminal interaction measures include at least one of sending warning information, sending in-vehicle and out-of-vehicle audio and video information, establishing a call with the user terminal, sending broadcast messages, and performing a remote vehicle unlocking operation; the remote measures include sending vehicle information and / or information of the locked person to the target object; the target object includes the mobile terminal of the rescue platform and / or emergency contact.

[0108] In one embodiment of this application, the status data includes at least one of image data of the locked person and point cloud data; the environmental data includes at least one of temperature data, humidity data, and carbon dioxide content inside the vehicle. The risk assessment module 220 is also used to perform motion feature analysis on point cloud data, and determine the vital signs data of the locked person based on the results of the motion feature analysis; perform facial feature analysis on image data, and determine the facial feature data of the locked person based on the results of the facial feature analysis; and assess the risks existing in the vehicle by the locked person based on the vital signs data, facial feature data, and environmental data, and obtain the risk assessment results.

[0109] When a person is detected locked inside a vehicle, this application embodiment effectively assesses whether the person is in danger based on the person's status data and the vehicle's environmental data, thus achieving dynamic assessment of the danger posed by the person. Only when danger is detected will an alarm be triggered according to the established alarm measures, thereby avoiding alarms that would interfere with the driver's activities whenever a person is detected. This improves the safety and flexibility of vehicle use and reduces unnecessary resource consumption.

[0110] It is worth noting that in the embodiments of the above-mentioned vehicle occupant risk detection device, the various units and modules included are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be achieved; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the scope of protection of the present invention.

[0111] Below, for reference Figure 3 To describe the vehicle according to embodiments of this application. Figure 3 The diagram shown is a structural schematic of a vehicle provided in an exemplary embodiment of this application.

[0112] like Figure 3 As shown, vehicle 30 includes one or more processors 301 and memory 302.

[0113] The processor 301 may be a central processing unit (CPU) or other form of processing unit with data processing and / or instruction execution capabilities, and may control other components in the vehicle 30 to perform desired functions.

[0114] The memory 302 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and / or cache memory. Non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 301 may execute the program instructions to implement the in-vehicle occupant risk detection methods of the various embodiments of this application described above, and / or other desired functions.

[0115] In one example, vehicle 30 may also include input device 303 and output device 304, which are interconnected via a bus system and / or other forms of connection mechanism (not shown).

[0116] The input device 303 may include, for example, a keyboard, a mouse, etc.

[0117] The output device 304 can output various information to the outside. The output device 304 may include, for example, a display, a speaker, a printer, and a communication network and its connected remote output devices, etc.

[0118] Of course, for the sake of simplicity, Figure 3 Only some of the components of vehicle 30 relevant to this application are shown in this illustration; components such as buses, input / output interfaces, etc., are omitted. In addition, vehicle 30 may include any other suitable components depending on the specific application.

[0119] In addition to the methods and devices described above, embodiments of this application may also be computer program products, which include computer program instructions that, when executed by a processor, cause the processor to perform the steps in the in-vehicle occupant risk detection methods according to various embodiments of this application as described above.

[0120] Computer program products can be written in any combination of one or more programming languages ​​to perform the operations of the embodiments of this application. The programming languages ​​include object-oriented programming languages ​​such as Java and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0121] Furthermore, embodiments of this application may also be computer-readable storage media storing computer program instructions thereon, which, when executed by a processor, cause the processor to perform the steps in the vehicle occupant risk detection methods according to various embodiments of this application described above.

[0122] Computer-readable storage media may take the form of any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may, for example, include, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0123] The basic principles of this application have been described above with reference to specific embodiments. However, it should be noted that the advantages, benefits, and effects mentioned in this application are merely examples and not limitations, and should not be considered as essential features of each embodiment of this application. Furthermore, the specific details of the above application are for illustrative and facilitative purposes only, and are not limitations. These details do not limit the application to the necessity of employing the aforementioned specific details for implementation.

[0124] The block diagrams of devices, apparatuses, devices, and systems involved in this application are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As those skilled in the art will recognize, these devices, apparatuses, devices, and systems can be connected, arranged, and configured in any manner. Words such as “comprising,” “including,” “having,” etc., are open-ended terms meaning “including but not limited to,” and are used interchangeably with them. The terms “or” and “and” as used herein refer to the terms “and / or,” and are used interchangeably with them unless the context clearly indicates otherwise. The term “such as” as used herein refers to the phrase “such as but not limited to,” and is used interchangeably with it.

[0125] It should also be noted that in the apparatus, equipment, and methods of this application, the components or steps can be disassembled and / or recombined. These disassemblies and / or recombinations should be considered as equivalent solutions of this application.

[0126] The above description of the claimed aspects is provided to enable any person skilled in the art to make or use this application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein can be applied to other aspects without departing from the scope of this application. Therefore, this application is not intended to be limited to the aspects shown herein, but rather to be applied within the widest scope consistent with the principles and novel features of this application.

[0127] The above description has been given for illustrative and descriptive purposes. Furthermore, this description is not intended to limit the embodiments of this application to the forms described herein. Although numerous exemplary aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, alterations, additions, and sub-combinations thereof.

Claims

1. A method for detecting the risk of occupants inside a vehicle, characterized in that, If someone is detected locked inside the vehicle, acquire the status data of the locked person and the environmental data inside the vehicle; Based on status data and environmental data, the risks to locked personnel inside the vehicle are assessed, and risk assessment results are obtained. If the risk assessment indicates that the locked-in person is in danger, determine the alarm measures and execute the alarm operation in accordance with the alarm measures.

2. The method according to claim 1, characterized in that, Based on status and environmental data, the risks posed to locked individuals within the vehicle are assessed, yielding risk assessment results, including: Based on state data, identify the emotions of the locked person inside the vehicle to determine the emotional state of the locked person; Based on environmental data, determine the degree of physiological impact of the in-vehicle environment on locked-in personnel; Based on emotional state and the degree of physiological impact, the risks to locked individuals inside the vehicle are assessed, and risk assessment results are obtained.

3. The method according to claim 2, characterized in that, Based on emotional state and the degree of physiological impact, the risks posed to locked individuals within the vehicle are assessed, yielding risk assessment results, including: The emotional state was compared with the stable state, and the degree of physiological impact was numerically analyzed with the scope of the target impact. If the emotional state is stable and the degree of physiological impact does not exceed the target's impact range, the risk assessment result for the locked person inside the vehicle is determined to be no danger. If the emotional state is unstable or the physiological impact exceeds the target's range, the risk assessment result for the locked person inside the vehicle is determined to be dangerous.

4. The method according to claim 3, characterized in that, Perform alarm operations according to the alarm procedures, including: If the emotional state is not stable, then follow the first measure in the alarm procedures for adjusting the emotions of the locked person and execute the alarm operation. If the degree of physiological impact exceeds the target range, the environmental factors causing the degree of physiological impact are identified, and the alarm operation is performed in accordance with the second measure in the alarm measures for adjusting environmental factors.

5. The method according to claim 1, characterized in that, Determine alarm measures, including: Based on status data and environmental data, determine the risk level of the locked-in person inside the vehicle; Among multiple measures, the one corresponding to the risk level is identified and used as the alarm measure.

6. The method according to claim 1, characterized in that, The measures include at least one of the following: vehicle control measures, user terminal interaction measures, and remote measures; Vehicle control measures include at least one of the following: activating air purification mode, turning on the air conditioner, recording the vehicle environment, playing the target video, adjusting the windows, activating the vehicle's audible and visual alarms, and controlling the multimedia system to display self-rescue methods. User terminal interaction measures include at least one of the following: sending warning information, sending in-vehicle and out-of-vehicle audio and video information, establishing a call with the user terminal, sending broadcast messages, and performing remote vehicle unlocking operations; Remote measures include sending vehicle information and / or information about locked-up persons to the target; the target includes the mobile terminals of rescue platforms and / or emergency contacts.

7. The method according to claim 1, characterized in that, The status data includes at least one of the image data and point cloud data of the locked personnel; the environmental data includes at least one of the temperature data, humidity data and carbon dioxide content inside the vehicle. Based on status and environmental data, the risks posed to locked individuals within the vehicle are assessed, yielding risk assessment results, including: Motion feature analysis is performed on point cloud data, and the vital signs data of the locked personnel are determined based on the results of the motion feature analysis. Facial feature analysis is performed on the image data, and the facial feature data of the locked person is determined based on the results of the facial feature analysis; Based on vital sign data, facial feature data, and environmental data, the risks posed to locked individuals within the vehicle are assessed, and risk assessment results are obtained.

8. A computer-readable storage medium, characterized in that, The storage medium stores a computer program for executing the vehicle occupant risk detection method according to any one of claims 1 to 7.

9. A vehicle, characterized in that, include: processor; Memory used to store processor-executable instructions; A processor for executing the vehicle occupant risk detection method according to any one of claims 1 to 7.

10. A computer program product, characterized in that, The computer program product includes instructions that, when executed on a vehicle, cause the vehicle to implement the occupant risk detection method of any one of claims 1 to 7.

Images