Real-time monitoring method and system for life entity in automobile, electronic equipment and computer readable medium

Abstract

The invention provides a real-time monitoring method for life bodies in an automobile, and belongs to the field of intelligent driving. Data are collected through a sensing layer, intelligent analysis and risk assessment are carried out through a decision-making layer, finally, corresponding relieving and rescue measures are automatically executed through an execution layer, children / pets in sleep, coma and other non-moving states are reliably recognized, and the driving safety is improved. Multiple living bodies in the vehicle are distinguished and accurately positioned, the risk level (such as mild hypoxia vs endangered) is judged by fusing physiological and environmental data, a full-automatic closed loop of'detection-decision-rescue 'is realized, and manual response lag is avoided.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of intelligent driving, and in particular relates to a vehicle in-vehicle life real-time monitoring method and system, an electronic device and a computer readable medium. BACKGROUND

[0002] Children or pets are often forgotten in closed compartments, leading to frequent accidents such as suffocation and heatstroke. According to public data, at least 300 children die every year worldwide. Existing solutions mainly include three categories:

[0003] Pressure / switch sensor: such as seat cushion switch (CN104732711A), which detects the presence of personnel by detecting seat load, but cannot distinguish between living beings and objects, and cannot sense moving targets leaving the seat.

[0004] Infrared / ultrasonic probe: such as infrared motion detection (CN104732711A) or ultrasonic Doppler effect (CN202010880530.5), which can detect moving targets, but is ineffective for children / pets in a static sleep state.

[0005] Single biological sensor: such as millimeter wave radar to detect respiration and heartbeat (CN202010880530.5), but is susceptible to environmental interference (such as reduced respiration rate at high temperatures), and cannot distinguish between living being types (children vs pets).

[0006] Existing solutions generally have static detection blind spots, multi-target recognition confusion, lack of environmental coupling analysis, and emergency response relies on manual intervention, which cannot form a closed-loop rescue. SUMMARY

[0007] The present application aims to solve at least one of the technical problems in the prior art and proposes a vehicle in-vehicle life real-time monitoring method and system.

[0008] In a first aspect, the present application provides a vehicle in-vehicle life real-time monitoring method, which includes:

[0009] Collecting multi-source life state data;

[0010] Fusing multi-source data and making risk determination;

[0011] Making a graded response according to the risk determination.

[0012] In some embodiments, the step of collecting multi-source life state data includes:

[0013] When a signal is received that all doors are locked, enter real-time monitoring mode;

[0014] Multiple sensors are activated and scanned simultaneously to collect multi-source data of life status.

[0015] In some embodiments, in the step of activating and scanning multiple sensors simultaneously to collect multi-source data of life status, comprising:

[0016] Millimeter wave radar is used to emit millimeter waves and analyze the echo, extract vital signs signals through algorithms, and monitor breathing rate and heartbeat to obtain millimeter wave radar data;

[0017] The sensors embedded in the seat are activated to detect whether there is a load of ≥5 kg to obtain weight sensor data;

[0018] The wide-angle infrared camera is started and collects images inside the vehicle, and the images are analyzed in real time to identify the morphological characteristics of the target, and distinguish as "child", "pet" or "object" to obtain camera data;

[0019] The temperature and humidity sensor continuously monitors the environmental parameters in the vehicle cabin, including carbon dioxide concentration, temperature and humidity, to obtain environmental data.

[0020] In some embodiments, in the step of fusing multi-source data and making risk judgment, comprising:

[0021] The multi-source data is fused and all data is calculated using a weighted confidence model to obtain the comprehensive confidence of the existence of life, and if the confidence exceeds the threshold, it is determined as "static existence";

[0022] According to the comprehensive confidence, a risk judgment is made.

[0023] In some embodiments, according to the comprehensive confidence, a three-level risk judgment is made, comprising:

[0024] Level 1: static existence, confirming that there is a life left in the vehicle;

[0025] Level 2: physiological abnormalities, based on Level 1, the millimeter wave radar monitors abnormal physiological signals of the life;

[0026] Level 3: environmental deterioration, high-level alarm, based on Level 1, The temperature and humidity sensor monitors that the environmental parameters exceed the safety threshold, indicating that the environment is rapidly becoming dangerous.

[0027] In some embodiments, the risk index is defined as , T is the temperature in ℃, is the ppm value, when Time triggered Level 3 response.

[0028] In some embodiments, in the step of grading response according to risk determination, the following is included:

[0029] For all risk levels, the following response is included: sound and light alarm and APP push, alarm information is pushed to the vehicle owner's mobile phone APP through the vehicle-mounted T-Box;

[0030] For Level 2 and Level 3 risks, the following response is included: lowering the window and air conditioning external circulation;

[0031] For Level 3 risks or Level 2 risks that have not been resolved for a long time, the following response is included: e-Call rescue and automatic positioning sharing.

[0032] In a second aspect, the present application also provides a real-time monitoring system for life bodies in a vehicle, comprising:

[0033] The acquisition unit is configured to acquire multi-source data of life states;

[0034] The fusion unit is configured to fuse the multi-source data and make a risk determination;

[0035] The response unit is configured to grade response according to the risk determination.

[0036] In a third aspect, the present application also provides an electronic device, comprising:

[0037] One or more processors;

[0038] A memory configured to store one or more programs;

[0039] When the one or more programs are executed by the one or more processors, the one or more processors implement any of the methods.

[0040] In a fourth aspect, the present application also provides a computer readable medium, wherein the computer readable medium stores a computer program, and the computer program is executed by a processor to implement the steps in any of the methods.

[0041] The real-time monitoring method for life bodies in a vehicle provided by the present application collects data through a sensing layer, intelligently analyzes and evaluates risks through a decision layer, and finally automatically executes corresponding mitigation and rescue measures through an execution layer, which can reliably identify children / pets in a motionless state such as sleep and coma, distinguish and accurately locate multiple life bodies in the vehicle, judge the risk level (such as mild hypoxia vs. critical situation) by fusing physiological and environmental data, realize a full-automatic closed loop of "detection-decision-rescue", and avoid the lag of manual response. BRIEF DESCRIPTION OF DRAWINGS

[0042] Figure 1 This is a schematic diagram illustrating the steps of an embodiment of the real-time monitoring method for living beings inside a car according to the present invention;

[0043] Figure 2 This is a logical schematic diagram of an embodiment of the real-time monitoring method for living beings inside a car according to the present invention;

[0044] Figure 3 This is a schematic diagram of one embodiment of the real-time monitoring system for living organisms inside a car according to the present invention;

[0045] Figure 4 This is a schematic diagram of the structure of an embodiment of the electronic device of the present invention. Detailed Implementation

[0046] To enable those skilled in the art to better understand the technical solutions of the present invention, exemplary embodiments of the present invention are described below in conjunction with the accompanying drawings, including various details of the embodiments of the present invention to aid understanding. These should be considered merely exemplary. Therefore, those skilled in the art should recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present invention. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description.

[0047] Where there is no conflict, the various embodiments of the present invention and the features thereof may be combined with each other.

[0048] As used herein, the term “and / or” includes any and all combinations of one or more related enumerated entries.

[0049] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the invention. As used herein, the singular forms “a” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that when the terms “comprising” and / or “made of” are used in this specification, the presence of the stated feature, integral, step, operation, element, and / or component is specified, but the presence or addition of one or more other features, integrals, steps, operations, elements, components, and / or groups thereof is not excluded. Terms such as “connected” or “linked” are not limited to physical or mechanical connections but can include electrical connections, whether direct or indirect.

[0050] Unless otherwise specified, all terms used herein (including technical and scientific terms) have the same meaning as commonly understood by one of ordinary skill in the art. It will also be understood that terms such as those defined in commonly used dictionaries should be interpreted as having the meaning consistent with their meaning in the context of the relevant art and the invention, and will not be interpreted as having an idealized or overly formal meaning unless expressly so defined herein.

[0051] In the technical solution of this invention, the collection, storage, use, processing, transmission, provision, and disclosure of user personal information all comply with relevant laws and regulations and do not violate public order and good morals. The use of user data in this technical solution follows relevant national laws and regulations (e.g., the "Information Security Technology - Personal Information Security Specification"). For example: appropriate measures are taken for personal information access control; restrictions are imposed on the display of personal information; the purpose of using personal information does not exceed the scope of direct or reasonable association; and explicit identity targeting is eliminated when using personal information to avoid precisely locating a specific individual.

[0052] In related technologies, infrared detectors can only detect moving targets, and cannot trigger alarms when children or pets are asleep; they cannot detect dangerous physiological states such as suffocation or heatstroke (such as abnormal heart rate or respiratory arrest); they rely on door opening and closing logic, and will trigger false alarms if the driver leaves briefly (such as to refuel); they only notify the car owner and do not link the vehicle control system (such as automatic window lowering / air conditioning).

[0053] To address at least one of the technical problems existing in the aforementioned related technologies, the present invention provides a method for real-time monitoring of living beings inside a car. Figure 1 , Figure 2 The present invention provides a flowchart and logic diagram of a method for real-time monitoring of living beings inside a car.

[0054] like Figure 1 As shown, the real-time monitoring method for living beings inside a car includes the following steps:

[0055] Step S10: Collect multi-source data on life status.

[0056] In this embodiment, the step of collecting multi-source data on vital states includes:

[0057] Once a signal indicating that all doors are locked is received, the system enters real-time monitoring mode.

[0058] Specifically, the system is linked with the vehicle's BCM (Body Control Module). When it receives a signal that all doors are locked, the system is activated from standby mode and enters real-time monitoring mode.

[0059] It is understandable that the system will only be activated when the vehicle is locked and personnel may leave the premises, in order to avoid false alarms while the vehicle is in motion.

[0060] Multiple sensors are activated simultaneously and scanned to collect multi-source data on life status.

[0061] Specifically, the following implementation methods are included:

[0062] Millimeter-wave radar: Starts operation, transmits millimeter waves and analyzes the echoes. Algorithms extract vital signs such as chest cavity micro-movements and heartbeat, and monitor respiratory rate and heartbeat (accuracy ±0.5 bpm) to obtain millimeter-wave radar data.

[0063] High-precision weight sensor: The sensor embedded in the seat is activated to detect if there is a load of ≥5kg to obtain weight sensor data. This threshold is used for initial screening to exclude heavy objects such as backpacks, and works with radar to distinguish living beings from static objects.

[0064] Wide-angle infrared camera: Activates and captures images inside the vehicle. Built-in AI models (such as convolutional neural networks) analyze the images in real time, identifying the morphological features of targets and classifying them as "children," "pets," or "objects" to obtain camera data.

[0065] / Temperature and humidity sensor: Continuously monitors environmental parameters inside the vehicle, including carbon dioxide concentration, temperature and humidity, to obtain environmental data.

[0066] It is understandable that by integrating the micro-motion breathing detection (0.1mm displacement sensitivity) of millimeter-wave radar with the continuous load analysis of weight sensors, and eliminating vehicle vibration noise through Kalman filtering, the static target recognition accuracy is >99%.

[0067] This step is understandably the system's data input stage. The four main sensors detect vital signs (radar), physical presence (weight), visual form (camera), and environmental conditions (…). A comprehensive sensing network is constructed from four dimensions (temperature, humidity, etc.) to provide a multi-source, redundant data foundation for decision-making and ensure the reliability of detection.

[0068] Step S20: Integrate multi-source data and determine risks.

[0069] In this embodiment, the step of fusing multi-source data and performing risk assessment includes:

[0070] A weighted confidence model is used to fuse multi-source data and calculate all data to obtain the overall confidence level of the existence of living organisms. If the confidence level exceeds the threshold, it is determined to be "static existence".

[0071] Specifically, millimeter-wave radar data (weight 0.6): as the core evidence of vital signs, it has the highest weight because it can directly detect breathing and heartbeat.

[0072] Weight sensor data (weight 0.2): as supplementary evidence of existence.

[0073] Environmental / camera data (weight 0.2): Environmental data or visual recognition results serve as supplementary evidence.

[0074] The engine comprehensively calculates all the data to arrive at a comprehensive confidence level for the existence of a "living entity". If the confidence level exceeds a threshold, it is determined to be "statically existing".

[0075] Risk is classified and determined based on the overall confidence level.

[0076] Specifically, this includes a three-tiered risk assessment:

[0077] Level 1: Static Presence - Basic Alert Level. The system has confirmed that a living being has been left inside the vehicle.

[0078] Level 2: Physiological Abnormalities - Intermediate Alarm Level. Building upon Level 1, millimeter-wave radar detects abnormal physiological signals in the organism (such as rapid breathing, tachycardia, or bradycardia).

[0079] Level 3: Environmental Deterioration - High Alert Level. Based on Level 1, The temperature and humidity sensor detected that environmental parameters exceeded the safety threshold. A concentration of >5000ppm or a temperature >35°C indicates that the environment is rapidly becoming dangerous.

[0080] Understandably, it transforms the raw data from the sensing layer into meaningful risk levels. Level 1 is a necessary condition to trigger all subsequent actions. Levels 2 and 3 are superimposed conditions; they can occur in parallel, and the highest risk level will be applied. For example, even if the patient is physiologically normal, the system will still handle the situation as the highest risk if the environment deteriorates to Level 3.

[0081] Furthermore, define the risk index. , Temperature (°C) The value is ppm. A Level 3 response is triggered at that time.

[0082] It is understandable that this model achieves coupled risk assessment, and its advantages are:

[0083] Both heat stress (contributed by temperature T) and hypoxia / poisoning risk (contributed by temperature T) were considered. Concentration C contributes). For example, even if the temperature is not extremely high (e.g., T=32℃), but if A rapid increase in concentration due to respiration by pets / children (e.g., C=8000ppm), with a risk index R=32 / 40+8000 / 10000=0.8+0.8=1.6, will immediately trigger the highest level alarm. Conversely, under dry and direct sunlight conditions, it may... Even if the temperature isn't high, a rapid rise in temperature can still quickly trigger an alarm.

[0084] Compared to waiting for a single parameter to reach an absolute threshold (such as T>50℃ or C>10000ppm), this model can issue an alert in the early stages of risk accumulation. For example, when T=36℃ and C=4000ppm, R=36 / 40+4000 / 10000=0.9+0.4=1.3, at which point the system has already been classified as Level 3. In reality, 36℃ and 4000ppm individually may not have reached the individual thresholds of other systems, but the coupling effect already constitutes a high risk.

[0085] Step S30: Implement a tiered response based on risk assessment.

[0086] Specifically, for all risk levels (once Level 1 and above are triggered):

[0087] Audible and visual alarm: Immediately triggers an in-vehicle alarm and hazard lights outside the vehicle to attract the attention of people in the surrounding area. This is the most direct and fastest on-site alarm.

[0088] APP push: The alarm information (including risk level, in-vehicle photos / environmental data) is pushed to the owner's mobile APP via the in-vehicle T-Box.

[0089] For Level 2 and Level 3 risks (automatic life support measures):

[0090] Window lowering by 5cm and air conditioning external circulation: The system automatically lowers the windows by 5cm (using an anti-pinch design for safety) via the vehicle control module and switches the air conditioning to external circulation mode. This is intended to immediately improve the survival environment inside the vehicle, introducing fresh air and lowering the temperature, buying valuable time for rescue.

[0091] Highest priority: For Level 3 risks (environmental degradation) or persistent Level 2 risks:

[0092] e-Call Assistance + Automatic Location Sharing: The system automatically connects the vehicle's emergency call (e-Call) service to a live agent. The agent will receive a pre-set alarm message (such as "A child has been detected in your vehicle and the interior environment is dangerous"), and the system will automatically share the vehicle's GPS location information with the assistance center and pre-set emergency contacts.

[0093] Furthermore, it also includes a tiered call and alarm process on the cloud platform.

[0094] Specifically, the cloud platform prioritizes calling the vehicle owner → if there is no response within 2 minutes, it transfers the call to the emergency contact → if there is still no response within 5 minutes, it automatically connects to 110 (police), simultaneously sending the vehicle's VIN code and coordinates. This includes:

[0095] Step 1: Prioritize calling the car owner

[0096] After determining the risk level, the cloud platform immediately and automatically calls the mobile phone number that the car owner has bound in the APP through the built-in voice call system (VoIP) or the communication module integrated with the operator.

[0097] Step 2: Upgrade call to emergency contact (after 2 minutes of no response). After the initial call to the vehicle owner, the system waits for 2 minutes. If the vehicle owner does not answer the phone within 2 minutes, or does not perform actions such as "confirm processing" on the APP, the system determines it as "no response".

[0098] The cloud platform automatically calls preset emergency contacts (such as family members' mobile phones). When the call is made, a pre-recorded alarm voice will be played, such as: "Warning! A child has been found left in your vehicle [license plate number] and the environment is dangerous. Please handle the situation immediately or contact the vehicle owner."

[0099] Step 3: Automatically connect to public emergency services (after 5 minutes of no response). The timer starts from the first call to the vehicle owner. If the problem is not resolved within 5 minutes (i.e., neither the vehicle owner nor the emergency contact responds effectively), the system determines that external assistance is required.

[0100] Automatic 110 Connection: The system automatically connects to the local 110 emergency call platform via the e-Call system. After connection, an automatically generated distress message will be played, clearly explaining the situation.

[0101] Simultaneous transmission of critical data: Simultaneously with the call establishment, the cloud platform sends a pre-prepared rescue information package to the emergency call center via a data channel. This information package includes at least:

[0102] Vehicle VIN code: A unique identifier for a vehicle, which can be used to query owner information and vehicle model (to help rescue personnel understand the vehicle structure).

[0103] Real-time GPS coordinates: Provides the vehicle's precise geographical location, which is crucial for rescue personnel to quickly reach the scene.

[0104] This may also include: risk level, sensor readings (such as interior temperature, etc.). (concentration), etc.

[0105] Understandably, this is the ultimate safety guarantee. When all individual responses fail, the system automatically and mandatorily brings in professional public rescue forces. The "5-minute" golden window and the design of "automatically sending VIN and coordinates" are intended to minimize the time required for alarm description and location, buying every second for rescue.

[0106] The real-time monitoring method for living beings inside a car provided by this invention collects data through the sensing layer, performs intelligent analysis and risk assessment through the decision-making layer, and finally automatically executes corresponding mitigation and rescue measures through the execution layer. It can reliably identify children / pets in a non-motorized state such as sleeping or coma, distinguish and accurately locate multiple living beings inside the car, and integrate physiological and environmental data to determine the risk level (such as mild hypoxia vs. endangered), realizing a fully automatic closed loop of "detection-decision-rescue" and avoiding the lag of human response.

[0107] Please see Figure 3 The present invention also provides a real-time monitoring system for living beings inside a vehicle. Applied to the real-time monitoring method for living beings inside a vehicle provided in the above embodiments, it specifically includes:

[0108] The acquisition unit is used to collect multi-source data on life status.

[0109] In this embodiment, the step of collecting multi-source data on vital states includes:

[0110] Once a signal indicating that all doors are locked is received, the system enters real-time monitoring mode.

[0111] Specifically, the system is linked with the vehicle's BCM (Body Control Module). When it receives a signal that all doors are locked, the system is activated from standby mode and enters real-time monitoring mode.

[0112] It is understandable that the system will only be activated when the vehicle is locked and personnel may leave the premises, in order to avoid false alarms while the vehicle is in motion.

[0113] Multiple sensors are activated simultaneously and scanned to collect multi-source data on life status.

[0114] Specifically, the following implementation methods are included:

[0115] Millimeter-wave radar: Starts operation, transmits millimeter waves and analyzes the echoes. Algorithms extract vital signs such as chest cavity micro-movements and heartbeat, and monitor respiratory rate and heartbeat (accuracy ±0.5 bpm) to obtain millimeter-wave radar data.

[0116] High-precision weight sensor: The sensor embedded in the seat is activated to detect if there is a load of ≥5kg to obtain weight sensor data. This threshold is used for initial screening to exclude heavy objects such as backpacks, and works with radar to distinguish living beings from static objects.

[0117] Wide-angle infrared camera: Activates and captures images inside the vehicle. Built-in AI models (such as convolutional neural networks) analyze the images in real time, identifying the morphological features of targets and classifying them as "children," "pets," or "objects" to obtain camera data.

[0118] / Temperature and humidity sensor: Continuously monitors environmental parameters inside the vehicle, including carbon dioxide concentration, temperature and humidity, to obtain environmental data.

[0119] It is understandable that by integrating the micro-motion breathing detection (0.1mm displacement sensitivity) of millimeter-wave radar with the continuous load analysis of weight sensors, and eliminating vehicle vibration noise through Kalman filtering, the static target recognition accuracy is >99%.

[0120] This step is understandably the system's data input stage. The four main sensors detect vital signs (radar), physical presence (weight), visual form (camera), and environmental conditions (…). A comprehensive sensing network is constructed from four dimensions (temperature, humidity, etc.) to provide a multi-source, redundant data foundation for decision-making and ensure the reliability of detection.

[0121] The fusion unit is used to fuse data from multiple sources and perform risk assessment.

[0122] In this embodiment, the step of fusing multi-source data and performing risk assessment includes:

[0123] A weighted confidence model is used to fuse multi-source data and calculate all data to obtain the overall confidence level of the existence of living organisms. If the confidence level exceeds the threshold, it is determined to be "static existence".

[0124] Specifically, millimeter-wave radar data (weight 0.6): as the core evidence of vital signs, it has the highest weight because it can directly detect breathing and heartbeat.

[0125] Weight sensor data (weight 0.2): as supplementary evidence of existence.

[0126] Environmental / camera data (weight 0.2): Environmental data or visual recognition results serve as supplementary evidence.

[0127] The engine comprehensively calculates all the data to arrive at a comprehensive confidence level for the existence of a "living entity". If the confidence level exceeds a threshold, it is determined to be "statically existing".

[0128] Risk is classified and determined based on the overall confidence level.

[0129] Specifically, this includes a three-tiered risk assessment:

[0130] Level 1: Static Presence - Basic Alert Level. The system has confirmed that a living being has been left inside the vehicle.

[0131] Level 2: Physiological Abnormalities - Intermediate Alarm Level. Building upon Level 1, millimeter-wave radar detects abnormal physiological signals in the organism (such as rapid breathing, tachycardia, or bradycardia).

[0132] Level 3: Environmental Deterioration - High Alert Level. Based on Level 1, The temperature and humidity sensor detected that environmental parameters exceeded the safety threshold. A concentration of >5000ppm or a temperature >35°C indicates that the environment is rapidly becoming dangerous.

[0133] Understandably, it transforms the raw data from the sensing layer into meaningful risk levels. Level 1 is a necessary condition to trigger all subsequent actions. Levels 2 and 3 are superimposed conditions; they can occur in parallel, and the highest risk level will be applied. For example, even if the patient is physiologically normal, the system will still handle the situation as the highest risk if the environment deteriorates to Level 3.

[0134] Furthermore, define the risk index. , Temperature (°C) The value is ppm. A Level 3 response is triggered at that time.

[0135] It is understandable that this model achieves coupled risk assessment, and its advantages are:

[0136] Both heat stress (contributed by temperature T) and hypoxia / poisoning risk (contributed by temperature T) were considered. Concentration C contributes). For example, even if the temperature is not extremely high (e.g., T=32℃), but if A rapid increase in concentration due to respiration by pets / children (e.g., C=8000ppm), with a risk index R=32 / 40+8000 / 10000=0.8+0.8=1.6, will immediately trigger the highest level alarm. Conversely, under dry and direct sunlight conditions, it may... Even if the temperature isn't high, a rapid rise in temperature can still quickly trigger an alarm.

[0137] Compared to waiting for a single parameter to reach an absolute threshold (such as T>50℃ or C>10000ppm), this model can issue an alert in the early stages of risk accumulation. For example, when T=36℃ and C=4000ppm, R=36 / 40+4000 / 10000=0.9+0.4=1.3, at which point the system has already been classified as Level 3. In reality, 36℃ and 4000ppm individually may not have reached the individual thresholds of other systems, but the coupling effect already constitutes a high risk.

[0138] The response unit is used to classify responses based on risk assessment.

[0139] Specifically, for all risk levels (once Level 1 and above are triggered):

[0140] Audible and visual alarm: Immediately triggers an in-vehicle alarm and hazard lights outside the vehicle to attract the attention of people in the surrounding area. This is the most direct and fastest on-site alarm.

[0141] APP push: The alarm information (including risk level, in-vehicle photos / environmental data) is pushed to the owner's mobile APP via the in-vehicle T-Box.

[0142] For Level 2 and Level 3 risks (automatic life support measures):

[0143] Window lowering by 5cm and air conditioning external circulation: The system automatically lowers the windows by 5cm (using an anti-pinch design for safety) via the vehicle control module and switches the air conditioning to external circulation mode. This is intended to immediately improve the survival environment inside the vehicle, introducing fresh air and lowering the temperature, buying valuable time for rescue.

[0144] Highest priority: For Level 3 risks (environmental degradation) or persistent Level 2 risks:

[0145] e-Call Assistance + Automatic Location Sharing: The system automatically connects the vehicle's emergency call (e-Call) service to a live agent. The agent will receive a pre-set alarm message (such as "A child has been detected in your vehicle and the interior environment is dangerous"), and the system will automatically share the vehicle's GPS location information with the assistance center and pre-set emergency contacts.

[0146] Furthermore, it also includes a tiered call and alarm process on the cloud platform.

[0147] Specifically, the cloud platform prioritizes calling the vehicle owner → if there is no response within 2 minutes, it transfers the call to the emergency contact → if there is still no response within 5 minutes, it automatically connects to 110 (police), simultaneously sending the vehicle's VIN code and coordinates. This includes:

[0148] Step 1: Prioritize calling the car owner

[0149] After determining the risk level, the cloud platform immediately and automatically calls the mobile phone number that the car owner has bound in the APP through the built-in voice call system (VoIP) or the communication module integrated with the operator.

[0150] Step 2: Upgrade call to emergency contact (after 2 minutes of no response). After the initial call to the vehicle owner, the system waits for 2 minutes. If the vehicle owner does not answer the phone within 2 minutes, or does not perform actions such as "confirm processing" on the APP, the system determines it as "no response".

[0151] The cloud platform automatically calls preset emergency contacts (such as family members' mobile phones). When the call is made, a pre-recorded alarm voice will be played, such as: "Warning! A child has been found left in your vehicle [license plate number] and the environment is dangerous. Please handle the situation immediately or contact the vehicle owner."

[0152] Step 3: Automatically connect to public emergency services (after 5 minutes of no response). The timer starts from the first call to the vehicle owner. If the problem is not resolved within 5 minutes (i.e., neither the vehicle owner nor the emergency contact responds effectively), the system determines that external assistance is required.

[0153] Automatic 110 Connection: The system automatically connects to the local 110 emergency call platform via the e-Call system. After connection, an automatically generated distress message will be played, clearly explaining the situation.

[0154] Simultaneous transmission of critical data: Simultaneously with the call establishment, the cloud platform sends a pre-prepared rescue information package to the emergency call center via a data channel. This information package includes at least:

[0155] Vehicle VIN code: A unique identifier for a vehicle, which can be used to query owner information and vehicle model (to help rescue personnel understand the vehicle structure).

[0156] Real-time GPS coordinates: Provides the vehicle's precise geographical location, which is crucial for rescue personnel to quickly reach the scene.

[0157] This may also include: risk level, sensor readings (such as interior temperature, etc.). (concentration), etc.

[0158] Understandably, this is the ultimate safety guarantee. When all individual responses fail, the system automatically and mandatorily brings in professional public rescue forces. The "5-minute" golden window and the design of "automatically sending VIN and coordinates" are intended to minimize the time required for alarm description and location, buying every second for rescue.

[0159] The real-time monitoring system for living beings inside a car provided by this invention collects data through the sensing layer, performs intelligent analysis and risk assessment through the decision-making layer, and finally automatically executes corresponding mitigation and rescue measures through the execution layer. It can reliably identify children / pets in a non-motorized state such as sleeping or coma, distinguish and accurately locate multiple living beings inside the car, and integrate physiological and environmental data to determine the risk level (such as mild hypoxia vs. endangered), realizing a fully automatic closed loop of "detection-decision-rescue" and avoiding the lag of human response.

[0160] Based on the same inventive concept, embodiments of the present invention also provide an electronic device. Figure 4 This is a structural block diagram of an electronic device provided in an embodiment of the present invention. Figure 4 As shown, an embodiment of the present invention provides an electronic device including: one or more processors 101, a memory 102, and one or more I / O interfaces 103. The memory 102 stores one or more programs, which, when executed by the one or more processors, enable the one or more processors to implement any of the real-time monitoring methods for living beings inside a vehicle as described in the above embodiments; the one or more I / O interfaces 103 are connected between the processor and the memory, configured to enable information interaction between the processor and the memory.

[0161] The processor 101 is a device with data processing capabilities, including but not limited to a central processing unit (CPU); the memory 102 is a device with data storage capabilities, including but not limited to random access memory (RAM, more specifically SDRAM, DDR, etc.), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), and flash memory (FLASH); the I / O interface (read / write interface) 103 is connected between the processor 101 and the memory 102, and can realize information interaction between the processor 101 and the memory 102, including but not limited to a data bus (Bus).

[0162] In some embodiments, the processor 101, memory 102, and I / O interface 103 are interconnected via bus 104, and thus connected to other components of the computing device.

[0163] In some embodiments, the one or more processors 101 include a field-programmable gate array.

[0164] This invention also provides a computer-readable medium. The computer-readable medium stores a computer program, which, when executed by a processor, implements the steps of any of the vehicle-in-vehicle real-time monitoring methods described in the above embodiments. The computer-readable storage medium can be volatile or non-volatile.

[0165] This invention also provides a computer program product, including computer-readable code, or a non-volatile computer-readable storage medium carrying computer-readable code. When the computer-readable code is run in the processor of an electronic device, the processor in the electronic device executes the above-described real-time monitoring method for living beings inside a car.

[0166] Those skilled in the art will understand that all or some of the steps, systems, and apparatuses disclosed above, and their functional modules / units, can be implemented as software, firmware, hardware, or suitable combinations thereof. In hardware implementations, the division between functional modules / units mentioned above does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed collaboratively by several physical components. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit (ASIC). Such software can be distributed on a computer-readable storage medium, which may include computer storage media (or non-transitory media) and communication media (or transient media).

[0167] As is known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information, such as computer-readable program instructions, data structures, program modules, or other data. Computer storage media includes, but is not limited to, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), static random access memory (SRAM), flash memory or other memory technologies, portable compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and is accessible to a computer. Furthermore, it is known to those skilled in the art that communication media typically contain computer-readable program instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.

[0168] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0169] The computer program instructions used to perform the operations of this invention may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), is personalized by utilizing state information from the computer-readable program instructions. This electronic circuitry can execute the computer-readable program instructions to implement various aspects of the invention.

[0170] The computer program product described herein can be implemented specifically through hardware, software, or a combination thereof. In one alternative embodiment, the computer program product is specifically embodied in a computer storage medium; in another alternative embodiment, the computer program product is specifically embodied in a software product, such as a software development kit (SDK), etc.

[0171] Various aspects of the present invention are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0172] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0173] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0174] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0175] Example embodiments have been disclosed herein, and while specific terminology has been used, it is for illustrative purposes only and should be construed as such, and is not intended to be limiting. In some instances, it will be apparent to those skilled in the art that features, characteristics, and / or elements described in conjunction with particular embodiments may be used alone, or in combination with features, characteristics, and / or elements described in conjunction with other embodiments, unless otherwise expressly indicated. Therefore, those skilled in the art will understand that various changes in form and detail may be made without departing from the scope of the invention as set forth in the appended claims.

Claims

1. A method for real-time monitoring of living beings inside a car, characterized in that, It includes: Collect multi-source data on life status; Integrate multi-source data and conduct risk assessment; A tiered response will be implemented based on risk assessment.

2. The method for real-time monitoring of living beings inside a vehicle according to claim 1, characterized in that, The steps involved in collecting multi-source data on life states include: Once a signal indicating that all doors are locked is received, the system enters real-time monitoring mode. Multiple sensors are activated simultaneously and scanned to collect multi-source data on life status.

3. The method for real-time monitoring of living beings inside a vehicle according to claim 2, characterized in that, The steps of simultaneously activating and scanning multiple sensors to collect multi-source data on vital states include: Millimeter-wave radar is used to transmit millimeter waves and analyze the echoes. Vital signs signals are extracted through algorithms, and respiratory rate and heart rate are monitored to obtain millimeter-wave radar data. The sensors embedded in the seat are activated to detect whether there is a load of ≥5kg in order to obtain weight sensor data; The wide-angle infrared camera is activated and captures images inside the vehicle. The images are analyzed in real time to identify the shape characteristics of the target and classify it as "children", "pets" or "objects" in order to obtain camera data. Temperature and humidity sensors continuously monitor environmental parameters inside the vehicle compartment, including carbon dioxide concentration, temperature, and humidity, to obtain environmental data.

4. The method for real-time monitoring of living beings inside a vehicle according to claim 3, characterized in that, The steps of integrating multi-source data and determining risks include: A weighted confidence model is used to fuse multi-source data and calculate all data to obtain the comprehensive confidence of the existence of life. If the confidence exceeds the threshold, it is determined to be "static existence". Risk is classified and determined based on the overall confidence level.

5. The method for real-time monitoring of living beings inside a vehicle according to claim 4, characterized in that, Based on the comprehensive confidence level, a three-level risk assessment is performed, including: Level 1: Static existence, confirming that a living being has been left inside the vehicle; Level 2: Physiological abnormalities. Building upon Level 1, millimeter-wave radar detects abnormal physiological signals in living organisms. Level 3: Environmental deterioration, high alert level, based on Level 1. The temperature and humidity sensor detected that the environmental parameters exceeded the safety threshold, indicating that the environment is rapidly becoming dangerous.

6. The method for real-time monitoring of living beings inside a vehicle according to claim 4, characterized in that, Define risk index , The temperature is ℃. The value is ppm. A Level 3 response is triggered at that time.

7. The method for real-time monitoring of living beings inside a vehicle according to claim 6, characterized in that, The steps for tiered response based on risk assessment include: For all risk levels, the following responses are included: audible and visual alarms and APP push notifications, which push alarm information to the owner's mobile APP via the in-vehicle T-Box; For Level 2 and Level 3 risks, the following responses are included: lowering windows and using external air conditioning recirculation; For Level 3 risks or persistent Level 2 risks, the following responses are included: e-Call assistance and automatic location sharing.

8. A real-time monitoring system for living beings inside a car, characterized in that, include: The acquisition unit is used to collect multi-source data on life status. The fusion unit is used to fuse multi-source data and perform risk assessment. The response unit is used to classify responses based on risk assessment.

9. An electronic device, characterized in that, include: One or more processors; Memory, used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the method as described in any one of claims 1 to 7.

10. A computer-readable medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method as described in any one of claims 1 to 7.

Images