Infant detection in vehicle cabin

The method addresses the risk of infants being forgotten in vehicles by using cabin monitoring and data processing systems to detect distress and issue alarms, ensuring timely intervention and energy efficiency.

EP4459587A1Pending Publication Date: 2024-11-06VEONEER SWEDEN SAFETY SYST AB
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
EP2023171260
Authority / Receiving Office
EP · EP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-03
Publication Date
2024-11-06

Smart Images

  • Figure IMGAF001_ABST
    Figure IMGAF001_ABST
Patent Text Reader

Abstract

A cabin of a vehicle (300) is monitored periodically to detect the presence of a distressed infant. If a distressed infant is detected, an alarm signal (31, 32) is issued.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The invention refers to a method for detecting the presence of a distressed infant in a cabin of a vehicle, especially a parked vehicle, and issuing an alarm upon detection.

[0002] It occurs that an infant is forgotten in a parked vehicle. This can involve into a risky situation for the infant, e.g., because of rising temperature in the vehicle. Cases of infant death have been reported, see, e.g., https: / / www.cbsnews.com / amp / news / hot-car-deaths-2019-how-can-a-parent-forget-their-child-in-the-car-a-psychologist-explains / #app.

[0003] It is an object of the invention to provide a method to avoid that infants suffer health impairments or die having been forgotten in a vehicle.

[0004] This object is achieved by the method according to claim 1. The dependent claims relate to advantageous embodiments. Claim 7 relates to a corresponding vehicle.

[0005] The method according to the invention for detecting a distressed infant in a cabin of a parked vehicle includes the following steps: One or more cabin monitoring systems of the vehicle are woken up. This is relevant as in a parked state of the vehicle such cabin monitoring systems are not active. Data are acquired from the one or more cabin monitoring systems. These data represent information on the interior of the cabin of the vehicle. The acquired data are analysed to identify indications of the presence of a distressed infant in the cabin. The analysis of the data is performed by a data processing system on board of the vehicle. If an indication of the presence of a distressed infant in the cabin has been identified, i.e., if a distressed infant has been detected in the cabin, an alarm signal is issued. This sequence of steps is repeated at defined time-intervals, at least if no distressed infant has been detected in the cabin.

[0006] Due to the method, should an infant have been forgotten in the cabin of the vehicle and be in distress, for example because the temperature in the cabin has risen to an uncomfortable or even dangerous level, an alarm signal is issued. This alarm signal is to draw attention to the distressed infant in the cabin, so that measures can be taken to avoid health impairment or death of the infant.

[0007] Once an alarm signal has been triggered, this alarm signal can be maintained until disabled by intervention of a person, e.g., someone coming to the aid of the infant. It is not strictly necessary, therefore, to repeat the steps of the method even after a distressed infant has been detected and an alarm signal issued. However, it is possible to carry on with the method even after issuing an alarm signal. For example, depending on the nature of the alarm signal, further alarm signals may be issued if the method repeatedly detects a distressed infant in the cabin.

[0008] The method is carried out periodically, at fixed time intervals of, e.g., 1 - 5 seconds length, at least, as discussed above, as long as no distressed infant has been detected in the vehicle. In between repetitions of the steps of the method, the systems of the parked vehicle involved, i.e., the one or more cabin monitoring systems and the data processing system for analysing the acquired data, can be inactive or operate at reduced levels of activity. This saves energy and avoids draining the vehicle's power supply needlessly quickly. For the same reason it is preferable that only those sub-systems of the one or more cabin monitoring systems and of the data processing system are woken-up which are required for performing the steps of the method. The data processing system may for example be an ECU of the vehicle or part of such an ECU.

[0009] In an embodiment, the alarm signal is an acoustic signal and / or a signal transmitted via a communication network. Upon detection of a distressed infant in the cabin, any device or system on board of the vehicle that is required for issuing the alarm signal is activated, for example by the data processing system. An acoustic signal may for example be emitted by the car horn or an acoustic alarm system otherwise intended for deterring breaking into the car. A signal transmitted via the communication network may for example be an eCall message, a text message to a mobile phone, or a message to authorities. Such a message may include any information relevant for efficient action, e.g., not only that an infant in a cabin of a car requires attention, but also where this car is located (e.g., position data from a navigation system on board of the vehicle) and information for identifying the vehicle, like type of vehicle, brand of vehicle, number plate data. An acoustic alarm signal, once triggered, may be maintained until disabled, e.g., from inside the vehicle. This implies that someone has opened the vehicle and thus is able to rescue the infant. An alarm signal transmitted over a communication network may be repeated after a certain time. In such a case, in particular, the steps of the method are repeated after detection of a distressed infant, and an alarm signal can be transmitted repeatedly, if the method continues to detect a distressed infant. However, such a signal need not be transmitted at each repetition of the steps of the method, but at longer intervals, e.g., every 5 minutes.

[0010] In an embodiment, upon detection of a distressed infant the temperature within the cabin is monitored. If the temperature is above or below a range pre-defined as acceptable, measures for temperature control may be taken. For example, the data processing system may activate actuators to open one or more windows of the car, if a temperature above the acceptable range has been detected in the cabin. If a temperature below the acceptable range has been detected in the cabin, the data processing system may activate actuators to close windows of the car which have been open and may subsequently activate a heating system for the cabin. Temperature control may also be done via an air conditioning system of the vehicle. The monitoring of the temperature may make use of one or more temperature sensors present in the vehicle already for purposes other that this embodiment of the method. However, one or more dedicated temperature sensors may also be employed.

[0011] In an embodiment the one or more cabin monitoring systems include a microphone. The microphone may be part of a user interface of the vehicle. For purposes of the method, the microphone is to provide data representing acoustic signals captured by the microphone, which acoustic signals might include crying of a distressed infant. The analysis of the data provided by the microphone may include a spectral analysis of the data to identify spectral signatures, like a fundamental frequency, which allow to distinguish between an infant crying in distress and cries from a non-distressed infant. Studies have revealed the existence of such distinguishing spectral signatures, e.g.: https: / / ieeexplore.ieee.org / abstract / document / 7828634 / metrics#metrics, https: / / ieeexplore.ieee.org / document / 7806117, http: / / article.sapub.org / pdf / 10.5923.j.ajbe.20130306.07.pdf.

[0012] The spectral analysis may involve a Fast-Fourier-Transform (FFT) of the data representing the acoustic signals captured by the microphone.

[0013] In an embodiment, the one or more cabin monitoring systems include a camera. For purposes of the method the camera is to capture image data of the interior of the cabin. The image data then are analysed by the data processing system to detect the presence of a distressed infant in the cabin of the vehicle. This analysis may involve identifying a facial area of the infant and analysing facial features, like the area around the mouth and the eyes to identify potential distress of the infant.

[0014] The analysis of the data acquired from the one or more cabin monitoring systems, be they acoustical data or image data, may also employ a trained machine learning algorithm.

[0015] In an embodiment, the wake-up of the one or more cabin monitoring systems is triggered at the defined time-intervals by a logic clock. This logic clock preferentially is a low-power system to avoid quick depletion of the vehicle's energy supply.

[0016] A vehicle according to the invention is configured to perform the method according to the invention. The vehicle includes a data processing system, one or more cabin monitoring systems, and an alarm system. The data processing system, the one or more cabin monitoring systems, and the alarm system are configured to perform the method according to the invention. This implies that the data processing system is suitably connected to the one or more cabin monitoring systems and the alarm system to transmit signals and receive required data. The data processing system is provided with program instructions to carry out the steps of the method. The alarm system is designed to issue an alarm signal upon activation. The cabin monitoring system is configured to capture acoustic signals and / or image data from the interior of the cabin of the vehicle and provide corresponding data to the data processing system.

[0017] Below, the invention and its advantages will be described further with reference to the accompanying figures. Figure 1is a flow chart of an embodiment of the method according to the invention. Figure 2is a representation of an embodiment of the method according to the invention. Figure 3shows a time sequence of steps of the method. Figure 4shows a vehicle according to the invention.

[0018] The figures are only examples of how the invention can be implemented and are not to be taken as a limitation of the invention to the examples shown.

[0019] Fig. 1 is a flow chart of an embodiment of the method 100 according to the invention. In step 110 one or more cabin monitoring systems of the vehicle are woken up. This can happen, for example, due to wake-up signals issued by any suitable time-keeping device on board of the vehicle.

[0020] In step 120, data from the one or more cabin monitoring systems are acquired. These data may include data representing acoustic signals, captured for example by a microphone, as well as image data, provided for example by a camera.

[0021] In step 130 the acquired data are analysed for indications of the presence of a distressed infant in the cabin of the vehicle. This analysis can be based, for example, on a spectral analysis of data representing acoustic signals, or on image analysis based on acquired image data. Methods based on machine learning may also be employed.

[0022] If at decision block 140 it has been established that no distressed infant is present in the cabin, the sequence of the steps so far, represented by blocks 110, 120, 130, 140 is repeated after a defined time interval.

[0023] If at decision block 140 it has been established that a distressed infant is present in the cabin, an alarm signal is issued in block 150. The alarm signal may include an acoustic signal to alert nearby persons. The alarm signal may include a signal transmitted via a communication network, to alert, for example, authorities or the owner of the vehicle.

[0024] Once triggered, an alarm signal may be maintained until interrupted from within the vehicle. This may in particular apply to an acoustic alarm signal. On the other hand, it may suffice to transmit an alarm signal via a communication network only once or at longer time intervals. Alternatively, once the alarm signal has been triggered, the method may continue to repeat the steps represented by blocks 110, 120, 130, and 140, and maintain the alarm signal (at least an acoustic alarm signal) as long as in block 140 the presence of a distressed infant has been established.

[0025] Fig. 2 represents an embodiment of the method according to the invention. A data processing system 10 of the vehicle (not shown) includes a logic clock 11, of low power consumption and operational even in a parked state of the vehicle. The logic clock 11 sends a wake-up signal 15 to a part 12 of the data processing system 10 which part is relevant for the method according to the invention, at pre-defined time-intervals. This part 12 of the data processing system 10 may include one or more sub-systems of the data-processing system 10. After wake-up due to the wake-up signal 15, part 12 of the data processing system 10 issues a wake-up signal 16 to a cabin monitoring system 20, which here includes a microphone 25 and a camera 26. As an alternative, logic clock 11 could also send a wake-up signal directly to the cabin monitoring system 20. Subsequently, part 12 of the data processing system 10 communicates with cabin monitoring system 20 to acquire data 22 from the cabin monitoring system 20; the data 22 represent acoustic signals captured by the microphone 25 and image data provided by the camera 26. The data 22 are analysed in part 12 to identify indications of the presence of a distressed infant in the cabin. If a distressed infant is detected in the cabin, part 12 issues an activation signal 17 to alarm system 30. As a result, the alarm system 30 issues an acoustic alarm signal 31 and / or an alarm signal 32 transmitted via a communication network.

[0026] If a distressed infant is detected in the cabin, part 12 of the data processing system 10 may also communicate with further systems of the vehicle, like here with a temperature monitoring system 40 to determine if a temperature in the cabin is within or outside of a pre-defined acceptable range. The temperature monitoring system 40 includes at least a temperature sensor but may also be a complete air conditioning system. Should the temperature in the cabin be found to be outside the acceptable range, part 12 of the data processing system 10 may take further steps to control the temperature in the cabin, for example by using an air conditioning system, if present, or by activating a heating system 42 or one or more actuators 44 to raise or lower one or more windows of the cabin.

[0027] Fig. 3 shows a time sequence of steps of the method according to the invention; the steps are shown along time axis 200. A time sequence 210 is shown to start at an instant 201, and is shown to start again at an instant 203, a pre-defined time interval 202 after instant 201. The sequence of steps 210 includes a wake-up step 211, a data acquisition step 212, a data analysis step 213, and a conditional alarm triggering step 214. In step 211 the wake-up of the involved systems is performed, with reference to Fig. 2 for example of the part 12 of the data processing system 10 and of the cabin monitoring system 20. In step 212, data are acquired from the cabin monitoring system. These data are analysed in step 213 and if this analysis indicates the presence of a distressed infant in the cabin, an alarm signal is issued in step 214. Between time sequences 210 the involved systems, with reference to Fig. 2, the involved part 12 of the data processing system 10 and the cabin monitoring system 20, are inactive, so that a further wake-up step 211 is required at the beginning of the next time sequence 210. Between the time sequences 210, the energy consumption due to the method is extremely low, the only requirements between the time sequences 210 are the operation of a time-keeping device like the logic clock 11 in Fig. 2, which typically operates anyway, and the marking of the passage of the pre-defined time interval 202.

[0028] Fig. 4 shows a vehicle 300 according to the invention. The vehicle 300 includes a data processing system 10, a cabin monitoring system 20, and an alarm system 30. The vehicle 300 is configured for performing the method according to the invention. This includes that the data processing system 10 is connected to the cabin monitoring system 20 for communicating with cabin monitoring system 20. The data processing system 10 is programmed to acquire data from the cabin monitoring system 20, analyse these data to identify indications of the presence of a distressed infant in a cabin of the vehicle 300, and activate the alarm system 30 if indications of the presence of a distressed infant are identified. The programming of the data processing system 10 includes the repetition of these steps after pre-defined time-intervals, as has been discussed above.List of Reference Signs

[0029] 10data processing system 11logic clock 12part (of data processing system) 15wake-up signal 16wake-up signal 17activation signal 20cabin monitoring system 22data 25microphone 26camera 30alarm system 31acoustic alarm signal 32alarm signal transmitted over communication network 40temperature monitoring system 42heating system 44actuators (for cabin windows) 100method 110-150method steps 200time axis 211wake-up step 212data acquisition step 213data analysis step 214alarm step 300vehicle

Claims

1. Method for detecting a distressed infant in a cabin of a parked vehicle (300), the method including the following steps: a) wake up one or more cabin monitoring systems (20) of the vehicle (300); b) acquire data (22) from the one or more cabin monitoring systems (20); c) analyse the acquired data (22) to identify indications of the presence of a distressed infant in the cabin of the vehicle (300); d) if an indication of the presence of a distressed infant in the cabin has been identified, issue an alarm signal (31, 32); e) repeat the sequence of steps a) to d) at defined time-intervals (202), at least if no indication of the presence of a distressed infant in the cabin has been identified.

2. Method according to claim 1, wherein the alarm signal is an acoustic signal (31) and / or a signal (32) transmitted via a communication network.

3. Method according to one of the previous claims, wherein upon detection of a distressed infant the temperature within the cabin is monitored.

4. Method according to one of the previous claims, wherein the one or more cabin monitoring systems (20) include a microphone (25).

5. Method according to one of the previous claims, wherein the one or more cabin monitoring systems (20) include a camera (26).

6. Method according to one of the previous claims, wherein the wake-up of the one or more cabin monitoring systems (20) of the vehicle (300) is triggered at the defined time-intervals (202) by a logic clock (11).

7. Vehicle (300) including a data processing system (10); a cabin monitoring system (20); and an alarm system (30); characterised in that the data processing system (10), the cabin monitoring system (20), and the alarm system (30) are configured to perform the method according to claim 1.

Citation Information

Patent Citations

  • Safety pre-warning system and method for people detained in vehicle

    CN113442864A

  • Sequenced Sensor Power Management for Extended Battery Life of Trapped Occupant Detectors

    US20210247828A1

  • Method and device for protecting child inside vehicle, computer device, computer-readable storage medium, and vehicle

    US20220222949A1