Method and system for avoiding vehicle-related heatstroke or hypothermia

Abstract

1. A method for monitoring an interior space of a vehicle, the method comprising: - a method comprising the method steps of automatically recognizing the presence of a living organism in the interior space of the vehicle by at least one infrared sensor; automatically measuring the body temperature of the living organism in the interior space by the infrared sensor a plurality of times within one time interval; automatically recognizing a danger based on the measured body temperature values; and automatically initiating measures when a danger is recognized, wherein the recognition of the presence, the measurement of the body temperature, the recognition of the danger and the initiation of measures are performed by a data processing device of the vehicle, which receives and processes infrared sensor signals or infrared sensor data from the infrared sensor.

Description

[Technical Field]

[0001] The present invention relates to a method for monitoring an interior space within a vehicle and a system for carrying out such a method. [Background technology]

[0002] Statistics demonstrate that the risk of death due to excessive heating of living bodies inside vehicles is significant. For example, in the United States, approximately 855 people died from the effects of excessive heating inside vehicles between 1998 and 2020. Children are particularly vulnerable. For example, when children are intentionally left or simply forgotten in a vehicle, or when they climb inside themselves, their body temperature rises excessively much more quickly than that of adults (see, for example, Pediatric Vehicular Heatstroke Report, Kids in Hot Cars, National Safety Council | 1121 Spring Lake Drive | Itasca, IL 60143-3201 | (800) 723-3643 | nsc.org).

[0003] To avoid such deaths, some special measures have already been taken in the past, namely: German Utility Model No. 202015000305 discloses a retrofittable electronic safety system for a child car seat, using a combination of a transmitter mounted on the child car seat and a Handy-App. DE 10 2012 206 535 A1 discloses a child occupancy detection and warning system mounted in a vehicle, in which a motion sensor is monitored and, when activated, indicates the presence of a child in a child seat placed in the vehicle. DE 10 2014 216 569 A1 discloses a method for warning a driver leaving a stationary vehicle when a person or animal is present inside the vehicle. German Utility Model No. 202013103689 discloses a system for preventing children from being left unattended in a car, in which a security module is connected to a mobile phone, and an alarm is issued when the mobile phone is moved too far away from the security module. German utility model no. 202019005079 discloses a security system for preventing children from being left unattended in a car, using a presence sensor configured as a seat pad and used as an alarm activation switch. DE 10 2018 000 689 A1 discloses an alarm method in which an occupied rear seat of a vehicle is recognized and alarm information is output to a mobile terminal if further conditions are met.

[0004] All of these measures have in common that they either use very limited detection of a potentially dangerous situation or use indirect signs to determine a potentially dangerous situation as a basis for issuing a warning.

[0005] Therefore, when applying this known measure, it is possible that a living body is present in the vehicle but no alarm is issued. However, this is not recognized by the applied measure. Therefore, this known measure still cannot eliminate life-threatening situations, which in the worst case scenario could even lead to death due to excessive body temperature. However, application of this known measure can also generate false alarms. As a result, this known measure still hinders the activation of public life-saving devices, because a relatively high frequency of false alarms impedes emergency personnel on the one hand and increases costs on the other. Furthermore, this measure can be intentionally ignored or accidentally ignored. As a result, the alarm system remains inoperative and the life-threatening situation cannot be detected at all. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] German Utility Model Registration No. 202015000305 [Patent Document 2] German Patent Application Publication No. 102012206535 [Patent Document 3] German Patent Application Publication No. 102014216569 [Patent Document 4] German Utility Model Registration No. 202013103689 [Patent Document 5] German Utility Model Registration No. 202019005079 [Patent Document 6] German Patent Application Publication No. 102018000689 Summary of the Invention [Problem to be solved by the invention]

[0007] It is therefore an object of the present invention to provide an improved method and system such that the above-mentioned problems are avoided. [Means for solving the problem]

[0008] This problem is solved by the method according to claim 1.

[0009] The subject of the present invention is therefore a method for monitoring the interior space of a vehicle, comprising the following method steps: automatically recognizing the presence of a living organism in the interior space of the vehicle by means of at least one infrared sensor, automatically measuring the body temperature of the living organism present in the interior space by means of the infrared sensor a number of times within a time interval, automatically recognizing a danger based on the measured body temperature values, and automatically initiating measures when a danger is recognized, wherein the presence recognition, the temperature measurement, the danger recognition and the initiation of measures are performed by a data processing device of the vehicle, which receives and processes infrared sensor signals or infrared sensor data from the infrared sensor.

[0010] Furthermore, this problem is solved by a system according to claim 15. The subject of the invention is therefore a system for monitoring the interior space of a vehicle, which is configured to carry out the method according to the invention.

[0011] The inventive measures have the advantage that, unlike known measures which often use limited detection of a potentially dangerous situation (for example, by a heart rate sensor fixed to the seat belt) and on the other hand often use indirect signs to determine a potentially dangerous situation (by monitoring the seat pad or the occupancy of the seat), the inventive method or system uses an accurate yet direct main parameter, namely the body temperature of the living body, which is fully adapted to the inventive method or system.

[0012] That is, the body temperature of the living body is first used as a primary parameter for directly identifying that the living body is in the interior space of the vehicle. Then, the primary parameter of the body temperature is used to recognize or detect danger. butThis is done by observing the body temperature of the living being identified as being in the vehicle over a time interval.

[0013] Therefore, the awareness or risk of the danger teeth This can be done by the direct primary parameter of body temperature, which may also be used to recognize that a living being is present in the interior space of the vehicle, i.e., the primary parameter is used in a double way.

[0014] This means that misinterpretation of indirect parameters, such as seat occupancy or respiratory cycle, which are used in known measures to recognize presence on the one hand and to evaluate other vital parameters, i.e., to indirectly evaluate the body temperature of a living body in the interior space of the vehicle, can be completely eliminated. Therefore, unnoticed excessive heating and cooling of the body of a living body in the interior space of the vehicle can be completely eliminated.

[0015] Further particularly preferred embodiments and further configurations of the invention are set out in the dependent claims and the following description, where it can be said with respect to different categories of claims that the advantages and effects set out in relation to one category of claim also exist for the measures set out in another category of claim as appropriate in the respective category of claim.

[0016] However, the risk recognition or risk based on the primary parameter can be supplemented or improved using other secondary parameters. The secondary parameters include the time course of the body temperature of the living body inside the vehicle, i.e., a parameter that directly affects the primary parameter. Therefore, the secondary parameters can include, for example, the outside air temperature outside the vehicle, the internal temperature inside the vehicle, or meteorological data related to the weather conditions at the vehicle's location. All these secondary parameters affect the temperature course of the interior space of the vehicle and therefore directly affect the time course of the body temperature. The content of the secondary parameters will be explained in more detail below at the appropriate points in the general description.

[0017] However, it should be noted that the secondary parameters may be used in any combination of multiple primary parameters with multiple secondary parameters, or by combining a group of different secondary parameters with one primary parameter.

[0018] For the purposes of this patent application, the term vehicle may be interpreted broadly and may therefore be interpreted as, for example, an aircraft such as an airplane or a helicopter, a rail vehicle, a road vehicle, a watercraft, a gondola, etc. Thus, for example, road vehicles may include private motor vehicles (PKW) generally configured as limousines, station wagons, vans or SUVs, etc., or lorries (LKW) with or without trailers.

[0019] Generally and comprehensively, such vehicles have interior spaces that can be divided into various interior space regions, sections, or portions into which living beings regularly or potentially unpredictably enter. Thus, for example, in a limousine-type automobile, four or five people regularly occupy the space in the passenger compartment on the seats provided for them. However, it cannot be ruled out that pets (e.g., dogs, cats, or small animals such as hamsters) are intentionally and often regularly brought into the trunk space region. It is also possible that children, while playing in a parked automobile, may crawl through the center seat opening in the rear seat to enter the trunk or climb over the seats to enter the trunk unpredictably. Because the automobile doors are child-safe locked to prevent opening from the interior space, it is virtually impossible for them to exit the vehicle on their own.

[0020] On the other hand, the measures of the present invention make it easy to track all living organisms in the interior space of a vehicle, which can be divided into various interior space regions, sections, or portions as described above, and to monitor their body temperatures almost automatically and continuously. Therefore, the infrared sensors described above, which are available on the market in various forms, are primarily used. Preferably, at least one infrared sensor is used for each interior space region of the vehicle. The infrared sensor can completely detect each interior space region due to its detection range. If this is not guaranteed, multiple infrared sensors (e.g., with different detection ranges each optimized for the interior space region to be detected) may be used within the interior space of the vehicle. This may be advantageous, for example, when each seat region of multiple seats in the passenger compartment can be easily detected by one infrared sensor, but the foot area corresponding to each seat region is difficult to detect or cannot be detected at all. The same applies, for example, to the trunk (collectively referred to as storage space) of a typical automobile that is not directly used for transporting people, and possibly also to the engine compartment. Therefore, in a bus or a lorry or another vehicle in general, other interior space areas may be considered that are equipped with the above-mentioned infrared sensors not finally mentioned here.

[0021] In this regard, it has proven useful for the infrared sensor to transmit infrared sensor signals or data that enable differentiating between multiple temperature zones. Therefore, the infrared sensor can provide a pixel resolution for its detection range. For example, the detection range of the infrared sensor can be configured (i.e., formed or designed) to describe a cone shape with an opening angle ranging from, for example, 60° to, for example, 180°, preferably ranging from, for example, 90° to 120°. Also, other detection ranges may be defined to adapt to the conditions of various interior space regions. Thus, for example, when appropriately positioned relative to the interior wall of the interior space, an entire seat row in a passenger compartment can be detected, or the interior wall beneath the corresponding interior space of another interior space region of a vehicle can also be detected. Multiple objects with different surface parameters can be identified or distinguished from one another by the pixel resolution. Thus, for example, the temperature of a window in a passenger compartment when directly exposed to sunlight can be much higher than that of other interior wall regions of the passenger compartment or of an assembly arranged in the passenger compartment. In contrast, when the outside temperature is low, the temperature of the window is significantly lower than, for example, a heated seat surface. Furthermore, the illustrated objects always remain in constant positions relative to the infrared sensor, at least when the windows and doors are closed. This allows for unambiguous recognition of these objects. Therefore, living organisms can also be clearly recognized because they produce unique thermal signatures that appear differently from the other objects within the detection range of the illustrated infrared sensor. Generally, living organisms have thermal signatures that exhibit average temperature profiles or values ​​that are higher or lower than the temperature of the surrounding interior walls of the cabin interior space, and the living organism masks other objects within the cabin (e.g., seat surfaces) and the exterior boundaries of the cabin, i.e., the interior space (e.g., windows, floor, roof, etc.) with their bodies. As a result, the living organism is easily identifiable. Generally, the living organism appears as a moving region with uniform and often well-differentiated thermal signatures against the background.Therefore, the infrared sensor transmits a unique infrared sensor signal or infrared sensor data to the living body within its detection range, which is different from that of a detectable object adjacent to the living body in the internal space or the boundary of the internal space (the object and boundary are detected at a substantially constant position, the configuration of the object and boundary does not change, and the object and boundary are merely masked by the living body or covered by the shadow of the living body as seen by the infrared sensor). Except for the thermal characteristics fluctuating within a specific range of temperature, the thermal characteristics of the living body generally fluctuate at least partially or at a specific location unless the living body is asleep or unconscious. The infrared sensor can be configured, for example, as a group of individual sensors and can transmit an analog infrared sensor signal. However, preferably, the infrared sensor is configured as a semiconductor integrated sensor having an array of multiple sensor elements and has a single signal processing unit that enables it to output digital infrared sensor data.

[0022] The infrared sensor signal or data output from the infrared sensor is processed by a data processing device in the vehicle. This processing can be performed by a microcomputer equipped with corresponding other analog or digital electronic components and running software. Preferably, a microcontroller or an application-specific integrated circuit (ASIC) is used. Also, instead of a separate data processing device, the functions described below may be provided by the vehicle's on-board computer. As a result, the data processing device described herein can be realized by this on-board computer.

[0023] Preferably, the data processing device is configured with corresponding software programming or hardware implementation to recognize the presence of a living organism in the interior space of the vehicle by detecting at least one unique temperature zone pattern and / or in particular a unique change in the unique temperature zone pattern, and to distinguish between animals and humans based on the temperature zone pattern and / or a change in the temperature zone pattern. To this end, the data processing device analyzes the infrared sensor signal or infrared sensor data, detects various temperature zone patterns, and compares the detected temperature zone pattern with stored patterns or movement patterns to recognize a pattern that matches a living organism or a movement unique to this living organism. In particular, humans and animals can be distinguished by different shapes of the patterns and by different movement progressions or changes in the patterns.

[0024] When the data processing device confirms the presence of a living organism, the data processing device calculates the body temperature of the living organism from the infrared sensor data for the infrared sensor signal or infrared sensor data that recognizes the living organism. To calculate the body temperature from the infrared sensor data, the data processing device automatically infers the living organism from the pattern of the living organism. For this purpose, the relationship between the value of the infrared signal or the infrared sensor data and the temperature is pre-stored in the data processing device in a unit of interest, such as Kelvin, Fahrenheit, or Celsius. By averaging the temperature values ​​below the limit of the pattern indicating a living organism, the (surface) temperature can be directly calculated as at least one indication of the body temperature of the living organism.

[0025] Subsequently, a risk is detected by the data processing device based on the calculated values ​​of the body temperature by at least one of the calculated values ​​of the body temperature exceeding a threshold value or by a trend of the calculated values ​​of the body temperature exhibiting a risk characteristic. identificationThis threshold value may be a predetermined maximum temperature value, such as 39°C, or another medically prescribed value. The same applies analogously to a predetermined minimum temperature value. The danger characteristic of the trend, i.e., the change or rate of change of the body temperature, may be, for example, the rate of change of the body temperature toward a higher or lower value, in particular the rate of approaching a limit value or threshold per unit time, or the shape of the curve of the temperature, its first derivative, i.e., its slope, or its predicted progression into the future. Such a curve shape may be generated directly from multiple measurements of the temperature or temperatures. However, it may be advantageous to first fit these measurements using various mathematical methods known in principle. That is, the mathematical method may be a smooth curve. The derivative of this smooth curve then estimates the temperature gradient over a certain period of time, eliminating statistical misinterpretations. In this case, graded thresholds or graded characteristics may also be used to define different danger levels and initiate graded actions accordingly. Also, the thresholds or the risk characteristics may be adapted during operation, for example by updating software.

[0026] Particularly preferably, the infrared sensor is realized as an infrared camera, which is used to transmit a series of still or moving thermal images of the interior space, in which case the still or moving thermal images (i.e. a video sequence or a continuous video) are displayed by the infrared sensor signal or the infrared sensor data. In particular, this type of thermographic display allows a more detailed analysis by a data processing device with regard to the further use of the images of the interior space of the vehicle thus obtained. Thus, in these images, the living body itself can be seen. identification Not only can the body temperature itself be calculated, but by analyzing the image sequence it can also be inferred whether the living being is, for example, panicked or inactive, or in some cases even already completely unconscious.

[0027] As mentioned above, the detection range of the at least one infrared sensor advantageously includes the seating area and the foot area of ​​the interior space of the passenger compartment of the vehicle allocated for passenger transport. Therefore, even smaller animals or children that are not on the seating surface but are—for whatever reason—located in the foot area of ​​the respective seat or seat row can be detected. This allows for the overall height and volume of the passenger compartment to be detected, and therefore also the overall height and volume of the storage space of the passenger compartment of the vehicle.

[0028] As mentioned above, the interior space of a vehicle may also include other areas or zones as passenger compartments. Therefore, it is advantageous for the detection range of the at least one infrared sensor to include the interior space of the vehicle allocated for animal, luggage, and / or cargo transport. This interior space may also be the cargo space of a trailer. In this case, to access the infrared sensor signal or data of the corresponding infrared sensor, the infrared sensor must be connected, either wired or wirelessly, to a data processing device present in the vehicle itself. To detect this interior space, the infrared sensor may also be installed in the trunk of the vehicle. It may be advantageous to install one infrared sensor each on the left and right sides of the trunk, particularly in order to minimize the risk of possible obstruction by cargo. The trunk lid or the lid area of ​​the trunk door is also suitable for installing sensors.

[0029] With regard to the passenger compartment as the interior space of a vehicle, it has proven useful to have at least one infrared sensor or multiple infrared sensors located in the A-pillars and / or B-pillars and / or C-pillars and / or D-pillars and in the trunk lid of the vehicle, and to detect the interior space of the vehicle with their detection ranges, so that detection blockages that make detection impossible in the interior space can be reliably avoided almost completely, at least within the required limits, by appropriate positioning, adaptation and limitation of the respective detection ranges.

[0030] As mentioned above, multiple infrared cameras may be provided, multiple infrared sensors may be overlapping in groups with respect to their detection ranges, and multiple infrared sensors may be used to compare individual infrared sensor signals or data with each other to avoid misinterpretations or false alarms.

[0031] Since the outside air temperature and in many cases the difference between the outside air temperature and the temperature inside the vehicle also play an important role when identifying danger, i.e. the temperature rise and fall conditions in the interior space depend on both of these parameters, it has proven to be further useful to automatically detect the outside air temperature outside the vehicle by an outside air temperature sensor and automatically detect the internal temperature inside the interior space of the vehicle by an internal temperature sensor, the data processing device receiving an external temperature sensor signal or data from the external temperature sensor and an internal temperature sensor signal or data from the internal temperature sensor, predicting the temperature trend inside the interior space of the vehicle from the signals or data, and incorporating this prediction of the internal temperature trend into the recognition of the danger.

[0032] The data processing device may also use the vehicle's mobile communication device to obtain weather data from a weather service center regarding current and / or future weather conditions (at the vehicle's current location or at the vehicle's future current location taking into account the change in its current location while in motion), predict temperature changes within the interior space of the vehicle from the weather data, and incorporate this prediction of the internal temperature change into the risk recognition.

[0033] The predicted temperature profile in the interior space of a vehicle depends on several environmental parameters, as described above. However, the actual temperature profile in the interior space also depends on the structure and characteristics of the vehicle. Therefore, even if sunlight is intense, for example, passenger compartment insulation, insulating glass, or interior blinds can prevent a very rapid temperature rise in the interior space. Therefore, it may be useful to perform the prediction of the interior temperature profile based on a general digital model of the temperature profile for the interior space of the vehicle or a device-specific or custom digital model of the temperature profile of the interior space of the vehicle, and to digitally store and use the respective model in the data processing device to predict the time profile of the interior temperature. As a result, it is possible to accurately predict when the interior temperature profile will become a hazard that requires recognition. These models can be created by computer simulation or by measurements on an actual vehicle.

[0034] When a danger to a living organism is identified or predicted by the data processing device, measures are implemented by the data processing device to avoid the danger to the living organism or the consequences of the danger, whereby the initiation of the measures by the data processing device is of at least one of the following groups: - wirelessly transmitting a predetermined message to a receiving device, in particular a mobile device, particularly preferably a smartphone, assigned to the user or owner of the vehicle, in which case a mobile radio communication module (such as a GSM, UMTS, LTE, LTE+ or 5G module) connected to the vehicle's data processing device may be used (GSM stands for "Global System for Mobile Communications", UMTS stands for "Universal Mobile Telecommunications System", LTE stands for "Long Term Evolution"), which transmits the message to the recipient. - opening the interior space of the vehicle, in particular by at least partially automatically opening or opening a vehicle window or by automatically opening or unlocking a vehicle door or a trunk lid or trunk door, for which corresponding electronic control signals are sent to the respective electric actuators which carry out said operation, and when the vehicle door or trunk lid is unlocked, this is followed by an optical or acoustic signal informing the occupant that the unlocking has been carried out. - Closing or keeping windows or doors closed, which can be beneficial in case of danger of excessive hypothermia caused by the cold. - activating a ventilation system for ventilating the interior space of the vehicle, by means of an activation signal to a control or regulator of the ventilation system (e.g., a blower or air conditioner) that controls the air flowing into the interior space, the air conditioner being capable of cooling or heating depending on the perceived risk; - activating the vehicle's heating system to heat or maintain the heat of the interior space of the vehicle, e.g., a block heater may be activated in this situation to avoid excessive hypothermia of the living bodies in the vehicle, especially on cold days. - activating an acoustic warning of the vehicle: for this purpose, a signal horn can be activated automatically by a suitable control signal, or the warning device of the vehicle can also be activated, for example generating an acoustic signal to call special attention. - detecting location data by the vehicle's positioning system and transmitting said location data wirelessly to a receiving device, for which purpose geographic coordinates (GPS coordinates) are requested by the vehicle's GPS system (GPS stands for "Global Positioning System") and transmitted to the recipient, for example via the vehicle's mobile radio communication module. - Establishing a wireless communication connection with an emergency call center. For this purpose, the mobile wireless communication module of the vehicle is likewise used, for example, to establish a voice or IP telephone connection between the interior space of the vehicle and an emergency call center, for example, to inquire about the status of the person in the interior space or to talk to the person in the interior space and relieve tension. -Wirelessly transmitting situation-specific information or data to a data server, in particular to a data server of an emergency call center.

[0035] The situation-specific information or data may include information from the following groups: - the number of living organisms recognized within the interior space of the vehicle; and - the location of the recognized living body within the interior space of the vehicle; - the duration of time spent inside the interior space of the vehicle; the temperature of the interior space of the vehicle; and the outside air temperature of the vehicle; and the body temperature of the recognized organism; and -Automatic determination of the need to notify an emergency physician; - location data of the vehicle; - information data for identifying the vehicle, such as markings, model, registration markings, date of first registration, etc.; real-time data indicative of infrared sensor signals or data of the at least one infrared sensor; There can be at least one element of

[0036] All this situation-specific information or data allows the emergency call center to adapt its response to the situation, in particular to dispatch the appropriate emergency personnel to the scene (firefighters alone, firefighters and rescue personnel, firefighters and rescue personnel and emergency doctors, etc.), and to provide the dispatched emergency personnel with relevant information in advance. In a fully extended version, a live infrared camera feed can be established directly from the vehicle to the emergency vehicle heading for the rescue or to the mobile terminal devices (laptops, tablet computers, smartphones, etc.) of the emergency personnel and / or the emergency call center. Thus, the emergency personnel already have a complete picture of the current situation of the living body in the interior space of the vehicle before their arrival at the scene, and can immediately and appropriately assist the person upon arrival at the scene. Similarly, the actual first aid or emergency treatment required at the scene can be determined and planned in advance and can be carried out immediately upon arrival at the scene and after the rescue or rescue of the living body. Emergency personnel can also easily determine how many people were in the vehicle at the time of the accident and whether or not any of the people involved in the accident are missing after the accident, for example, because they may have fled in a state of adrenaline shock or become disoriented and wander around.

[0037] Furthermore, in the case of cloud-based, fully automated action by a rescue service provider, the owner of a vehicle having a system for monitoring the interior space as described above can register the vehicle with the rescue service provider and thereafter receive fully automated action and instructions from emergency personnel based on situation-specific information or data.

[0038] Automated learning may be used in the system to determine or compare unique temperature patterns, possibly over time, and possibly to determine or compare risk characteristics for trends in body temperature and other variables. To this end, corresponding data or information may be collected during ongoing operation and used for further ongoing automated learning. That is, the system may be continually improved. Alternatively, predetermined characteristics or criteria may be programmed to recognize patterns, trends, etc.

[0039] A combination of these measures is also possible. Thus, for example, the method may be configured so that certain patterns or trends are pre-defined and cannot be changed, so that known dangerous situations can be recognized in every situation, while judgment can be assisted by automatic learning to better assess other situations.

[0040] These and other aspects of the invention are illustrated in the figures described below.

[0041] The present invention will be described in detail below again based on embodiments with reference to the accompanying drawings, in which the same components are designated by the same reference numerals in different drawings, but the present invention is not limited to these embodiments. [Brief explanation of the drawings]

[0042] [Figure 1] 1 is a block diagram of a vehicle having a system of the present invention for monitoring an interior space; [Figure 2] 1 is a flow chart of the method of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0043] In Figure 1, a vehicle 1 is shown as a rectangle, reduced to the components necessary for discussing the present invention. The interior space 2 of the vehicle 1 is divided into three interior space regions: a front seat row 3, a rear seat row 4, and a trunk 5. While a car is described here with respect to the vehicle 1, the interior space regions 3-5 of other vehicles may be more than three. Thus, for example, a public bus may have multiple interior space regions resulting from multiple seat rows, further augmented by multiple storage compartments under the seats as needed.

[0044] Furthermore, the left and right A-pillars 6, the left and right B-pillars 7 and the left and right trunk walls 8 are visualized. Naturally, more than two or three pillars may be provided for use in connection with the present invention.

[0045] The vehicle 1 is equipped with a system for monitoring the interior space, which comprises several system components:

[0046] The left A-pillar and the right A-pillar 6 each have one small first infrared camera 9A that detects the spatial area above the seat surface of the first seat row 3. Furthermore, the left A-pillar and the right A-pillar 6 each have one small second infrared camera 9B that detects the spatial area below the seat surface of the first seat row 3, i.e., the foot area of ​​the first seat row 3. Obviously, both infrared cameras 9B may be installed at suitable positions on the front panel of the passenger compartment or in the front doors. If a center console is present, they can also be positioned on the left and right sides of this center console to detect the foot area of ​​the first seat row 3. Naturally, more than two grouped infrared cameras each may be used here (for each pillar).

[0047] The left B-pillar and the right B-pillar 7 each have one small third infrared camera 10A that detects the space area above the seat surface of the second seat row 4. Furthermore, the left B-pillar and the right B-pillar 7 each have one small second infrared camera 10B that detects the space area below the seat surface of the second seat row 4, i.e., the foot area of ​​the second seat row 4. Both infrared cameras 10B may be installed on both rear doors. If a center console is present, they can also be positioned on the left and right sides of the center console to detect the foot area of ​​the second seat row 4.

[0048] A sufficient number of infrared cameras can be integrated into the roof lining in order to detect the interior space 2 as completely as possible from above. For this detection from above, another infrared camera 11B can be installed, for example, on the luggage compartment lid or, if necessary, on the so-called luggage rack 16.

[0049] Furthermore, the left and right walls 8 of the trunk room each have one small fifth infrared camera 11. As a result, the interior space of the trunk room 5 is detected from the left and right, or from above as needed.

[0050] The described infrared cameras 9A-11B constitute the infrared sensors of the system.

[0051] Furthermore, the vehicle 1 has a data processing device 12 realized by a computer of the vehicle 1. The data processing device 12 is connected to the infrared cameras 9A-11B via a camera data bus 13 and receives infrared images of each detection range generated by the infrared cameras 9A-11B as a digital data stream.

[0052] Furthermore, in order to utilize data services and voice communications via the LTE mobile radio communication module 14, the data processing device 12 is connected to the mobile radio communication module 14 (e.g., the LTE mobile radio communication module) of the vehicle 1 via a communication bus 13B.

[0053] Furthermore, the data processing device 12 is connected to the three temperature sensors 15A-15C via the sensor line 13C so that the first temperature sensor 15A detects the outside air temperature outside the vehicle 1, the second temperature sensor 15B detects the internal space temperature in the passenger compartment consisting of the first seat row 3 and the second seat row 4, and the third temperature sensor 15C detects the internal space temperature in the trunk room 5.

[0054] The system described above implements a method for monitoring the interior space of a vehicle 1 during its operation, which method is visualized by Fig. 2 and is described below.

[0055] To ensure continuous interior space monitoring, if necessary after recognition that the vehicle 1 has been parked and the driver has left the vehicle 1 (for example because the key is no longer present in the vehicle), the method starts at block I and continues to be executed, for example according to the rules for a parked vehicle.

[0056] Then, in block II, the data processing device 12 checks whether the data provided by the infrared cameras 9A-11B indicates that a living being is present in the interior space 2 of the vehicle 1.

[0057] If a clue that a living organism is present in the interior space 2 of the vehicle 1 is identified, the check is repeated immediately or after a certain period of time. The period between such checks and the duration of the check itself may be variable. Thus, the data processing device 12 checks the first few minutes after the driver leaves the vehicle 1 to see if the data provided by the infrared cameras 9A-11B suggest that a living organism is present in the interior space 2 of the vehicle 1. The next period between such checks can then be extended at any time, while the check phase (duration) can be minimized. This ensures that no living organism in the interior space 2 of the vehicle 1 is overlooked, while minimizing the power consumption of the system. Further variables such as the battery level or, in particular in the case of electric vehicles, whether the vehicle is currently charging or is powered only by the vehicle battery, can also influence the number of interactions and the length of the respective time intervals.

[0058] When a living body is introduced into the interior space 2, the body temperature of the living body is detected at least twice within one time interval at block III, at two different times, but preferably the body temperature is detected substantially continuously according to the image rate provided by the infrared camera.

[0059] Furthermore, here, the outside air temperature can also be detected by the first temperature sensor 15A, and likewise the two interior space temperatures can be detected by the second temperature sensor 15B and the third temperature sensor 15C. The detection can also be performed at time intervals or equally substantially continuously. Furthermore, here, weather data can also be queried by the mobile radio communication module 14 at this point.

[0060] Based on the detected body temperature, and taking into account, if necessary, the measured outside and interior temperatures and / or acquired meteorological data, in block IV it is basically checked according to a rule whether a danger to the body and life of the living being can be identified, in which case the trend of the body temperature value or the absolute value of the body temperature is used and the course of the body temperature is predicted into the future, taking into account or not the measured outside and interior temperatures and, if necessary, also meteorological data.

[0061] Thus, for example, the weather data may predict that, although there is currently a lot of solar radiation, cloudiness and wind will occur within the next 15 minutes, resulting in a drop in the outside air temperature. In this case, the actual body temperature value within a certain period (e.g., a long period (e.g., about 60 minutes)) may itself indicate a risk of excessive body temperature rise, but no immediate action is taken. Rather, it is observed whether the body temperature stabilizes or even begins to drop again due to environmental influences during a portion of the period, such as half of the period (e.g., an additional 30 minutes). However, instead, an alert may be sent to the vehicle owner's smartphone that a living body may have been left inside the vehicle.

[0062] In the opposite situation, weather data may be transmitted that indicates that a dangerous situation to body and life may occur very soon.

[0063] The same holds equally well for situations where there is a risk of excessive hypothermia.

[0064] Furthermore, in situations where the living being left in the vehicle is a small living being, action may be taken immediately, since in this case the small living being may be a child or an animal. If a danger is not identified in block IV, a branch is made to block III, where measurement data (i.e., body temperature, as already described in block III) is newly measured and processed or examined as described. These blocks are executed successively until a danger is identified, so that the measurement, processing, and identification of a possible danger can proceed simultaneously, with new data being continuously measured and examined.

[0065] If in block IV a danger requiring action is detected or the time course of the danger or the progression of the danger requires action, a branch is made to block V, where the action is carried out automatically in an advantageously improved manner, as explained above: the vehicle owner is thus informed of the detected danger at his current location, for example by electronic information, so that he can intervene directly, and opening of the windows and, if necessary, the doors may be prevented, the ventilation of the interior space 2 may be initiated, and the subsequent activation of an acoustic alarm and finally the automated initiation of emergency services may be prevented.

[0066] The method ends in block VI by receiving a user interaction (for example, by input from the vehicle owner himself while in the vehicle) that informs the data processing device 12 that the danger has been eliminated.

[0067] However, if the vehicle is still in a parked state, as mentioned at the beginning of the case of block I, the method starts anew and is repeated, for example after a predetermined period of time, at block I, until the vehicle is no longer in a parked state and, if necessary, until the driver is clearly present again in the vehicle 1 (this can be confirmed, for example, by the presence of the driver's (radio) key in the vehicle 1).

[0068] However, this method not only minimizes temperature-related dangers, but also provides a general warning system for protecting living beings in vehicle 1. Thus, for example, a living being in parked vehicle 1 is recognized in block II even in comfortable weather or temperature conditions. If this living being suddenly and unexpectedly disappears from view so that its body temperature cannot be measured in block III, this situation can be interpreted as a danger in block IV. Consequently, measures are carried out in accordance with block V. Thus, for example, the driver can be informed by this method that a child initially identified in vehicle 1 has suddenly disappeared from the measurable area because the child has moved into an area that is not visible (e.g., because the area is obscured by another object in vehicle 1) or because the child has left vehicle 1 without permission.

[0069] As already explained several times, the method and the system can be used not only to protect a living organism from an excessive increase in temperature inside the vehicle 1, but also to protect a living organism from an excessive decrease in temperature inside the vehicle 1. However, measures are applied that are used to increase or maintain the body temperature of a living organism inside the vehicle 1, as opposed to measures that can decrease the body temperature of a living organism inside the vehicle 1.

[0070] The method or the system may also be used as an alarm system to recognize and alarm any unauthorized intrusion of a person (or in general, a person, such as a thief, for example) into the vehicle 1.

[0071] Furthermore, the method or system can also be used in automatically recognized accidents to provide emergency personnel with accurate information about the number and location of living bodies around the vehicle 1. Thus, effects on living bodies inside the vehicle 1, such as heating effects due to fire or hot gases or cooling effects due to, for example, a cracked window, can be accurately detected and communicated to the emergency personnel as important parameters for better planning and developing rescue operations, which may ultimately contribute to saving lives.

[0072] Furthermore, in order to protect objects (eg electronic devices) left inside the vehicle 1 from heat damage, thermal monitoring of the interior space of the vehicle 1 by the above-mentioned infrared sensors, in particular infrared cameras, can be used.

[0073] With the widespread adoption of technology in the automotive market, automatically detected temperature data of the interior or outside air temperature can be transmitted from each vehicle 1 to a meteorological service center via a mobile wireless communication module (e.g., via GSM, UMTS, LTE, etc.). This temperature data can then be processed centrally, enabling accurate, particularly location-specific, output of the temperature. In this case, a large number of vehicles 1 equipped with multiple vehicle sensors can form a network of deployed sensors to create temperature maps for very localized areas, if necessary. This network can assist in further improving the weather model, such as the vehicle's temperature forecast, particularly with regard to the expected temperature inside the vehicle 1. However, in this context, it should also be mentioned that the system can be used for preventive purposes within the vehicle 1. In this case, the system transmits a temperature within the X°-Y° range as an alarm to a meteorological service center or a public information service center. The information service center itself can then use this data to send proactive alarms to vehicles in the relevant area or to the smartphones of vehicle owners or vehicle users. Thus, for example, similar to the transmission of severe weather alerts from an insurance company to a customer's smartphone, an alert regarding a dangerous temperature within the vehicle 1 with a potential risk of excessive overheating or excessive underheating of living organisms within the vehicle 1 may be automatically transmitted as a proactive measure.

[0074] However, the sensors of the vehicle 1 may be used for a variety of other applications in connection with the present invention.

[0075] For example, when a rain or severe weather warning is sent to the vehicle, a comparison with the weather information can be performed by a rain sensor in the vehicle. During rain and severe weather, the system checks whether the windows and / or sunroof are open. If this check ends with a positive result, a message regarding the open interior space is notified to the smartphone. Simultaneously with this notification, i.e., in parallel in time, it is checked whether a living being is present in the vehicle 1. If a living being is not present in the vehicle, the windows and sunroof are closed when they are open. If a living being is present in the vehicle 1, a check is first performed by the smartphone to close the windows. If this check is not made, the windows are not automatically closed and therefore remain open.

[0076] Furthermore, for example, one or more water level or humidity sensors may be used in the vehicle as an additional measure for recognizing a danger. If the vehicle 1 falls into water during a traffic accident and water enters the vehicle 1, the water sensor will immediately recognize the water intrusion. The system then notifies emergency personnel of the coordinates, occupant information, and the cause of the water intrusion, and other measures are rejected. Alternatively, the infrared sensor may be configured as an infrared camera, so that the temperature distribution or temperature zone pattern of the intruding water can be recognized by a data processing device. As a result, a fall into water can be detected, especially without additional water level or humidity sensors in the vehicle, and corresponding measures can be taken.

[0077] The system or method is also suitable for automatically recognizing smugglers. In this case, a guard can be automatically notified, for example, when too many people are present at the border, for example in a trailer or container. The guard is automatically notified about the number of living organisms in the trailer. Automatic notification can also be performed when a (infrared) sensor is deactivated, removed or dismounted.

[0078] The system and method can also be used to eliminate or detect the COVID pandemic. That is, the body temperature of all persons in the interior space of the vehicle 1 can be continuously measured. The average body temperature (excluding the heating or cooling effect of heating or cooling the interior space, if necessary) can also be calculated by observing the body temperature over time, and therefore, whether a person is potentially sick or at a healthy level can be determined based on their body temperature. Therefore, manual temperature measurement at borders using a thermometer is unnecessary. Furthermore, automatically obtained measurement data is more accurate. Furthermore, automatically recorded GPS data showing the movements of relevant persons can be managed or evaluated within areas at risk of the pandemic.

[0079] Finally, it is further pointed out that the figures described in detail above are merely examples which may be modified in various ways by those skilled in the art without departing from the scope of the invention. For the sake of completeness, it is also pointed out that the use of the indefinite article "a" does not exclude the possibility of a plurality of the relevant features being present. The present application relates to the invention described in the claims, but may also include the following configurations as other aspects. 1. A method for monitoring the interior space of a vehicle, said method comprising the following method steps: - a method step (II) of automatically recognizing the presence of a living body in the interior space (2) of said vehicle (1) by means of at least one infrared sensor (9A-11B); - a method step (III) of automatically measuring the body temperature of the living body present in the internal space (2) multiple times within one time interval by the infrared sensors (9A-11B); - a method step (IV) of automatically recognizing a danger based on the measured temperature value; and - a method step (V) of automatically initiating measures when a danger is recognized, The method, wherein the steps of recognizing presence (II), measuring body temperature (III), recognizing danger (IV) and initiating measures (V) are performed by a data processing device (12) of the vehicle (1), which receives and processes infrared sensor signals or infrared sensor data from the infrared sensors (9A-11B). 2. 2. The method according to claim 1, wherein the infrared sensors (9A-11B) transmit infrared sensor signals or infrared sensor data that enable identification of multiple temperature zones within the detection range of the infrared sensors (9A-11B). 3. 3. The method according to claim 1 or 2, wherein the data processing device (12) recognizes the presence of a living organism in the interior space (2) of the vehicle (1) by detecting at least one unique temperature zone pattern and / or in particular a unique change in the unique temperature zone pattern, and in particular identifies an animal or person based on the temperature zone pattern and / or the change in the temperature zone pattern. 4. The method according to any one of 1 to 3 above, wherein the data processing device (12) calculates the body temperature of the living body from the infrared sensor signal or infrared sensor data that recognizes the living body. 5. The method according to any one of 1 to 4 above, wherein the data processing device (12) identifies danger based on the calculated body temperature values ​​when at least one of the calculated body temperature values ​​exceeds a threshold value or when the trend of the calculated body temperature values ​​shows signs of danger. 6. the infrared sensors (9A-11B) are implemented as infrared cameras used to transmit a series of still or video thermal images of the interior space (2), 6. The method according to any one of 1 to 5 above, wherein the plurality of still images of the thermal images or the moving images of the thermal images are displayed by the infrared sensor signal or the infrared sensor data. 7. A method according to any one of 1 to 6 above, wherein the detection range of the at least one infrared sensor (9A-11B) includes the seating area and the foot area of ​​the interior space (2) of the passenger compartment allocated for passenger transportation of the vehicle (1). 8. 8. A method according to any one of claims 1 to 7, wherein the detection range of said at least one infrared sensor (9A-11B) includes the interior space (2) of said vehicle (1) allocated for animal transport, luggage transport and / or cargo transport. 9. The method according to any one of 1 to 8 above, wherein at least one infrared sensor (9A-11B) or a plurality of infrared sensors (9A-11B) are installed in the A-pillar (6) and / or B-pillar (7) and / or C-pillar of the vehicle and in the trunk lid, and the interior space (2) of the vehicle is detected by the detection range of the infrared sensors (9A-11B). 10. -Automatically detecting the outside air temperature outside the vehicle (1) by an outside air temperature sensor (15A); - automatically detecting the internal temperature of the interior space (2) of the vehicle (1) by internal temperature sensors (15B, 15C); 10. The method according to any one of claims 1 to 9, wherein the data processing device (12) receives an external temperature sensor signal or data from the external temperature sensor (15A) and an internal temperature sensor signal or data from the internal temperature sensors (15B, 15C), predicts a temperature progression in the interior space (2) of the vehicle (1) from said signals or data, and incorporates this prediction of the internal temperature progression into the risk recognition (IV). 11. 11. The method according to any one of claims 1 to 10, wherein the data processing device (12) uses a mobile communication device (14) of the vehicle (1) to query weather data relating to current and / or future weather conditions from a weather service center, predicts a temperature course within the interior space (2) of the vehicle (1) from the weather data, and incorporates this prediction of the internal temperature course into the risk recognition (IV). 12. 12. The method according to any one of claims 10 to 11, wherein the prediction of the internal temperature progression is performed based on a general digital model of the temperature progression for the interior space (2) of the vehicle (1) or a digital model specific to a type or pattern of the temperature progression in the interior space (2) of the vehicle (1), and the data processing device (12) digitally stores the respective model and uses it for predicting the time progression of the internal temperature. 13. The initiation of said action (V) by said data processing device (12) includes the following groups: - wirelessly transmitting a predetermined message to a receiving device, in particular a mobile device, particularly preferably a smartphone, assigned to the user or owner of the vehicle (1); - opening the interior space (2) of said vehicle (1), in particular by at least partially automatically opening or opening a vehicle window or by automatically opening or unlocking a vehicle door or a trunk lid or trunk door, -Closing or keeping closed windows or doors; - activating a ventilation system for ventilating an interior space (2) of the vehicle (1); - activating a heating system of the vehicle (1) for heating or maintaining heating of the interior space (2) of the vehicle (1); -activating an acoustic alarm of said vehicle (1); - detecting position data by a positioning system of the vehicle (1) and wirelessly transmitting the position data to a receiving device; establishing a wireless communication connection with an emergency call center; - wirelessly transmitting situation-specific information or data to a data server, in particular to a data server of an emergency call center; 13. A method according to any one of 1 to 12 above, comprising at least one of the following operations. 14. The situation-specific information or data may include information from the following groups: - the number of living organisms recognized in the interior space (2) of the vehicle (1); - location information of the recognized living body in the interior space (2) of the vehicle (1); - the duration of being in the interior space (2) of said vehicle (1); the temperature of the interior space of the vehicle (1); - the outside air temperature of the vehicle (1); the body temperature of the recognized organism; and -Automatic determination of the need to notify an emergency physician; - position data of the vehicle (1); - information data for identifying the vehicle; - real-time data indicative of the infrared sensor signal or data of said at least one infrared sensor (9A-11B); 14. The method according to claim 13, comprising at least one element of: 15. A system for monitoring the interior space of a vehicle configured to perform a method according to any one of 1 to 14 above. [Explanation of symbols]

[0080] 1 vehicle 2. Interior space 3 Front seat row, interior space area 4 Rear seat row, interior space area 5. Trunk room and interior space area 6 A-pillar 7 B-pillar 8. Trunk room side wall 9A Infrared Camera 9B Infrared Camera 10A Infrared Camera 10B Infrared Camera 11A Infrared camera 11B Infrared camera 12 Data Processing Device 13A Camera Data Bus 13B communication bus 13C Sensor wire 14 Mobile wireless communication module, mobile wireless communication device 15B Temperature sensor, internal temperature sensor 15C temperature sensor, internal temperature sensor 16 Luggage shelf

Claims

1. A method for monitoring the interior space of a vehicle, said method comprising the following method steps: - a method step (II) of automatically recognizing the presence of at least one living organism in the interior space (2) of said vehicle (1) by means of a plurality of infrared sensors (9A-11B); - a method step (III) of automatically measuring the body temperature of the living body present in the interior space (2) multiple times within a time interval by the multiple infrared sensors (9A-11B); - a method step (IV) of automatically recognizing a predicted risk of excessive hyperthermia and hypothermia of said living body based on the temperature values ​​identified by observing said body temperature over a time interval; - a method step (V) of automatically initiating measures when said danger is recognized, The recognition of presence (II), the measurement of body temperature (III), the recognition of danger (IV) and the initiation of measures (V) are carried out by a data processing device (12) of the vehicle (1), which receives, compares and processes infrared sensor signals or infrared sensor data from the plurality of infrared sensors (9A-11B); The method in which the detection ranges of the plurality of infrared sensors (9A-11B) partially overlap, and the process of determining a detection error is performed by comparing the detection values ​​in the overlapping areas, The data processing device (12) calculates the body temperature of the living body from the infrared sensor signal or infrared sensor data that recognizes the living body, The method further comprises the step of: determining whether a trend in the calculated body temperature value indicates a danger; and determining whether the danger exists based on the calculated body temperature value.

2. 2. The method of claim 1, wherein the plurality of infrared sensors (9A-11B) transmit infrared sensor signals or infrared sensor data that enable identification of a plurality of temperature zones within a detection range of the plurality of infrared sensors (9A-11B).

3. 3. The method according to claim 1 or 2, wherein the data processing device (12) recognizes that a living organism is present in the interior space (2) of the vehicle (1) by detecting at least one unique temperature zone pattern and / or a unique change in the unique temperature zone pattern, and identifies an animal or a person based on the temperature zone pattern and / or the change in the temperature zone pattern.

4. the plurality of infrared sensors (9A-11B) are realized as infrared cameras used to transmit a plurality of successive still or video thermal images of the interior space (2), The method according to any one of claims 1 to 3, wherein the plurality of still thermal images or the plurality of moving thermal images are displayed by the infrared sensor signal or the infrared sensor data.

5. 5. The method according to claim 1, wherein the detection ranges of the plurality of infrared sensors (9A-11B) include the seating area and the foot area of ​​the interior space (2) of the passenger compartment of the vehicle (1) allocated for the transport of passengers.

6. 6. The method according to any one of claims 1 to 5, wherein the detection range of the plurality of infrared sensors (9A-11B) includes an interior space (2) of the vehicle (1) allocated for animal transport, luggage transport and / or cargo transport.

7. The method according to any one of claims 1 to 6, wherein the plurality of infrared sensors (9A-11B) are installed in the A-pillars (6) and / or the B-pillars (7) and / or the C-pillars of the vehicle and in a trunk room lid, and the interior space (2) of the vehicle is detected based on the detection ranges of the plurality of infrared sensors (9A-11B).

8. - Automatically detecting the outside air temperature outside the vehicle (1) by an outside air temperature sensor (15A); - automatically detecting the internal temperature in the interior space (2) of the vehicle (1) by the internal temperature sensors (15B, 15C); said data processing device (12) receives external temperature sensor signals or data from said external temperature sensor (15A) and internal temperature sensor signals or data from said internal temperature sensors (15B, 15C), predicts the temperature evolution in the interior space (2) of said vehicle (1) from said signals or data, and incorporates this prediction of the internal temperature evolution into said risk recognition (IV); The method according to any one of claims 1 to 7, comprising:

9. The data processing device (12) uses a mobile communication device (14) of the vehicle (1) to query weather data relating to current and / or future weather conditions from a weather service center, predicts from the weather data a temperature progression within the interior space (2) of the vehicle (1), and incorporates this prediction of the interior temperature progression into the risk recognition (IV). The method according to any one of claims 1 to 8, comprising:

10. 10. The method according to claim 8, wherein the prediction of the interior temperature course is performed based on a general digital model of the temperature course for the interior space (2) of the vehicle (1) or a digital model specific to a type or pattern of the temperature course of the interior space (2) of the vehicle (1), and the data processing device (12) digitally stores the respective model and uses it for predicting the time course of the interior temperature.

11. The initiation of said action (V) by said data processing device (12) includes the following groups: - wirelessly transmitting a predefined message to a receiving device or a mobile device or smartphone assigned to the user or owner of said vehicle (1); - opening the interior space (2) of said vehicle (1) by at least partially automatically opening or opening a vehicle window or by automatically opening or unlocking a vehicle door or a trunk lid or trunk door, - closing or keeping closed windows or doors; - activating a ventilation system for ventilating the interior space (2) of said vehicle (1); - activating a heating system of said vehicle (1) for heating or maintaining the heating of an interior space (2) of said vehicle (1); - activating an acoustic alarm of said vehicle (1); - detecting position data by a positioning system of said vehicle (1) and transmitting said position data wirelessly to a receiving device; - establishing a radio communication connection with an emergency call center; - wirelessly transmitting situation-specific information or data to a data server or to a data server of an emergency call center; The method according to any one of claims 1 to 10, wherein there is at least one operation of:

12. The situation-specific information or data may include information from the following groups: the number of recognized living organisms in the interior space (2) of the vehicle (1); - location information of the recognized living body within the interior space (2) of the vehicle (1); - the duration of being inside the interior space (2) of said vehicle (1); the temperature of the interior space of the vehicle (1), the outside air temperature of the vehicle (1), - the body temperature of the recognized living organism; - Automatic determination of the need to notify an emergency physician; - position data of said vehicle (1); - information data for identifying said vehicle; - real-time data representing the infrared sensor signals or data of said plurality of infrared sensors (9A-11B); 12. The method of claim 11, wherein there is at least one element of:

13. A system for monitoring the interior space of a vehicle, configured to carry out a method according to any one of claims 1 to 12.

Images