System for detecting the presence of unwanted animals inside a motor vehicle's passenger compartment

A multi-sensor system in vehicles identifies and alerts occupants about unwanted animals using signature detection and data fusion, enhancing road safety by addressing the limitations of existing systems.

FR3148975A1Inactive Publication Date: 2024-11-29STELLANTIS AUTO SAS
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
FR2023005045
Authority / Receiving Office
FR · FR
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-23
Publication Date
2024-11-29
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing vehicle detection systems fail to accurately identify and alert occupants about the presence of unwanted animals in the passenger compartment, posing a risk to road safety.

Method used

A multi-sensor system using cameras, microphones, and other sensors to detect and identify animal signatures through data fusion, alerting users via multimedia systems.

Benefits of technology

Effectively detects and identifies various unwanted animals, providing timely alerts to prevent accidents by leveraging a database of animal signatures and multimedia interfaces.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

A system for detecting the presence of an unwanted animal (ANI) inside the passenger compartment (PC) of a motor vehicle (MV), comprising detection means using sensors of different detection technologies (CAM, MIC), arranged in the passenger compartment (PC) of the vehicle (MV), means for processing the detection information delivered by said sensors (CAM, MIC), capable of identifying the type of animal (ANI) detected from a database (DB) in which the different types of animals (ANI) likely to enter a passenger compartment of a motor vehicle are pre-registered and listed, and means (HMI) for alerting a user of the vehicle (MV) to the presence of an animal (ANI) in the passenger compartment (PC) and informing them of the type of animal (ANI) detected in the passenger compartment (PC). (Figure 1)
Need to check novelty before this filing date? Find Prior Art

Description

Title of the invention: System for detecting the presence of unwanted animals inside a motor vehicle passenger compartment

[0001] The present invention relates generally to the detection of the presence of living beings in the passenger compartment of a motor vehicle and more particularly relates to a system for detecting the presence of unwanted animals which have inadvertently entered the passenger compartment of a motor vehicle; the term "animals" designating in the broad sense any animal species which could potentially be dangerous directly for humans or indirectly by their simple presence in the passenger compartment of a motor vehicle capable of causing dangerous situations for the driving of the vehicle and therefore likely to impact road safety.

[0002] The present invention is primarily but not exclusively aimed at the detection of small animals whose intrusion into the passenger compartment of a vehicle is not necessarily immediately noticed by the user of the vehicle.

[0003] With globalization, more and more animal species, usually confined to their region of origin, such as the Asian hornet or the tiger mosquito, are found in other regions of the globe, such as Europe, and are added to the other species already present, such as mosquitoes, wasps, which are particularly virulent and dangerous in summer, etc.

[0004] Who has not been confronted with a wasp that has entered the passenger compartment of the vehicle, for example when cleaning the vehicle and / or because the windows or doors of the vehicle were left open after parking.

[0005] Although insects are the most common creatures found in the interiors of our vehicles, other types of unwanted animal species can enter our vehicles without our knowledge.

[0006] For example, let us cite spiders, rodents (rats, mice, field mice, etc.) and other small mammals or even certain reptiles (snakes, lizards, etc.) which can be dangerous for human beings and which, even if they are not or only slightly dangerous, can distract the attention of the driver who may want to chase them away by disorderly gestures and cause an accident if their intrusion into the vehicle has not been detected at the appropriate time.

[0007] It is therefore important, particularly for road safety, to be able to prevent accidents due to the presence of unwanted animals in the passenger compartment of a motor vehicle.

[0008] In the automotive field, systems are known which aim to keep certain animals away from a motor vehicle by generating ultrasounds for example.

[0009] On the other hand, none of these systems takes into account the different animal species likely to enter the interior of a vehicle in order to be able to identify them precisely and generate an alert adapted to the type of animal detected and identified.

[0010] The objective of the present invention is to provide a robust solution for detecting the presence of unwanted animals inside a motor vehicle passenger compartment.

[0011] To this end, the present invention has as its first object a system for detecting the presence of an undesirable animal inside a motor vehicle passenger compartment, comprising detection means using sensors of different detection technologies, arranged in the passenger compartment of the vehicle, means for processing the detection information delivered by said sensors, capable of identifying the type of animal detected from a database in which the different types of animals likely to enter a motor vehicle passenger compartment are pre-recorded and listed, and means for alerting a user of the vehicle to the presence of an animal in the passenger compartment and informing him of the type of animal detected present in the passenger compartment.

[0012] According to one characteristic, the processing means and the database are hosted in a multimedia system of the vehicle or relocated to a remote server communicating with the multimedia system of the vehicle by wireless communication means.

[0013] According to another characteristic, the means for alerting the user of the vehicle to the presence of an animal in the passenger compartment and informing him of the type of animal detected present in the passenger compartment comprise a human-machine interface coupled to the multimedia system of the vehicle, capable of broadcasting an audio and / or video alert message and announcing the type of animal detected.

[0014] According to another characteristic, the detection means comprise at least one image sensor and one acoustic sensor.

[0015] According to another characteristic, the image sensor is a camera with a wide field of vision and sensitive to wavelengths located in the visible and infrared spectra, capable of capturing images of the interior of the passenger compartment and the acoustic sensor is a microphone capable of capturing sounds inside the passenger compartment.

[0016] According to another characteristic, the camera and the microphone are contained in the same box arranged on the ceiling of the passenger compartment and substantially centered on the ceiling.

[0017] According to another characteristic, the detection means further comprise one or more sensors, arranged in the passenger compartment of the vehicle, chosen from: a radar, an infrared sensor, a sound sensor.

[0018] The second subject of the present invention is a motor vehicle comprising a system as described above.

[0019] The third subject of the present invention is a method implemented by the system as described above, consisting of detecting the presence of an animal in the passenger compartment of the vehicle from the sensors arranged in the passenger compartment of the vehicle, processing the information delivered by the sensors to determine one or more signatures of the detected animal, classifying the signature(s) by the processing means of the vehicle, with one or more so-called reference signatures, pre-recorded in the database and listing the main signatures of unwanted animals likely to enter the interior of a vehicle passenger compartment, to identify the animal and, alerting the user of the vehicle of the presence of an unwanted animal in the passenger compartment of the vehicle by also informing him of the type of animal identified.

[0020] Finally, the present invention has as its fourth object, a computer program product comprising instructions which, when the program is executed by a computer, lead the latter to implement the steps of the method as described above.

[0021] Other advantages and characteristics of the present invention may emerge more clearly from the description which follows, given solely by way of non-limiting example and made with reference to the drawings in which:

[0022] [Fig.l] illustrates a perspective view of the interior of a motor vehicle passenger compartment comprising a system according to the invention; and

[0023] [Fig.2] illustrates a flowchart of the main steps of a process implemented by the system according to the invention.

[0024] The present invention is based on the use of several sensors of different technologies, arranged inside the passenger compartment of a motor vehicle to operate individually or in association in the manner of a multi-sensor system, in particular to allow both the detection of unwanted animals and the recognition of the type of unwanted animal detected (its "signature(s)"): insects: mosquitoes, wasps, hornets, etc., snakes, spiders, small mammals, etc. which have entered the passenger compartment, whether the vehicle is stationary or moving.

[0025] By "signature" is meant one or more specific and distinctive characteristics of an animal that can be detected inside a confined and enclosed space such as a motor vehicle interior.

[0026] Thus, the signatures of insects such as a wasp or a hornet can be determined from their buzzing characterized by their frequency (wing beat), their sound amplitude, their erratic movement, etc., or in the case of reptiles (snake, lizard, etc.) by their shape, their movement if they move around in the cabin, or in the case of small mammals (dog, cat, field mouse, marten, etc.) by their heartbeat, the rhythm of their breathing, the infrared (thermal) radiation emitted by their body, the sounds emitted: cries or noises resulting from their activity in the passenger compartment, ...

[0027] Among the sensors capable of being used in a car interior and meeting the detection criteria for obtaining or participating in the reconstruction of animal signatures, there is a camera (camera in the visible and / or infrared range), a microphone, a radar, an infrared sensor, a sound sensor, etc.

[0028] A single sensor can perform several detection functions such as the camera which can detect infrared radiation and movements within the images captured by the camera following suitable image processing.

[0029] Some sensors are more dedicated to detecting the movements of certain types of animals, such as small mammals (which are warm-blooded animals). Thus, so-called volumetric infrared movement sensors, also called PIR sensors (Passive Infrared Sensor), evaluate the weight of an animal using its infrared (or thermal) radiation. This type of sensor makes it possible to differentiate between a human and an animal.

[0030] There are also other types of so-called microwave motion sensors (radars) which can complement the detection made by the previous sensors.

[0031] A microphone-type acoustic sensor, capable of capturing sounds inside the passenger compartment and sensitive in particular to ultrasound, makes it possible to capture sounds (or vibrations) emitted by animals (heartbeats, breathing, cries, etc.) and / or by their activities inside the passenger compartment in the case of small mammals, or buzzing in the case of flying insects.

[0032] For other types of “silent” animals such as spiders and reptiles, other camera-type sensors, associated or not with a radar, make it possible to scan the cabin and deliver images which, associated with an image processing computer and a shape recognition algorithm, allow the detection and identification of the animal by its shape and type of movement.

[0033] All of these sensors, at a minimum, a camera with a wide field of vision and sensitive to wavelengths located in the visible and infrared spectra, and a microphone capable of capturing sounds inside the passenger compartment of the vehicle, including in particular ultrasound, in association with ad hoc processing algorithms, make it possible to detect and recognize any type of animal detected, by their “signatures” (visual, sound, thermal, vibration, etc.). Thus, the pooling of information from sensors of different technologies makes it possible to detect and robustify the classification of the type of animal detected.

[0034] The signatures are determined by a processing computer analyzing the information delivered by the various sensors arranged in the passenger compartment of the vehicle. The computer uses, for example, a data fusion algorithm. The signatures are then classified from so-called reference animal signatures, stored in a database in which signatures of unwanted animals likely to enter a motor vehicle interior are listed. For each animal, several signatures (visual, sound, thermal, vibration) are pre-recorded and stored in the database.

[0035] The presence of these animals in the passenger compartment of a motor vehicle can cause dangerous situations when driving.

[0036] The invention also consists of alerting the user of the vehicle by means of one or more human-machine interfaces, in particular a buzzer, a voice message of the voice assistant type: "attention an animal has entered the passenger compartment", reproduced by an audio system of the vehicle and / or video displaying a text on one or more screens arranged on the dashboard, the central console or on the windshield or other display medium for example a head-up display, HUD (an English acronym for "Head Up Display"), or even on a portable terminal held by the user of the vehicle.

[0037] This alert can be supplemented by an audio and / or visual message inviting the user to stop quickly if a vehicle is subsequently detected moving.

[0038] Advantageously, additional information on the type of animal that has entered the passenger compartment is announced by the same audio and / or video systems as those introduced above to enable the driver and / or other occupants of the vehicle present at the time of the alert to take appropriate measures depending on the type of animal identified.

[0039] A system SYS according to the invention is described below, with reference to [Fig. 1].

[0040] In order to be able to recognize all types of animals likely to enter the HAB passenger compartment of a VHL motor vehicle, it is necessary to arrange at least one motion sensor and one sound sensor inside the HAB passenger compartment.

[0041] The motion sensor can be produced from a CAM camera with a wide field of vision scanning the interior of the HAB passenger compartment. This CAM camera can advantageously be arranged on the PFD ceiling of the HAB passenger compartment and substantially in the center of the PFD ceiling. The CAM camera covers the spectrum of visible and infrared frequencies and is for example associated with a MIC microphone capable of capturing sounds in the HAB passenger compartment of the VHL vehicle, in the same BOI box arranged on the PFD ceiling.

[0042] The BOI box can be permanently fixed on the PFD ceiling of the HAB passenger compartment, being powered by the on-board electrical network of the VHL vehicle and connected by the CAN (Controller Aéra Network) wired network or other, not shown, of the VHL vehicle to communicate with the SMM multimedia system of the VHL vehicle.

[0043] As a variant, the BOI box can be a stand-alone box attached to the PFD ceiling of the HAB passenger compartment, self-powered by a battery and communicating by radio channels with the SMM multimedia system of the VHL vehicle via COM communication means of the VHL vehicle coupled to the SMM multimedia system and those of the BOI box, not shown.

[0044] Other sensors such as one or more infrared sensors, one or more ultrasonic sensors and one or more radars, not shown, may be arranged in different areas of the HAB cabin to supplement the detection coverage of the CAM camera and the MIC microphone arranged on the PFD ceiling of the HAB cabin.

[0045] All these sensors make it possible to deliver information: signals, sounds and images which are received and processed by an ECU type computer (English acronym for “Electronic Control Unit”) on board the VHL vehicle; the computer belonging for example to the SMM multimedia system of the VHL vehicle.

[0046] The ECU calculator can implement MDT processing means using in particular data fusion means such as those used in particular to enable multi-sensor perception of the external environment of a vehicle for driving in autonomous mode. In the present invention, the data fusion means are used for perception of the interior of the HAB passenger compartment of the VHL vehicle.

[0047] The MDT processing means exploit one or more shape and movement recognition algorithms as well as one or more sound processing algorithms to be able to extract one or more signatures of the detected ANI animal.

[0048] These signatures are then compared, by automatic classification, or supervised classification, to reference signatures which have been previously recorded and listed in a library, or database BDD, hosted by the SMM multimedia system of the VHL vehicle.

[0049] As a variant, the MDT processing means and the BDD database can be hosted and stored in a remote server, or CLD cloud, or only the BDD database.

[0050] The wireless communication means COM, coupled with the multimedia system SMM, make it possible to exchange by radio waves with the cloud CLD, the signature information of the detected animal ANI.

[0051] [Fig.2] illustrates a flowchart of the main steps of a method according to the invention implemented by the SYS system according to the invention.

[0052] In a first step 100, the method consists of detecting the presence of an animal ANI in the passenger compartment HAB of the vehicle VHL from the sensors CAM and MIC, arranged in the passenger compartment HAB of the vehicle VHL.

[0053] It consists, in a second step 200, of processing the information delivered by the different CAM and MIC sensors to determine one or more signatures of the detected animal ANI.

[0054] In a third step 300, the method consists of classifying the signature(s), i.e. comparing the signature(s) determined by the processing means MDT, with one or more so-called reference signatures, pre-recorded in the database BDD and listing the main signatures of undesirable animals likely to enter the interior of a vehicle passenger compartment, to identify the animal.

[0055] In a fourth and final step 400, the method consists of alerting the user of the VHL vehicle of the presence of an undesirable animal ANI in the passenger compartment HAB of the VHL vehicle by also informing him of the type of animal identified ANI.

[0056] The method implements a computer program product comprising instructions which, when the program is executed by a computer, cause the latter to implement the steps of the method.

[0057] This program is implemented, for example, by one or more processors linked to the SMM multimedia system.

[0058] Such a program can be updated with the possibility of adding services using an OTA “Over The Air” type update.

Claims

Claims

1. System (SYS) for detecting the presence of an unwanted animal (ANI) inside a passenger compartment (HAB) of a motor vehicle (VHL), comprising detection means using sensors of different detection technologies (CAM, MIC), arranged in the passenger compartment (HAB) of the vehicle (VHL), means (MDT) for processing the detection information delivered by said sensors (CAM, MIC), capable of identifying the type of animal (ANI) detected from a database (BDD) in which the different types of animals (ANI) likely to enter a passenger compartment of a motor vehicle are pre-recorded and listed, and means (IHM) for alerting a user of the vehicle (VHL) to the presence of an animal (ANI) in the passenger compartment (HAB) and informing him of the type of animal (ANI) detected present in the passenger compartment (HAB).

2. System (SYS) according to the preceding claim, in which the processing means (MDT) and the database (BDD) are hosted in a multimedia system (SMM) of the vehicle (VHL) or relocated in a remote server (CLD) communicating with the multimedia system (SMM) of the vehicle (VHL) by wireless communication means (COM).

3. System (SYS) according to the preceding claim, in which the means for alerting the user of the vehicle (VHL) to the presence of an animal (ANI) in the passenger compartment (HAB) and informing him of the type of animal (ANI) detected present in the passenger compartment (HAB) comprise a human-machine interface (HMI) coupled to the multimedia system (SMM) of the vehicle (VHL), capable of broadcasting an audio and / or video alert message and announcing the type of animal (ANI) detected.

4. System (SYS) according to one of the preceding claims, in which the detection means comprise at least one image sensor (CAM) and one acoustic sensor (MIC).

5. System (SYS) according to the preceding claim, in which the image sensor (CAM) is a camera with a wide field of vision and sensitive to wavelengths located in the visible and infrared spectra, capable of capturing images of the interior of the passenger compartment (HAB) and in which the acoustic sensor (MIC) is a microphone capable of capturing sounds inside the passenger compartment (HAB).

6. System according to the preceding claim, in which the camera (CAM) and the microphone (MIC) are contained in the same box (BOI) arranged on the ceiling (PFD) of the passenger compartment (HAB) and substantially centered on the ceiling (PFD).

7. System (SYS) according to one of claims 4 to 6, in which the detection means further comprise one or more sensors, arranged in the passenger compartment (HAB) of the vehicle (VHL), chosen from: a radar, an infrared sensor, a sound sensor.

8. Motor vehicle (VHL) comprising a system (SYS) according to one of the preceding claims.

9. Method implemented by the system (SYS) according to claims 1 to 7, consisting of detecting (100) the presence of an animal (ANI) in the passenger compartment (HAB) of the vehicle (VHL) from the sensors (CAM and MIC) arranged in the passenger compartment (HAB) of the vehicle (VHL), processing (200) the information delivered by the sensors (CAM and MIC) to determine one or more signatures of the detected animal (ANI), classifying (300) the signature(s) by the processing means (MDT) of the vehicle (VHL), with one or more so-called reference signatures, pre-recorded in the database (BDD) and listing the main signatures of unwanted animals likely to enter the interior of a vehicle passenger compartment, to identify the animal and, alerting (400) the user of the vehicle (VHL) of the presence of an unwanted animal (ANI) in the passenger compartment (HAB) of the vehicle (VHL) while also informing it of the type of identified animal (ANI).

10. Computer program product comprising instructions which, when the program is executed by a computer, cause the latter to implement the steps of the method according to the preceding claim.

Citation Information

Patent Citations

  • Monitoring of vectors for epidemic control

    US20180293869A1

  • System and method for use of a sensor matrix in a vehicle interior

    WO2023019211A1