Method of controlling a motor vehicle based on an estimate of the age of a person in the motor vehicle, associated device and motor vehicle.

Abstract

A method for controlling a motor vehicle (100) comprising a passenger compartment including an interior (150), characterized in that it comprises the following steps: Receiving an image of the interior of the passenger compartment (150) from a camera (120); Extracting, from the image of the interior of the passenger compartment (150), a first image of the face of a first person (200) present in the interior of the passenger compartment (150); Generating age information for the first person (200) from the first image; Determining a first area of ​​the interior of the passenger compartment (150) in which the first person (200) is located; Initially controlling the motor vehicle (100) based on the age information and the first area. Figure for the abstract: Figure 1

Description

Title of the invention: Method for controlling a motor vehicle based on an estimate of the age of a person in the motor vehicle, associated device and motor vehicle.

[0001] The invention relates to the control of a motor vehicle, for example the control of the starting of the motor vehicle, the inhibition of an airbag or the transmission of an alert message.

[0002] There is a need to make such a command more intelligent.

[0003] For this purpose, the invention relates to a method for controlling a vehicle at automobile comprising a passenger compartment comprising, for example, an interior (and an exterior) characterized in that it comprises the following steps: • Receiving an image of the interior of the passenger compartment (in other words: an image of the passenger compartment), from a camera of the motor vehicle (filming the interior of the passenger compartment), then • Extraction, in the image of the interior of the passenger compartment (in other words: of the passenger compartment), of a first image of a face of a first person present in (the interior of) the passenger compartment (in other words: in the passenger compartment), (the image of the interior of the passenger compartment thus includes said face), then • Production (in other words: determination) of age information (in other words: an age) of the first person, from the first image, then • Determination of a first zone inside the passenger compartment in which the first person is located, then • First order of the motor vehicle from the age information and the first zone.

[0004] Thus, thanks to the invention, using a camera, therefore at reduced cost compared to a solution comprising dedicated sensors, the motor vehicle can be controlled according to an estimated age (i.e., the age information) of one or more people present in the vehicle.

[0005] According to one embodiment, the camera comprises a field angle equal to 180 degrees.

[0006] More generally, for example, the field angle is greater than 80 degrees and less than or equal to 180 degrees.

[0007] For example, the camera is located less than 10 centimeters from an interior rearview mirror (also conventionally called a central rearview mirror) located inside the passenger compartment.

[0008] The camera may be located inside the passenger compartment or in a closing wall the passenger compartment (alternatively, outside a motor vehicle windshield and filming through the windshield).

[0009] The extraction step can be carried out by an algorithm known to those skilled in the art.

[0010] As an example, we can cite the algorithm described in the following article: Zhang, Kaipeng et al. “Joint Face Detection and Alignment Using Multitask Cascaded Convo-lutional Networks.” IEEE Signal Processing Letters 23.10 (2016): 1499-1503. Crossref. Web.

[0011] It is also possible to use the program called “Face Capture Module” offered by the company called “Yoti Ltd” or a method called “Viola and Jones”.

[0012] For example, the face may extend over (i.e., cover) between 35% and 100% (of an area) of the first image. Alternatively, for example, 1 to 10% of the area of ​​the face is outside the first image.

[0013] According to one embodiment, the production of the age information of the first person is implemented by an electronic neural network, from the first image.

[0014] For example, the electronic neural network is a convolutional neural network.

[0015] Such neural networks or other alternative solutions are known to those skilled in the art, and are, for example, described in the following articles: • Agbo-Ajala O., Viriri S., Oloko-Oba M., Ekundayo O., and Heymann R., “Apparent age prediction from faces: A survey of modem approaches,” Front Big Data, vol. 5, p. 1025806, Oct. 2022. - PMC - PubMed, • Osman, O and Yap, Moi (2019) “ Computational Intelligence in Automatic Face Age Estimation: A Survey “. IEEE Transactions on Emerging Topics in Computational Intelligence, 3 (3). pp. 271-285. ISSN 2471-285X, • Angulu, R., Tapamo, JR & Adewumi, AO “Age estimation via face images: a survey”. J Image Video Proc. 2018, 42 (2018).

[0016] It is also possible to use the solution marketed by the company called “Yoti Ltd”.

[0017] Generally, age information, for example age, is determined based on facial appearance.

[0018] According to one embodiment, the image of the interior of the passenger compartment comprises a plurality of disjoint parts, each of the parts of the plurality of disjoint parts corresponding (the implementation of such a correspondence is, of course, within the reach of those skilled in the art. It can be implemented, for example, by a correspondence table, in memory) to an area of ​​a plurality of areas of the interior of the passenger compartment, and the step of determining a first area of ​​the interior of the passenger compartment comprises a step of determining a portion, among the plurality of disjoint portions, in which said face is located (for example, in which the first image is located, or alternatively, for example, in which the entire face, at least a portion or a center of the face is located), said first area (determined during the step of determining the first area) being that corresponding to said portion among the plurality of areas of the interior of the passenger compartment.

[0019] Alternatively, the first zone may be determined using presence sensors in the vehicle, for example on vehicle seats, or on seat belts, or using other cameras filming the interior of the passenger compartment.

[0020] According to one embodiment: The age information indicates that the first person is under 18 years old (in other words: is a child).

[0021] According to one embodiment: The first person is in the first zone when he (i.e.: the first person) is driving (in particular, when he is holding a steering wheel of the first vehicle) the motor vehicle (in other words: when the first person is in a driver's seat of the first vehicle), The first command inhibits a start of a propulsion engine of the motor vehicle.

[0022] According to one embodiment, the first command writes an indicator into a memory of the motor vehicle.

[0023] For example, in this embodiment, the method comprises the following steps: Upon receiving an instruction to start the motor vehicle, (for example from a start button located inside the passenger compartment of the motor vehicle,) checking whether the indicator is written (in other words; is present) or not, for example by reading the memory, then Starting the motor vehicle provided that the indicator is not written (in other words; is present) in memory (otherwise, starting the vehicle is inhibited).

[0024] Alternatively, the age indicator indicates that the first person is over 18 years old (or more generally, is an adult) and the first command may authorize a start (in other words: and the first command may command a start of the motor vehicle upon receipt of the start instruction).

[0025] According to another variant, the first control can control the vehicle in a specific manner when the age information indicates that the first person is over 40 years old or over 80 years old, for example.

[0026] According to one embodiment, the first person is in the first zone when sitting in the back seat of the motor vehicle.

[0027] In this embodiment and when the age information indicates that the first person is under 18 years old (or is under 16, 17 or 21 years old, i.e., is a child), the first command may: • Inhibit (a triggering of) an airbag, for example a side (rear) airbag, of the motor vehicle, in the event of impact detection (the first command then includes, for example, sending a command to inhibit the side airbag to the side airbag), for example to limit the risks of injury to the first person in the event of the side airbag being triggered, • Limit the volume of a sound emission (for example, from a multimedia module of the motor vehicle) inside the passenger compartment, • Control the emission of an alert signal (for example, by the multimedia module), upon detection of a cut-off of the motor vehicle's ignition, in order to avoid the risk of an adult driver forgetting the person.

[0028] For example, in this embodiment, an adult driver may be similarly detected and their presence may condition the first command.

[0029] According to one embodiment, the age information is an estimated age of the first person, for example equal to 15 years.

[0030] Alternatively, the age information is (directly) information that the first person is under 18 or over 18, or more generally that the first person belongs to an age category. The age information may, for example, in this case be equal to adult.

[0031] For example, the steps of the method may be repeated, for example at intervals of between 1 second and 30 seconds.

[0032] The invention also relates to a computer program comprising instructions executable by a microprocessor or a microcontroller or a computer, for implementing the steps of the method according to the invention, when it is executed by the microprocessor or the microcontroller or the computer.

[0033] The method according to the invention can be implemented by an electronic device (or a motor vehicle). The invention therefore also relates to an electronic device (or a motor vehicle) configured to implement the steps of the method according to the invention, as well as a motor vehicle comprising the electronic device.

[0034] The characteristics and advantages of the computer program, the electronic device, and the vehicle are identical to those of the method according to the invention (without it being necessary to repeat them here).

[0035] When the electronic device, the motor vehicle, the projection device (or another element) is “configured to” (or “capable of”) producing or implementing a step or operation, this implies, for example, that the element comprises means for carrying out the step or operation. The means preferably comprise electronic means, for example a computer program, data in memory, specialized electronic circuits, wired or wireless connections, a microprocessor and / or a microcontroller.

[0036] Other characteristics and advantages of the present invention will appear more clearly on reading the detailed description which follows, comprising embodiments of the invention given as non-limiting examples and illustrated by the appended drawings, in which: • [Fig.l] represents an electronic device and a motor vehicle, according to an embodiment of the invention, in top view, • [Fig.2] represent an image of the interior of the vehicle's passenger compartment car of [Fig.l], according to one embodiment, • [Fig.3] represents an implementation of the method according to the invention, according to an exemplary embodiment, by the electronic device and the motor vehicle of [Fig.l],

[0037] In [Fig.l], certain elements are, of course, seen through transparency, in particular the person 200 and the driver's seat 185, the rear bench seat 180 and the side airbag 190.

[0038] Detailed description of an exemplary embodiment of the invention, with reference to Figures 1 to 3.

[0039] [Fig.l] represents a motor vehicle 100. The motor vehicle 100 comprises:

[0040] A microprocessor 110 comprising a memory 111, and

[0041] An interior of a 150 cabin (and a 400 exterior), and

[0042] A steering wheel (of the vehicle) 170 and a rearview mirror (interior) 160, and

[0043] A driver's seat 185 and a bench seat (rear) 180, and

[0044] And, connected to the microprocessor 110, a camera 120 having a field angle equal to 180 degrees and located 5 centimeters from the rearview mirror 160, a motor (for propulsion of the vehicle) 130, a multimedia module 140, and a side airbag 190.

[0045] In step S00 [Fig. 3], the microprocessor 110 receives an image IGA_100, shown [Fig. 2], of the interior of the passenger compartment 150 from a camera 120 filming the interior 150 of the passenger compartment. The image IGA_100 comprises the parts AVI, AV2, AR1, AR2 and AR3.

[0046] In step S10, the microprocessor 110 extracts, in the image IGA_100 of the interior of the passenger compartment 150, an image 300 of a face 210 of a first person 200 present in the interior of the passenger compartment 150. The microprocessor can use for this one of the algorithms known to those skilled in the art, for example that described in the following article: • Zhang, Kaipeng et al. “Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks.” IEEE Signal Processing Letters 23.10 (2016): 1499-1503. Crossref. Web.

[0047] In step S30, the microprocessor 110 determines that the person 200 is a child (in other words: under 18 years old), in other words, produces information indicating that the person 200 is a child (in other words: under 18 years old). For this, the microprocessor 110 can use a solution known to those skilled in the art (for example, cited previously), for example a convolutional neural network.

[0048] In step S40, the microprocessor 110 determines that the face or image 300 is in the AV2 portion of the image IGA_100 of the interior of the passenger compartment 150.

[0049] In step S50, the microprocessor 110 determines that the portion AV2 corresponds to an area of ​​the interior of the passenger compartment 150 where a driver of the motor vehicle 100 stands when driving the motor vehicle 100, holding the steering wheel 170, and sitting on the driver's seat 185.

[0050] In step S60, the microprocessor 110 receives an instruction to start the motor vehicle 100 from a start button located inside the passenger compartment 150 of the motor vehicle 100.

[0051] In step S70, the microprocessor 110 inhibits the starting of the motor vehicle 100 to prevent a child from taking the wheel of the motor vehicle 100.

[0052] In the case where, at step S30, the microprocessor 110 determined that the person 200 is an adult instead of a child, without however steps S00 to S10 and S40 to S60 being modified, at step S70, the microprocessor 110 would command a start of the motor vehicle 100.

[0053] In the case where, at step S40, the microprocessor 110 determined that the face or image 300 is in the part AR1 of the image IGA_100, without however steps S00 to S30 being modified, at step S50, the microprocessor 110 would determine that the person 200 would be on the right of the bench 180.

[0054] At step S60, the microprocessor 100 could then: • Inhibit a triggering of the airbag 190, • Limiting the volume of a sound emission by the multimedia module 140 in the interior of the passenger compartment 150, • Control the emission of an alert signal, by the multimedia module 140, upon detection of a cut-off of the contact of the motor vehicle 100.

Claims

Claims

1. Method for controlling a motor vehicle (100) comprising a passenger compartment comprising an interior (150) characterized in that it comprises the following steps: • Reception (S00) of an image (IGA_100) of the interior of the passenger compartment (150), from a camera (120) of the motor vehicle (100), • Extraction (S 10), in the image (IGA_100) of the interior of the passenger compartment (150), of a first image (300) of a face (210) of a first person (200) present in the interior of the passenger compartment (150), • Production (S30) of age information for the first person (200), from the first image (300), • Determination (S50) of a first zone, of the interior of the passenger compartment (150), in which the first person (200), • First order (S70) of the motor vehicle (100) from the age information and the first zone.

2. Control method according to the preceding claim in which the camera (120) comprises a field angle equal to 180 degrees.

3. Control method according to any one of the preceding claims in which the production of the age information of the first person is implemented by an electronic neural network, from the first image (300).

4. A control method according to any one of the preceding claims wherein the image (IGA_100) of the interior of the passenger compartment (150) comprises a plurality of disjointed portions, each of the portions of the plurality of disjointed portions corresponding to an area of ​​a plurality of areas of the interior of the passenger compartment (150), and the step of determining a first area of ​​the interior of the passenger compartment (150) comprises a step of determining (S40) a portion (AV2, AR1), among the plurality of disjointed portions, in which the first image (300) is located, said first area being that corresponding to said portion (AV2, AR1) among the plurality of areas of the interior of the passenger compartment (150).

5. A control method according to any one of the preceding claims wherein: • The age information indicates that the first person (200) is under 18 years old.

6. Control method according to the preceding claim: • The first person (200) is in the first zone when driving the motor vehicle (100), • The first command inhibits a start of a propulsion engine (130) of the motor vehicle (100).

7. Computer program comprising instructions, executable by a microprocessor or a microcontroller, for implementing the method according to any one of claims 1 to 6, when executed by the microprocessor or the microcontroller.

8. Electronic device (110) configured to implement the steps of the method according to any one of claims 1 to 6.

9. Motor vehicle (100) comprising the electronic device (110) according to the preceding claim.

Images