Method of sending a message, implemented in a motor vehicle, device and associated motor vehicle.

A method and system in vehicles determine the presence and behavior of children alone, sending messages to address their needs, improving safety and convenience by enabling targeted responses.

FR3161833A1Pending Publication Date: 2025-10-31STELLANTIS AUTO SAS +1
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
FR2024004342
Authority / Receiving Office
FR · FR
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-04-25
Publication Date
2025-10-31

AI Technical Summary

Technical Problem

Existing systems fail to effectively communicate the presence and behavior of children alone in a vehicle to drivers or other individuals, limiting the ability to take appropriate actions.

Method used

A method and system that determines if a person in the vehicle is alone and a child using sensors and AI models, and sends a message via RF communication based on these determinations, allowing for conditional playback of audio or video recordings to address the child's behavior.

Benefits of technology

Enables informed responses to the child's behavior by drivers or others, enhancing safety and convenience through targeted communication.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

A method for sending a message, implemented in a motor vehicle (100), characterized in that it comprises the following steps: Determining that a person (141), in the passenger compartment (150) of a motor vehicle (100), is alone and determining that the person (141) is a child, and Detecting the behavior of the person (141); Sending the message, via a radio frequency communication network (300), on: Determining that the person (141) is alone and determining that the person (141) is a child, and Detecting the behavior of the person (141). Figure for the abstract: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

Title of the invention: Method for sending a message, implemented in a motor vehicle, device and associated motor vehicle.

[0001] The invention relates to motor vehicles. There is a need to offer new services to drivers (in other words: to owners) of motor vehicles in order to facilitate the use of motor vehicles.

[0002] To this end, the invention relates to a method for sending a message (in other words: a communication method or a method for communicating a message), implemented for example in a motor vehicle, characterized in that it comprises the following steps: - Determination that a person, in the passenger compartment of a motor vehicle, is alone and determination that the person is a child (i.e., a person under the age of 18, for example a child (in other words: a person) under the age of 3, 6 or 12 (and for example of an age greater than 0 years or equal to 0 years)), and - Detection of a person's behavior (in other words: mood or attitude), - Then, send the message, via a radio frequency communication network, to: • Determination that the person is alone and determination that the person is a child, and (both) • Detection of the person's behavior. In other words: Then, a message is sent via a radio frequency communication network, conditional on (both) determining that the person is alone and (both) determining that the person is a child, and (both) detecting the person's behavior. Thus, the message is not sent via the radio frequency communication network if: • It is determined that the person is not alone or that the person is not a child, or • if the person's behavior is not detected.

[0003] Thus, the driver of the vehicle or another individual, or even an electronic device, can be informed of the child's behavior when alone, and possibly take appropriate action.

[0004] The message may be addressed to a mobile phone, for example a mobile phone of the driver of the motor vehicle.

[0005] It will be clear to a person skilled in the art how to implement the step of determining that the person is alone in the passenger compartment of the motor vehicle, and that there are several approaches to this. In particular: - For motor vehicles equipped with seats containing weight sensors in their cushions, the step of determining whether a person is alone in the vehicle's passenger compartment can be implemented using data received from these weight sensors, and / or - For motor vehicles equipped with seat belt attachment (or buckle) detectors, the step of determining whether the person is alone in the vehicle's passenger compartment can be implemented using data received from these attachment detectors, and / or - The motor vehicle including a camera (capable of filming a passenger compartment of the motor vehicle) the step of determining whether the person is alone, in the passenger compartment of the motor vehicle, can be implemented from images received from the camera (for example, a neural network (or more generally, an artificial intelligence model), trained for this purpose, counts the number of people in the passenger compartment from the images or indicates whether there is a person alone or not).

[0006] Alternatively (or in combination with any or all of the three above), the motor vehicle comprising a microphone (in a passenger compartment of the motor vehicle), the step of determining whether the person is alone, in the passenger compartment of the motor vehicle, can be implemented from sounds received from the microphone (for example, a neural network, trained for this purpose, counts the number of people in the passenger compartment from the sounds or indicates whether there is a person alone or not).

[0007] It will also be clear to a person skilled in the art how to implement the step of determining whether the person is a child (i.e., a person under 18 years of age, for example, a child (in other words: a person) under 3, 6, or 12 years of age (and, for example, an age greater than 0 years or equal to 0 years)), and that there are several approaches to this. In particular: - For a motor vehicle equipped with a child seat that includes a weight sensor in its seat (or more generally, a presence sensor in the seat), the step of determining whether the person is a child can be implemented using data received from this weight sensor (or more generally, the presence sensor in the seat), and / or - A motor vehicle equipped with a camera (capable of filming the vehicle's interior) can be used to determine whether a person inside the vehicle is a child. This determination can be made using images received from the camera (for example, a neural network (or more generally, an artificial intelligence model), trained for this purpose, can indicate whether the person is a child based on the images). The following article describes, for example, such an approach: • Lee, Dong-Guw, et al. "Sequential thermal image based adult and baby detection robust to thermal residual heat marks." 2022 IEEE / RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2022.] - Alternatively (or in combination with any or all of the three above), the motor vehicle including a microphone (in a passenger compartment of the motor vehicle), the step of determining whether the person is a child, in the passenger compartment of the motor vehicle, can be implemented from sounds received from the microphone (for example, a neural network (or more generally, an artificial intelligence model), trained for this purpose, indicates whether the person is a child, from the sounds).

[0008] Other approaches are possible, such as that described in the following article, for example using radio frequency communication known as "Wifi": - Zeng, Xiaolu, et al. “WiCPD: Wireless child presence detection System for smart cars.” IEEE Internet of Things Journal 9.24 (2022): 24866-24881.

[0009] Also, it will become clear to the person skilled in the art how to implement the step of detecting the person's behavior, and that there are very different approaches to this, in particular; - In a motor vehicle equipped with a camera (capable of filming the vehicle's interior), the step of detecting the person's behavior can be implemented using images received from the camera (for example, a neural network (or more generally, an artificial intelligence model), trained for this purpose, detects the person's behavior from the images). The following article describes, for example, such an approach: • Salehin, HM Ishtiaq, et al. "Development of an loT based smart baby monitoring System with face recognition." 2021 IEEE World AI loT Congress (AIIoT). IEEE, 2021.] - Alternatively (or in combination with the above approach), if the motor vehicle is equipped with a microphone (in the vehicle's passenger compartment), the step of detecting the person's behavior can be implemented using sounds received from the microphone (for example, a network). of neurons, trained for this purpose, detects the person's behavior). The article at the following link describes, for example, such an approach: https: / / jiho-ml.com / building-sound-event-detection-model / ("Building a Sound Event Detection model for a smart home device", PARK JI HO), for example to detect laughter or crying.

[0010] Alternatively or in combination, the person's behavior can be detected from the person's movements, for example from respiratory movement, when the behavior is sleeping.

[0011] According to one embodiment, the behavior is sleeping (in other words: sleep).

[0012] As is well known, sleep can be detected from the person's breathing movements which can be detected from motion detectors (for example, an ultrasonic detector in the passenger compartment of the motor vehicle, a motion detector in the child seat, see for example the "Sleep Detection Pad" marketed by the company called "CuboAi").

[0013] Sleep can also be detected from images of the person (for example, by detecting that their eyes are closed) or from a characteristic breathing sound detected in the passenger compartment.

[0014] According to one embodiment, the behavior is crying (in other words: crying).

[0015] By way of example, various articles describing several approaches to detecting crying can be cited: - Yogita K. Dubey, Sachin Damke, “Baby Monitoring System using Image” International Journal of Engineering and Advanced Technology (IJEAT), Volume-8 Issue-6, August 2019. - Zhang, Ke, Hua-Nong Ting, and Yao-Mun Choo. “Baby cry recognition based on SLGAN model data generation and deep feature fusion.” Expert Systems with Applications 242 (2024): 122681. -Yao, Xuewen, et al. “Infant crying detection in real-world environments.” ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2022.

[0016] Crying can also be detected from characteristic images or movements.

[0017] Alternatively, the behavior is laughing, calling for his mother or father, being worried or falling asleep.

[0018] According to one embodiment, the method comprises a control for the playback of a sound recording (via a loudspeaker in the passenger compartment) and / or a visual recording (via a screen in the passenger compartment) on: - Determination that the person is alone and determination that the person is a child, and (at the same time), - Detection of the person's behavior.

[0019] In other words: the command to play back an audio and / or video recording is conditional upon determining that the person is alone and (simultaneously) that the person is a child and (simultaneously) upon detecting the person's behavior. Thus, the command to play back the audio and / or video recording is not implemented (in other words: may not be implemented) if: - It is determined that the person is not alone or that the person is not a child, or - The person's behavior is not detected.

[0020] Alternatively, no playback of a sound and / or visual recording is implemented.

[0021] For example, the message may include video images of the passenger compartment.

[0022] According to one embodiment, the process according to the invention comprises, prior to at the stage of ordering the playback of the sound recording, a stage of receiving a response to the message (thus, the message could be considered as a request), via the radio frequency communication network, the order to play back the sound and / or visual recording being conditional upon the receipt of said response.

[0023] Alternatively, the command to reproduce the sound and / or visual recording is implemented independently of a response.

[0024] The response may be received from a mobile phone, for example from the driver of the vehicle, from another individual, or from another electronic device.

[0025] According to one embodiment, the response includes an identifier of the sound and / or visual recording, and the method includes a step of selecting the sound and / or visual recording (i.e.: to be reproduced during the playback of the sound recording) from the identifier of the sound recording.

[0026] Alternatively, the sound and / or visual recording is selected from other criteria or is pre-selected.

[0027] The invention also relates to a computer program comprising instructions executable by a microprocessor or a microcontroller or a computer, to implement the steps of the process according to the invention, when executed by the microprocessor or the microcontroller or the computer.

[0028] The method according to the invention can be implemented by an electronic device (or a motor vehicle). The invention therefore also relates to an electronic device (or a motor vehicle) configured to implement the steps of the process according to the invention, as well as a motor vehicle comprising the electronic device.

[0029] The characteristics and advantages of the computer program, the electronic device, and the vehicle are identical to those of the method according to the invention (without it being necessary to repeat them here).

[0030] When the electronic device, motor vehicle, projection device (or other element) is "configured to" (or "capable of") performing or implementing a step or operation, this implies, for example, that the element includes means for performing the step or operation. These means preferably include electronic means, for example, a computer program, data in memory, specialized electronic circuits, wired or wireless connections, a microprocessor, and / or a microcontroller.

[0031] Other features and advantages of the present invention will become more apparent upon reading the following detailed description, which includes embodiments of the invention given by way of non-limiting examples and illustrated by the accompanying drawings, in which: [Fig. 1] represents an electronic device and a motor vehicle, according to an embodiment of the invention, in top view, [Fig.2] represents an implementation of the process according to the invention, according to an example of an embodiment, by the electronic device and the motor vehicle of [Fig.1].

[0032] On [Fig.1], certain elements are, of course, seen through transparency (in particular, child 141).

[0033] Detailed description of an example embodiment of the invention, with reference to figures 1 and 2.

[0034] Figure 1 represents a vehicle 100, which is a motor vehicle. The vehicle 100 comprises a passenger compartment 150, a child 141 in a seat 140 (shown schematically), and a microprocessor 110. Furthermore, the microprocessor 110 is connected to the following components of the vehicle 100: A 130 sound recording player, and a 120 camera.

[0035] With reference to [Fig.2], at step S00, the microprocessor 110 determines, from the image received from the camera 120, in a manner understandable to a person skilled in the art (for example, using an electronic neural network of the microprocessor 110) that: Child 141 is alone in the passenger compartment, and the child is crying.

[0036] At step S10, the microprocessor 110 sends, via the mobile telephone network 300, a message to the driver's mobile phone 200 vehicle 100 located outside the motor vehicle, indicating that child 141 is crying.

[0037] At step S20, the message is received by application 210 on mobile phone 200. Application 210 commands the mobile phone to display the message.

[0038] At step S30, the driver of vehicle 100 selects, via application 210 makes a sound recording. The phone 200 then sends an identifier of the sound recording to the microprocessor 110, via the mobile telephone network 300, which receives it.

[0039] At step S40, the microprocessor 110 selects the sound recording from a list (not shown) based on the sound recording identifier and commands the sound recording player 130 to play back the sound recording, via the speakers 131 and 132.

[0040] The command of the sound recording player 130 to play back the sound recording is thus conditioned on the receipt of the sound recording identifier, at step S30, by the microprocessor 110.

[0041] Alternatively, at step S10, the microprocessor 110: - Directly controls the sound recording player 130 to play back a sound recording (via the speakers 131 and 132) selected from a list of recordings stored in the memory of the microprocessor 110 or the sound recording player 130, (and / ) or - Sends images (including child 141) of the passenger compartment obtained by camera 120, to mobile phone 200, more specifically to application 210, via mobile phone network 300, which displays these images on the screen of mobile phone 200, for example, if at step S00, microprocessor 110 determines that child 141 is asleep.

[0042] The steps of the process in [Fig.2], implemented by the microprocessor 110, can for example be implemented by the computer program 111 of the microprocessor 110.

Claims

Demands

1. A method for sending a message, implemented in a motor vehicle (100), characterized in that it comprises the following steps: - Determination (S00) that a person (141), in a passenger compartment (150) of a motor vehicle (100), is alone and determination that the person (141) is a child, and - Detection of a behavior of the person (141), - Sending the message (S10), via a radio frequency communication network (300), on: • Determination that the person (141) is alone and determination that the person (141) is a child, and • Detection of the behavior of the person (141).

2. A method of sending the message according to claim 1 wherein the behavior is sleeping.

3. A method of sending the message according to claim 1 wherein the behavior is crying.

4. A method for sending the message according to any one of the preceding claims comprising a command for a playback (S40) of an audio or visual recording on: - Determination (S00) that the person (141) is alone and determination that the person (141) is a child, and - Detection of the behavior of the person (141).

5. A method for sending the message according to the preceding claim comprising, prior to the step of ordering the playback of the sound or visual recording, a step of receiving (S30) a response to the message, via the radio frequency communication network (300), the ordering the playback (S40) of the sound or visual recording being conditional upon the receipt of said response.

6. Computer program comprising instructions, executable by a microprocessor or microcontroller, for implementing the method according to any one of claims 1 to 5, when executed by the microprocessor or microcontroller.

7.

8. Electronic device (110) configured to implement the steps of the process according to any one of claims 1 to 5. Motor vehicle (100) comprising the electronic device (110) according to the preceding claim.

Citation Information

Patent Citations

  • Vehicle-mounted early warning method, vehicle-mounted intelligent monitoring equipment and storage medium

    CN112061026A

  • Method and device for protecting child inside vehicle, computer device, computer-readable storage medium, and vehicle

    US20220222949A1

  • Cabin monitoring system

    US20220242352A1

  • Child monitoring system inside a car

    US20240017730A1