METHOD AND DEVICE FOR PROTECTING A CHILD INSIDE A VEHICLE, COMPUTER DEVICE, COMPUTER-READABLE STORAGE MEDIUM AND VEHICLE
Patent Information
- Application Number
- DE602022008017
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-01-08
- Filing Date
- 2022-01-05
- Publication Date
- 2024-11-27
- Estimated Expiration
- 2042-01-05
AI Technical Summary
Children are at risk of accidents and heat-related injuries due to being left unattended in vehicles, as traditional child locks require active activation and drivers cannot easily monitor their safety, especially in the rear seat during driving.
A method and device that utilize image, voiceprint, and torso detection to classify passengers as children or adults, triggering protective measures such as sending warnings, activating child locks, maintaining comfortable temperatures, and displaying child status on in-vehicle screens, ensuring the vehicle remains stationary until authorized to start driving.
Enhances child safety by automatically detecting and responding to the presence of children in vehicles, preventing accidents and heat-related injuries through proactive warnings and safety measures, even when drivers are distracted or cannot monitor the rear seat.
Description
Technical Field
[0001] The invention relates to the technical field of automobiles, and in particular to a method and device for protecting a child inside a vehicle, a computer device, a computer-readable storage medium, and a vehicle.Background Art
[0002] Children, as a special group of vehicle occupants, have limited behavioral and cognitive abilities.
[0003] Tragedies caused by children being left in vehicles are commonly reported. A meteorological service report issued by a company of American shows that more than 800 children in the United States have died of heatstroke in vehicles since records began in 1998. Another organization concerned with child safety also released similar data. In the United States, an average of almost 38 children died of being trapped inside vehicles each year. This number of deaths reached its peak in 2018, up to 52.
[0004] A traditional child lock can often protect a child occupant only when it is actively activated by others (for example, parents). Once parents fail to activate the child lock in time, the child may open a vehicle door and suffer from an accident as a result of being unable to distinguish a possible danger.
[0005] In addition, since a child often sits in the rear seat of a vehicle, a driver cannot easily observe the state of the child. Furthermore, the driver cannot pay attention to the child during the driving of the vehicle. Devices for protecting a child in a vehicle which take such a situation into account are known from US2015 / 0379362 A2 and US2020 / 0285842 A1.
[0006] Therefore, there is a need for a vehicle control technique that can better provide protection and caring for children.Summary of the Invention
[0007] The invention is set out in the appended set of claims.
[0008] In order to solve or at least alleviate one or more of the above problems, the following technical solutions are provided.
[0009] According to the invention, a method for protecting a child inside a vehicle is provided. The method includes at least: receiving image data inside a vehicle; performing facial detection on the image data to detect passengers in the vehicle; further classifying the detected passengers in the vehicle into children and adults according to the facial detection; and performing a corresponding first protection operation when a result of the classification indicates that there is a child alone in the vehicle.
[0010] In the method for protecting a child inside a vehicle according to an embodiment of the invention, the corresponding protection operation includes: sending an early warning message to a vehicle owner, enabling an in-vehicle screen viewing function in a smart terminal of the vehicle owner, and / or maintaining the temperature in the vehicle at a comfortable sensible temperature.
[0011] The method for protecting a child inside a vehicle according to an embodiment of the invention further includes: receiving voiceprint data inside the vehicle; and performing voiceprint detection on the voiceprint data, where the operation of classification is also based on the voiceprint detection.
[0012] The method for protecting a child inside a vehicle according to an embodiment of the invention further includes: performing torso detection on the image data, where the operation of classification is also based on the torso detection, and where the torso detection includes detecting a shoulder posture and / or width.
[0013] The method for protecting a child inside a vehicle according to an embodiment of the invention further includes: receiving distance data from an in-vehicle radar; and performing living body detection on the distance data, where a non-living body is removed from the detected passengers in the vehicle according to the living body detection, and then, the operation of classification is performed.
[0014] The method for protecting a child inside a vehicle according to an embodiment of the invention further includes performing the following protection operation when the result of the classification indicates that there is a child in the vehicle: activating a child lock upon receiving a signal indicating that a vehicle is coming from behind; and / or activating the child lock during driving.
[0015] The method for protecting a child inside a vehicle according to an embodiment of the invention further includes: playing a nursery rhyme when the result of the classification indicates that there is a child in the vehicle, the facial detection indicates that the child shows a negative emotion, and the voiceprint detection indicates that the child is crying.
[0016] The method for protecting a child inside a vehicle according to an embodiment of the invention further includes performing the following protection operation when a signal indicating that the vehicle is started is received, and the image data indicates that the starting is performed by the child in the vehicle: prohibiting the vehicle from entering a driving state until an authorization is obtained from the vehicle owner; sending an early warning message to the vehicle owner; and / or enabling the in-vehicle screen viewing function in the smart terminal of the vehicle owner.
[0017] The method for protecting a child inside a vehicle according to an embodiment of the invention further includes displaying, when the vehicle is driving and the result of the classification indicates that there is a child in the vehicle, image data representative of the child in the vehicle on a display screen in the vehicle.
[0018] According to a further aspect of the invention, a computer device is provided. The computer device includes a processor and a memory. When a computer program stored on the memory is run on the processor, any one of the methods for protecting a child inside a vehicle above is implemented.
[0019] According to another aspect of the invention, a computer-readable storage medium is provided. The computer-readable storage medium has a computer program stored thereon. When the computer program is run on a processor, any one of the methods for protecting a child inside a vehicle above is implemented.
[0020] According to the invention, a device for protecting a child inside a vehicle according to claim 10 is provided. The device includes at least: a first receiving unit configured to receive image data inside a vehicle; a first detection unit configured to perform facial detection on the image data to detect passengers in the vehicle; a classification unit configured to further classify the detected passengers in the vehicle into children and adults according to the facial detection; and a protection unit configured to perform a corresponding first protection operation when a result of the classification indicates that there is a child alone in the vehicle.
[0021] In the device for protecting a child inside a vehicle according to an embodiment of the invention, the corresponding protection operation includes: sending an early warning message to a vehicle owner, enabling an in-vehicle screen viewing function in a smart terminal of the vehicle owner, and / or maintaining the temperature in the vehicle at a comfortable sensible temperature.
[0022] The device for protecting a child inside a vehicle according to an embodiment of the invention further includes: a second receiving unit configured to receive voiceprint data inside the vehicle; and a second detection unit configured to perform voiceprint detection on the voiceprint data, where the operation of classification is also based on the voiceprint detection.
[0023] The device for protecting a child inside a vehicle according to an embodiment of the invention further includes a fourth detection unit configured to perform torso detection on the image data, where the operation of classification is also based on the torso detection, and where the torso detection includes detecting a shoulder posture and / or width.
[0024] In the device for protecting a child inside a vehicle according to the invention, the protection unit is further configured to perform the following second protection operation when the result of the classification indicates that there is a child in the vehicle: activating a child lock upon receiving a signal indicating that a vehicle is coming from behind; and / or activating the child lock during driving.
[0025] In the device for protecting a child inside a vehicle according to an embodiment of the invention, the protection unit is further configured to output a signal indicating to play a nursery rhyme when the result of the classification indicates that there is a child in the vehicle, the facial detection indicates that the child shows a negative emotion, and the voiceprint detection indicates that the child is crying.
[0026] In the device for protecting a child inside a vehicle according to an embodiment of the invention, the protection unit is further configured to perform the following protection operation when a signal indicating that the vehicle is started is received, and the image data indicates that the starting is performed by the child in the vehicle: prohibiting the vehicle from entering a driving state until an authorization is obtained from the vehicle owner; sending an early warning message to the vehicle owner; and / or enabling the in-vehicle screen viewing function in the smart terminal of the vehicle owner.
[0027] In the device for protecting a child inside a vehicle according to an embodiment of the invention, the protection unit is further configured to display, when the vehicle is driving and the result of the classification indicates that there is a child in the vehicle, image data representative of the child in the vehicle on a display screen in the vehicle.
[0028] According to yet still another aspect of the invention, a vehicle is provided, which includes any one of the devices for protecting a child inside a vehicle above.Brief Description of the Drawings
[0029] The above and other objectives and advantages of the invention will be clearer and more thorough from the following detailed description in conjunction with the drawings. FIG. 1 shows a flowchart of a method 1000 for protecting a child inside a vehicle according to an embodiment of the invention. FIG. 2 shows a block diagram of a device 2000 for protecting a child inside a vehicle according to an embodiment of the invention. FIG. 3 shows a method for determining activation / deactivation of a child lock in a vehicle according to the invention Detailed Description of Embodiments
[0030] It should be understood that the term "vehicle" or other similar terms used herein includes general motor vehicles, such as passenger vehicles (including sport utility vehicles, buses, trucks, etc.), various commercial vehicles, ships, aircrafts, etc., and includes hybrid vehicles, electric vehicles, plug-in hybrid electric vehicles, etc. A hybrid vehicle is a vehicle with two or more power sources, such as a vehicle powered by a gasoline engine and an electric motor.
[0031] It should also be noted that the terms such as "first", "second", "third" and "fourth" in the description and the claims of the present invention are used to distinguish similar objects, and do not necessarily describe a specific order of precedence. In addition, the terms "comprise", "include" and similar expressions are intended to indicate non-exclusive inclusions, unless otherwise specifically stated.
[0032] Various exemplary embodiments according to the invention will be described below in detail with reference to the drawings.
[0033] FIG. 1 shows a flowchart of a method 1000 for protecting a child inside a vehicle according to an embodiment of the invention. In step S 1 10, image data inside a vehicle is received. Optionally, these pieces of image data are received from an in-vehicle image sensor.
[0034] In step S 120, facial detection is performed on the received image data to detect passengers in the vehicle. Optionally, the facial detection is performed on a single frame of image data using a processor, such as a system-on-chip, a micro processing unit, or a domain controller. Optionally, the facial detection can be performed by means of a single-stage deep learning object detection network, such as a multi-task convolutional neural network (MTCNN) and a CenterNet.
[0035] In step S 130, the detected passengers in the vehicle are further classified into children and adults according to the facial detection. Optionally, a deep learning network can be used to classify the detected facial image region into children (for example, 0-12 years old) and adults (for example, 18 years old and above). For a network design, reference may be made to, for example, an ordinal regression with multiple output CNN for Age Estimation. Children can be further subdivided into infants (0-4 years old, needing a safety seat) and average children (4-12 years old).
[0036] In step S 140, a corresponding protection operation is performed when a result of the classification indicates that there is a child alone in the vehicle (that is, in a scenario where a child is left in the vehicle). The protection operation described here is an operation, such as an environmental control operation or an early warning operation, for avoiding or at least mitigating the problem that the child is put in danger as a result of being left in the vehicle. The protection operation may include sending an early warning message to a vehicle owner. The protection operation may also include enabling an in-vehicle screen viewing function in a smart terminal of the vehicle owner, which allows a real-time screen of the child in the vehicle to be transmitted to the smart terminal of the vehicle owner, so that the vehicle owner can observe, in real time, the state of the child being left. The protection operation may also include maintaining the temperature in the vehicle at a comfortable sensible temperature (for example, 24°C-26°C), to prevent the child from suffering from an accident, such as sunstroke and frostbite, as a result of being left in the vehicle. The smart terminal is, for example, an electronic device such as a mobile phone and a tablet computer.
[0037] The method for protecting a child inside a vehicle according to an embodiment of the invention further includes receiving voiceprint data inside the vehicle, and performing voiceprint detection on the received voiceprint data. The operation of classification can also be based on a result of the voiceprint detection. For example, upon detecting, through voiceprint detection, that there is only child voiceprint data but no adult voiceprint data, it is determined that the vehicle is in the scenario where a child is left in the vehicle. The voiceprint detection and the foregoing facial detection can be combined and applied to the determination of an in-vehicle scenario.
[0038] The method for protecting a child inside a vehicle according to an embodiment of the invention further includes: receiving distance data from an in-vehicle radar, and performing living body detection on the distance data. The living body detection can filter out false facial detection. If a passenger detected by an image sensor is identified as a non-living body by the living body detection, data indicating the detected passenger is removed from passenger data to be subsequently classified. The in-vehicle radar is, for example, a millimeter-wave radar mounted at the rear of the vehicle.
[0039] The method for protecting a child inside a vehicle according to an embodiment of the invention further includes performing torso detection on the received image data. The operation of classification of children and adults can also be based on, for example, a shoulder posture and width in the torso detection, so as to filter out facial detection-based misclassifications, and correct a facial detection-based classification result. For example, when the torso is facing towards a camera, a passenger with a shoulder width less than 26 cm is generally considered to be a child, more particularly an infant under Children; and a passenger with a shoulder width greater than 34 cm is generally considered to be an adult. If a passenger is classified as a child (for example, an infant under Children) based on the facial detection, whereas it is determined through the torso detection that the passenger has a shoulder width of greater than 34 cm when facing towards the camera, the facial detection-based classification result is considered to be wrong, and should be corrected based on the torso detection.
[0040] The method for protecting a child inside a vehicle according to the invention further includes performing a protection operation when the result of the classification indicates that there is a child in the vehicle (that is, in a scenario where a child is protected against opening the door). The protection operation includes activating a child lock upon receiving a signal indicating that a vehicle is coming from behind. When the child lock is activated, the vehicle door cannot be opened directly by a switch on the door. The signal indicating that a vehicle is coming from behind may come from a vehicle control center, or directly from a vehicle rear view sensor, such as a millimeter-wave radar, a laser radar, or an image sensor. This can protect the child from opening the vehicle door and getting out of the vehicle without seeing a vehicle coming from behind, and thus putting the child in danger. The protection operation additionally or alternatively includes activating the child lock during driving. This can prevent the child from opening the door accidentally during the driving of the vehicle, and thus putting the child in danger.
[0041] Optionally, in the scenario where a child is protected against opening the door, if it is determined through the facial detection that there is a child in the vehicle and the child sits in a rear seat, a child lock for the rear seat can be activated. External and internal parameters of the camera may be used to convert the child from image coordinates to xy coordinates in a vehicle space coordinate system (where the x coordinate system is in a traveling direction of the vehicle, and the y coordinate system is on both sides, in a width direction, of the vehicle). An empirical value of the head size of the child and the size of the face imaged on the screen are used to determine whether the child sits in the rear seat. The millimeter-wave radar or a seat sensor mounted in the vehicle may also be used to determine whether the child sits in the rear seat. That is, z (depth) coordinates of the child in the vehicle space coordinate system are obtained from depth coordinates of front and rear seats.
[0042] In the scenario where a child is protected against opening the door, the state of the child lock can be adjusted in real time depending on whether there is a vehicle coming from behind. As shown in FIG. 3, data from a vehicle rear view sensor is used to determine, in real time, whether there is a vehicle approaching from behind. If there is a vehicle approaching from behind, the child lock is activated, and it is continuously monitored whether there is a vehicle coming from behind. If there is no vehicle approaching from behind, the child lock is deactivated.
[0043] The method for protecting a child inside a vehicle according to an embodiment of the invention further includes: when the result of the classification indicates that there is a child in the vehicle, the facial detection indicates that the child shows a negative emotion, and the voiceprint detection indicates that the child in the vehicle is crying (that is, in a scenario where the child is crying), automatically playing a nursery rhyme to keep the child in the vehicle stable emotionally. The nursery rhyme may be a nursery rhyme stored in local storage, or a nursery rhyme downloaded from cloud storage.
[0044] The method for protecting a child inside a vehicle according to an embodiment of the invention further includes performing a protection operation when a signal indicating that the vehicle is started is received, and the image data indicates that the starting of the vehicle is performed by the child in the vehicle (that is, in a scenario where the child is starting the vehicle). The protection operation may include prohibiting the vehicle from entering a driving state. The protection operation may also include sending an early warning message to a vehicle owner. The early warning message may be sent to the vehicle owner by means of a short message, a mobile phone application, etc. The protection operation may also include enabling an in-vehicle screen viewing function in a smart terminal of the vehicle owner. The prohibition of the vehicle entering the driving state can be released after an authorization is obtained from the vehicle owner.
[0045] The method for protecting a child inside a vehicle according to an embodiment of the invention further includes displaying, when the vehicle is driving and the result of the classification indicates that there is a child in the vehicle (that is, in a scenario where a child is paid attention to), image data representative of the children in the vehicle on a display screen in the vehicle, for example, on a center console screen in the vehicle. This may allow a user in the front seat to view the state of the child in the vehicle without turning his / her head, generally speaking, the state of the child in the rear seat. The user in the front seat may also freely zoom in and out the size of the screen. Using the image data, the voiceprint data, etc., in combination with the behavior and emotional state of the child, two modes can be intelligently switched, i.e. displaying of a child face or displaying of a child whole body, which is applicable to more scenarios for attention.
[0046] FIG. 2 shows a block diagram of a device 2000 for protecting a child inside a vehicle according to an embodiment of the invention. The device 2000 for protecting a child inside a vehicle includes a first receiving unit 210, a first detection unit 220, a classification unit 230, and a protection unit 240.
[0047] The first receiving unit 210 is configured to receive image data inside a vehicle. Optionally, these pieces of image data are received from an in-vehicle image sensor.
[0048] The first detection unit 220 is configured to perform facial detection on the received image data to detect passengers in the vehicle. Optionally, the facial detection is performed on a single frame of image data using a processor, such as a system-on-chip, a micro processing unit, or a domain controller. Optionally, the facial detection can be performed by means of a single-stage deep learning object detection network, such as a multi-task convolutional neural network (MTCNN) and a CenterNet.
[0049] The classification unit 230 is configured to further classify the detected passengers in the vehicle into children and adults according to the facial detection. Optionally, a deep learning network can be used to classify the detected facial image region into children (for example, 0-12 years old) and adults (for example, 18 years old and above). For a network design, reference may be made to, for example, an ordinal regression with multiple output CNN for Age Estimation. Children can be further subdivided into infants (0-4 years old, needing a safety seat) and average children (4-12 years old).
[0050] The protection unit 240 is configured to perform a corresponding protection operation when a result of the classification indicates that there is a child alone in the vehicle (that is, in a scenario where a child is left in the vehicle). The protection operation described here is an operation, such as an environmental control operation or an early warning operation, for avoiding or at least mitigating the problem that the child is put in danger as a result of being left in the vehicle. The protection operation may include sending an early warning message to a vehicle owner. In the context of the invention, the "vehicle owner" may be an early warning contact pre-saved in a vehicle system, or any relevant person who has contact information stored in a vehicle memory (local storage or cloud storage). The protection operation may also include enabling an in-vehicle screen viewing function in a smart terminal of the vehicle owner, which allows a real-time screen of the child in the vehicle to be transmitted to the smart terminal of the vehicle owner, so that the vehicle owner can observe, in real time, the state of the child being left. The protection operation may also include maintaining the temperature in the vehicle at a comfortable sensible temperature (for example, 24°C-26°C), to prevent the child from suffering from an accident, such as sunstroke and frostbite, as a result of being left in the vehicle. The smart terminal is, for example, an electronic device such as a mobile phone and a tablet computer.
[0051] The device for protecting a child inside a vehicle according to an embodiment of the invention further includes a second receiving unit and a second detection unit. The second receiving unit is configured to receive voiceprint data inside the vehicle. The second detection unit is configured to perform voiceprint detection on the second voiceprint data. The operation of classification can also be based on a result of the voiceprint detection. For example, upon detecting, through voiceprint detection, that there is only child voiceprint data but no adult voiceprint data, it is determined that the vehicle is in the scenario where a child is left in the vehicle. The voiceprint detection and the foregoing facial detection can be combined and applied to the determination of an in-vehicle scenario.
[0052] The device for protecting a child inside a vehicle according to an embodiment of the invention further includes a third receiving unit and a third detection unit. The third receiving unit is configured to receive distance data from an in-vehicle radar. The third detection unit is configured to perform living body detection on the distance data. The living body detection can filter out false facial detection. If a passenger detected by an image sensor is identified as a non-living body by the living body detection, data indicating the detected passenger is removed from passenger data to be subsequently classified. The in-vehicle radar is, for example, a millimeter-wave radar mounted at the rear of the vehicle.
[0053] The device for protecting a child inside a vehicle according to an embodiment of the invention further includes a fourth detection unit. The fourth detection unit is configured to perform torso detection on the received image data. The operation of classification of children and adults can also be based on, for example, a shoulder posture and width in the torso detection, so as to filter out facial detection-based misclassifications, and correct a facial detection-based classification result. For example, when the torso is facing towards a camera, a passenger with a shoulder width less than 26 cm is generally considered to be a child, more particularly an infant under Children; and a passenger with a shoulder width greater than 34 cm is generally considered to be an adult. If a passenger is classified as a child (for example, an infant under Children) based on the facial detection, whereas it is determined through the torso detection that the passenger has a shoulder width of greater than 34 cm when facing towards the camera, the facial detection-based classification result is considered to be wrong, and should be corrected based on the torso detection.
[0054] In the device for protecting a child inside a vehicle according to an embodiment of the invention, the protection unit 240 is further configured to perform a protection operation when the result of the classification indicates that there is a child in the vehicle (that is, in a scenario where a child is protected against opening the door). The protection operation includes activating a child lock upon receiving a signal indicating that a vehicle is coming from behind. When the child lock is activated, the vehicle door cannot be opened directly by a switch on the door. The signal indicating that a vehicle is coming from behind may come from a vehicle control center, or directly from a vehicle rear view sensor, such as a millimeter-wave radar, an image sensor, or a laser radar. This can protect the child from opening the vehicle door and getting out of the vehicle without seeing a vehicle coming from behind, and thus putting the child in danger. The protection operation additionally or alternatively includes activating the child lock during driving. This can prevent the child from opening the door accidentally during the driving of the vehicle, and thus putting the child in danger.
[0055] Optionally, in the scenario where a child is protected against opening the door, if it is determined through the facial detection that there is a child in the vehicle and the child sits in a rear seat, a child lock for the rear seat can be activated. External and internal parameters of the camera may be used to convert the child from image coordinates to xy coordinates in a vehicle space coordinate system (where the x coordinate system is in a traveling direction of the vehicle, and the y coordinate system is on both sides, in a width direction, of the vehicle). An empirical value of the head size of the child and the size of the face imaged on the screen are used to determine whether the child sits in the rear seat. The millimeter-wave radar or a seat sensor mounted in the vehicle may also be used to determine whether the child sits in the rear seat. That is, z (depth) coordinates of the child in the vehicle space coordinate system are obtained from depth coordinates of front and rear seats.
[0056] In the scenario where a child is protected against opening the door, the state of the child lock can be adjusted in real time depending on whether there is a vehicle coming from behind. As shown in FIG. 3, data from a vehicle rear view sensor is used to determine, in real time, whether there is a vehicle approaching from behind. If there is a vehicle approaching from behind, the child lock is activated, and it is continuously monitored whether there is a vehicle coming from behind. If there is no vehicle approaching from behind, the child lock is deactivated.
[0057] In the device for protecting a child inside a vehicle according to an embodiment of the invention, the protection unit 240 is further configured to: when the result of the classification indicates that there is a child in the vehicle, the facial detection indicates that the child shows a negative emotion, and the voiceprint detection indicates that the child in the vehicle is crying (that is, in a scenario where the child is crying), automatically play a nursery rhyme to keep the child in the vehicle stable emotionally. The nursery rhyme may be a nursery rhyme stored in local storage, or a nursery rhyme downloaded from cloud storage.
[0058] In the device for protecting a child inside a vehicle according to an embodiment of the invention, the protection unit 240 is further configured to perform a protection operation when a signal indicating that the vehicle is started is received, and the image data indicates that the starting of the vehicle is performed by the child in the vehicle (that is, in a scenario where the child is starting the vehicle). The protection operation may include prohibiting the vehicle from entering a driving state. The protection operation may also include sending an early warning message to a vehicle owner. The early warning message may be sent to the vehicle owner by means of a short message, a mobile phone application, etc. The protection operation may also include enabling an in-vehicle screen viewing function in a smart terminal of the vehicle owner. The prohibition of the vehicle entering the driving state can be released after an authorization is obtained from the vehicle owner.
[0059] In the device for protecting a child inside a vehicle according to an embodiment of the invention, the protection unit 240 is further configured to display, when the vehicle is driving and the result of the classification indicates that there is a child in the vehicle (that is, in a scenario where a child is paid attention to), image data representative of the children in the vehicle on a display screen in the vehicle, for example, on a center console screen in the vehicle. This may allow a user in the front seat to view the state of the child in the vehicle without turning his / her head, generally speaking, the state of the child in the rear seat. The user in the front seat may also freely zoom in and out the size of the screen. Using the image data, the voiceprint data, etc., in combination with the behavior and emotional state of the child, two modes can be intelligently switched, i.e. displaying of a child face or displaying of a child whole body, which is applicable to more scenarios for attention.
[0060] In conclusion, by means of the technique for protecting a child inside a vehicle provided in the invention, the received sensor data is used to perform detection associated with the child, and then, different protection and caring operations are provided in different scenarios related to the child in the vehicle according to detection results. This greatly improves the safety and experience of children in a vehicle.
[0061] Some block diagrams shown in FIG. 2 are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities may be implemented in the form of software, in one or more hardware modules or integrated circuits, or in different networks and / or processor apparatuses and / or micro-controller apparatuses.
[0062] It should be understood that the method for protecting a child inside a vehicle according to the foregoing embodiments of the invention can be implemented as a computer program product. Therefore, the invention may, for example, take the form of a computer program product implemented on one or more computer-available storage media (including but not limited to a magnetic disk memory, an optical memory, etc.) containing computer-available program code therein.
[0063] It should also be understood that the device for protecting a child inside a vehicle according to the foregoing embodiments of the invention can be incorporated into a vehicle.
[0064] It should also be understood that in some alternative embodiments, the functions / steps included in the method may not occur in the order shown in the flowchart. For example, two functions / steps shown in sequence may be executed substantially simultaneously or even in a reverse order. This specifically depends on the functions / steps involved.
[0065] Although only some implementations of the invention are described above, a person of ordinary skill in the art should understand that the invention may be implemented in multiple forms without departing from the scope of the appended claims. Accordingly, the presented examples and implementations are considered to be illustrative rather than restrictive, and the invention may encompass various modifications and replacements without departing from the scope of the appended claims.
Claims
1. A method (1000) for protecting a child inside a vehicle, comprising: receiving image data inside a vehicle (S 110); performing facial detection on the image data to detect passengers in the vehicle (S120); further classifying the detected passengers in the vehicle into children and adults according to the facial detection (S130); characterized by further comprising: performing a corresponding first protection operation when a result of the classification indicates that there is a child alone in the vehicle (S140); and performing the following second protection operation when the result of the classification indicates that there is a child in the vehicle: activating a child lock upon receiving a signal indicating that a vehicle is coming from behind; and / or activating the child lock during driving.
2. The method (1000) for protecting a child inside a vehicle according to claim 1, wherein the first protection operation comprises: sending an early warning message to a vehicle owner, enabling an in-vehicle screen viewing function in a smart terminal of the vehicle owner, and / or maintaining the temperature in the vehicle at a comfortable sensible temperature.
3. The method (1000) for protecting a child inside a vehicle according to claim 1 or 2, <b>characterized by further comprising: receiving voiceprint data inside the vehicle; and performing voiceprint detection on the voiceprint data, wherein the operation of classification is also based on the voiceprint detection.
4. The method (1000) for protecting a child inside a vehicle according to any one of the preceding claims, characterized by further comprising: performing torso detection on the image data, wherein the operation of classification is also based on the torso detection, and wherein the torso detection comprises detecting a shoulder posture and / or width.
5. The method (1000) for protecting a child inside a vehicle according to claim 3 or 4 when dependent on claim 3, characterized by further comprising: playing a nursery rhyme when the result of the classification indicates that there is a child in the vehicle, the facial detection indicates that the child shows a negative emotion, and the voiceprint detection indicates that the child is crying.
6. The method (1000) for protecting a child inside a vehicle according to any one of the preceding claims, <b>characterized by further comprising: performing the following third protection operation when a signal indicating that the vehicle is started is received, and the image data indicates that the starting is performed by the child in the vehicle: prohibiting the vehicle from entering a driving state until an authorization is obtained from the vehicle owner; sending an early warning message to the vehicle owner; and / or enabling the in-vehicle screen viewing function in the smart terminal of the vehicle owner.
7. The method (1000) for protecting a child inside a vehicle according to any one of the preceding claims, characterized by further comprising: displaying, when the vehicle is driving and the result of the classification indicates that there is a child in the vehicle, image data representative of the child in the vehicle on a display screen in the vehicle.
8. A computer device, comprising a processor and a memory, characterized in that when a computer program stored on the memory is run on the processor, the method for protecting a child inside a vehicle of any one of claims 1 to 8 is implemented.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that when the computer program is run on a processor, the method for protecting a child inside a vehicle of any one of claims 1 to 7 is implemented.
10. A device (2000) for protecting a child inside a vehicle, comprising: a first receiving unit (210) configured to receive image data inside a vehicle; a first detection unit (220) configured to perform facial detection on the image data to detect passengers in the vehicle; a classification unit (230) configured to further classify the detected passengers in the vehicle into children and adults according to the facial detection; and characterized by further comprising: a protection unit (240) configured to: perform a corresponding first protection operation when a result of the classification indicates that there is a child alone in the vehicle; and perform the following second protection operation when the result of the classification indicates that there is a child in the vehicle: activating a child lock upon receiving a signal indicating that a vehicle is coming from behind; and / or activating the child lock during driving.
11. The device (2000) for protecting a child inside a vehicle according to claim 10, <b>characterized by further comprising: a second receiving unit configured to receive voiceprint data inside the vehicle; and a second detection unit configured to perform voiceprint detection on the voiceprint data, wherein the operation of classification is also based on the voiceprint detection.
12. A vehicle, characterized by comprising: the computer device of claim 8 or the device for protecting a child inside a vehicle of claim 10 or 11.
