In-vehicle streaming media rearview mirror, in-vehicle child detection method and vehicle

Abstract

The present application provides a vehicle-mounted streaming media rearview mirror, a method for detecting children left behind in a vehicle, and a vehicle. The vehicle-mounted streaming media rearview mirror includes a liveness detection module and a processor. The liveness detection module performs liveness detection in the vehicle, obtains liveness features corresponding to one or more objects in the vehicle, and determines whether each object is a child user based on the liveness features corresponding to each object. While reducing the installation cost of the liveness detection module, it can accurately detect whether there is a child user left behind in the vehicle. When it is determined that each object includes a child user but does not include an adult user, the processor sends a warning signal to the vehicle-mounted control terminal, instructing the vehicle-mounted control terminal to execute a warning operation. When the vehicle-mounted control terminal detects that a child user is left behind in the vehicle, it can execute a warning operation to ensure the safety of the child user in the vehicle.

Description

Technical Field

[0001] The present application relates to the field of intelligent vehicle technology, and in particular to a vehicle-mounted streaming media rearview mirror, a method for detecting children left behind in a vehicle, a vehicle and electronic equipment. Background Art

[0002] When a car is closed, the internal environment of the car may be affected by factors such as high temperature, making it unsuitable for people to stay for a long time. If someone is left inside a closed car, the people inside the car may be in danger, especially when children are left inside the car. Due to their limited mobility, they are more likely to be in danger. Therefore, how to accurately detect the presence of children left in the car has become a technical problem that needs to be solved urgently. Summary of the invention

[0003] The embodiments of the present application disclose a vehicle-mounted streaming media rearview mirror, a method for detecting children left behind in a vehicle, a vehicle and electronic equipment, which can accurately detect children left behind in a vehicle, protect the safety of children, and reduce the difficulty and cost of setting up a liveness detection module.

[0004] According to a first aspect of an embodiment of the present application, there is provided a vehicle-mounted streaming media rearview mirror, comprising:

[0005] a liveness detection module, configured to perform liveness detection in the vehicle, obtain liveness features corresponding to one or more objects in the vehicle, and determine whether each of the objects is a child user according to the liveness features corresponding to each of the objects, and send a first signal to the processor when it is determined that the one or more objects include a child user but do not include an adult user;

[0006] The processor is communicatively connected to the liveness detection module, and is used to receive the first signal and send an early warning signal to the vehicle-mounted control terminal, wherein the early warning signal is used to instruct the vehicle-mounted control terminal to perform an early warning operation, and the early warning operation is used to prompt that a child user is left in the vehicle.

[0007] In the embodiment of the present application, a liveness detection module integrated in the vehicle-mounted streaming media rearview mirror is used to perform liveness detection, and liveness features corresponding to one or more objects in the vehicle are obtained. Based on the liveness features corresponding to each object, it is determined whether each object is a child user. The liveness detection module can accurately detect each object in the vehicle. When it is detected that each object includes a child user but not an adult user, the processor in the vehicle-mounted streaming media rearview mirror sends an early warning signal to the vehicle-mounted control terminal, and the vehicle-mounted control terminal performs an early warning operation. When a child user left in the vehicle is detected, a warning prompt can be issued in time to ensure the safety of the child user in the vehicle. Moreover, the liveness detection module is integrated in the vehicle-mounted streaming media rearview mirror, which can reduce the difficulty and cost of setting up the liveness detection module.

[0008] In some possible embodiments, the liveness detection module is further configured to stop performing the liveness detection and send a second signal to the processor when it is determined that the one or more objects include an adult user;

[0009] The processor is further configured to, after sending the warning signal to the vehicle-mounted control terminal, if receiving the second signal, stop sending the warning signal to the vehicle-mounted control terminal in response to the second signal.

[0010] In this embodiment, when the liveness detection module detects that various objects in the car include adult users, it stops performing liveness detection, and can stop detection in time after confirming that there are no child users or other living beings such as pets left in the car, thereby reducing energy consumption; when it is detected that various objects in the car include adult users, the processor stops sending warning signals to the vehicle-mounted control terminal, so that the vehicle-mounted control terminal can stop the warning operation in time after confirming that there are no child users or other living beings such as pets left in the car, thereby improving the flexibility and accuracy of executing the warning operation.

[0011] In some possible embodiments, the liveness detection module is also used to receive a door status signal and a door lock status signal. If the door status signal indicates that the door is closed and the door lock status signal indicates that the door is locked, liveness detection is immediately performed on the vehicle; if the door status signal indicates that the door is closed and the door lock status signal indicates that the door is not locked, liveness detection is performed on the vehicle after waiting for a first period of time.

[0012] In this embodiment, the liveness detection module can flexibly adjust the liveness detection method according to the door status signal and the door lock status signal, which can not only take into account the detection of children left in the car, but also reduce energy consumption to meet the needs of different scenarios.

[0013] In some possible embodiments, the liveness detection module is also used to perform liveness detection in the vehicle within a second time period after waiting for a first time period if the door status signal indicates that the door is closed and the door lock status signal indicates that the door is not locked; if the detection result of the liveness detection performed within the second time period is that the one or more objects include child users but do not include adult users, a first signal is sent to the processor.

[0014] In this embodiment, in a scenario where the vehicle door is closed but not locked, the liveness detection module may perform liveness detection in the vehicle within a second period of time after waiting for a first period of time, and determine whether to issue an early warning based on the liveness detection results within the second period of time. This allows a warning to be issued even if the vehicle door is not locked but a child user is left in the vehicle for a long time, thereby further improving the safety of child users in the vehicle.

[0015] In some possible embodiments, the processor is further configured to, upon receiving a cancel warning signal sent by the vehicle-mounted control terminal, send a stop detection signal to the living body detection module and stop sending the warning signal to the vehicle-mounted control terminal;

[0016] The living body detection module is further used to receive the stop detection signal and stop performing the living body detection according to the stop detection signal.

[0017] In this embodiment, the vehicle control terminal can send a cancellation warning signal to the processor of the vehicle streaming media rearview mirror. After receiving the cancellation warning signal, the processor sends a stop detection signal to the liveness detection module, so that the liveness detection module stops performing liveness detection. The liveness detection can be temporarily stopped according to the needs of the car owner. By setting the cancellation warning mode, the liveness detection module can perform liveness detection more flexibly according to the actual situation, meeting the needs of users in different application scenarios.

[0018] In some possible embodiments, the liveness detection module is further configured to, if receiving the stop detection signal, stop performing the liveness detection and wait for a third period of time before re-performing the liveness detection on the vehicle.

[0019] In this embodiment, in the warning cancellation mode, the liveness detection module stops performing liveness detection after receiving a stop detection signal, and re-performs liveness detection after waiting for a third period of time. This can prevent the liveness detection from being stopped for too long in the warning cancellation mode and failing to detect the child user left in the car in time, resulting in the child user being left in the car for too long, thereby ensuring the safety of the child user.

[0020] In some possible embodiments, the liveness detection module is also used to perform liveness detection in the vehicle if it is currently in a delayed warning mode, after the received door status signal indicates that the door is closed and the received door lock status signal indicates that the door is locked and waits for a delay period.

[0021] In this embodiment, the liveness detection module performs liveness detection in the delayed warning mode after the vehicle is locked and the waiting delay period has elapsed. The liveness detection module can delay liveness detection of objects in the vehicle when the owner temporarily leaves the vehicle according to the owner's needs, thereby better meeting the needs of users in different scenarios, avoiding false alarms, and reducing the energy consumption generated by the liveness detection module.

[0022] In some possible embodiments, the processor is further configured to send a first warning signal to the vehicle control terminal according to the first signal, wherein the first warning signal is used to instruct the vehicle control terminal to perform a first warning operation; if the upgraded warning condition is met, a second warning signal is sent to the vehicle control terminal, wherein the second warning signal is used to instruct the vehicle control terminal to perform a second warning operation;

[0023] The warning effect of the second warning operation is greater than the warning effect of the first warning operation.

[0024] In this embodiment, the processor can trigger the vehicle-mounted control terminal to execute a second warning operation with a stronger warning effect when the upgraded warning conditions are met, thereby further ensuring the safety of child users in the vehicle.

[0025] According to a second aspect of an embodiment of the present application, a method for detecting children left behind in a vehicle is provided, which is applied to a vehicle-mounted streaming media rearview mirror, wherein the vehicle-mounted streaming media rearview mirror includes a liveness detection module, and the method includes:

[0026] Performing liveness detection in the vehicle through the liveness detection module to obtain liveness features corresponding to one or more objects in the vehicle, and determining whether each of the objects is a child user according to the liveness features corresponding to each of the objects;

[0027] When it is determined that the one or more objects include child users but not adult users, a warning signal is sent to the vehicle-mounted control terminal, wherein the warning signal is used to instruct the vehicle-mounted control terminal to perform a warning operation, wherein the warning operation is used to prompt that a child user is left in the vehicle.

[0028] In this embodiment, liveness detection is performed in the vehicle through the liveness detection module in the vehicle-mounted streaming media rearview mirror to obtain liveness features corresponding to one or more objects in the vehicle, and whether each object is a child user is determined based on the liveness features corresponding to each object. When it is determined that one or more objects include child users but not adult users, an early warning signal is sent to the vehicle-mounted control terminal to instruct the vehicle-mounted control terminal to perform an early warning operation to prompt that a child user is left behind in the vehicle. It can accurately detect whether a child user is left behind in the vehicle, and when it is detected that a child user is left behind in the vehicle, a warning prompt can be issued in time to ensure the safety of children in the vehicle. The liveness detection module is integrated in the vehicle-mounted streaming media rearview mirror, which can reduce the difficulty and cost of setting up the liveness detection module.

[0029] In some possible embodiments, the method further includes:

[0030] When it is determined that the one or more objects include an adult user, the liveness detection module is controlled to stop performing liveness detection and stop sending the warning signal to the vehicle-mounted control terminal.

[0031] In this embodiment, when the liveness detection module determines that all objects in the car include adult users, the liveness detection module stops performing liveness detection, and the vehicle-mounted control terminal can stop executing the warning operation when it detects that there are no missing child users or other living things such as pets in the car, thereby improving the flexibility and accuracy of executing the warning operation.

[0032] In some possible embodiments, before performing liveness detection in the vehicle by the liveness detection module, the method further includes:

[0033] Receiving a door status signal and a door lock status signal through the living body detection module;

[0034] The performing liveness detection in the vehicle by using the liveness detection module includes:

[0035] If the door status signal indicates that the door is closed and the door lock status signal indicates that the door is locked, immediately performing a liveness detection on the vehicle through the liveness detection module;

[0036] If the door status signal indicates that the door is closed and the door lock status signal indicates that the door is not locked, then after waiting for a first period of time, liveness detection is performed on the vehicle through the liveness detection module.

[0037] In this embodiment, the liveness detection module performs liveness detection after receiving the door status signal and the door lock status signal, and can flexibly adjust the detection method of liveness detection according to the door status signal and the door lock status signal, which can not only take into account the detection of children left in the car, but also reduce energy consumption, thereby meeting the needs of different scenarios.

[0038] In some possible embodiments, after waiting for the first period of time, performing liveness detection on the vehicle by the liveness detection module includes:

[0039] After waiting for a first period of time, performing liveness detection on the vehicle by the liveness detection module for a second period of time;

[0040] The sending of a warning signal to the vehicle-mounted control terminal when it is determined that the one or more objects include a child user but do not include an adult user includes:

[0041] If the detection result of the liveness detection performed within the second time period is that the one or more objects include child users but do not include adult users, the warning signal is sent to the vehicle-mounted control terminal.

[0042] In this embodiment, after waiting for a first period of time through the liveness detection module, a liveness detection is performed in the vehicle within a second period of time, and the detection results of the liveness detection within the second period of time are combined to determine whether to issue an early warning. In a scenario where the door is closed but not locked, the detection results of the liveness detection within the second period of time are combined to determine whether to issue an early warning. Even if the door is not locked, but a child user is left in the car for a long time, an early warning will still be issued, further improving the safety of child users in the car.

[0043] In some possible embodiments, when it is determined that the one or more objects include a child user but do not include an adult user, sending a warning signal to the vehicle-mounted control terminal includes:

[0044] When it is detected for the first time that the one or more objects include a child user but do not include an adult user, sending a first warning signal to the vehicle control terminal, wherein the first warning signal is used to instruct the vehicle control terminal to perform a first warning operation;

[0045] If the upgraded warning conditions are met, a second warning signal is sent to the vehicle-mounted control terminal. The second warning signal is used to instruct the vehicle-mounted control terminal to perform a second warning operation. The second warning signal is used to instruct the vehicle-mounted control terminal to perform a second warning operation; the warning effect of the second warning operation is greater than the warning effect of the first warning operation.

[0046] In this implementation, when the upgraded warning conditions are met, the vehicle-mounted control terminal can execute a second warning operation with a stronger warning effect to further ensure the safety of child users in the vehicle.

[0047] According to a third aspect of an embodiment of the present application, a vehicle is provided, the vehicle comprising a vehicle-mounted streaming media rearview mirror and a vehicle-mounted control terminal, the vehicle-mounted streaming media rearview mirror comprising a living body detection module;

[0048] The vehicle-mounted streaming media rearview mirror is used to perform liveness detection in the vehicle through the liveness detection module to obtain liveness features corresponding to one or more objects in the vehicle, and send a warning signal to the vehicle-mounted control terminal when it is determined according to the liveness features corresponding to each of the objects that the one or more objects include a child user but do not include an adult user;

[0049] The vehicle-mounted control terminal is used to receive the warning signal and perform a warning operation according to the warning signal, wherein the warning operation is used to prompt the user that a child is left behind in the vehicle.

[0050] In this embodiment, a vehicle is provided, which includes a vehicle-mounted streaming media rearview mirror and a vehicle-mounted control terminal that are communicatively connected. The vehicle-mounted streaming media rearview mirror is integrated with a liveness detection module, which can perform liveness detection on one or more objects in the vehicle to determine whether each object is a child user, and send a warning signal to the vehicle-mounted control terminal when it is determined that the one or more objects include child users but do not include adult users. The vehicle-mounted control terminal performs a warning operation according to the warning signal to prompt that a child user is left in the vehicle. The vehicle can accurately detect whether a child user is left in the vehicle, and when it is detected that a child user is left in the vehicle, it can issue a warning prompt in time to ensure the safety of children in the vehicle. The liveness detection module is integrated in the vehicle-mounted streaming media rearview mirror, which can reduce the difficulty and cost of setting up the liveness detection module.

[0051] According to a fourth aspect of an embodiment of the present application, an electronic device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor implements the method in the above embodiment. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0053] Figure 1 A schematic diagram of an application scenario of a method for detecting children left behind in a vehicle in an embodiment;

[0054] Figure 2A is a structural block diagram of a vehicle-mounted streaming media rearview mirror in one embodiment;

[0055] Figure 2B It is a structural block diagram of a vehicle-mounted streaming media rearview mirror in another embodiment;

[0056] Figure 3 It is a structural block diagram of a vehicle-mounted streaming media rearview mirror in another embodiment;

[0057] Figure 4 is a flow chart of a method for detecting children left behind in a vehicle in one embodiment;

[0058] Figure 5 A flowchart of triggering a liveness detection module to perform liveness detection in one embodiment;

[0059] Figure 6 A flowchart of sending an early warning signal to a vehicle-mounted control terminal in one embodiment;

[0060] Figure 7 is a structural block diagram of a vehicle in one embodiment;

[0061] Figure 8 FIG. 4 is a structural block diagram of an electronic device in an embodiment. DETAILED DESCRIPTION

[0062] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0063] It should be noted that the terms "including" and "having" and any variations thereof in the embodiments of the present application and the accompanying drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device including a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices.

[0064] It will be understood that the term "plurality" used in this application refers to two or more.

[0065] See also Figure 1 , Figure 1 FIG. 1 is a schematic diagram of an application scenario of a method for detecting children left behind in a vehicle in an embodiment. Figure 1 As shown, the vehicle 100 includes a vehicle-mounted streaming media rearview mirror 110 and a vehicle-mounted control terminal (not shown), and the vehicle-mounted streaming media rearview mirror 110 and the vehicle-mounted control terminal are communicatively connected.

[0066] The vehicle-mounted streaming media rearview mirror 110 is an electronic rearview mirror. The vehicle-mounted streaming media rearview mirror 110 may include a display screen and may be connected to a camera for communication. The camera may be used to capture images, and the vehicle-mounted streaming media rearview mirror 110 may play the video stream captured by the camera in real time through the display screen. For example, the camera may capture images of the rear view of the vehicle, and the vehicle-mounted streaming media rearview mirror 110 may play the images of the rear view of the vehicle captured by the camera in real time through the display screen. Furthermore, the vehicle-mounted streaming media rearview mirror may include a video channel, and the camera is used to capture images. The images captured by the camera are transmitted to the video channel, and after being processed by the video channel, the images of the rear view of the vehicle captured in real time are finally displayed on the display screen of the vehicle-mounted streaming media rearview mirror.

[0067] The vehicle-mounted control terminal usually refers to the intelligent device integrated in the car. Optionally, the vehicle-mounted control terminal may include the body control module (BCM) and the vehicle-mounted networking terminal (Telematics Box, T-BOX). BCM is an electronic control unit responsible for controlling and managing the vehicle's body electrical systems, such as the lighting system, door and window system, seat system, air conditioning system, audio system and anti-theft system. T-BOX is an in-vehicle networking device that can connect the vehicle to the cloud, the vehicle to other terminal devices through mobile communication technology, Bluetooth, WIFI and other functions to realize information interaction between the vehicle and the outside world. Through the vehicle-mounted control terminal in the vehicle, various functions such as remote control and remote communication of the vehicle, vehicle condition monitoring, fault diagnosis, navigation, safety monitoring, etc. can be realized.

[0068] The vehicle-mounted streaming media rearview mirror 110 is connected to the vehicle-mounted control terminal through the vehicle's controller area network (CAN). Through the CAN bus, the vehicle-mounted streaming media rearview mirror 110 and the vehicle-mounted control terminal can share data in real time and achieve mutual connection and communication.

[0069] In an embodiment of the present application, the vehicle-mounted streaming media rearview mirror 110 may be integrated with a liveness detection module and connected to the processor of the vehicle-mounted streaming media rearview mirror 110. The liveness detection module can perform liveness detection in the vehicle. Through the liveness detection, the liveness characteristics corresponding to one or more objects in the vehicle can be obtained. According to the liveness characteristics of each object, it is determined whether the object is an adult user, a child user, or other living being (such as a pet).

[0070] It should be noted that in the embodiments of the present application, adult users refer to older users who have certain self-rescue capabilities when facing danger, and child users refer to young users who have weaker self-rescue capabilities when facing danger and find it difficult to ensure their own safety.

[0071] Liveness detection refers to the process of detecting the vital signs of an object and obtaining the corresponding detection data. The obtained detection data can be used as liveness features. The liveness detection module analyzes the acquired liveness features, and then determines whether the object that collected the liveness features is an adult user or a child user based on the analysis results. The liveness detection module analyzes the liveness features corresponding to all objects in the vehicle in turn to determine whether each object in the vehicle is a child user.

[0072] A variety of liveness detection methods can be used to detect objects in the vehicle, including one or more of image detection, thermal imaging detection, and breathing detection. Image detection is to capture an image containing an object through a camera, and obtain the liveness features corresponding to the object according to the image. The liveness features may include facial features, body proportions, etc. of the object. Thermal imaging detection is to collect an infrared image containing an object through an infrared camera, and determine the liveness features corresponding to the object according to the infrared image. The liveness features may include the heat distribution of the object's body, etc. Breathing detection is to detect the breathing of the object by transmitting a radar signal and receiving a reflected signal, and obtain the liveness features corresponding to the object according to the received signal. The liveness features may include one or more of the breathing frequency, heartbeat, pulse, movement, etc. of the object. The liveness detection module may send a first signal to the processor when it is determined that one or more objects in the vehicle include a child user but not an adult user. After receiving the first signal, the processor may respond to the first signal and send an early warning signal to the vehicle control terminal to instruct the vehicle control terminal to perform an early warning operation to prompt that a child user is left in the vehicle.

[0073] See also Figure 2A , Figure 2A 2 is a structural block diagram of a vehicle-mounted streaming media rearview mirror in an embodiment. The vehicle-mounted streaming media rearview mirror 200 includes a living body detection module 210 and a processor 220 .

[0074] The liveness detection module 210 may perform liveness detection in the vehicle, obtain liveness features corresponding to one or more objects in the vehicle, and determine whether each object is a child user according to the liveness features corresponding to each object, and send a first signal to the processor when it is determined that the one or more objects include a child user but do not include an adult user;

[0075] The processor 220 can receive the first signal, and in response to the first signal, send a warning signal to the vehicle-mounted control terminal, where the warning signal is used to instruct the vehicle-mounted control terminal to perform a warning operation, where the warning operation is used to prompt the user that a child is left in the vehicle.

[0076] See also Figure 2B , Figure 2B FIG. 2 is a block diagram of a vehicle-mounted streaming media rearview mirror in an embodiment. In addition to a liveness detection module 210 and a processor 220, the vehicle-mounted streaming media rearview mirror 200 also includes a display screen 230, a video processing module 240, and a power supply 250. The video processing module 240, the processor 220, the display screen 230, etc. in the vehicle-mounted streaming media rearview mirror 200 can form a video path, which can be used to process the digital video signal collected by the camera to obtain a video image, and the processor 220 controls the display screen 230 to display the video image.

[0077] The processor 220 may also receive data transmitted from other devices and process the data, and may also generate and output control signals according to the received data to control the operation of the corresponding device. The processor 220 may include but is not limited to a microprocessor (Microcontroller Unit, MCU), a central processing unit (Central Processing Unit, CPU), etc.

[0078] Exemplarily, the video processing module 240 may include a deserializer, which can convert the digital video signal collected by the camera module from a serial data stream back into a parallel data stream, and transmit the parallel data stream to the processor 220 so as to display the video image on the display screen 230.

[0079] In some embodiments, the vehicle-mounted streaming media rearview mirror may also include an on-screen display module (On Screen Display, OSD), which can be used to overlay information such as text, graphics, and images on the display screen 230, so that the display screen 230 can display status information (such as vehicle speed, time, temperature, etc.) or other information needed during vehicle driving while displaying video images.

[0080] The liveness detection module 210 is used to perform liveness detection in the vehicle, obtain liveness features corresponding to one or more objects in the vehicle, and determine whether each object is a child user based on the liveness features corresponding to each object. When it is determined that one or more objects include child users but do not include adult users, a first signal is sent to the processor.

[0081] In some embodiments, the liveness detection module 210 may include a controller and a detection unit, and the controller may include but is not limited to an MCU, a CPU, etc. The detection unit may be used to detect liveness features corresponding to objects in the vehicle. Taking the liveness detection module 210 using breathing detection as an example, the detection unit may include an antenna, which may transmit a wireless signal and receive a reflected wireless signal, and the breathing frequency of the object may be detected based on the reflected wireless signal. Taking the liveness detection module 210 using thermal imaging as an example, the detection unit may include an infrared camera, which may send an infrared signal and collect an infrared image containing the object, and obtain the thermal distribution of the object's body based on the infrared image.

[0082] The living body features corresponding to users of different age groups are different. Therefore, the living body detection module 210 can identify the age group corresponding to the user object through the detected living body features, thereby determining whether there is a child user in the car.

[0083] Exemplarily, the liveness detection performed by the liveness detection module is breathing detection. The breathing frequency of child users is different from that of adult users, and the breathing frequency of child users is higher than that of adult users. Therefore, by detecting the breathing frequency of each object in the car, it can be determined whether each object is a child user or an adult user.

[0084] Exemplarily, the liveness detection module can perform breathing detection through a radar composed of a detection unit. The detection unit may include an antenna, which may be set on a protrusion on the vehicle-mounted streaming media rearview mirror for transmitting and receiving wireless signals. The detection unit transmits signals to each object in the car and receives reflected signals. The controller calculates the breathing frequency of each object in the car based on the reflected signals. The breathing frequency of child users is higher than that of adult users. If the breathing frequency corresponding to an object is higher than the frequency threshold, the object is a child user. If the breathing frequency corresponding to an object is lower than the frequency threshold, the object is an adult user. Therefore, it can be determined whether each object is a child user based on the breathing frequency of each object.

[0085] In some embodiments, the detection unit may transmit a signal to each object in the vehicle, and the controller may determine the breathing cycle of each object according to the reflected signal, and determine whether each object is a child user according to the breathing cycle of each object. Specifically, the controller may pre-process the reflected signal of each object, extract the breathing features in the reflected signal of each object, analyze the breathing features of each object, obtain the breathing cycle of each object, determine whether the breathing cycle of each object belongs to the breathing cycle range corresponding to the child user, and determine that the current object is a child user when the breathing cycle of the current object belongs to the breathing cycle range corresponding to the child user.

[0086] Optionally, depending on the transmitted signal, the radar for breathing detection may include a UWB radar or a millimeter wave radar.

[0087] Exemplarily, when the radar for breathing detection is a UWB radar, the antenna may transmit an ultra-wideband signal.

[0088] Exemplarily, when the radar for breathing detection is a millimeter wave radar, the antenna can emit high frequency band signals.

[0089] It should be noted that the processor is in a low-power sleep mode when it is not working. When the processor needs to work, it needs to wake up the processor first. After the processor is awakened and initialized, it can start working. When the liveness detection module determines that one or more objects in the car include child users but not adult users, it first sends a wake-up signal to the processor to wake up the processor. After the processor is awakened and initialized, the liveness detection module sends a first signal to the processor.

[0090] In the embodiment of the present application, the first signal may include liveness detection results or warning information of various objects in the car, etc., which may indicate that the objects in the car include child users but not adult users.

[0091] The processor 220 is used to receive the first signal, and in response to the first signal, send a warning signal to the vehicle control terminal, the warning signal is used to instruct the vehicle control terminal to perform a warning operation, and the warning operation is used to prompt a child user left in the vehicle.

[0092] After receiving the first signal, the processor 220 sends a warning signal to the vehicle control terminal. After receiving the warning signal, the vehicle control terminal performs a warning operation according to the warning signal to prompt that a child user is left in the vehicle. Optionally, the warning operation can be to control the vehicle to perform a warning, for example, the vehicle can be controlled to perform operations such as honking, flashing lights, and voice broadcasting. Optionally, the warning operation can also be to send warning information to the terminal device of the owner, such as a warning text message, a warning voice (such as sending a warning voice by calling the owner's phone), etc., to prompt the owner or people around the vehicle that a child user is left in the vehicle.

[0093] It should be noted that in the embodiment of the present application, the vehicle owner refers to an adult user who can control the closing or opening of the door of the current vehicle and has a certain mobility to control the vehicle status, and is not necessarily the actual owner of the vehicle.

[0094] In the embodiment of the present application, the first signal may include a liveness detection result of each object in the vehicle or a warning information, etc., which may indicate that the objects in the vehicle include a child user but not an adult user. After receiving the first signal, the processor sends a warning signal to the vehicle control terminal. After receiving the warning signal, the vehicle control terminal performs a warning operation according to the warning signal to prompt that a child user is left in the vehicle.

[0095] It should be noted that the vehicle-mounted streaming media rearview mirror and the vehicle-mounted control terminal can be connected through the vehicle's bus communication, the processor can send a warning signal to the vehicle-mounted control terminal through the bus, and the vehicle-mounted control terminal can send a signal to the processor through the bus.

[0096] It should be noted that if a warning signal is sent to the vehicle control terminal, the vehicle control terminal will execute the warning operation when it receives the warning signal; if the warning signal is stopped from being sent to the vehicle control terminal, the vehicle control terminal will not execute the warning operation when it does not receive the warning signal.

[0097] Optionally, the warning operation may be to control the vehicle to give a warning, for example, the vehicle may be controlled to honk, flash lights, and perform voice broadcasting, etc. Optionally, the warning operation may also be to send a warning message to the vehicle owner's terminal device, such as a warning text message, a warning voice (such as sending a warning voice by calling the vehicle owner's phone), etc., to remind the vehicle owner or people around the vehicle that a child user is left in the vehicle.

[0098] The vehicle-mounted streaming media rearview mirror may also include an independent power supply module (not shown), which supplies power to the liveness detection module and the processor separately, so that the liveness detection module and the processor can continue to work when the vehicle is turned off (or shut down).

[0099] In the embodiment of the present application, the liveness detection module obtains liveness features corresponding to one or more objects in the vehicle by performing liveness detection in the vehicle, and determines whether each object in the vehicle is a child user based on the liveness features corresponding to each object, so as to accurately detect children left behind in the vehicle, and the liveness detection module is integrated in the vehicle rearview mirror, which reduces the difficulty and cost of setting. When the liveness detection module detects that one or more objects include child users but not adult users, the processor sends a first signal to the processor, and after receiving the first signal, the processor sends an early warning signal to the vehicle control terminal, so that the vehicle control terminal performs an early warning operation. When the vehicle control terminal detects that a child user is left behind in the vehicle, it can promptly perform an early warning operation to ensure the safety of the child user.

[0100] In some embodiments, various objects within the vehicle may include adult users.

[0101] The liveness detection module 210 may be configured to stop liveness detection and send a second signal to the processor when it is determined that one or more objects include an adult user.

[0102] The processor 220 is used for, after sending the warning signal to the vehicle-mounted control terminal, if a second signal is received, then in response to the second signal, stopping sending the warning signal to the vehicle-mounted control terminal.

[0103] It should be noted that the liveness detection module detects that various objects in the car include adult users, which is equivalent to the liveness detection module detecting that there are no child users left in the car.

[0104] In some embodiments, the liveness detection module detecting that there is no child user left in the car may also include the liveness detection module detecting that there is no user in the car, that is, an empty car.

[0105] Optionally, the liveness detection module can detect that there is no child user left in the car during the first liveness detection, or the liveness detection module can detect that there is no child user left in the car when the on-board control terminal performs a warning operation after sending a first signal to the processor.

[0106] For example, if the liveness detection module detects that there is no child user left in the vehicle during the first liveness detection, the liveness detection is stopped and a second signal is sent to the processor. The processor receives the second signal, and since the processor does not send an early warning signal to the vehicle control terminal at this time, the processor does not need to stop sending an early warning signal to the vehicle control terminal, and the vehicle control terminal does not perform an early warning operation.

[0107] For example, if the liveness detection module detects that there is no child user left in the vehicle after sending the first signal to the processor, the liveness detection is stopped and a second signal is sent to the processor. The processor receives the second signal and stops sending the warning signal to the vehicle control terminal. The vehicle control terminal does not receive the warning signal and stops the warning operation.

[0108] In an embodiment of the present application, when the liveness detection module detects that there is no child left behind in the car, it stops performing liveness detection to reduce energy consumption; when it is confirmed that there is no child user left behind in the car, the processor stops sending warning signals to the vehicle-mounted control terminal. The vehicle-mounted control terminal can stop executing the warning operation in time when it is confirmed that there is no child user left behind in the car, thereby improving the accuracy and flexibility of executing the warning operation.

[0109] In some embodiments, the liveness detection module 210 is turned on after receiving the door status signal and the door lock status signal sent by the vehicle control terminal to perform liveness detection in the vehicle.

[0110] The liveness detection module 210 is used to receive a door status signal and a door lock status signal. If the door status signal indicates that the door is closed and the door lock status signal indicates that the door is locked, liveness detection is immediately performed in the vehicle; if the door status signal indicates that the door is closed and the door lock status signal indicates that the door is not locked, liveness detection is performed in the vehicle after waiting for a first period of time.

[0111] If the door is closed but not locked, the owner may have left the vehicle for a short time. The liveness detection module 210 can confirm that the owner has left the vehicle for a long time or has left the vehicle for a short time based on the liveness detection results of liveness detection performed over a period of time.

[0112] It should be noted that when the door is closed, the vehicle-mounted control terminal can transmit the door status signal and the door lock status signal through the bus to inform other devices in the vehicle that the door status has changed, and the liveness detection module can receive the door status signal and the door lock status signal through the bus.

[0113] The liveness detection module 210 is used for performing liveness detection in the vehicle within a second time period after waiting for a first time period when the door status signal indicates that the door is closed and the door lock status signal indicates that the door is not locked; if the detection result of the liveness detection performed within the second time period is that one or more objects include child users but do not include adult users, a first signal is sent to the processor.

[0114] In the above embodiment, in the scenario where the vehicle door is closed but not locked, the liveness detection module can perform liveness detection in the vehicle within a second period of time after waiting for a first period of time, and determine whether to issue an early warning based on the detection results of the liveness detection within the second period of time. This allows a warning to be issued even if the vehicle door is not locked but a child user is left in the vehicle for a long time, thereby further improving the safety of child users in the vehicle.

[0115] In an embodiment of the present application, the liveness detection module can flexibly adjust the liveness detection method according to the door status signal and the door lock status signal, which can not only take into account the detection of children left in the car, but also reduce energy consumption to meet the needs of different scenarios.

[0116] In some embodiments, when the owner leaves the vehicle for a short time, if the vehicle-mounted control terminal performs a warning operation, the owner can trigger the vehicle's warning cancellation mechanism, and the vehicle-mounted control terminal sends a warning cancellation signal to the processor.

[0117] The processor 220 is further configured to send a stop detection signal to the living body detection module and stop sending the warning signal to the vehicle-mounted control terminal after receiving the cancel warning signal sent by the vehicle-mounted control terminal.

[0118] The living body detection module 210 is further configured to receive a stop detection signal and stop performing living body detection according to the stop detection signal.

[0119] It should be noted that the cancellation warning mechanism can be triggered by the vehicle owner's terminal device or when the door state changes to the open state when the vehicle control terminal performs the warning operation. When the vehicle owner temporarily leaves the vehicle and the vehicle control terminal performs the warning operation, the vehicle owner can set the cancellation warning on the terminal device, and the terminal device sends the cancellation warning information to the vehicle control terminal, so that the vehicle control terminal sends the cancellation warning signal, and the vehicle temporarily stops the liveness detection and temporarily stops the warning; when the vehicle owner temporarily leaves the vehicle and the vehicle control terminal performs the warning operation, the door can be opened, and the door changes to the open state, so that the vehicle control terminal sends the cancellation warning signal, and the vehicle temporarily stops the liveness detection and temporarily stops the warning. Among them, the vehicle owner can set the cancellation warning on the terminal device only when he is close to the vehicle.

[0120] For example, if the owner is within 5 meters of the vehicle, the owner can set the cancel warning on the mobile phone to cancel the vehicle's ongoing warning.

[0121] The living body detection module 210 is further configured to, if the stop detection signal is received, stop performing the living body detection and wait for a third period of time before re-performing the living body detection on the vehicle.

[0122] In the above embodiment, when the warning is canceled, the liveness detection module stops performing liveness detection and waits for a third period of time before performing liveness detection again. This can prevent the liveness detection from being stopped for too long in the warning cancellation mode and failing to detect the child user left in the car in time, resulting in the child user being left in the car for too long, thereby ensuring the safety of the child user.

[0123] In an embodiment of the present application, if the vehicle's warning cancellation mechanism is triggered, the vehicle-mounted control terminal sends a warning cancellation signal to the processor. After receiving the warning cancellation signal, the processor sends a detection stop signal to the liveness detection module and stops sending warning signals to the vehicle-mounted control terminal. The vehicle can stop the warning and liveness detection in time when the warning cancellation state is in place. When the owner leaves the vehicle for a short period of time, the vehicle-mounted control terminal can suspend the warning in time, thereby ensuring the safety of child users while better meeting user needs.

[0124] In some embodiments, when the owner leaves the vehicle for a short period of time, the owner can trigger the vehicle delay warning mechanism.

[0125] The liveness detection module 210 is also used to perform liveness detection in the vehicle if it is currently in the delayed warning mode, after the received door status signal indicates that the door is closed and the received door lock status signal indicates that the door is locked and waits for a delay period.

[0126] It should be noted that the delay warning is triggered by a delay operation before the door is closed, and the delay operation may include a trigger operation performed by the owner on a pre-set terminal device. For example, the delay operation may be the owner clicking a delay warning button on his or her mobile phone screen or the owner clicking a delay operation button on the vehicle-mounted streaming media rearview mirror.

[0127] Each time before the door is closed, the owner can perform a delay operation, and after the door is closed, the owner cannot perform a delay operation. To ensure the safety of child users in the car and prevent the child users from being left in the car for too long, the delay time is always less than the second time threshold.

[0128] Optionally, when the delay duration is less than the second time threshold, the delay duration can be set by the vehicle owner according to needs.

[0129] For example, the second time threshold may be 10 minutes. If the delay time is less than 10 minutes, the owner may set the delay time to 5 minutes. Within 5 minutes after the door is closed, the liveness detection module does not perform liveness detection. After waiting for 5 minutes, the liveness detection module performs liveness detection on each object in the car.

[0130] In an embodiment of the present application, the car owner triggers the delayed warning mechanism, and the liveness detection module can wait for the delay period before performing liveness detection on each object in the car. The liveness detection module can delay the liveness detection of objects in the car when the car owner temporarily leaves the vehicle according to the needs of the car owner, thereby better meeting the needs of users in different scenarios and reducing the energy consumption generated by the liveness detection module.

[0131] In some embodiments, the processor 220 is also used to send a first warning signal to the vehicle-mounted control terminal based on the first signal, and the first warning signal is used to instruct the vehicle-mounted control terminal to perform a first warning operation; if the upgraded warning conditions are met, a second warning signal is sent to the vehicle-mounted control terminal, and the second warning signal is used to instruct the vehicle-mounted control terminal to perform a second warning operation, and the warning effect of the second warning operation is greater than the warning effect of the first warning operation.

[0132] In an embodiment of the present application, the vehicle-mounted control terminal can execute a second warning operation with a stronger warning effect when the upgraded warning conditions are met, thereby further ensuring the safety of child users in the vehicle.

[0133] See also Figure 3 , Figure 3 FIG. 1 is a schematic diagram showing the connection between each functional module in a vehicle-mounted streaming media rearview mirror, a camera and a vehicle-mounted control terminal in an embodiment. Figure 3 As shown, the vehicle-mounted streaming media rearview mirror includes: a processor 310, a living body detection module 320, a power chip 330, a display screen 340, a deserializer 350 and a screen display unit 360, and the figure also includes a camera 370 and a vehicle-mounted control terminal 380.

[0134] like Figure 3 As shown, the power chip 330 is respectively connected to the processor 310, the living body detection module 320, the display screen 340, the deserializer 350 and the vehicle control terminal 380 to provide support for the operation of the above-mentioned units.

[0135] The processor 310 is respectively connected to the liveness detection module 320, the display screen 340, the deserializer 350, and the screen display unit 360 in a two-way communication manner. Through the above communication connections, the processor 310 can receive data or signals from the liveness detection module 320, the display screen 340, the deserializer 350, and the screen display unit 360 respectively; the processor 310 can process the received data, generate a corresponding control signal, and send a control signal or control instruction to the corresponding module through the above communication connection to control the operation of the corresponding module.

[0136] The communication connection between different modules can be realized through pins. It should be noted that different pins have different functions.

[0137] The processor 310 is connected to the liveness detection module 320 through multiple pins. The processor 310 is connected to the liveness detection module 320 through a serial peripheral interface (SPI) pin, an interrupt (INT) pin, and a reset signal (RESET) pin. The liveness detection module 320 can transmit the liveness detection result to the processor 310 through the SPI pin, and can wake up the processor 310 through the INT pin; the processor 310 can reset the liveness detection module 320 through the RESET pin to eliminate the fault.

[0138] The processor 310 is connected to the display screen 340 via a general-purpose input / output pin (GPIO). The processor 310 can quickly transmit data to the display screen 340 via the GPIO, so that the display screen 340 can display a corresponding image.

[0139] The processor 310 is connected to the vehicle-mounted control terminal 380 via a CAN bus. The processor 310 can send an early warning signal to the vehicle-mounted control terminal 380 via the CAN bus, and the vehicle-mounted control terminal performs an early warning operation according to the early warning signal transmitted from the CAN bus.

[0140] The deserializer 350 is connected to the camera 370. The camera can transmit the captured image to the deserializer 350 processor. The deserializer 350 transmits the processed image to the processor 310. The processor 310 obtains the image captured by the camera through the above connection path, and the image is transmitted to the display screen 340 for display after processing.

[0141] The deserializer 350 is also connected to the screen display unit 360. The deserializer 350 can transmit the processed image to the screen display unit 360. The screen display unit 360 superimposes additional information on the received image and then transmits it to the processor. The processor processes the received information through an image processing algorithm and then transmits it to the display screen 340, so that the display screen 340 can display the image with the corresponding information superimposed.

[0142] See also Figure 4 , Figure 4 The flowchart of a method for detecting a child left behind in a vehicle in one embodiment is as follows. The method may include the following steps:

[0143] Step 410: Perform liveness detection in the vehicle through a liveness detection module to obtain liveness features corresponding to one or more objects in the vehicle.

[0144] Step 420 , judging whether each object is a child user according to the living body characteristics corresponding to each object, if so, executing step 430 , if not, executing step 440 .

[0145] In the embodiment of the present application, the liveness detection module is used to detect whether all objects in the car are child users. If so, it means that there is a child user left in the car and the vehicle needs to issue an early warning; if not, it means that there is no child user left in the car and liveness detection of objects in the vehicle can be stopped.

[0146] Step 430, when it is determined that one or more objects include child users but not adult users, a warning signal is sent to the vehicle control terminal, the warning signal is used to instruct the vehicle control terminal to perform a warning operation, and the warning operation is used to prompt that a child user is left in the vehicle.

[0147] Execute step 410 again.

[0148] Step 440: When it is determined that the one or more objects include an adult user, the liveness detection module is controlled to stop performing liveness detection and stop sending a warning signal to the vehicle-mounted control terminal.

[0149] In an embodiment of the present application, if it is determined that one or more objects in the vehicle include a child user but no adult user, the vehicle needs to issue an early warning to indicate that a child user is left in the vehicle.

[0150] In some embodiments, the vehicle control terminal may perform a warning operation including a vehicle body warning and a communication warning. The vehicle body warning refers to an audible and visual warning, which alerts people relatively close to the vehicle to the fact that a child user is left in the vehicle. The audible and visual warning may include but is not limited to: controlling the flashing of vehicle lights, controlling the vehicle horn, and controlling the vehicle voice prompts; the communication warning refers to communicating with a pre-set contact to remind the user that a child user is left in the vehicle. The contact may include the owner, emergency contact, or guardian and other relevant adult users. The communication method includes sending a mobile phone application warning message, sending a warning text message, or making a warning call.

[0151] Optionally, the vehicle body warning may be performed periodically. For example, after receiving the warning signal, the vehicle body warning is performed within a fourth time period, after the fourth time period, the vehicle body warning is stopped and waits for a fifth time period, after the fifth time period, the vehicle body warning is performed again, and the above process is repeated.

[0152] Exemplarily, after receiving the warning signal, the vehicle-mounted control terminal may issue an audible and visual warning for 3 seconds, then wait for 4 seconds and then continue to issue an audible and visual warning for 3 seconds again, repeating the above process until the vehicle warning status is manually intervened, and the intervention means include but are not limited to, such as the car door being opened.

[0153] Optionally, the pre-set contacts may include one or more. In the case of including multiple pre-set contacts, a priority may be set for each contact, and communication warnings may be issued to each contact in descending order of priority.

[0154] Exemplarily, when making an early warning call, the early warning call is first made to the contact with the highest priority. If the early warning call of the contact with the highest priority is not answered, the early warning call is made to the contact with the second highest priority.

[0155] In some embodiments, the vehicle-mounted control terminal includes a BCM and a T-BOX. A warning signal is sent to the BCM for vehicle body warning, and the BCM performs a vehicle body warning operation to control the vehicle lighting system or the vehicle audio system for sound and light warning. A warning signal is sent to the T-BOX for communication warning, and the T-BOX performs a communication warning operation to communicate with a pre-set contact.

[0156] Step 340: When it is determined that one or more objects include an adult user, the liveness detection module is controlled to stop performing liveness detection and stop sending a warning signal to the vehicle-mounted control terminal.

[0157] In an embodiment of the present application, if it is determined that one or more objects in the vehicle include adult users, and there are no child users left in the vehicle, the liveness detection module can be controlled to stop liveness detection. If a warning signal has been sent to the vehicle-mounted control terminal, it means that the child user and / or other living beings such as pets left in the vehicle are now accompanied by adult users, and the vehicle does not need to issue a warning again. In this case, the warning signal is stopped from being sent to the vehicle-mounted control terminal, and the vehicle stops issuing a warning.

[0158] In an embodiment of the present application, the liveness detection module in the vehicle-mounted streaming media rearview mirror can perform liveness detection in the vehicle, obtain liveness features corresponding to one or more objects in the vehicle, and determine whether each object is a child user based on the liveness features corresponding to each object; the vehicle-mounted control terminal can decide whether to perform an early warning operation based on the result of the liveness detection. If a child user is left in the vehicle, the vehicle can be controlled to issue an early warning to ensure the safety of the child user; the vehicle-mounted control terminal can stop executing the early warning operation when there are adult users in the vehicle, thereby improving the flexibility and accuracy of the vehicle-mounted control terminal in executing the early warning operation.

[0159] See also Figure 5 , Figure 5 This is a flow chart of triggering a liveness detection module to perform liveness detection in an embodiment. The above method may further include the following steps:

[0160] Step 510: Receive a door status signal and a door lock status signal through a living body detection module.

[0161] If the door status signal indicates that the door is closed and the door lock status signal indicates that the door is locked, step 520 is executed. If the door status signal indicates that the door is closed and the door lock status signal indicates that the door is unlocked, step 530 is executed.

[0162] Step 520: If the door status signal indicates that the door is closed and the door lock status signal indicates that the door is locked, immediately perform a liveness detection on the vehicle through the liveness detection module.

[0163] Step 530: If the door status signal indicates that the door is closed and the door lock status signal indicates that the door is not locked, then after waiting for a first period of time, a liveness detection module is used to perform liveness detection on the inside of the vehicle.

[0164] If the door status signal indicates that the door is closed and the door lock status signal indicates that the door is not locked, the vehicle is in a closed state but the door is not locked, and the owner may leave the vehicle for a short time. In this case, liveness detection can be performed on each object in the vehicle after waiting for the first period of time.

[0165] In some embodiments, if the door status signal indicates that the door is closed and the door lock status signal indicates that the door is not locked, then after waiting for a first period of time, a liveness detection module performs liveness detection on the vehicle within a second period of time.

[0166] Exemplarily, if the door status signal indicates that the door is closed and the door lock status signal indicates that the door is not locked, then after waiting for 2 minutes, the liveness detection module performs liveness detection on the vehicle within 8 minutes.

[0167] In some embodiments, if the detection results of the liveness detection performed within the second time period are that one or more objects include a child user but do not include an adult user, a warning signal is sent to the vehicle-mounted control terminal.

[0168] Through the above implementation, the liveness detection module performs liveness detection on the vehicle for a second period of time after waiting for a first period of time. In a scenario where the door is closed but not locked, the liveness detection result within the second period of time can be combined to determine whether to issue an early warning. Even if the door is not locked, if a child user is left in the car for a long time, an early warning will still be issued, further improving the safety of child users in the car.

[0169] It should be noted that in order to avoid long waiting time or long liveness detection time resulting in failure to timely detect child users left in the car and issue an early warning, the sum of the first time duration and the second time duration shall not exceed 10 minutes.

[0170] In an embodiment of the present application, a door status signal and a door lock status signal are received by a liveness detection module, and liveness detection is performed based on the door status signal and the door lock status signal, so that the liveness detection module can flexibly adjust the detection method of liveness detection based on the door status signal and the door lock status signal, which can not only take into account the detection of children left in the car, but also reduce energy consumption, thereby meeting the needs in different scenarios.

[0171] In some embodiments, if the vehicle-mounted control terminal performs a warning operation, the vehicle owner can trigger the vehicle's warning cancellation mechanism to stop the liveness detection module from performing liveness detection and to stop the vehicle-mounted control terminal from performing the warning operation.

[0172] In some embodiments, after the vehicle-mounted control terminal cancels the warning, if the liveness detection module receives a stop detection signal, it stops performing liveness detection and waits for a third period of time before performing liveness detection in the vehicle again.

[0173] Exemplarily, if the third time length is 90 seconds, then 90 seconds after entering the warning cancellation state, the liveness detection module may perform liveness detection on the vehicle again.

[0174] It should be noted that the third duration is always smaller than the first time threshold. The first time threshold indicates that the third duration is shorter.

[0175] Exemplarily, the first time threshold is 90 seconds, and the third time length is always less than 90 seconds.

[0176] In some embodiments, if the vehicle control terminal performs a warning operation, the vehicle owner can trigger the vehicle's delayed warning mechanism, causing the liveness detection module to wait for the delay time before performing liveness detection.

[0177] See also Figure 6 , Figure 6 The flowchart of sending a warning signal to a vehicle-mounted control terminal in one embodiment is shown in FIG. 1 . The step of sending a warning signal to a vehicle-mounted control terminal may include the following steps:

[0178] Step 610: When it is first detected that one or more objects include a child user but not an adult user, a first warning signal is sent to the vehicle control terminal, where the first warning signal is used to instruct the vehicle control terminal to perform a first warning operation.

[0179] In the embodiment of the present application, the warning signal may include a first warning signal and a second warning signal, and the vehicle-mounted control terminal performs a first warning operation after receiving the first warning signal. The first warning operation may include an acoustic and visual warning, and the acoustic and visual warning may include a sound warning and a light warning. The sound warning may include controlling the vehicle to honk or controlling the vehicle voice system to prompt a warning, and the light warning may include controlling the vehicle lights to flash for warning.

[0180] Optionally, when the vehicle-mounted control terminal executes the first warning operation, it can be executed on a periodic basis.

[0181] For example, the vehicle control terminal may repeatedly perform periodic warning operations by controlling the vehicle to continuously honk the horn and flash the lights for 3 seconds and wait for 5 seconds as one cycle.

[0182] Step 620: If the upgraded warning conditions are met, a second warning signal is sent to the vehicle-mounted control terminal. The second warning signal is used to instruct the vehicle-mounted control terminal to perform a second warning operation. The second warning signal is used to instruct the vehicle-mounted control terminal to perform a second warning operation; the warning effect of the second warning operation is greater than the warning effect of the first warning operation.

[0183] In an embodiment of the present application, if the upgraded warning conditions are met, the vehicle-mounted control terminal performs a second warning operation after receiving the second warning signal, and the vehicle may perform a second warning. The warning effect of the second warning is greater than the warning effect of the first warning, to indicate that the child user in the current vehicle has been left behind for a long time or the safety situation of the child user in the current vehicle is more urgent. The second warning operation may include a sound warning, a light warning, and a communication warning, wherein the sound warning may include controlling the vehicle to honk or the vehicle voice system to prompt, the light warning may include controlling the vehicle to flash lights, and the communication warning may include sending text messages or making phone calls to pre-set contacts. When the vehicle-mounted control terminal performs the second warning operation, the duration of the vehicle's horn, voice system prompt, or light flashing may be greater than the duration of the vehicle's horn, voice system prompt, or light flashing during the first warning.

[0184] In some embodiments, the upgraded warning condition may include the vehicle-mounted control terminal executing the first warning operation for a fourth time period. Under this condition, the child user is left in the vehicle for a long time, and the child user in the vehicle may face a greater safety risk. In this case, the vehicle needs to perform a second warning to indicate that a child user is left in the vehicle and the child user is left in the vehicle for a long time.

[0185] In some embodiments, the upgraded warning condition may include that after the vehicle enters the warning cancellation state and waits for a third period of time, when the liveness detection module performs liveness detection in the vehicle again, the liveness detection result shows that a child user is left in the vehicle. Under this condition, after the warning is cancelled, no adult user enters the vehicle to accompany the child user who is left behind, and the child user is left in the vehicle for a long time, and the vehicle must issue a second warning.

[0186] In some embodiments, the upgraded warning condition may include that the vehicle enters the delayed warning state and after waiting for the delay time, the liveness detection module performs liveness detection on the vehicle again, and the liveness detection result shows that a child user is left in the vehicle. Under this condition, after the delay time, the time when the child user is left in the vehicle is greater than or equal to the delay time, and the child user is left in the vehicle for a long time, the vehicle must issue a second warning.

[0187] In an embodiment of the present application, when the upgraded warning conditions are met, the vehicle-mounted control terminal executes a second warning operation with a stronger warning effect. When a child user is left in the vehicle for too long, the probability of the child user being noticed by people around the vehicle and the owner is increased, thereby further ensuring the safety of the child user.

[0188] In some embodiments, if a child user is left in the vehicle, the owner may remotely intervene in the vehicle to reduce the safety risks faced by the child if intervention conditions are met.

[0189] Among them, the intervention conditions may include one of the following: the time the child user is left in the car is greater than or equal to a fourth time period, the time the vehicle-mounted control terminal performs the first warning operation is greater than or equal to a fifth time period, or the temperature inside the vehicle is not within a preset temperature threshold.

[0190] Exemplarily, the fourth time duration may be 10 minutes, the fifth time duration may be 5 minutes, and the temperature threshold may be 10°C to 35°C.

[0191] For example, the vehicle owner's remote intervention in the vehicle operation may include controlling the sunroof or glass window of the vehicle to open so that the vehicle is no longer closed; or controlling the air conditioner to turn on and adjust the temperature of the vehicle environment to within a temperature threshold. The intervention operation can make the environment of the child user left in the vehicle more comfortable and safe, thereby ensuring the safety of the child user.

[0192] Through the above implementation, when the vehicle owner is far away from the child user left behind or the internal environment of the vehicle poses a great danger to the child user left behind, the environment in which the child user is located can be adjusted more quickly, further ensuring the safety of the child user.

[0193] See also Figure 7 , Figure 7 FIG. 1 is a structural block diagram of a vehicle in one embodiment. Figure 7 As shown, the vehicle 700 includes a vehicle-mounted streaming media rearview mirror 710 and a vehicle-mounted control terminal 720 .

[0194] The vehicle-mounted streaming media rearview mirror 710 is used to perform liveness detection in the vehicle through a liveness detection module, obtain liveness features corresponding to one or more objects in the vehicle, and send a warning signal to the vehicle-mounted control terminal when it is determined based on the liveness features corresponding to each object that one or more objects include child users but do not include adult users.

[0195] The vehicle-mounted control terminal 720 is used to receive the warning signal and perform a warning operation according to the warning signal, wherein the warning operation is used to remind the user that a child is left behind in the vehicle.

[0196] In some embodiments, the vehicle-mounted streaming media rearview mirror 710 is also used to stop performing liveness detection when it is determined that one or more objects include adult users, and to stop sending a warning signal to the vehicle-mounted control terminal after sending a warning signal to the vehicle-mounted control terminal.

[0197] In some embodiments, the vehicle-mounted streaming media rearview mirror 710 is also used to receive a door status signal and a door lock status signal. If the door status signal indicates that the door is closed and the door lock status signal indicates that the door is locked, a liveness detection is immediately performed in the vehicle; if the door status signal indicates that the door is closed and the door lock status signal indicates that the door is not locked, a liveness detection is performed in the vehicle after waiting for a first period of time.

[0198] In some embodiments, the vehicle-mounted streaming media rearview mirror 710 is also used to perform liveness detection in the vehicle within a second period of time after waiting for a first period of time if the door status signal indicates that the door is closed and the door lock status signal indicates that the door is not locked; if the detection results of the liveness detection performed within the second period of time are that one or more objects include child users but do not include adult users, a warning signal is sent to the vehicle-mounted control terminal.

[0199] In some embodiments, the vehicle-mounted control terminal 720 is also used to send a cancellation warning signal to the vehicle-mounted streaming media rearview mirror.

[0200] The vehicle-mounted streaming media rearview mirror 710 is also used to stop performing liveness detection and stop sending warning signals to the vehicle-mounted control terminal after receiving a cancellation warning signal sent by the vehicle-mounted control terminal.

[0201] In some embodiments, the vehicle-mounted streaming media rearview mirror 710 is also used to, if a stop detection signal is received, stop performing liveness detection and wait for a third period of time, and then re-perform liveness detection in the vehicle.

[0202] In some embodiments, the vehicle-mounted control terminal 720 is also used to send a delay warning signal to the vehicle-mounted streaming media rearview mirror.

[0203] The vehicle-mounted streaming media rearview mirror 710 is also used to perform liveness detection in the vehicle if it is currently in the delayed warning mode, after the received door status signal indicates that the door is closed and the received door lock status signal indicates that the door is locked and waits for the delay period.

[0204] In some embodiments, the vehicle-mounted streaming media rearview mirror 710 is also used to send a first warning signal to the vehicle-mounted control terminal. If the upgraded warning conditions are met, a second warning signal is sent to the vehicle-mounted control terminal.

[0205] The vehicle-mounted control terminal 720 is also used to receive a first warning signal and perform a first warning operation according to the first warning signal; or, to receive a second warning signal and perform a second warning operation according to the second warning signal; wherein the warning effect of the second warning operation is greater than the warning effect of the first warning operation.

[0206] In an embodiment of the present application, liveness detection is performed on the vehicle through a liveness detection module integrated in the vehicle-mounted streaming media rearview mirror to obtain liveness features corresponding to one or more objects in the vehicle, and whether each object is a child user is determined based on the liveness features corresponding to each object. When it is determined that one or more objects include child users but do not include adult users, an early warning signal is sent to the vehicle-mounted control terminal to instruct the vehicle-mounted control terminal to perform an early warning operation to prompt that a child user is left in the vehicle. The liveness detection module integrated in the vehicle-mounted streaming media rearview mirror can be used to perform liveness detection on objects in the vehicle, and while reducing the installation cost of the liveness detection module, it can accurately detect whether a child user is left in the vehicle, and when it is detected that a child user is left in the vehicle, a warning prompt can be issued in time.

[0207] See also Figure 8 , Figure 8 FIG. 1 is a structural block diagram of an electronic device in an embodiment. Figure 8 As shown, the electronic device 800 may include one or more of the following components: a processor 810, and a memory 820 coupled to the processor 810, wherein the memory 820 may store one or more computer programs, and the one or more computer programs may be configured to implement the methods described in the above embodiments when executed by one or more processors 810.

[0208] The processor 810 may include one or more processing cores. The processor 810 uses various interfaces and lines to connect various parts of the entire electronic device 800, and executes various functions and processes data of the electronic device 800 by running or executing instructions, programs, code sets or instruction sets stored in the memory 820, and calling data stored in the memory 820. Optionally, the processor 810 can be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). The processor 810 can integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 810, but may be implemented separately through a communication chip.

[0209] The memory 820 may include a random access memory (RAM) or a read-only memory (ROM). The memory 820 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 820 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc. The data storage area may also store data created by the electronic device 800 during use, etc.

[0210] It is understandable that the electronic device 800 may include more or fewer structural elements than those in the above structural block diagram, for example, a power module, a speaker, a Bluetooth module, a sensor, etc., and this is not limited here.

[0211] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The storage medium can be a disk, an optical disk, a ROM, etc.

[0212] As used herein, any reference to memory, storage, database, or other medium may include nonvolatile and / or volatile memory. Suitable nonvolatile memory may include ROM, programmable ROM (Programmable ROM, PROM), erasable PROM (Erasable PROM, EPROM), electrically erasable PROM (Electrically Erasable PROM, EEPROM), or flash memory. Volatile memory may include random access memory (random access memory, RAM), which is used as an external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as static RAM (Static RAM, SRAM), dynamic RAM (Dynamic Random Access Memory, DRAM), synchronous DRAM (synchronous DRAM, SDRAM), double data rate SDRAM (Double Data Rate SDRAM, DDR SDRAM), enhanced SDRAM (Enhanced Synchronous DRAM, ESDRAM), synchronous link DRAM (Synchlink DRAM, SLDRAM), memory bus direct RAM (Rambus DRAM, RDRAM) and direct memory bus dynamic RAM (Direct Rambus DRAM, DRDRAM).

[0213] It should be understood that the "one embodiment" or "an embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. Those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required for the present application.

[0214] In the various embodiments of the present application, it should be understood that the size of the serial numbers of the above-mentioned processes does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

Claims

1. A vehicle-mounted streaming media rearview mirror, characterized in that: include: a liveness detection module, configured to perform liveness detection in the vehicle, obtain liveness features corresponding to one or more objects in the vehicle, and determine whether each of the objects is a child user according to the liveness features corresponding to each of the objects, and send a first signal to the processor when it is determined that the one or more objects include a child user but do not include an adult user; The processor is communicatively connected to the liveness detection module, and is used to receive the first signal and send an early warning signal to the vehicle-mounted control terminal, wherein the early warning signal is used to instruct the vehicle-mounted control terminal to perform an early warning operation, and the early warning operation is used to prompt that a child user is left in the vehicle.

2. The vehicle-mounted streaming media rearview mirror according to claim 1, characterized in that: The liveness detection module is further configured to stop performing the liveness detection and send a second signal to the processor when it is determined that the one or more objects include an adult user; The processor is further configured to, after sending the warning signal to the vehicle-mounted control terminal, if receiving the second signal, stop sending the warning signal to the vehicle-mounted control terminal in response to the second signal.

3. The vehicle-mounted streaming media rearview mirror according to claim 1, characterized in that: The liveness detection module is also used to receive a door status signal and a door lock status signal. If the door status signal indicates that the door is closed and the door lock status signal indicates that the door is locked, liveness detection is immediately performed in the vehicle; if the door status signal indicates that the door is closed and the door lock status signal indicates that the door is not locked, liveness detection is performed in the vehicle after waiting for a first period of time.

4. The vehicle-mounted streaming media rearview mirror according to claim 3, characterized in that: The liveness detection module is also used to perform liveness detection in the vehicle within a second time period after waiting for a first time period if the door status signal indicates that the door is closed and the door lock status signal indicates that the door is not locked; if the detection results of the liveness detection performed within the second time period are that the one or more objects include child users but do not include adult users, a first signal is sent to the processor.

5. The vehicle-mounted streaming media rearview mirror according to claim 1, characterized in that: The processor is further configured to, upon receiving a cancel warning signal sent by the vehicle-mounted control terminal, send a stop detection signal to the living body detection module and stop sending the warning signal to the vehicle-mounted control terminal; The living body detection module is further used to receive the stop detection signal and stop the living body detection according to the stop detection signal.

6. The vehicle-mounted streaming media rearview mirror according to claim 5, characterized in that: The living body detection module is further configured to, if receiving the stop detection signal, stop performing the living body detection and wait for a third period of time before re-performing the living body detection on the vehicle.

7. The vehicle-mounted streaming media rearview mirror according to claim 1, characterized in that: The liveness detection module is also used to perform liveness detection in the vehicle if it is currently in the delayed warning mode, after the received door status signal indicates that the door is closed and the received door lock status signal indicates that the door is locked and waits for a delay period.

8. The vehicle-mounted streaming media rearview mirror according to claim 1, characterized in that: The processor is further configured to send a first warning signal to the vehicle control terminal according to the first signal, wherein the first warning signal is used to instruct the vehicle control terminal to perform a first warning operation; if an upgraded warning condition is met, send a second warning signal to the vehicle control terminal, wherein the second warning signal is used to instruct the vehicle control terminal to perform a second warning operation; The warning effect of the second warning operation is greater than the warning effect of the first warning operation.

9. A method for detecting children left behind in a vehicle, characterized in that: Applied to a vehicle-mounted streaming media rearview mirror, the vehicle-mounted streaming media rearview mirror includes a living body detection module, and the method includes: Performing liveness detection in the vehicle through the liveness detection module to obtain liveness features corresponding to one or more objects in the vehicle, and determining whether each of the objects is a child user according to the liveness features corresponding to each of the objects; When it is determined that the one or more objects include child users but not adult users, a warning signal is sent to the vehicle-mounted control terminal, wherein the warning signal is used to instruct the vehicle-mounted control terminal to perform a warning operation, wherein the warning operation is used to prompt that a child user is left in the vehicle.

10. The method according to claim 9, characterized in that The method further comprises: When it is determined that the one or more objects include an adult user, the liveness detection module is controlled to stop performing liveness detection and stop sending the warning signal to the vehicle-mounted control terminal.

11. The method according to claim 9, characterized in that Before performing liveness detection in the vehicle by the liveness detection module, the method further includes: Receiving a door status signal and a door lock status signal through the living body detection module; The performing liveness detection in the vehicle by using the liveness detection module includes: If the door status signal indicates that the door is closed and the door lock status signal indicates that the door is locked, immediately performing a liveness detection on the vehicle through the liveness detection module; If the door status signal indicates that the door is closed and the door lock status signal indicates that the door is not locked, then after waiting for a first period of time, liveness detection is performed on the vehicle through the liveness detection module.

12. The method according to claim 11, characterized in that After waiting for the first time period, performing liveness detection on the vehicle by the liveness detection module includes: After waiting for a first period of time, performing liveness detection on the vehicle by the liveness detection module for a second period of time; The sending of a warning signal to the vehicle-mounted control terminal when it is determined that the one or more objects include a child user but do not include an adult user includes: If the detection results of the liveness detection performed within the second time period all show that the one or more objects include child users but do not include adult users, the warning signal is sent to the vehicle-mounted control terminal.

13. The method according to claim 9, characterized in that The sending of a warning signal to the vehicle-mounted control terminal when it is determined that the one or more objects include a child user but do not include an adult user includes: When it is detected for the first time that the one or more objects include a child user but do not include an adult user, sending a first warning signal to the vehicle control terminal, wherein the first warning signal is used to instruct the vehicle control terminal to perform a first warning operation; If the upgraded warning conditions are met, a second warning signal is sent to the vehicle-mounted control terminal, and the second warning signal is used to instruct the vehicle-mounted control terminal to perform a second warning operation; the warning effect of the second warning operation is greater than the warning effect of the first warning operation.

14. A vehicle, characterized in that: The vehicle comprises an on-board streaming media rearview mirror and an on-board control terminal, and the on-board streaming media rearview mirror comprises a living body detection module; The vehicle-mounted streaming media rearview mirror is used to perform liveness detection in the vehicle through the liveness detection module to obtain liveness features corresponding to one or more objects in the vehicle, and send a warning signal to the vehicle-mounted control terminal when it is determined according to the liveness features corresponding to each of the objects that the one or more objects include a child user but do not include an adult user; The vehicle-mounted control terminal is used to receive the warning signal and perform a warning operation according to the warning signal, wherein the warning operation is used to prompt the user that a child is left behind in the vehicle.

15. An electronic device, characterized in that: The method comprises a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor implements the method according to any one of claims 9 to 13.

Images