In-vehicle child detection early warning method and device, electronic equipment and readable storage medium

Abstract

The invention discloses an in-vehicle child detection early warning method and device, electronic equipment and a readable storage medium, and relates to the technical field of vehicle control, and the in-vehicle child detection early warning method comprises the steps: carrying out the scanning imaging of an in-vehicle object through a millimeter wave radar when a driving position is detected to be vacant, and obtaining a scanning image; performing character recognition on the scanned image, and judging whether a child exists in the vehicle or not; and if the child exists, pushing warning prompt information to the user mobile terminal. According to the invention, the child left in the vehicle can be automatically detected, the warning prompt information is pushed in time when the child left in the vehicle exists, safety accidents are avoided, and the warning precision is improved.

Description

Technical Field

[0001] The present application relates to the field of vehicle control, and in particular to a method, device, electronic device and computer-readable storage medium for detecting and warning children in a vehicle. Background Art

[0002] At present, there have been many accidents where children were left in cars due to carelessness of parents, and the children's life, health and safety were threatened due to the closed environment, poor air circulation and high temperature in the car. Therefore, it is urgent to strengthen the detection and early warning when children are left in the car. Some methods for life monitoring of children in the car have appeared on the market to achieve safety monitoring of abandoned children. These methods mainly use methods based on the detection and collection of vital signs in the car to determine whether there are children in the car. These detection methods collect features of children and adults at the same time. In some scenarios where both children and adults are in the car, false alarms may occur, and the warning accuracy is low.

[0003] The above information disclosed in this Background section is only for understanding the background of the present inventive concept and therefore it may contain information that does not constitute prior art. Summary of the invention

[0004] The main purpose of this application is to provide a child detection and warning method in a car, aiming to realize automatic detection of children left behind in the car, and timely push warning prompt information when there is a left-behind child in the car, so as to avoid safety accidents and improve the accuracy of warning.

[0005] To achieve the above objectives, the present application provides a method for detecting and warning children in a vehicle, the method comprising:

[0006] When the driver's seat is detected to be vacant, the millimeter-wave radar is used to scan and image the objects inside the vehicle to obtain a scanned image;

[0007] Performing person recognition on the scanned image to determine whether there is a child in the car;

[0008] If there are children, a warning message will be pushed to the user's mobile terminal.

[0009] Optionally, the step of performing person recognition on the scanned image to determine whether there is a child in the vehicle includes:

[0010] Processing the scanned image according to a preset image recognition algorithm to obtain a plurality of scanned objects in the scanned image;

[0011] Eliminate permanent objects in the vehicle from the scanned objects to obtain objects to be identified;

[0012] Performing feature recognition on the surface features of the object to be recognized by using a preset person recognition algorithm, and setting the object to be recognized that meets the person surface features as a person object;

[0013] Based on the body length of the character object, it is determined whether the character object is a child.

[0014] Optionally, the step of determining whether the character object is a child based on the body length of the character object includes:

[0015] Obtaining the distance between the human object and the millimeter-wave radar;

[0016] Obtaining the total length of the human object in the scanned image;

[0017] Determine the body length corresponding to the human object based on the distance and the total length;

[0018] Whether the character object is a child is determined based on the body length and a preset body length-age comparison table.

[0019] Optionally, the step of obtaining the total length of the person object in the scanned image includes:

[0020] Performing joint point recognition on the person object in the scanned image to obtain position coordinates of the neck joint point, waist joint point and knee joint point in the person object;

[0021] Obtaining the position coordinates corresponding to the head vertex and foot point of the character object respectively;

[0022] The total length of the character object is calculated according to the position coordinates corresponding to the head vertex, the neck joint point, the waist joint point, the knee joint point and the foot point respectively.

[0023] Optionally, the step of pushing warning prompt information to the user's mobile terminal includes:

[0024] If the current door status is unlocked and there is only a child in the car, the current distance between the driver and the vehicle is detected;

[0025] After the current distance is greater than a preset distance threshold and lasts for a first preset time period, a warning prompt message is pushed to the user's mobile terminal;

[0026] If the current door status is locked and there is only a child in the car, a warning prompt message will be pushed to the user's mobile terminal after the second preset time.

[0027] Optionally, after the step of pushing the warning prompt information to the user's mobile terminal, the method further includes:

[0028] Acquiring the temperature inside the vehicle, and when the temperature inside the vehicle is higher than a preset temperature threshold, turning on the vehicle air conditioner to cool down;

[0029] Based on a preset two-dimensional mapping table, querying a first preset frequency corresponding to the vehicle interior temperature;

[0030] The two-dimensional mapping table is used to represent the mapping relationship between the temperature inside the vehicle and the first preset frequency. The higher the temperature inside the vehicle, the higher the corresponding first preset frequency.

[0031] Continuously push warning prompt information to the user mobile terminal based on the first preset frequency.

[0032] Optionally, after the step of pushing the warning prompt information to the user's mobile terminal, the method further includes:

[0033] Obtaining a temperature change amplitude within a third preset time period;

[0034] Calculating a temperature change rate according to the temperature change amplitude and the third preset time length;

[0035] Calculating a second preset frequency based on the current vehicle interior temperature, the temperature change rate, and a preset temperature threshold;

[0036] Continuously push warning prompt information to the user mobile terminal based on the second preset frequency.

[0037] The present application also provides a child detection and warning device in a vehicle, the child detection and warning device in a vehicle is applied to an electronic device, and the child detection and warning device in a vehicle comprises:

[0038] An imaging scanning module is used to scan and image objects in the vehicle through a millimeter-wave radar to obtain a scanned image when the driver's seat is detected to be vacant;

[0039] A person recognition module, used to perform person recognition on the scanned image to determine whether there is a child in the car;

[0040] The information push module is used to push warning information to the user's mobile terminal if there are children.

[0041] The present application also provides an electronic device, which is a physical device, and includes: a memory, a processor, and a program for detecting and warning children in the vehicle that is stored in the memory and can be run on the processor. When the program for detecting and warning children in the vehicle is executed by the processor, the steps of the method for detecting and warning children in the vehicle as described above can be implemented.

[0042] The present application also provides a computer-readable storage medium, on which is stored a program for implementing the in-vehicle child detection and warning method. When the program of the in-vehicle child detection and warning method is executed by a processor, the steps of the in-vehicle child detection and warning method as described above are implemented.

[0043] The present application also provides a computer program product, including a computer program, which implements the steps of the above-mentioned child in-vehicle detection and warning method when executed by a processor.

[0044] The present application proposes a method, device, electronic device and computer-readable storage medium for detecting and warning children in a car. The method comprises: when the driver's seat is detected to be vacant, the objects in the car are scanned and imaged by a millimeter-wave radar to obtain a scanned image; the scanned image is used for character recognition to determine whether there is a child in the car; if there is a child, a warning prompt message is pushed to the user's mobile terminal. In the technical solution of the present application, by scanning and imaging with a millimeter-wave radar when the driver's seat is vacant, character recognition is performed based on the scanned image obtained, so as to determine whether the child is left in the car, and finally the warning prompt message is pushed directly to the user's mobile terminal, so as to promptly remind the user when the child may be at risk of safety. Compared with the traditional child detection and warning method, the technical solution of the present application distinguishes between adults and children based on the scanned image, reduces the false alarm rate, avoids the waste of computing power, and improves the accuracy of warning. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Figure 1 This is a flow chart of a method for detecting and warning children in a vehicle in an embodiment of the present application;

[0046] Figure 2 It is a schematic diagram of the distance and the total length of the human object in the embodiment of the present application;

[0047] Figure 3 This is a schematic diagram of the lengths of various parts of a person object in an embodiment of the present application;

[0048] Figure 4 This is a structural schematic diagram of a child detection and warning device in a vehicle according to an embodiment of the present application;

[0049] Figure 5 This is a schematic diagram of the device structure of the hardware operating environment involved in the embodiment of the present application.

[0050] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0051] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0052] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0053] The terms "first" and "second" in the description and claims of the embodiments of the present application are used to distinguish different objects rather than to describe a specific order of objects. For example, a first target object and a second target object are used to distinguish different target objects rather than to describe a specific order of target objects.

[0054] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0055] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0056] In the embodiment of the present application, when the driver's seat is detected to be vacant, the millimeter-wave radar is used to scan and image the objects in the car to obtain a scanned image, and then the scanned image is used for character recognition to determine whether there are children in the car. If there are children, a warning prompt message is pushed to the user's mobile terminal. In the technical solution of the embodiment of the present application, by using the millimeter-wave radar for scanning and imaging when the driver's seat is vacant, and then based on the obtained scanned image, character recognition is performed to determine the situation of children left behind in the car, and finally a warning prompt message is pushed directly to the user's mobile terminal, prompting the user in time when the child may be at risk of safety. Compared with the traditional child detection and warning method, the technical solution of the embodiment of the present application distinguishes between adults and children based on the scanned image, reduces the false alarm rate, avoids the waste of computing power, and improves the accuracy of warnings.

[0057] Please refer to Figure 1 , Figure 1This is a flowchart of the first embodiment of the in-vehicle child detection and warning method of the present application. It should be noted that although the logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than here.

[0058] A first embodiment of the present application provides a method for detecting and warning a child in a vehicle, which is applied to a vehicle. The method for detecting and warning a child in a vehicle comprises the following steps:

[0059] Step S100, when it is detected that the driver's seat is vacant, the millimeter wave radar is used to scan and image the objects in the vehicle to obtain a scanned image;

[0060] In this embodiment, the vacant driver's seat is used as a trigger condition for executing the in-car child detection and warning method. It is understandable that when the driver's seat is vacant, the car is in a stopped state, and there is no one in the main driver's seat. At this time, adults or children with certain self-care abilities in other positions in the car may have gotten off the car, and in-car child detection and warning are needed to detect children who may be incapable of self-care in the car to avoid danger.

[0061] First, the method of detecting whether the driver's seat is vacant can be detected by using a pressure sensor. A pressure sensor is set under the main driver's seat to read the pressure value of the seat. When the pressure value is lower than a certain threshold, the driver's seat can be determined to be vacant. In addition, the method of detecting whether the driver's seat is vacant can also be detected by using a camera configured inside the car. For example, when a camera is set inside the car to collect images of the main driver's seat area, it can be determined whether the driver's seat is vacant by analyzing whether the image collected by the camera includes the driver.

[0062] In addition, the millimeter-wave radar can be set in front of or in the car, and the main coverage area includes all rear areas, based on the position that can scan all rear areas. In particular, if a child safety seat is installed inside the vehicle, the scanning area of ​​the millimeter-wave radar can be focused on the area where the child safety seat is located to improve scanning accuracy and imaging quality.

[0063] Step S200, performing person recognition on the scanned image to determine whether there is a child in the car;

[0064] In the embodiment of the present application, after obtaining the scanned image of the rear area, it is necessary to perform character recognition processing on the scanned image. In the process of character recognition on the scanned image, the character objects other than non-character objects in the image can be first identified, and then the child object can be further identified from the character objects. It should be noted that the children and child objects mentioned in the embodiment of the present application refer to children whose age is less than a certain age threshold, who have no self-care ability and simple self-rescue ability (such as the ability to open a car door or turn on the air conditioner), such as children under 6 years old. Of course, the user can also set a higher age threshold according to demand to improve safety. In the technical scheme of the embodiment of the present application, it is mainly based on the height (i.e., body length) of the character object to determine whether the character object is a child. The comparison table of children's age and height in big data can be obtained to determine the height corresponding to the age threshold. For example, the height of a 6-year-old child is generally 118cm. On the other hand, the user can also set an adaptive height threshold according to the actual height of his own children to achieve more accurate child detection warning.

[0065] Step S300: If a child is present, a warning message is pushed to the user's mobile terminal.

[0066] It should be noted that in addition to confirming the presence of children in the car, it is also necessary to determine whether there are other adults or children with self-rescue and self-care capabilities in the car. It is understandable that if there are adults or other children with self-rescue and self-care capabilities in the car, warning prompt information may not be pushed to the user's mobile terminal.

[0067] In addition, when there are only children in the car, in addition to pushing warning information to the user's mobile terminal, the vehicle can also be controlled to open the windows (the extent of the window opening should not affect the safety of the children in the car, for example, the width of the gap after the window is opened cannot allow an adult's arm to fit in) and turn on the air conditioner to prevent high or low temperatures in the car from posing a threat to the life and health of children.

[0068] It should be noted that if there are children with certain self-rescue and self-care abilities and young children without self-rescue and self-care abilities in the car, for example, there are both an 8-year-old child and a 1-year-old child, and the car door is closed, and the temperature in the car is high (such as above 30°C), the 8-year-old child can adapt to the environment and will not be threatened by life and health. However, for young children, such high temperatures may pose a threat to life and health, and 8-year-old children cannot realize the need to open windows for ventilation or turn on air conditioning. At this time, the vehicle can be automatically controlled to open windows for ventilation or turn on air conditioning, and a prompt message can be sent to the user to inform the user that the vehicle has automatically opened windows or turned on air conditioning, so please pay attention to the status of the children in time.

[0069] In an embodiment of the present application, the in-vehicle child detection and warning method can be applied to an in-vehicle child detection and warning system installed in a vehicle. The system is connected to a cloud platform via the Internet. When it is necessary to push warning prompt information, the system sends the corresponding warning prompt information to the cloud platform via an established Internet communication channel. The cloud platform then pushes text messages or application software push information to the user's mobile terminal (such as a mobile phone) of the logged-in user's account.

[0070] In a feasible embodiment, the step of performing person recognition on the scanned image to determine whether there is a child in the car may include:

[0071] Step S210, processing the scanned image according to a preset image recognition algorithm to obtain a plurality of scanned objects in the scanned image;

[0072] Step S220, removing the permanent objects in the vehicle from the scanned objects to obtain the objects to be identified;

[0073] Step S230, performing feature recognition on the surface features of the object to be recognized by using a preset person recognition algorithm, and setting the object to be recognized that meets the person surface features as a person object;

[0074] Step S240, judging whether the character object is a child based on the body length of the character object;

[0075] Step S250, judging whether the character object is a child according to the body length and a preset body length-age comparison table.

[0076] In the embodiment of the present application, the image recognition algorithm is a pre-trained image recognition algorithm, which can identify individual objects from the image obtained after scanning the rear area of ​​the vehicle, such as seats, dolls, ornaments, bags and people in the vehicle. The image recognition algorithm is trained by a large number of scanned images of the rear area of ​​the vehicle, and can accurately identify various items in the rear area of ​​the vehicle. In addition, the permanent objects in the vehicle are various items that may exist in the vehicle under normal circumstances, such as seats, dolls, ornaments, bags and other objects.

[0077] In another feasible embodiment, there may be some dangerous items in the car, such as kettles, knives and other items that may pose a safety threat to children. While performing feature recognition on the object to be identified to determine the person object, dangerous items in the objects to be identified are also detected at the same time. When the objects to be identified in the car include dangerous items, warning information is promptly pushed to the user's mobile terminal to prompt the user to store and handle the dangerous items in the car in time.

[0078] On the other hand, in the process of feature recognition of the object to be recognized, the person recognition algorithm used is also a pre-trained image recognition algorithm that can recognize people from each object to be recognized. The person recognition algorithm is obtained by training in advance through a large number of facial images and full-body images of people. After the person object is determined, the body length of the person is further detected, and whether the person object is a child is determined based on a pre-set body length and age comparison table. The body length and age comparison table includes ages corresponding to different body lengths. After the corresponding age is queried according to the body length, it is determined whether the person object is a child based on a pre-set age threshold. For example, when the age threshold is 12 years old, the person object younger than 12 years old is identified as a child.

[0079] In a feasible embodiment, the step of determining whether the character object is a child based on the body length of the character object may include:

[0080] Step S241, obtaining the distance between the human object and the millimeter wave radar;

[0081] Step S242, obtaining the total length of the person object in the scanned image;

[0082] Step S243: determining the body length corresponding to the human object based on the distance and the total length.

[0083] It is understandable that, referring to Figure 2 , the closer the human object in the scanned image is to the millimeter-wave radar, the larger the human object is in the viewing angle occupied by the scanned image, and the longer the corresponding total length of the human object is (for example, position 2 is closer to the millimeter-wave radar than position 1, so viewing angle 2 is larger than viewing angle 1). Therefore, it is necessary to first obtain the distance between the human object and the millimeter-wave radar, where the distance can be calculated by the time and wave speed from the emission to the reception of the millimeter wave and the return (distance = wave speed * time / 2). In addition, the total length can be reflected in the body length of the human object in the scanned image. It should be noted that the total length of the human object in the scanned image is not equal to the real body length, and the real body length needs to be calculated in combination with the distance calculated previously.

[0084] The total length refers to the sum of the lengths between the joints of the body in the person object. It is understandable that in a car, a person cannot maintain an upright posture, so to measure a person's height, it is necessary to consider the bending conditions at the joints of the human body and calculate the lengths of various parts of the human body respectively, that is, the total length of the person object obtained in the embodiment of the present application is equivalent to the body length (height) of the person object in an upright state.

[0085] In addition, in step S243, based on the distance and the total length, the body length corresponding to the character object is determined mainly by multiplying the total length by a certain proportional coefficient. Wherein, the proportional coefficient is determined by the distance. It can be understood that the farther the distance is, the larger the proportional coefficient is (the proportional coefficient is at least greater than 1), and the body length corresponding to the character object is used to characterize the real height of the character object. In the process of determining the body length corresponding to the character object based on the distance and the total length, it is first necessary to determine the proportional coefficient, which is obtained by querying a two-dimensional mapping table of distance-proportional coefficient, obtaining the body length corresponding to different distances in advance through experiments, and calculating the ratio of distance to body length, thereby obtaining the proportional coefficient corresponding to each distance, and generating a two-dimensional mapping table of distance-proportional coefficient. In actual application scenarios, after detecting the distance, the corresponding proportional coefficient can be queried according to the distance, and finally the product of the distance and the proportional coefficient is calculated to obtain the body length.

[0086] In a feasible embodiment, the step of obtaining the total length of the person object in the scanned image may include:

[0087] Step A100, performing joint point recognition on the person object in the scanned image to obtain position coordinates of the neck joint points, waist joint points and knee joint points in the person object;

[0088] Step A200, obtaining the position coordinates corresponding to the head vertex and foot point of the character object respectively;

[0089] Step A300, calculating the total length of the character object according to the position coordinates corresponding to the head vertex, the neck joint point, the waist joint point, the knee joint point and the foot point respectively.

[0090] In an embodiment of the present application, joint point recognition is first required, wherein a pre-trained joint point recognition algorithm is required in the process of performing joint point recognition on a person object. The joint point recognition algorithm can recognize the corresponding joint points from the person object in the scanned image, including at least neck joint points, waist joint points and knee joint points, and determine the position coordinates of each joint point, wherein the coordinates are the coordinates of each point on the coordinate system with the center point of the scanned image as the origin. Then the position coordinates corresponding to the head vertex and foot points of the person object are obtained respectively, and the distances between the head vertex, the joint points and the foot points can be used to characterize the length of this section in the person image. For example, referring to Figure 3, the distance between the head vertex and the neck joint point is the head length, the distance between the neck joint point and the waist joint point is the chest and abdomen length, the distance between the waist joint point and the knee joint point is the thigh length, and the distance between the knee joint point and the foot point is the calf length. Finally, the sum of the head length, the chest and abdomen length, the thigh length and the calf length is combined to obtain the total length of the character object.

[0091] It should also be noted that Figure 3 The figure shows the joints and lengths of a person standing upright. However, in actual application scenarios, the person is not standing upright, so it is necessary to calculate the length of each part separately and then sum them up to get a relatively accurate total length, so as to more accurately analyze the body length of the person object and determine whether the person object is a child.

[0092] In a feasible embodiment, the step of pushing the warning prompt information to the user's mobile terminal may include:

[0093] Step S310, if the current door state is unlocked and there is only a child in the car, then detect the current distance between the driver and the vehicle;

[0094] Step S320, after the current distance is greater than a preset distance threshold and lasts for a first preset time period, push a warning prompt message to the user's mobile terminal;

[0095] Step S320: If the current door state is locked and there is only a child in the car, a warning prompt message is pushed to the user's mobile terminal after a second preset time.

[0096] It should be noted that in the embodiments of the present application, the child refers to a young child who has no self-care and self-rescue ability. When there is only a child who has no self-care ability in the car (there are no adults and children with certain self-care and self-rescue abilities in the car), it is first determined whether the door is locked. The locked state means that the door has been locked from the outside and cannot be opened from the outside without a key, while the unlocked state means that the door is not closed, or the door is closed but can still be opened directly from the outside.

[0097] On the one hand, when the current door state is unlocked and there are only children in the car, first determine whether the driver has left the vehicle to exclude the safety scenario of the driver staying near the vehicle. Specifically, the distance between the driver and the vehicle can be detected by human sensing devices such as radar, camera or infrared detection installed on the outside of the vehicle. When the detected current distance is greater than the preset distance threshold, the driver is deemed to have left the vehicle. It should be noted that when detecting the current distance of the driver, it is necessary to identify the object to avoid misidentifying outsiders as the driver. This can be determined by the movement trajectory of the object. For example, the driver's movement trajectory may be to leave the main driving first, and then stay around the vehicle or move away from the vehicle.

[0098] After the driver leaves the vehicle for a first preset period of time, the child in the vehicle is at risk of being maliciously assaulted by an outsider. At this time, the child is in extreme danger, and a warning message should be pushed to the user's mobile terminal (mobile phone) immediately. In particular, in this case, a warning call can be made to the user's mobile phone to warn the user, so as to prompt the user to lock the car door or take the child out in time to protect the child's safety.

[0099] On the other hand, when the current door state is locked and there are only children in the car, whether the child is a safety risk needs to be further determined in combination with the situation in the car (such as oxygen content and temperature, etc.), and then a warning prompt message is pushed to the user's mobile terminal after a second preset time, wherein the second preset time is determined by the environmental parameters in the car, for example, the greater the difference between the air temperature and the suitable temperature (such as 16°C), the shorter the second preset time; the lower the oxygen content, the shorter the second preset time; the faster the temperature rises, the shorter the second preset time, etc. The embodiment of the present application uses the above method to timely remind users (i.e., parents) when there is a safety risk for children left in the car, so as to avoid safety accidents.

[0100] Compared with directly sending an alarm to the user's mobile terminal when a child is detected to be left behind in the car, the technical solution of the embodiment of the present application adds a certain buffer time (a first preset time length and a second preset time length), so that the user will not be frequently disturbed by warning information when leaving the vehicle in a short period of time. It improves the flexibility of the child detection and warning solution in the scenarios where the user gets off the car for a short time shopping, checking the condition of the car, throwing away garbage or going to the toilet, and avoids the waste of communication resources caused by invalid warning information in the short term.

[0101] In a feasible embodiment, after the step of pushing the warning prompt information to the user's mobile terminal, the method further includes:

[0102] Step S301, obtaining the temperature inside the vehicle, and when the temperature inside the vehicle is higher than a preset temperature threshold, turning on the vehicle air conditioner to cool down;

[0103] Step S302, querying a first preset frequency corresponding to the vehicle interior temperature based on a preset two-dimensional mapping table;

[0104] The two-dimensional mapping table is used to characterize the mapping relationship between the in-vehicle temperature and the first preset frequency. The higher the in-vehicle temperature is, the shorter the corresponding first preset frequency is.

[0105] Step S302: continuously push warning prompt information to the user mobile terminal based on the first preset frequency.

[0106] In an embodiment of the present application, when the temperature inside the car is higher than a preset temperature threshold, the car air conditioner is automatically turned on to cool the car. For example, when it is detected that the temperature inside the car is higher than 30°C, the car air conditioner is adjusted to cooling mode, and the target temperature is set to 26°C to quickly cool down the car environment.

[0107] Optionally, the oxygen content in the car can also be detected. When the oxygen content in the car is lower than a preset threshold, the air conditioner's external circulation mode is turned on to speed up air circulation and avoid life threats to children due to lack of oxygen in the car.

[0108] In one possible scenario, the car is in an off state, and the child detection and warning system in the car cannot send a start command to the vehicle control system to directly start the air conditioner. At this time, the App (Application) prompt information can be pushed to the user's mobile terminal (mobile phone) to obtain vehicle start permission, and after the user confirms, a start command can be sent to the vehicle control system through the cloud platform to achieve remote start. After the car is started, the car air conditioner can be powered by the internal battery, which has the effect of cooling the environment inside the car and accelerating air circulation.

[0109] In addition, in order to further improve the safety of children left behind in the car, after the warning prompt information is pushed to the user's mobile terminal, if the user continues to not return to the vehicle, the warning prompt information will be pushed to the user at a certain frequency to strengthen the reminder. The embodiment of the present application also provides a method for specifically determining the first preset frequency, wherein the temperature in the car is associated with the first preset frequency, and when the temperature is higher, the user is warned at a higher first preset frequency, thereby improving the safety of children in the car.

[0110] Exemplarily, the two-dimensional mapping table is shown in Table 1 below;

[0111]

[0112] Table 1

[0113] It should be noted that the mapping relationship between temperature and the first preset frequency shown in the above two-dimensional mapping table is only an example, and the user can set the first preset frequency corresponding to each temperature value according to needs, and there is no limitation here.

[0114] In a feasible embodiment, after the step of pushing the warning prompt information to the user's mobile terminal, the method further includes:

[0115] Step S304, obtaining the temperature change amplitude within a third preset time period;

[0116] Step S305, calculating the temperature change rate according to the temperature change amplitude and the third preset time length;

[0117] Step S306, calculating a second preset frequency based on the current vehicle interior temperature, the temperature change rate, and a preset temperature threshold;

[0118] Step S307: continuously push warning prompt information to the user mobile terminal based on the second preset frequency.

[0119] It should be noted that the technical solutions of steps S304 to S307 are parallel to the technical solutions of steps S301 to S303. When the external ambient temperature is high (for example, higher than 30°C), the current temperature inside the car is not high when the air conditioner is turned on. However, when the driver and the adults in the car leave the car and turn off the air conditioner, and the car does not support remote start of the air conditioner, the temperature inside the car rises quickly. At this time, the corresponding preset frequency cannot be determined based on the current temperature, but the temperature change rate needs to be further calculated to send a warning message to the user's mobile terminal in time before the temperature inside the car exceeds the preset temperature threshold.

[0120] Exemplarily, when the external environment temperature is detected to be higher than 30°C, the temperature change amplitude within the third preset time (e.g., 60s) is obtained. Specifically, the temperature is detected to rise from 20°C to 26°C, that is, the temperature change amplitude is 6°C, and the temperature change rate is calculated to be 0.1°C / s. At this time, the current temperature inside the car is 26°C. If the preset temperature threshold is 30°C, the predicted time for the temperature inside the car to reach 30°C is (30°C-26°C) / 0.1°C / s=40s, and then the sum of 40s and the third preset time 60s is calculated. The second preset frequency is determined according to the sum of the time, which can be determined specifically according to a two-dimensional mapping table between the sum of the time and the second preset frequency. The shorter the sum of the time, the higher the temperature rise, the worse the safety, and the higher the corresponding second preset frequency. It should be noted that the values ​​of the third preset time and the preset temperature threshold in the above description are only examples, and users can set their values ​​according to actual needs, without limitation here.

[0121] The technical solution in the embodiment of the present application further improves the warning accuracy of the child detection and early warning scheme in the car by predicting the temperature changes. In the case of a sharp temperature change, it can promptly remind the user so that the children in the car can be cared for in time, thereby ensuring the life, health and safety of children left behind in the car.

[0122] Reference Figure 4 , Figure 4 This is a structural schematic diagram of the in-vehicle child detection and warning device of this application.

[0123] The present application also provides a child detection and warning device in a vehicle, the child detection and warning device in a vehicle comprising:

[0124] The imaging scanning module 10 is used to scan and image the objects in the vehicle by using the millimeter wave radar to obtain a scanned image when the driver's seat is detected to be vacant;

[0125] A person recognition module 20 is used to perform person recognition on the scanned image to determine whether there is a child in the car;

[0126] The information push module 30 is used to push warning information to the user's mobile terminal if a child is present.

[0127] Optionally, the character recognition module 20 is further used for:

[0128] Processing the scanned image according to a preset image recognition algorithm to obtain a plurality of scanned objects in the scanned image;

[0129] Eliminate permanent objects in the vehicle from the scanned objects to obtain objects to be identified;

[0130] Performing feature recognition on the surface features of the object to be recognized by using a preset person recognition algorithm, and setting the object to be recognized that meets the person surface features as a person object;

[0131] Based on the body length of the character object, it is determined whether the character object is a child.

[0132] Optionally, the character recognition module 20 is further used for:

[0133] Obtaining the distance between the human object and the millimeter-wave radar;

[0134] Obtaining the total length of the human object in the scanned image;

[0135] Determine the body length corresponding to the human object based on the distance and the total length;

[0136] Whether the character object is a child is determined based on the body length and a preset body length-age comparison table.

[0137] Optionally, the person identification module 20 is further used for:

[0138] Performing joint point recognition on the person object in the scanned image to obtain position coordinates of the neck joint point, waist joint point and knee joint point in the person object;

[0139] Obtaining the position coordinates corresponding to the head vertex and foot point of the character object respectively;

[0140] The total length of the character object is calculated according to the position coordinates corresponding to the head vertex, the neck joint point, the waist joint point, the knee joint point and the foot point respectively.

[0141] Optionally, the information push module 30 is further used for:

[0142] If the current door status is unlocked and there is only a child in the car, the current distance between the driver and the vehicle is detected;

[0143] After the current distance is greater than a preset distance threshold and lasts for a first preset time period, a warning prompt message is pushed to the user's mobile terminal;

[0144] If the current door status is locked and there is only a child in the car, a warning prompt message will be pushed to the user's mobile terminal after the second preset time.

[0145] Optionally, the information push module 30 is further used for:

[0146] Acquiring the temperature inside the vehicle, and when the temperature inside the vehicle is higher than a preset temperature threshold, turning on the vehicle air conditioner to cool down;

[0147] Based on a preset two-dimensional mapping table, querying a first preset frequency corresponding to the vehicle interior temperature;

[0148] The two-dimensional mapping table is used to represent the mapping relationship between the temperature inside the vehicle and the first preset frequency. The higher the temperature inside the vehicle, the higher the corresponding first preset frequency.

[0149] Continuously push warning prompt information to the user mobile terminal based on the first preset frequency.

[0150] Optionally, the information push module 30 is further used for:

[0151] Obtaining a temperature change amplitude within a third preset time period;

[0152] Calculating a temperature change rate according to the temperature change amplitude and the third preset time length;

[0153] Calculating a second preset frequency based on the current vehicle interior temperature, the temperature change rate, and a preset temperature threshold;

[0154] Continuously push warning prompt information to the user mobile terminal based on the second preset frequency.

[0155] The in-car child detection and warning device provided by the present application adopts the in-car child detection and warning method in the above embodiment to solve the technical problem of life safety danger caused by children being left in the car. Compared with the prior art, the beneficial effects of the in-car child detection and warning device provided by the embodiment of the present application are the same as the beneficial effects of the in-car child detection and warning method provided by the above embodiment, and other technical features of the in-car child detection and warning device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0156] like Figure 5 As shown, Figure 5 This is a structural diagram of an in-vehicle child detection and warning device in the hardware operating environment involved in the embodiment of the present application.

[0157] Specifically, the in-vehicle child detection and warning device may be a VCU (Vehicle Control Unit), a PC (Personal Computer), a tablet computer, a portable computer or a server or other device.

[0158] like Figure 5 As shown, the in-vehicle child detection and warning device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a wireless fidelity (WIreless-FIdelity, WI-FI) interface). The memory 1005 may be a high-speed random access memory (Random Access Memory, RAM) memory, or a stable non-volatile memory (Non-Volatile Memory, NVM), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0159] Those skilled in the art will understand that Figure 5 The device structure shown in the figure does not constitute a limitation on the in-vehicle child detection and warning device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0160] like Figure 5 As shown, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an in-vehicle child detection and warning application.

[0161] exist Figure 5 In the device shown, the network interface 1004 is mainly used to connect to the background server and communicate data with the background server; the user interface 1003 is mainly used to connect to the client and communicate data with the client; and the processor 1001 can be used to call the child detection and warning program in the car stored in the memory 1005 to implement the operations in the child detection and warning method in the above embodiment.

[0162] In addition, the embodiment of the present application also provides a vehicle, the vehicle includes the above-mentioned in-vehicle child detection and warning device. Of course, it can be understood that the vehicle also includes other devices such as energy storage devices and drive devices to ensure the normal operation of the vehicle.

[0163] In addition, an embodiment of the present application also proposes a computer storage medium, on which a computer program is stored. When the computer program is executed by a processor, the operations of the in-vehicle child detection and warning method provided in the above embodiment are implemented. The specific steps will not be repeated here.

[0164] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity / operation / object from another entity / operation / object, and do not necessarily require or imply any such actual relationship or order between these entities / operations / objects; the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0165] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. The device embodiment described above is only schematic, and the units described as separate components may or may not be physically separated. Some or all of the modules can be selected according to actual needs to achieve the purpose of the present application scheme. Those of ordinary skill in the art can understand and implement it without paying creative work.

[0166] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0167] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, disk, CD) as described above, including a number of instructions for a terminal device (which can be a mobile phone, computer, server, vehicle, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0168] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A method for detecting and warning children in a vehicle, characterized in that: The in-vehicle child detection and early warning method comprises: When the driver's seat is detected to be vacant, the millimeter-wave radar is used to scan and image the objects inside the vehicle to obtain a scanned image; Performing person recognition on the scanned image to determine whether there is a child in the car; If there are children, a warning message will be pushed to the user's mobile terminal.

2. The method for detecting and warning children in a vehicle as claimed in claim 1, characterized in that: The step of performing character recognition on the scanned image to determine whether there is a child in the car includes: Processing the scanned image according to a preset image recognition algorithm to obtain a plurality of scanned objects in the scanned image; Eliminate permanent objects in the vehicle from the scanned objects to obtain objects to be identified; Performing feature recognition on the surface features of the object to be recognized by using a preset person recognition algorithm, and setting the object to be recognized that meets the person surface features as a person object; Based on the body length of the character object, it is determined whether the character object is a child.

3. The method for detecting and warning children in a vehicle as claimed in claim 2, characterized in that: The step of determining whether the character object is a child based on the body length of the character object comprises: Obtaining the distance between the human object and the millimeter-wave radar; Obtaining the total length of the human object in the scanned image; Determine the body length corresponding to the human object based on the distance and the total length; Whether the character object is a child is determined based on the body length and a preset body length-age comparison table.

4. The method for detecting and warning children in a vehicle as claimed in claim 3, characterized in that: The step of obtaining the total length of the person object in the scanned image comprises: Performing joint point recognition on the person object in the scanned image to obtain position coordinates of the neck joint point, waist joint point and knee joint point in the person object; Obtaining the position coordinates corresponding to the head vertex and foot point of the character object respectively; The total length of the character object is calculated according to the position coordinates corresponding to the head vertex, the neck joint point, the waist joint point, the knee joint point and the foot point respectively.

5. The method for detecting and warning children in a vehicle as claimed in claim 1, characterized in that: The step of pushing the warning prompt information to the user's mobile terminal includes: If the current door status is unlocked and there is only a child in the car, the current distance between the driver and the vehicle is detected; After the current distance is greater than a preset distance threshold and lasts for a first preset time period, a warning prompt message is pushed to the user's mobile terminal; If the current door status is locked and there is only a child in the car, a warning prompt message will be pushed to the user's mobile terminal after the second preset time.

6. The method for detecting and warning children in a vehicle as claimed in claim 5, characterized in that: After the step of pushing the warning prompt information to the user's mobile terminal, the method further includes: Acquiring the temperature inside the vehicle, and when the temperature inside the vehicle is higher than a preset temperature threshold, turning on the vehicle air conditioner to cool down; Based on a preset two-dimensional mapping table, querying a first preset frequency corresponding to the vehicle interior temperature; The two-dimensional mapping table is used to represent the mapping relationship between the temperature inside the vehicle and the first preset frequency. The higher the temperature inside the vehicle, the higher the corresponding first preset frequency. Continuously push warning prompt information to the user mobile terminal based on the first preset frequency.

7. The method for detecting and warning children in a vehicle as claimed in claim 5, characterized in that: After the step of pushing the warning prompt information to the user's mobile terminal, the method further includes: Obtaining a temperature change amplitude within a third preset time period; Calculating a temperature change rate according to the temperature change amplitude and the third preset time length; Calculating a second preset frequency based on the current vehicle interior temperature, the temperature change rate, and a preset temperature threshold; Continuously push warning prompt information to the user mobile terminal based on the second preset frequency.

8. A child detection and warning device in a vehicle, characterized in that: The in-vehicle child detection and warning device comprises: An imaging scanning module is used to scan and image objects in the vehicle through a millimeter-wave radar to obtain a scanned image when the driver's seat is detected to be vacant; A person recognition module, used to perform person recognition on the scanned image to determine whether there is a child in the car; The information push module is used to push warning information to the user's mobile terminal if there are children.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; a memory communicatively coupled to the at least one processor; The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the steps of the in-vehicle child detection and warning method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a program for implementing the in-vehicle child detection and warning method, and the program for implementing the in-vehicle child detection and warning method is executed by a processor to implement the steps of the in-vehicle child detection and warning method as described in any one of claims 1 to 7.

Images