Terminal device forgotten reminder method, device, equipment and readable storage medium

Abstract

The present application relates to a terminal device forgotten reminder method, device, equipment and readable storage medium, and relates to the field of vehicle control technology, including when the vehicle is in a stopped state and at least one door is in an open state, judging whether the distance between the target object and the vehicle is greater than a distance threshold based on a camera module; if the distance between the target object and the vehicle is greater than the distance threshold, judging whether the vehicle is in a parking area based on a high-precision map; if the vehicle is in a parking area, judging whether the terminal device and the vehicle are positioned consistently based on the real-time positioning information of the terminal device and the real-time positioning information of the vehicle; if the positioning is consistent, controlling the vehicle to remind the terminal device to be forgotten. The present application uses camera tracking and high-precision maps to determine whether a terminal device is left in the vehicle and to remind the terminal device to be forgotten, without the need to use the vehicle being in a stalled or powered-off state as a judgment condition, thereby realizing the terminal device forgotten reminder function in scenarios where the vehicle does not need to be stalled or powered-off.

Description

Technical Field

[0001] The present application relates to the field of vehicle control technology, and in particular to a terminal device forgotten reminder method, device, equipment and readable storage medium. Background Art

[0002] With the rapid development of science and technology and economy, cars have become a part of people's daily life, greatly facilitating people's travel; at the same time, as life becomes more convenient, the functions of mobile phones and other terminal devices are becoming more powerful, and they have long become indispensable items for people to carry when traveling. Even mobile phones and other terminal devices can be used to start and shut down car functions. However, due to the current fast pace of life, people often forget mobile phones and other terminal devices in the car, and often find them after leaving a distance. At this time, returning to retrieve them is not only laborious, but also time-consuming, which may affect the schedule. It can be seen that it is of great significance to monitor and remind whether the terminal device is forgotten in the car.

[0003] In the prior art, the forgotten reminder function of terminal devices such as mobile phones is based on the judgment condition that the vehicle is turned off or powered off; however, due to the popularity of electric vehicles and the development of remote vehicle control technology, there are more and more scenarios where the vehicle does not need to be turned off or powered off. In this scenario, since the vehicle is not turned off or powered off, the forgotten reminder function based on the judgment condition that the vehicle is turned off or powered off cannot be activated, and thus the target object cannot be reminded that the terminal device is forgotten in the car, resulting in people not being able to learn in time that the terminal device is left in the car. It can be seen that how to realize the forgotten reminder of terminal devices in scenarios such as not turning off the engine or powering off is a problem that needs to be solved urgently. Summary of the invention

[0004] The present application provides a terminal device forgotten reminder method, device, equipment and readable storage medium to solve the problem in the related art that it is impossible to realize terminal device forgotten reminder in scenarios such as without turning off the engine or without powering off.

[0005] In a first aspect, a terminal device forgotten reminder method is provided, comprising the following steps:

[0006] When the vehicle is in a stopped state and at least one door is in an open state, determining based on the camera module whether the distance between the target object and the vehicle is greater than a distance threshold;

[0007] If the distance between the target object and the vehicle is greater than a distance threshold, determining whether the vehicle is in a parking area based on a high-precision map;

[0008] If the vehicle is in a parking area, determining whether the terminal device and the vehicle are positioned in the same manner according to the real-time positioning information of the terminal device and the real-time positioning information of the vehicle;

[0009] If the terminal device and the vehicle are positioned in the same way, the vehicle is controlled to provide a reminder that the terminal device has been forgotten.

[0010] In some embodiments, the camera module includes a first camera and a second camera, and the determining whether the distance between the target object and the vehicle is greater than a distance threshold based on the camera module includes:

[0011] Determining whether the target object is a tracking target based on the first camera;

[0012] If yes, tracking the target object based on the second camera to obtain tracking information;

[0013] It is determined whether the distance between the target object and the vehicle is greater than a distance threshold according to the tracking information.

[0014] In some embodiments, the determining whether the target object is a tracking target based on the first camera includes:

[0015] Collecting target feature information of the target object through the first camera;

[0016] Comparing the target characteristic information with preset characteristic information;

[0017] If the target feature information is consistent with the preset feature information, determining that the target object is a tracking target;

[0018] If the target feature information is inconsistent with the preset feature information, it is determined that the target object is not a tracking target.

[0019] In some embodiments, the step of tracking the target object based on the second camera to obtain tracking information includes:

[0020] Acquiring a moving image of the target object by using the second camera;

[0021] A state variable value of the target object is calculated based on the moving image, the state variable value including a relative horizontal coordinate and a relative vertical coordinate between the target object and the second camera, and the state variable value is used as tracking information.

[0022] In some embodiments, the determining whether the vehicle is in a parking area based on a high-precision map includes:

[0023] Collecting real-time positioning information of the vehicle through high-precision maps;

[0024] comparing the real-time positioning information of the vehicle with the preset positioning information of the parking area;

[0025] If the real-time positioning information of the vehicle is consistent with the preset positioning information of the parking area, it is determined that the vehicle is in the parking area;

[0026] If the real-time positioning information of the vehicle is inconsistent with the preset positioning information of the parking area, it is determined that the vehicle is in a non-parking area.

[0027] In some embodiments, judging whether the terminal device and the vehicle are located in the same position according to the real-time positioning information of the terminal device and the real-time positioning information of the vehicle includes:

[0028] comparing the real-time positioning information of the terminal device with the real-time positioning information of the vehicle;

[0029] If the real-time positioning information of the terminal device is consistent with the real-time positioning information of the vehicle, it is determined that the preliminary positioning of the terminal device and the vehicle is consistent;

[0030] Acquire the target real-time positioning information of the terminal device after a preset time;

[0031] Comparing the target real-time positioning information of the terminal device with the real-time positioning information of the vehicle;

[0032] If the target real-time positioning information of the terminal device is consistent with the real-time positioning information of the vehicle, it is determined that the positioning of the terminal device is consistent with that of the vehicle;

[0033] If the target real-time positioning information of the terminal device is inconsistent with the real-time positioning information of the vehicle, it is determined that the positioning of the terminal device is inconsistent with that of the vehicle.

[0034] In some embodiments, after the step of if the vehicle is in a parking area, the method further includes:

[0035] Control the terminal device to vibrate;

[0036] If the vibration sound of the terminal device is detected, the vehicle is controlled to provide a reminder that the terminal device has been forgotten.

[0037] In a second aspect, a terminal device forgotten reminder device is provided, comprising:

[0038] A first judgment unit, configured to judge, based on a camera module, whether a distance between a target object and the vehicle is greater than a distance threshold when the vehicle is in a stopped state and at least one door is in an open state;

[0039] A second judgment unit, configured to judge whether the vehicle is in a parking area based on a high-precision map if the distance between the target object and the vehicle is greater than a distance threshold;

[0040] A third judgment unit, which is used to judge whether the positioning of the terminal device and the vehicle is consistent according to the real-time positioning information of the terminal device and the real-time positioning information of the vehicle if the vehicle is in a parking area;

[0041] A forgotten reminder unit is used to control the vehicle to remind the user that the terminal device has been forgotten if the terminal device and the vehicle are located in the same position.

[0042] In some embodiments, the camera module includes a first camera and a second camera, and the first judgment unit is specifically used to:

[0043] Determining whether the target object is a tracking target based on the first camera;

[0044] If yes, tracking the target object based on the second camera to obtain tracking information;

[0045] It is determined whether the distance between the target object and the vehicle is greater than a distance threshold according to the tracking information.

[0046] In some embodiments, the first determination unit is further configured to:

[0047] Collecting target feature information of the target object through the first camera;

[0048] Comparing the target characteristic information with preset characteristic information;

[0049] If the target feature information is consistent with the preset feature information, determining that the target object is a tracking target;

[0050] If the target feature information is inconsistent with the preset feature information, it is determined that the target object is not a tracking target.

[0051] In some embodiments, the first determination unit is further configured to:

[0052] Acquiring a moving image of the target object by using the second camera;

[0053] A state variable value of the target object is calculated based on the moving image, the state variable value including a relative horizontal coordinate and a relative vertical coordinate between the target object and the second camera, and the state variable value is used as tracking information.

[0054] In some embodiments, the second determination unit is specifically configured to:

[0055] Collecting real-time positioning information of the vehicle through high-precision maps;

[0056] comparing the real-time positioning information of the vehicle with the preset positioning information of the parking area;

[0057] If the real-time positioning information of the vehicle is consistent with the preset positioning information of the parking area, it is determined that the vehicle is in the parking area;

[0058] If the real-time positioning information of the vehicle is inconsistent with the preset positioning information of the parking area, it is determined that the vehicle is in a non-parking area.

[0059] In some embodiments, the third judgment unit is specifically used to:

[0060] comparing the real-time positioning information of the terminal device with the real-time positioning information of the vehicle;

[0061] If the real-time positioning information of the terminal device is consistent with the real-time positioning information of the vehicle, it is determined that the preliminary positioning of the terminal device and the vehicle is consistent;

[0062] Acquire the target real-time positioning information of the terminal device after a preset time;

[0063] Comparing the target real-time positioning information of the terminal device with the real-time positioning information of the vehicle;

[0064] If the target real-time positioning information of the terminal device is consistent with the real-time positioning information of the vehicle, it is determined that the positioning of the terminal device is consistent with that of the vehicle;

[0065] If the target real-time positioning information of the terminal device is inconsistent with the real-time positioning information of the vehicle, it is determined that the positioning of the terminal device is inconsistent with that of the vehicle.

[0066] In some embodiments, the forgetting reminder unit is further used for:

[0067] Control the terminal device to vibrate;

[0068] If the vibration sound of the terminal device is detected, the vehicle is controlled to provide a reminder that the terminal device has been forgotten.

[0069] In a third aspect, a terminal device forgetting reminder device is provided, comprising: a memory and a processor, wherein at least one instruction is stored in the memory, and the at least one instruction is loaded and executed by the processor to implement the aforementioned terminal device forgetting reminder method.

[0070] In a fourth aspect, a computer-readable storage medium is provided, wherein the computer storage medium stores a computer program, and when the computer program is executed by a processor, the aforementioned terminal device forgotten reminder method is implemented.

[0071] The beneficial effects brought about by the technical solution provided by the present application include: it can effectively realize the forgotten reminder of the terminal device in scenarios such as without turning off the engine or powering off.

[0072] The present application provides a terminal device forgotten reminder method, apparatus, equipment and readable storage medium, including when the vehicle is in a stopped state and at least one door is in an open state, judging whether the distance between the target object and the vehicle is greater than a distance threshold based on a camera module; if the distance between the target object and the vehicle is greater than the distance threshold, judging whether the vehicle is in a parking area based on a high-precision map; if the vehicle is in a parking area, judging whether the terminal device and the vehicle are positioned consistently based on the real-time positioning information of the terminal device and the real-time positioning information of the vehicle; if the terminal device and the vehicle are positioned consistently, controlling the vehicle to remind the terminal device to be forgotten. The present application uses camera tracking and high-precision maps to determine whether a terminal device is left in the vehicle and to remind the user of the forgotten device. It does not need to use the vehicle being in a stalled or powered-off state as a judgment condition, thereby realizing the terminal device forgotten reminder function in scenarios where the engine does not need to be stalled or powered-off. BRIEF DESCRIPTION OF THE DRAWINGS

[0073] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0074] Figure 1 A flowchart of a method for reminding a terminal device of forgetting a message provided by an embodiment of the present application;

[0075] Figure 2 A schematic diagram of imaging a target object on a camera provided in an embodiment of the present application;

[0076] Figure 3 A schematic diagram of a possible route for a target object after getting off a bus provided in an embodiment of the present application;

[0077] Figure 4 A schematic diagram of the structure of a terminal device forgotten reminder device provided in an embodiment of the present application;

[0078] Figure 5 A schematic diagram of the structure of a terminal device forgotten reminder device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0079] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0080] The embodiments of the present application provide a terminal device forgotten reminder method, device, equipment and readable storage medium, which can solve the related technology.

[0081] To achieve the above objectives, the overall idea of ​​this application is as follows:

[0082] A terminal device forgotten reminder method, the method comprising the following steps:

[0083] Step S10: when the vehicle is in a stopped state and at least one door is in an open state, determining whether the distance between the target object and the vehicle is greater than a distance threshold based on the camera module;

[0084] Step S20: If the distance between the target object and the vehicle is greater than a distance threshold, determining whether the vehicle is in a parking area based on a high-precision map;

[0085] Step S30: if the vehicle is in a parking area, determining whether the terminal device and the vehicle are positioned in the same manner according to the real-time positioning information of the terminal device and the real-time positioning information of the vehicle;

[0086] Step S40: If the terminal device and the vehicle are located in the same position, the vehicle is controlled to provide a reminder that the terminal device has been forgotten.

[0087] The embodiments of the present application are further described in detail below in conjunction with the accompanying drawings.

[0088] See also Figure 1 As shown, the embodiment of the present application provides a terminal device forgotten reminder method, comprising the following steps:

[0089] Step S10: when the vehicle is in a stopped state and at least one door is in an open state, determining whether the distance between the target object and the vehicle is greater than a distance threshold based on the camera module;

[0090] Exemplarily, it should be understood that this embodiment uses whether the vehicle is in a stopped state and whether at least one door is open as the prerequisite judgment condition for the terminal device forgotten reminder, and has nothing to do with whether the vehicle is in an off or power-off state, that is, if the vehicle is in a stopped state and at least one door is open, then a start signal is sent to the central processor to start the terminal device forgotten reminder function, that is, to start judging whether the terminal device is left in the vehicle and to make a forgotten reminder. It should be understood that since there may be multiple target objects in the vehicle that need to be reminded of the terminal device forgotten, and different objects may be in different positions, such as A sitting in the driver's seat, B sitting in the co-pilot seat, C sitting in the left side of the back row, etc., when the vehicle is in a stopped state, as long as the door corresponding to the position of one of the people is open, the terminal device forgotten reminder function will be started. It should be noted that the target objects include but are not limited to drivers and passengers.

[0091] It is understandable that in this embodiment, a camera module is deployed on a vehicle that needs to provide a terminal device forgotten reminder function, and the camera module can be deployed and set at corresponding positions inside and outside the vehicle. When the terminal device forgotten reminder function is activated, the camera module calculates the distance between the object corresponding to the door in the open state and the vehicle, and compares the calculated distance with the distance threshold.

[0092] Determine whether the distance between the target object and the vehicle is greater than a distance threshold based on the camera module

[0093] Further, the camera module includes a first camera and a second camera, and the determining whether the distance between the target object and the vehicle is greater than a distance threshold based on the camera module includes:

[0094] Determining whether the target object is a tracking target based on the first camera;

[0095] If yes, tracking the target object based on the second camera to obtain tracking information;

[0096] It is determined whether the distance between the target object and the vehicle is greater than a distance threshold according to the tracking information.

[0097] Exemplarily, in this embodiment, multiple cameras are used to calculate the distance between the target object and the vehicle. Specifically, cameras can be arranged at suitable positions inside and outside the vehicle according to actual needs; for example, a first camera is arranged above the driver's seat inside the vehicle, and a second camera is mounted on the rearview mirror on the driver's side outside the vehicle. It should be noted that the number of the first camera and the number of the second camera can be determined according to actual needs and are not limited here; when the vehicle is in a stopped state and the left front door (i.e., the door on the driver's side) is opened, the first camera first determines whether the driver gets off from the left front door. If it is detected that the driver gets off from the left front door, the driver is listed as a tracking target and the second camera is started at the same time; the second camera will continue to capture and track the driver's movement position, and calculate the distance between the driver and the vehicle based on the movement position and the preset position of the second camera, and finally determine whether the driver leaves based on the size relationship between the distance and the distance threshold.

[0098] Further, the determining whether the target object is a tracking target based on the first camera includes:

[0099] Collecting target feature information of the target object through the first camera;

[0100] Comparing the target characteristic information with preset characteristic information;

[0101] If the target feature information is consistent with the preset feature information, determining that the target object is a tracking target;

[0102] If the target feature information is inconsistent with the preset feature information, it is determined that the target object is not a tracking target.

[0103] For example, it should be understood that, before determining whether the target object is a tracking target based on the first camera, this embodiment requires the target object to make the first camera face the target object to shoot a video when getting on the car or driving the car, and obtain the current image frame of the video to extract the target feature information of the target object and store it to form a sample. It is understandable that the target feature information can be external form information such as clothing color, or unique information possessed by the target object itself such as facial features. The specific information collected can be determined according to actual needs and is not limited here.

[0104] Take the example of target feature information being clothing color: when the driver is getting on or driving the car, the first camera is directed toward the driver to shoot a video, and the current image frame of the video is acquired, and the driver's clothing color information is extracted and stored to form a sample; when the vehicle is stopped and the left front door is open, the first camera will shoot a video of the driver, and when it is detected that the driver's clothing color in the current frame of the video is the same as the clothing color stored in the sample, the driver is determined to be the tracking target, otherwise the driver is determined not to be the tracking target.

[0105] Furthermore, the tracking the target object based on the second camera to obtain tracking information includes:

[0106] Acquiring a moving image of the target object by using the second camera;

[0107] A state variable value of the target object is calculated based on the moving image, the state variable value including a relative horizontal coordinate and a relative vertical coordinate between the target object and the second camera, and the state variable value is used as tracking information.

[0108] Exemplarily, in this embodiment, after the target object is determined to be a tracking object based on the target feature information collected by the first camera, the second camera will be activated to track and shoot the movement of the tracking object (i.e., the target object), and the image frame corresponding to the target object will be analyzed: the first image frame in which the target object exists is obtained from the video to determine the state variable value of the target object relative to the second camera, i.e., the horizontal and vertical coordinates of the target object relative to the second camera, and the image frames of the target object are continuously analyzed and the state variable value within the preset time is calculated, and finally the distance between the target object and the vehicle can be calculated based on the state variable value. It should be noted that the second camera can preferably be a mature and highly reliable binocular camera, and the specific value of the preset time can be determined according to actual needs and is not limited here.

[0109] The following will be combined Figure 2 The method for calculating the distance between the target object and the vehicle is explained.

[0110] Take the second camera as a binocular camera as an example: the two points A and B on the second camera represent the left aperture center and the right aperture center respectively, the distance between the two aperture centers is known (i.e. b=|AB|), and the focal length f is also known; the position of the target object E is M and N at the left and right imaging points of the second camera respectively. If the position of the target object is different, the positions of the points M and N will also change accordingly; the lengths of MF (i.e. the distance between the target object and the left aperture) and GN (i.e. the distance between the target object and the right aperture) can be measured according to the position of the target object. After measuring the lengths of MF and GN, this embodiment will continue to solve the distance d=EH from point E to the baseline, that is, the distance between the target object and the second camera. Since the second camera is set on the vehicle, the distance between the target object and the second camera is the distance between the target object and the vehicle.

[0111] According to the imaging principle and position relationship of the binocular camera:

[0112]

[0113] Simplifying the above formula, we can get:

[0114]

[0115] Therefore, after obtaining the position information of the target object, the distance between the target object and the vehicle can be calculated in combination with the attribute information of the second camera itself.

[0116] It should be understood that there are often multiple outcomes after the target object gets off the bus, such as: Figure 3 As shown ( Figure 3 The dotted line in the figure indicates returning to the vehicle after a short get-off, and the solid line indicates leaving the vehicle). The first is to go directly to the next destination after getting off; the second is to return to the vehicle after a short get-off, such as opening the passenger door, getting off to check the road conditions, and then immediately returning to the vehicle; the third is to take items from the back seat or trunk before going to the next destination, which will delay a certain amount of time. The second and third scenarios are often prone to misjudgment. Therefore, in order to avoid misjudgment, this embodiment will take the following measures:

[0117] Since the average walking speed of a normal adult is 1.5m / s, data of 10 seconds can be collected to calculate the distance between the target object and the vehicle. For example, when the second camera samples the data of the target object, it can obtain data every 0.5s for distance calculation, and a total of 20 sets of movement data can be obtained within 10s. Then, the real distance between the target object and the vehicle is determined based on the above 20 sets of movement data. This not only makes the result of determining whether the target object has left based on the real distance more reliable, but also eliminates the need to calculate the distance between the target object and the vehicle at every moment, thereby effectively reducing the amount of calculation.

[0118] It is understandable that the length of a general car body is between 3.5 meters and 6 meters. Based on the walking speed and the uncertainty of the target object moving forward or backward, this embodiment can take 2 meters as the alarm distance (i.e., the distance threshold). The calculation starts from the first distance data and the cumulative distance average is obtained. The calculation formula is as follows:

[0119]

[0120] In the formula, represents the cumulative distance average, Sn represents the distance data obtained for the nth time, and n represents the number of sampling distances.

[0121] when It indicates that the target object has left the vehicle, otherwise it indicates that the target object has not left.

[0122] Step S20: If the distance between the target object and the vehicle is greater than a distance threshold, determining whether the vehicle is in a parking area based on a high-precision map;

[0123] For example, in this embodiment, when it is determined that the target object has left, the high-precision map will be activated to obtain the location information of the vehicle, and further determine whether the vehicle is in the parking area based on the high-precision map and the location information of the vehicle, so as to avoid unnecessary determination of whether the terminal device is left in the vehicle. It should be noted that the parking area can be a parking lot or a designated parking space on the street. No matter which one, as long as it is marked on the high-precision map.

[0124] Furthermore, judging whether the vehicle is in a parking area based on a high-precision map includes:

[0125] Collecting real-time positioning information of the vehicle through high-precision maps;

[0126] comparing the real-time positioning information of the vehicle with the preset positioning information of the parking area;

[0127] If the real-time positioning information of the vehicle is consistent with the preset positioning information of the parking area, it is determined that the vehicle is in the parking area;

[0128] If the real-time positioning information of the vehicle is inconsistent with the preset positioning information of the parking area, it is determined that the vehicle is in a non-parking area.

[0129] Exemplarily, in this embodiment, the geographic coordinates (i.e., real-time positioning information) of the vehicle are obtained through a high-precision map, and then the real-time positioning information of the vehicle is compared with the preset positioning information of the parking area marked on the high-precision map to calculate the environment in which the vehicle is located. For example, if the real-time positioning information of the vehicle is consistent with the preset positioning information of the parking area, it is determined that the vehicle is in the parking area and needs to stay in the parking area for a long time; if the real-time positioning information of the vehicle is inconsistent with the preset positioning information of the parking area, it is determined that the vehicle is in a non-parking area, indicating that the target object may have only left for a short time, and at this time, it is not necessary to determine whether the terminal device is left in the car.

[0130] Step S30: if the vehicle is in a parking area, determining whether the terminal device and the vehicle are positioned in the same manner according to the real-time positioning information of the terminal device and the real-time positioning information of the vehicle;

[0131] Exemplarily, in this embodiment, after determining in step S10 and step S20 that the target object has left and the vehicle is in the parking area, it will be necessary to determine and remind whether the terminal device has been left in the vehicle. Specifically, the real-time positioning information of the vehicle can be sent to an application preset on the terminal device that communicates with the vehicle computer, and then the application is used to determine whether the real-time positioning information of the terminal device is consistent with the real-time positioning information of the vehicle. If the two are the same, it can be determined that the terminal device is left in the vehicle, and a reminder of the terminal device being forgotten is issued at the same time; if the two are not the same, it means that the terminal device is not in the vehicle, and no reminder of forgetting is required at this time. It should be noted that the terminal device can be a mobile phone, a tablet computer, or other device with communication function.

[0132] Further, judging whether the positioning of the terminal device and the vehicle is consistent based on the real-time positioning information of the terminal device and the real-time positioning information of the vehicle includes:

[0133] comparing the real-time positioning information of the terminal device with the real-time positioning information of the vehicle;

[0134] If the real-time positioning information of the terminal device is consistent with the real-time positioning information of the vehicle, it is determined that the preliminary positioning of the terminal device and the vehicle is consistent;

[0135] Acquire the target real-time positioning information of the terminal device after a preset time;

[0136] Comparing the target real-time positioning information of the terminal device with the real-time positioning information of the vehicle;

[0137] If the target real-time positioning information of the terminal device is consistent with the real-time positioning information of the vehicle, it is determined that the positioning of the terminal device is consistent with that of the vehicle;

[0138] If the target real-time positioning information of the terminal device is inconsistent with the real-time positioning information of the vehicle, it is determined that the positioning of the terminal device is inconsistent with that of the vehicle.

[0139] By way of example, it should be understood that the positioning accuracy of some devices in the prior art is not very high; for example, the positioning accuracy of some positioning devices can only reach 5 meters. Assuming that the target object has left with the terminal device and is 3 meters away from the vehicle, then due to the limited positioning accuracy of the positioning device, it will be determined that the positioning information of the terminal device is consistent with the positioning information of the vehicle, and then it will be determined that the terminal device is left in the car and a forgotten reminder will be issued. However, in fact, the terminal device is not in the car, but has been taken away by the target object, resulting in a misjudgment problem.

[0140] Therefore, in order to reduce the possibility of misjudgment, this embodiment will first determine whether the real-time positioning information of the terminal device is consistent with the real-time positioning information of the vehicle after determining that the vehicle is in the parking area. If not, it is directly determined that the terminal device is not left in the vehicle; if consistent, it is determined that the terminal device may be left in the vehicle. At this time, it is necessary to continue to collect the target real-time positioning information of the terminal device within the preset time. If the target object leaves with the terminal device, then after the preset time, the distance between the target object and the vehicle will be further expanded, and the distance between the terminal device and the vehicle will also be further expanded (that is, the distance between the terminal device and the vehicle will be greater than the positioning accuracy of the positioning device). At this time, the target real-time positioning information of the terminal device and the real-time positioning information of the vehicle are compared, and it is possible to accurately determine whether the positioning information of the terminal device is consistent with the positioning information of the vehicle to avoid misjudgment. It should be noted that the specific value of the preset time can be determined according to actual needs and is not limited here.

[0141] For example, after determining that the vehicle is in the parking area, the real-time positioning information of the terminal device obtained at the first time is used to determine that the positioning information of the terminal device is consistent with the positioning information of the vehicle. At this time, the target real-time positioning information of the terminal device obtained within the preset time is compared with the real-time positioning information of the vehicle, and it is found that the two are inconsistent, indicating that the terminal device is not in the vehicle, and a misjudgment occurred for the first time.

[0142] Step S40: If the terminal device and the vehicle are located in the same position, the vehicle is controlled to provide a reminder that the terminal device has been forgotten.

[0143] Exemplarily, in this embodiment, when it is determined that the terminal device and the vehicle are positioned in the same way, it means that the terminal device has been left in the vehicle, and at this time, it is necessary to control the vehicle to remind the terminal device to be forgotten. It should be noted that the forgotten reminder can be a sound reminder, or other reminder methods. It can be seen that this embodiment uses camera tracking and high-precision maps to determine whether the terminal device is left in the vehicle and to remind the user to forget. It does not need to use the vehicle being in a stalled or powered-off state as a determination condition, thereby realizing the terminal device forgotten reminder function in scenarios where the engine does not need to be turned off or powered off.

[0144] Further, after the step of if the vehicle is in a parking area, the method further includes:

[0145] Control the terminal device to vibrate;

[0146] If the vibration sound of the terminal device is detected, the vehicle is controlled to provide a reminder that the terminal device has been forgotten.

[0147] Exemplarily, in this embodiment, in addition to determining whether the terminal device is left in the vehicle through the positioning information between the terminal device and the vehicle, it can also be determined by controlling the terminal device to vibrate. Specifically, after determining in step S10 and step S20 that the target object has left and the vehicle is in the parking area, the real-time positioning information of the vehicle can be sent to an application preset on the terminal device that communicates with the vehicle computer. After receiving the real-time positioning information of the vehicle, the application will control the terminal device to start the vibration mode, so that the terminal device vibrates. If the vehicle collects the vibration sound, it means that the terminal device is left in the vehicle, and a reminder of the terminal device being forgotten will be issued; if the vehicle does not collect the vibration sound, it means that the terminal device is not left in the vehicle, and there is no need to issue a reminder of the terminal device being forgotten.

[0148] In summary, the present application establishes a camera tracking calculation model and a high-precision map information calculation model to perform terminal device forgotten reminders, that is, by using a camera to judge the behavior of target objects such as drivers, and combining the position judgment of the high-precision map to form the terminal device forgotten reminder judgment condition, thereby providing a method for terminal device forgotten reminder in complex scenarios without using the vehicle being turned off or powered off as a judgment condition.

[0149] It should be noted that the step numbers of the steps in the embodiments of the present application do not limit the sequence of the operations in the technical solution of the present application.

[0150] See also Figure 4 As shown, based on the same inventive concept as the method embodiment, the embodiment of the present application provides a terminal device forgotten reminder device, including:

[0151] A first judgment unit, configured to judge, based on a camera module, whether a distance between a target object and the vehicle is greater than a distance threshold when the vehicle is in a stopped state and at least one door is in an open state;

[0152] A second judgment unit, configured to judge whether the vehicle is in a parking area based on a high-precision map if the distance between the target object and the vehicle is greater than a distance threshold;

[0153] A third judgment unit, which is used to judge whether the positioning of the terminal device and the vehicle is consistent according to the real-time positioning information of the terminal device and the real-time positioning information of the vehicle if the vehicle is in a parking area;

[0154] A forgotten reminder unit is used to control the vehicle to remind the user that the terminal device has been forgotten if the terminal device and the vehicle are located in the same position.

[0155] Further, the camera module includes a first camera and a second camera, and the first judgment unit is specifically used for:

[0156] Determining whether the target object is a tracking target based on the first camera;

[0157] If yes, tracking the target object based on the second camera to obtain tracking information;

[0158] It is determined whether the distance between the target object and the vehicle is greater than a distance threshold according to the tracking information.

[0159] Furthermore, the first determining unit is further configured to:

[0160] Collecting target feature information of the target object through the first camera;

[0161] Comparing the target characteristic information with preset characteristic information;

[0162] If the target feature information is consistent with the preset feature information, determining that the target object is a tracking target;

[0163] If the target feature information is inconsistent with the preset feature information, it is determined that the target object is not a tracking target.

[0164] Furthermore, the first determining unit is further configured to:

[0165] Acquiring a moving image of the target object by using the second camera;

[0166] A state variable value of the target object is calculated based on the moving image, the state variable value including a relative horizontal coordinate and a relative vertical coordinate between the target object and the second camera, and the state variable value is used as tracking information.

[0167] Furthermore, the second judgment unit is specifically configured to:

[0168] Collecting real-time positioning information of the vehicle through high-precision maps;

[0169] comparing the real-time positioning information of the vehicle with the preset positioning information of the parking area;

[0170] If the real-time positioning information of the vehicle is consistent with the preset positioning information of the parking area, it is determined that the vehicle is in the parking area;

[0171] If the real-time positioning information of the vehicle is inconsistent with the preset positioning information of the parking area, it is determined that the vehicle is in a non-parking area.

[0172] Furthermore, the third judgment unit is specifically used for:

[0173] comparing the real-time positioning information of the terminal device with the real-time positioning information of the vehicle;

[0174] If the real-time positioning information of the terminal device is consistent with the real-time positioning information of the vehicle, it is determined that the preliminary positioning of the terminal device and the vehicle is consistent;

[0175] Acquire the target real-time positioning information of the terminal device after a preset time;

[0176] Comparing the target real-time positioning information of the terminal device with the real-time positioning information of the vehicle;

[0177] If the target real-time positioning information of the terminal device is consistent with the real-time positioning information of the vehicle, it is determined that the positioning of the terminal device is consistent with that of the vehicle;

[0178] If the target real-time positioning information of the terminal device is inconsistent with the real-time positioning information of the vehicle, it is determined that the positioning of the terminal device is inconsistent with that of the vehicle.

[0179] Furthermore, the forgetting reminder unit is also used for:

[0180] Control the terminal device to vibrate;

[0181] If the vibration sound of the terminal device is detected, the vehicle is controlled to provide a reminder that the terminal device has been forgotten.

[0182] It should be noted that those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working process of the above-described device and each unit can refer to the corresponding process in the aforementioned terminal device forgotten reminder method embodiment, and will not be repeated here.

[0183] The terminal device forgotten reminder device provided in the above embodiment can be implemented in the form of a computer program. The computer program can be used in Figure 5 The terminal device shown runs on the forgotten reminder device.

[0184] An embodiment of the present application also provides a terminal device forgotten reminder device, including: a memory, a processor and a network interface connected through a system bus, at least one instruction is stored in the memory, and at least one instruction is loaded and executed by the processor to implement all or part of the steps of the aforementioned terminal device forgotten reminder method.

[0185] The network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art will understand that Figure 5 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0186] The processor may be a CPU, or other general-purpose processors, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor, or the processor may be any conventional processor, etc. The processor is the control center of a computer device, and uses various interfaces and lines to connect various parts of the entire computer device.

[0187] The memory can be used to store computer programs and / or modules. The processor realizes various functions of the computer device by running or executing the computer programs and / or modules stored in the memory and calling the data stored in the memory. The memory can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a video playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as video data, image data, etc.), etc. In addition, the memory can include a high-speed random access memory, and can also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card (SmartMedia Card, SMC), a secure digital (Secure digital, SD) card, a flash card (Flash Card), at least one disk storage device, a flash memory device or other volatile solid-state storage device.

[0188] The embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, all or part of the steps of the aforementioned terminal device forgotten reminder method are implemented.

[0189] The embodiment of the present application implements all or part of the aforementioned process, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of each of the above methods when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, the computer-readable medium does not include electric carrier signals and telecommunication signals.

[0190] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, servers or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) that contain computer-usable program code.

[0191] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0192] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0193] The above description is only a specific implementation of the present application, so that those skilled in the art can understand or implement the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest range consistent with the principles and novel features applied for herein.

Claims

1. A method for reminding a terminal device of being forgotten, characterized in that: The following steps are involved: When the vehicle is in a stopped state and at least one door is in an open state, determining based on the camera module whether the distance between the target object and the vehicle is greater than a distance threshold; If the distance between the target object and the vehicle is greater than a distance threshold, determining whether the vehicle is in a parking area based on a high-precision map; If the vehicle is in a parking area, determining whether the terminal device and the vehicle are positioned in the same manner according to the real-time positioning information of the terminal device and the real-time positioning information of the vehicle; If the terminal device and the vehicle are located in the same position, the vehicle is controlled to remind the user that the terminal device has been forgotten; Wherein, after the step of if the vehicle is in the parking area, the method further includes: Control the terminal device to vibrate; If the vibration sound of the terminal device is detected, the vehicle is controlled to provide a reminder that the terminal device has been forgotten.

2. The terminal device forgotten reminder method according to claim 1, characterized in that: The camera module includes a first camera and a second camera, and the determining whether the distance between the target object and the vehicle is greater than a distance threshold based on the camera module includes: Determining whether the target object is a tracking target based on the first camera; If yes, tracking the target object based on the second camera to obtain tracking information; It is determined whether the distance between the target object and the vehicle is greater than a distance threshold according to the tracking information.

3. The terminal device forgotten reminder method according to claim 2, characterized in that: The determining whether the target object is a tracking target based on the first camera includes: Collecting target feature information of the target object through the first camera; Comparing the target characteristic information with preset characteristic information; If the target feature information is consistent with the preset feature information, determining that the target object is a tracking target; If the target feature information is inconsistent with the preset feature information, it is determined that the target object is not a tracking target.

4. The terminal device forgotten reminder method according to claim 2, characterized in that: The step of tracking the target object based on the second camera to obtain tracking information includes: Acquiring a moving image of the target object by using the second camera; A state variable value of the target object is calculated based on the moving image, the state variable value including a relative horizontal coordinate and a relative vertical coordinate between the target object and the second camera, and the state variable value is used as tracking information.

5. The terminal device forgotten reminder method according to claim 1, characterized in that: The determining whether the vehicle is in a parking area based on a high-precision map includes: Collecting real-time positioning information of the vehicle through high-precision maps; comparing the real-time positioning information of the vehicle with the preset positioning information of the parking area; If the real-time positioning information of the vehicle is consistent with the preset positioning information of the parking area, it is determined that the vehicle is in the parking area; If the real-time positioning information of the vehicle is inconsistent with the preset positioning information of the parking area, it is determined that the vehicle is in a non-parking area.

6. The terminal device forgotten reminder method according to claim 1, characterized in that: The determining, based on the real-time positioning information of the terminal device and the real-time positioning information of the vehicle, whether the positioning of the terminal device is consistent with that of the vehicle comprises: comparing the real-time positioning information of the terminal device with the real-time positioning information of the vehicle; If the real-time positioning information of the terminal device is consistent with the real-time positioning information of the vehicle, it is determined that the preliminary positioning of the terminal device and the vehicle is consistent; Acquire the target real-time positioning information of the terminal device after a preset time; Comparing the target real-time positioning information of the terminal device with the real-time positioning information of the vehicle; If the target real-time positioning information of the terminal device is consistent with the real-time positioning information of the vehicle, it is determined that the positioning of the terminal device is consistent with that of the vehicle; If the target real-time positioning information of the terminal device is inconsistent with the real-time positioning information of the vehicle, it is determined that the positioning of the terminal device is inconsistent with that of the vehicle.

7. A terminal device forgotten reminder device, characterized in that: include: A first judgment unit, configured to judge, based on a camera module, whether a distance between a target object and the vehicle is greater than a distance threshold when the vehicle is in a stopped state and at least one door is in an open state; A second judgment unit, configured to judge whether the vehicle is in a parking area based on a high-precision map if the distance between the target object and the vehicle is greater than a distance threshold; A third judgment unit, which is used to judge whether the positioning of the terminal device and the vehicle is consistent according to the real-time positioning information of the terminal device and the real-time positioning information of the vehicle if the vehicle is in a parking area; A forgotten reminder unit, which is used to control the vehicle to remind the terminal device to be forgotten if the terminal device and the vehicle are located in the same position; Wherein, the forgetting reminder unit is also used for: Control the terminal device to vibrate; If the vibration sound of the terminal device is detected, the vehicle is controlled to provide a reminder that the terminal device has been forgotten.

8. A terminal device forgotten reminder device, characterized in that: include: A memory and a processor, wherein the memory stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the terminal device forgotten reminder method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the terminal device forgotten reminder method according to any one of claims 1 to 6 is implemented.

Images