Ride Safety Prompting Method, Device, Terminal Device and Storage Medium

Abstract

An embodiment of the present application discloses a method, device, terminal device and storage medium for ride safety prompts. The method includes: detecting sound information in a target vehicle and determining a first confidence level according to the sound information; obtaining location information of a navigation destination and determining a second confidence level according to the location information; obtaining time information and determining a third confidence level according to the time information; determining a target result according to the first confidence level, the second confidence level and the third confidence level; if the target result indicates that there is a child in the target vehicle, output a prompt message, where the prompt message is used to prompt to lock the child lock of the target vehicle. Implementing this embodiment can remind the user to lock the child lock and improve the safety of children riding in the vehicle.

Description

Technical Field

[0001] This application relates to the technical field of vehicle safety, and particularly to a method, device, terminal device, and storage medium for vehicle safety prompts. Background Art

[0002] With the development of society and the improvement of people's living standards, vehicles have become an important means of transportation for people to travel. When driving a vehicle with children, users can turn on the child lock of the vehicle to avoid accidents caused by children accidentally opening the door while the vehicle is moving at high speed.

[0003] Currently, most vehicles are equipped with child locks, and the child locks are set on the vehicle door locks. However, when users drive out with children, they often forget to lock the child locks of the vehicle, resulting in the child locks being ineffective and posing a safety hazard. Summary of the Invention

[0004] Embodiments of this application disclose a method, device, terminal device, and storage medium for vehicle safety prompts, which can remind users to lock the child lock and improve the safety of children riding in the vehicle.

[0005] Embodiments of this application disclose a method for vehicle safety prompts, which is applied to a terminal device. The method includes:

[0006] Detect the sound information in the target vehicle and determine the first confidence level according to the sound information;

[0007] Obtain the location information of the navigation destination and determine the second confidence level according to the location information;

[0008] Obtain the time information and determine the third confidence level according to the time information;

[0009] Wherein, the first confidence level, the second confidence level, and the third confidence level are the credibility of the presence of children in the target vehicle;

[0010] Determine the target result according to the first confidence level, the second confidence level, and the third confidence level;

[0011] If the target result indicates the presence of children in the target vehicle, output a prompt message, where the prompt message is used to prompt to lock the child lock of the target vehicle.

[0012] In one embodiment, the terminal device is associated with and stores multiple voiceprint models and the voiceprint identifiers corresponding to each voiceprint model, and the voiceprint identifiers include adult identifiers or child identifiers;

[0013] The determining the first confidence level according to the sound information includes:

[0014] Extract at least one voiceprint feature from the voice information;

[0015] Compare the target voiceprint feature with each of the voiceprint models to obtain the similarity between the target voiceprint feature and each of the voiceprint models; wherein, the target voiceprint feature is any one of the at least one voiceprint feature;

[0016] Among each of the voiceprint models, determine the target voiceprint model whose similarity with the target voiceprint feature is greater than the similarity threshold;

[0017] Determine the voiceprint identifier corresponding to the target voiceprint feature according to the target voiceprint model;

[0018] Determine the first feature result according to the voiceprint identifiers corresponding to each of the voiceprint features;

[0019] If the first feature result indicates that there is a child in the target vehicle, determine the first confidence level corresponding to the first feature result.

[0020] In one embodiment, the terminal device is associated with and stores multiple preset locations and the child matching degrees corresponding to each of the preset locations, and the child matching degree is used to represent the possibility that there is a child in the vehicle going to the preset location;

[0021] The determining the second confidence level according to the location information includes:

[0022] Among each of the preset locations, determine the target preset location corresponding to the location information;

[0023] If the child matching degree corresponding to the target preset location is greater than the matching degree threshold, determine that the second feature result is that there is a child in the target vehicle, and determine the second confidence level corresponding to the second feature result.

[0024] In one embodiment, the time information includes the current date and the current time, and the determining the third confidence level according to the time information includes:

[0025] Obtain at least one preset date segment and the preset time periods corresponding to each of the preset date segments;

[0026] If the current date is within the target date segment among the at least one preset date segment, when the current time is within the preset time period corresponding to the target date segment, determine that the third feature result is that there is a child in the target vehicle, and determine the third confidence level corresponding to the third feature result.

[0027] In one embodiment, the determining the target result according to the first confidence level, the second confidence level, and the third confidence level includes:

[0028] Perform weighted calculation on the first confidence level, the second confidence level, and the third confidence level to obtain a target confidence level;

[0029] If the target confidence level is greater than a preset confidence level threshold, determine that the target result is that there is a child in the target vehicle.

[0030] In one embodiment, if the target result indicates that there is a child in the target vehicle, output a prompt message, including:

[0031] If the target result indicates that there is a child in the target vehicle, obtain navigation information, where the navigation information includes the target distance between the current position information and the location information, and the navigation voice broadcast information;

[0032] If the change speed of the target distance is greater than a speed threshold, determine that the target vehicle is in a driving state and output a prompt message; and / or,

[0033] If it is detected that the navigation voice broadcast information is being output, determine that the target vehicle is in the driving state and output a prompt message.

[0034] In one embodiment, before detecting the sound information in the target vehicle, the method further includes:

[0035] Obtain the ambient volume through the decibel meter of the terminal device;

[0036] If it is detected that the ambient volume is less than a volume threshold, determine that the terminal device enters the target vehicle and perform the step of detecting the sound information in the target vehicle.

[0037] An embodiment of the present application discloses a ride safety prompt device, which is applied to a terminal device. The device includes:

[0038] A first confidence level determination module, configured to detect the sound information in the target vehicle and determine a first confidence level according to the sound information;

[0039] A second confidence level determination module, configured to obtain the location information of the navigation destination and determine a second confidence level according to the location information;

[0040] A third confidence level determination module, configured to obtain time information and determine a third confidence level according to the time information;

[0041] Wherein, the first confidence level, the second confidence level, and the third confidence level are the confidence levels that there is a child in the target vehicle;

[0042] A target result determination module, configured to determine a target result according to the first confidence level, the second confidence level, and the third confidence level;

[0043] A prompt message output module, configured to output a prompt message if the target result indicates that there is a child in the target vehicle.

[0044] In one embodiment, the terminal device is associated with and stores multiple voiceprint models and voiceprint identifiers corresponding to each of the voiceprint models, and the voiceprint identifiers include adult identifiers or child identifiers;

[0045] The first confidence level determination module is further configured to extract at least one voiceprint feature from the voice information; compare the target voiceprint feature with each of the voiceprint models to obtain the similarity between the target voiceprint feature and each of the voiceprint models; where the target voiceprint feature is any one of the at least one voiceprint features; determine a target voiceprint model in each of the voiceprint models whose similarity to the target voiceprint feature is greater than a similarity threshold; determine the voiceprint identifier corresponding to the target voiceprint feature according to the target voiceprint model; determine a first feature result according to the voiceprint identifiers corresponding to each of the voiceprint features; if the first feature result indicates that there is a child in the target vehicle, determine the first confidence level corresponding to the first feature result.

[0046] In one embodiment, the terminal device is associated with and stores multiple preset locations and child matching degrees corresponding to each of the preset locations, and the child matching degree is used to represent the possibility that there is a child in the vehicle going to the preset location;

[0047] The second confidence level determination module is further configured to determine a target preset location corresponding to the location information among each of the preset locations; if the child matching degree corresponding to the target preset location is greater than a matching threshold, determine that the second feature result is that there is a child in the target vehicle, and determine the second confidence level corresponding to the second feature result.

[0048] In one embodiment, the time information includes the current date and the current time, and the third confidence level determination module is further configured to obtain at least one preset date segment and a preset time period corresponding to each of the preset date segments; if the current date is within a target date segment among the at least one preset date segments, when the current time is within the preset time period corresponding to the target date segment, determine that the third feature result is that there is a child in the target vehicle, and determine the third confidence level corresponding to the third feature result.

[0049] In one embodiment, the target result determination module is further configured to perform a weighted calculation on the first confidence level, the second confidence level, and the third confidence level to obtain a target confidence level;

[0050] If the target confidence level is greater than a preset confidence level threshold, determine that the target result is that there is a child in the target vehicle.

[0051] In one embodiment, the prompt information output module is further configured to, if the target result indicates that there is a child in the target vehicle, obtain navigation information, where the navigation information includes a target distance between the current position information and the location information and navigation voice broadcast information; if a change speed of the target distance is greater than a speed threshold, determine that the target vehicle is in a driving state and output prompt information; and / or, if it is detected that the navigation voice broadcast information is being output, determine that the target vehicle is in the driving state and output prompt information.

[0052] In one embodiment, the first confidence level determination module is further configured to obtain an ambient volume; if it is detected that the ambient volume is less than a volume threshold, determine that the terminal device enters the target vehicle and perform the step of detecting sound information in the target vehicle.

[0053] An embodiment of the present application discloses a terminal device, including:

[0054] A memory storing executable program code;

[0055] A processor coupled to the memory;

[0056] The processor calls the executable program code stored in the memory and executes the method described in any of the above embodiments.

[0057] An embodiment of the present application discloses a computer-readable storage medium storing a computer program, where, when the computer program is executed by a processor, the processor is caused to execute the method described in any of the above embodiments.

[0058] Through the method, device, terminal device and storage medium for ride safety prompt disclosed in the embodiments of the present application, the terminal device can detect the sound information in the target vehicle, determine the first confidence level according to the sound information, then obtain the location information of the navigation destination, determine the second confidence level according to the location information, and can also obtain the time information and determine the third confidence level according to the time information. The terminal device determines the target result according to the first confidence level, the second confidence level and the third confidence level. If the target result indicates that there is a child in the target vehicle, a prompt message is output. The terminal device determines the confidence levels respectively through the sound information, the location information and the time information, and then jointly determines the target result through the first confidence level, the second confidence level and the third confidence level, which can improve the accuracy of the target result and remind the user to lock the child lock when the target result is that there is a child in the target vehicle, improving the safety of children riding in the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required in the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0060] Figure 1 is a schematic diagram of an application scenario of a ride safety prompt method disclosed in the embodiments of the present application;

[0061] Figure 2 is a flowchart of a ride safety prompt method disclosed in the embodiments of the present application;

[0062] Figure 3 is a flowchart of determining the first confidence level according to the sound information disclosed in the embodiments of the present application;

[0063] Figure 4 is a flowchart of another ride safety prompt method disclosed in the embodiments of the present application;

[0064] Figure 5 is a modular schematic diagram of a ride safety prompt device disclosed in the embodiments of the present application;

[0065] Figure 6 is a structural block diagram of a terminal device disclosed in the embodiments of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0066] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present application without creative efforts belong to the scope of protection of the present application.

[0067] It should be noted that the terms "including" and "having" and any variations thereof in the embodiments of the present application are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units does not necessarily limit to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products, or devices.

[0068] It can be understood that the terms "first", "second", etc. used in the present application can be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish the first element from another element. For example, without departing from the scope of the present application, the first confidence level can be referred to as the second confidence level, and similarly, the second confidence level can be referred to as the first confidence level. Both the first confidence level and the second confidence level are confidence levels, but they are not the same confidence level.

[0069] The embodiments of the present application disclose a method, device, terminal device, and storage medium for ride safety reminders, which can remind users to lock the child lock and improve the safety of children riding in the car.

[0070] The following will be described in detail in conjunction with the accompanying drawings.

[0071] As Figure 1 shown, Figure 1 is a schematic diagram of an application scenario of a method for ride safety reminders disclosed in the embodiments of the present application. This application scenario includes a terminal device 10 and a target vehicle 20. Among them, the terminal device 10 may include, but is not limited to, mobile phones, tablets, wearable devices, laptop computers, vehicle-mounted terminals, etc. In addition, the operating system of the terminal device 10 may include, but is not limited to, the Android operating system, the IOS operating system, the Symbian operating system, the Black Berry operating system, the Windows Phone8 operating system, etc., which are not limited in the embodiments of the present application. Among them, the terminal device 10 can be fixed inside the target vehicle 20, such as a vehicle-mounted terminal, or can be carried by the user, such as a mobile phone, and this is not restricted.

[0072] In one embodiment, the terminal device 10 can detect the sound information inside the target vehicle 20, determine the first confidence level based on the sound information, then obtain the location information of the navigation destination, determine the second confidence level based on the location information, and can also obtain the time information and determine the third confidence level. Among them, the first confidence level, the second confidence level, and the third confidence level are the credibility of the existence of children inside the target vehicle 20. The terminal device 10 determines the target result based on the first confidence level, the second confidence level, and the third confidence level. If the target result indicates the existence of children inside the target vehicle 20, a prompt message is output, and the prompt message is used to prompt to lock the child lock of the target vehicle 20.

[0073] As Figure 2 shown, Figure 2 FIG. is a schematic flowchart of a method for prompting for ride safety disclosed in an embodiment of the present application. This method for prompting for ride safety can be applied to the terminal device in the above embodiment. This method for prompting for ride safety can include the following steps:

[0074] Step 210, detect the sound information inside the target vehicle and determine the first confidence level based on the sound information.

[0075] The terminal device can be a terminal device fixed inside the target vehicle, and then it can detect the sound information inside the target vehicle in real time. Optionally, the terminal device can also be a terminal device carried by the user. Then the terminal device can determine whether it is inside the target vehicle. The terminal device can detect the sound information inside the target vehicle only when it determines that it is inside the target vehicle.

[0076] Among them, the sound information can be detected by the recorder of the terminal device through the terminal device, or can be detected by the recorder set inside the target vehicle. The target vehicle then sends the detected sound information to the terminal device. The recorder can be an electronic component or electronic device with a recording function. After the terminal device detects the sound information inside the target vehicle, it can also filter the sound information to remove the interference information in the sound information. The terminal device can determine whether there is sound information of children in the sound information inside the target vehicle, so as to obtain the first confidence level. The first confidence level is the credibility of the existence of children inside the target vehicle. Optionally, the terminal device can also calculate the credibility of the non-existence of children inside the target vehicle.

[0077] As an alternative implementation, the terminal device can detect the face information inside the target vehicle and determine a first confidence level based on the face information. The terminal device sends a detection instruction to the target vehicle, and the target vehicle captures a face image containing a face through a camera installed inside and sends the face image to the terminal device. The terminal device can detect the face information in the face image and determine a first confidence level based on the face information. Optionally, the terminal device can detect the face information and voice information inside the target vehicle and jointly determine a first confidence level based on the face information and voice information. The terminal device can also detect other biometric information inside the target vehicle and jointly determine a first confidence level through the face information, voice information, and other biometric information, which is not limited herein. Implementing this implementation, the terminal device can jointly determine a first confidence level through the face information or other biometric information, improving the diversity of methods for determining the first confidence level and the accuracy of the first confidence level.

[0078] In one embodiment, the terminal device can determine a first feature result corresponding to the voice information. If it is determined that the first feature result indicates that there is a child inside the target vehicle, the first confidence level corresponding to the first feature result is determined. Herein, the first feature result is used to indicate whether there is a child inside the target vehicle. Since the first confidence level is the credibility that there is a child inside the target vehicle, when the first feature result indicates that there is no child inside the target vehicle, the first confidence level can be set to 0, or the first confidence level is not calculated, and only other confidence levels are used to determine the target result in subsequent step 240.

[0079] Step 220: Obtain the location information of the navigation destination and determine a second confidence level based on the location information.

[0080] Users usually activate the navigation function of the target vehicle or the terminal device while driving, and when using the navigation function, the user needs to input the navigation destination. Therefore, the terminal device can obtain the location information of the navigation destination and determine a second confidence level based on the location information. The second confidence level can be the credibility that there is a child inside the target vehicle. Optionally, the terminal device can also obtain the current location information and jointly determine the second confidence level based on the current location information and the location information of the navigation destination. For example, the terminal device can obtain that the current location information is a residence and the navigation destination is a school, and then determine the credibility that children are included among the users going from the residence to the school, that is, jointly determine the second confidence level based on the current location information and the location information of the navigation destination.

[0081] Optionally, the location information can be the name of the location, such as xx School, xx Mall, the location information can also be the category of the location, such as residence, mall, school, etc., and the location information can also be the longitude and latitude of the location, which is not limited herein.

[0082] In one embodiment, the terminal device may associatively store multiple preset locations and the child matching degrees corresponding to each preset location, where the child matching degree is used to represent the possibility that there are children in the vehicle going to the preset location. The step of determining the second confidence level according to the location information may include: determining a target preset location corresponding to the location information among the preset locations; if the child matching degree corresponding to the target preset location is greater than the matching degree threshold, determining that the second feature result is that there are children in the target vehicle, and determining the second confidence level corresponding to the second feature result.

[0083] Among them, the preset location may include the name of the location, such as xx School, xx Shopping Mall, and the preset location may also include the category of the location, such as residence, shopping mall, school, etc. The preset location may also include the longitude and latitude of the location, and there is no limitation on this. The terminal device may determine the target preset location corresponding to the location information by using the method corresponding to the type according to the location information and the type of the preset location.

[0084] Optionally, when both the location information and the preset location are the names of the locations, the terminal device may determine the preset location with the same name as the location information among the names of the preset locations, and use the preset location with the same name as the target preset location. For example, if the location information is "The First Primary School in xx City", it may be determined whether there is "The First Primary School in xx City" among the names of the preset locations.

[0085] Another option is that when both the location information and the preset location are the categories of the locations, the terminal device may determine the preset location with the same category as the location information among the categories of the preset locations, and use the preset location with the same category as the target preset location. For example, the preset locations include school, shopping mall, amusement park, residence, and the location information is school, then it may be determined that the target preset location is also school.

[0086] Another optional case is when both the location information and the preset locations are the longitude and latitude of locations. The terminal device can determine the distances between the location information and each preset location based on the longitude and latitude of the location information and the longitude and latitude of each preset location, and thus determine the target preset location according to the distances between the location information and each preset location. Among them, the terminal device can use the preset location with the shortest distance to the location information as the target preset location, or use the preset locations with distances less than the distance threshold to the location information as the target preset locations. For example, there are 3 preset locations A, B, and C stored in the terminal device. The distance between the location information and preset location A is 20m (meter), the distance between the location information and preset location B is 45m, and the distance between the location information and preset location C is 800m. Then the terminal device can use the preset location A with the shortest distance to the location information as the target preset location, or use the preset locations A and B with distances less than the distance threshold of 50m to the location information as the target preset locations. Among them, the target preset location can include one or more.

[0087] The terminal device obtains the child matching degree corresponding to the target preset location from the child matching degrees corresponding to each stored preset location, and compares the child matching degree corresponding to the target preset location with the matching degree threshold, so as to determine the second representation result, where the second representation result is used to represent whether there is a child in the target vehicle. If the child matching degree corresponding to the target preset location is greater than the matching degree threshold, it can be determined that the second representation result is that there is a child in the target vehicle. For example, the child matching degree corresponding to the target preset location is 80%, indicating that the probability that there is a child in the target vehicle going to the target preset location is 80%. The matching degree threshold can be 75%. Since 80% is greater than 75%, it is determined that the second representation result is that there is a child in the target vehicle. Optionally, if there are multiple target preset locations, when the child matching degree corresponding to any target preset location is greater than the matching degree threshold, it can be determined that the second representation result is that there is a child in the target vehicle.

[0088] When the second feature result represents that there is a child in the target vehicle, the terminal device can determine the second confidence corresponding to the second feature result. Among them, the second confidence can be a fixed value set in advance, or a value determined from multiple fixed values set in advance according to the child matching degree, or determined adaptively according to the child matching degree, and this is not limited.

[0089] Implementing this embodiment, the terminal device can associatively store multiple preset locations and the corresponding child matching degrees for each preset location, determine a target preset location corresponding to the location information from the multiple preset locations, and when the child matching degree corresponding to the target preset location is greater than the matching degree threshold, determine that the second characteristic result is that there is a child in the target vehicle, and then determine the second confidence corresponding to the second characteristic result, which can improve the accuracy of the second characteristic result and further improve the accuracy of the second confidence.

[0090] Step 230, obtain time information and determine a third confidence according to the time information.

[0091] Since the travel patterns of children are relatively fixed, the time of taking a vehicle usually falls within a fixed time period, such as the time period for going to and from school. Therefore, the terminal device can obtain the current time information and determine a third confidence according to the time information. The third confidence can be the credibility that there is a child in the target vehicle.

[0092] In one embodiment, the time information may include the current date and the current time. The step of determining a third confidence according to the time information may include: obtaining at least one preset date segment and the corresponding preset time period for each preset date segment; if the current date is within the target date segment of the at least one preset date segment, when the current time is within the preset time period corresponding to the target date segment, determine that the third characteristic result is that there is a child in the target vehicle, and determine the third confidence corresponding to the third characteristic result.

[0093] The terminal device can obtain at least one preset date segment and the corresponding preset time period for each preset date segment from the local database, or obtain at least one preset date segment and the corresponding preset time period for each preset date segment from the Internet big data, or obtain at least one preset date segment and the corresponding preset time period for each preset date segment input by the user, and there is no limitation on this.

[0094] The time information may include the current date and the current time. The current date includes the current month and day. For example, January 1st. The current time includes the current hour, minute, and second. For example, 16:20:59. The preset date segment may include the dates between the initial date and the end date. For example, the preset date segment may include the dates between January 1st and July 1st. The preset time period may include the time between the initial time and the end time. For example, the preset time period may include the time between 15:59:59 and 16:59:59. Each preset date segment may correspond to multiple preset time periods. For example, if the preset date segment is the dates between January 1st and July 1st, the corresponding preset time periods may be the time between 15:59:59 and 16:59:59 and the time between 18:59:59 and 19:59:59. If the preset date segment is the dates between August 1st and October 1st, the corresponding preset time periods may be the time between 15:59:59 and 16:59:59 and the time between 19:59:59 and 20:59:59.

[0095] The terminal device can determine whether the current date is within any of the preset date segments in at least one preset date segment. If the current date is within the target date segment in at least one preset date segment, it obtains the preset time period corresponding to the target date segment, and then determines whether the current time is within the preset time period corresponding to the target date segment. When the current time is within the preset time period corresponding to the target date segment, it determines that the third characteristic result is that there is a child in the target vehicle. The terminal device can determine the third confidence level corresponding to the third characteristic result. The third confidence level can be a fixed value set in advance, or can be determined according to the relationship between the current time and the preset time period corresponding to the target date segment, and there is no limitation on this. When the current date is not within any of the preset date segments, or when the current time is within the preset time period corresponding to the target date segment, it determines that the third characteristic result is that there is no child in the target vehicle. The terminal device can set the third confidence level to 0, or not calculate the third confidence level, and only use other confidence levels to determine the target result in the subsequent step 240.

[0096] Implementing this embodiment, if the current date is within the target date segment in at least one preset date segment, then when the current time is within the preset time period corresponding to the target date segment, the terminal device can determine that the third characteristic result is that there is a child in the target vehicle, and determine the third confidence level corresponding to the third characteristic result, which can improve the accuracy of the third characteristic result, and thus further improve the accuracy of the third confidence level.

[0097] Step 240, determine the target result according to the first confidence level, the second confidence level, and the third confidence level.

[0098] When the terminal device can determine the first confidence level according to the voice information, the second confidence level according to the location information, and the third confidence level according to the time information, the terminal device can determine the target result according to the first confidence level, the second confidence level, and the third confidence level.

[0099] Optionally, the terminal device can determine the target result according to one or more of the first confidence level, the second confidence level, and the third confidence level. When there is information indicating that there is no child in the target vehicle among the voice information, the location information, and the time information, the information indicating that there is a child in the target vehicle among the voice information, the location information, and the time information is selected as the target information, and the terminal device can determine the target result according to the confidence level corresponding to the target information. For example, the terminal device can determine that there is no child in the target vehicle according to the voice information, can determine that there is a child in the target vehicle according to the location information, the location information corresponds to the second confidence level, and can determine that there is a child in the target vehicle according to the time information, the time information corresponds to the third confidence level, then the terminal device can determine the target result according to the second confidence level and the third confidence level.

[0100] In one embodiment, the terminal device can perform weighted calculation on the first confidence level, the second confidence level, and the third confidence level to obtain the target confidence level; if the target confidence level is greater than the preset confidence level threshold, it is determined that the target result is that there is a child in the target vehicle.

[0101] Among them, the first confidence level can correspond to the first weight, the second confidence level can correspond to the second weight, the third confidence level can correspond to the third weight, and the first weight, the second weight, and the third weight can be pre-set, or can be respectively determined according to the magnitudes of the first confidence level, the second confidence level, and the third confidence level.

[0102] The terminal device can perform weighted calculation on the first confidence level, the second confidence level, and the third confidence level to obtain the target confidence level. For example, the first confidence level can be 80, the second confidence level can be 60, the third confidence level can be 60, the first weight corresponding to the first confidence level is 90%, the second weight corresponding to the second confidence level is 5%, and the weight corresponding to the third confidence level is 5%, then the target confidence level obtained by weighted calculation is 78. The terminal device can compare the target confidence level with the preset confidence level threshold, and when the target confidence level is greater than the preset confidence level threshold, determine that the target result is that there is a child in the target vehicle. For example, the target confidence level is 78, the preset confidence level threshold is 75, then the target confidence level is greater than the preset confidence level threshold, and it is determined that the target result is that there is a child in the target vehicle.

[0103] When implementing this embodiment, the terminal device can perform weighted calculation on the first confidence level, the second confidence level, and the third confidence level to obtain a target confidence level, and when the target confidence level is greater than a preset confidence threshold, determine that the target result is that there is a child in the target vehicle. By determining the target result through the target confidence level obtained by combining the first confidence level, the second confidence level, and the third confidence level, the accuracy of the target result can be improved.

[0104] Step 250, if the target result indicates that there is a child in the target vehicle, output a prompt message, where the prompt message is used to prompt to lock the child lock of the target vehicle.

[0105] If the target result indicates that there is a child in the target vehicle, the terminal device can output a prompt message to prompt the user to lock the child lock of the target vehicle. Among them, the output method of the prompt message is not limited, and the prompt message can include but is not limited to voice information, vibration information, and light information, etc. The prompt message can be output by the terminal device, or can be sent by the terminal device to the target vehicle and then output by the target vehicle.

[0106] In the embodiment of the present application, the terminal device can detect the sound information in the target vehicle, determine the first confidence level according to the sound information, then obtain the location information of the navigation destination, determine the second confidence level according to the location information, and can also obtain the time information and determine the third confidence level according to the time information. The terminal device determines the target result according to the first confidence level, the second confidence level, and the third confidence level. If the target result indicates that there is a child in the target vehicle, output a prompt message. The terminal device determines the confidence levels respectively through the sound information, the location information, and the time information, and then jointly determines the target result through the first confidence level, the second confidence level, and the third confidence level, which can improve the accuracy of the target result, and when the target result is that there is a child in the target vehicle, remind the user to lock the child lock, improving the safety of children riding in the car.

[0107] As Figure 3 shown, Figure 3 is a schematic flowchart of a process for determining the first confidence level according to sound information disclosed in the embodiment of the present application, including:

[0108] Step 310, extract at least one voiceprint feature from the sound information.

[0109] There are usually multiple users riding in the target vehicle, and the obtained sound information also includes the sound information of multiple users. The terminal device can extract at least one voiceprint feature from the sound information, and each voiceprint feature corresponds one-to-one with each user.

[0110] Step 320: Compare the target voiceprint feature with each voiceprint model to obtain the similarity between the target voiceprint feature and each voiceprint model. Among them, the target voiceprint feature is any one of at least one voiceprint feature.

[0111] The terminal device can be associated with multiple stored voiceprint models and the voiceprint identifiers corresponding to each voiceprint model. The voiceprint identifiers include adult identifiers or child identifiers. Among the multiple voiceprint models, there can be adult identifiers corresponding to multiple adult identifiers, or there can be adult identifiers corresponding to multiple child identifiers, but each voiceprint model is different. For example, there are 4 voiceprint models. The first voiceprint model can correspond to an adult identifier, and the second voiceprint model can also correspond to an adult identifier, but the first voiceprint model is different from the second voiceprint model. The third voiceprint model can correspond to a child identifier, and the fourth voiceprint model can also correspond to a child identifier, but the third voiceprint model is different from the fourth voiceprint model.

[0112] The terminal device can select any one of at least one voiceprint feature as the target voiceprint feature, and compare the target voiceprint feature with each voiceprint model to obtain the similarity between the first voiceprint model and each voiceprint model. Among them, each voiceprint model can be pre-entered by the regular users of the target vehicle, or can be obtained through training, and there is no restriction on this.

[0113] Step 330: Among each voiceprint model, determine the target voiceprint model whose similarity with the target voiceprint feature is greater than the similarity threshold.

[0114] The terminal device can select, according to the similarity between each voiceprint model and the target voiceprint feature, the target voiceprint model whose similarity with the target voiceprint feature is greater than the similarity threshold from each voiceprint model. Among them, the similarity threshold is data obtained through multiple experiments and is preset in the terminal device.

[0115] Step 340: Determine the voiceprint identifier corresponding to the target voiceprint feature according to the target voiceprint model.

[0116] The terminal device can determine the voiceprint identifier corresponding to the target voiceprint feature according to the target voiceprint model, and the target voiceprint model can include one or more.

[0117] When there is one target voiceprint model, the terminal device can use the voiceprint identifier corresponding to the target voiceprint model as the voiceprint identifier corresponding to the target voiceprint feature. For example, if the voiceprint identifier corresponding to the target voiceprint model is a children's identifier, then the children's identifier can be used as the voiceprint identifier corresponding to the target voiceprint feature. When there are multiple target voiceprint models, the terminal device can determine the voiceprint identifier corresponding to the target voiceprint feature according to the similarity between each target voiceprint model and the target voiceprint feature. Optionally, the terminal device can select the maximum similarity among the similarities between each target voiceprint model and the target voiceprint feature, and use the voiceprint identifier corresponding to the target voiceprint model with the maximum similarity as the voiceprint identifier corresponding to the target voiceprint feature. For example, the similarity between the first target voiceprint model and the target voiceprint feature is 80%, and the similarity between the second target voiceprint model and the target voiceprint feature is 98%. The voiceprint identifier corresponding to the first target voiceprint model is an adult identifier, and the voiceprint identifier corresponding to the second target voiceprint model is a children's identifier. Since 98% is greater than 80%, the children's identifier corresponding to the second target voiceprint model can be used as the voiceprint identifier corresponding to the target voiceprint feature.

[0118] Step 350: Determine a first feature result according to the voiceprint identifiers corresponding to each voiceprint feature.

[0119] Among them, the first feature result is used to represent whether there is a child in the target vehicle. After the terminal device determines the voiceprint identifiers corresponding to each voiceprint feature, the terminal device can determine whether there is a children's identifier among the voiceprint identifiers corresponding to each voiceprint feature. If so, it is determined that the first feature result is that there is a child in the target vehicle. If not, it is determined that the first feature result is that there is no child in the target vehicle.

[0120] Step 360: If the first feature result represents that there is a child in the target vehicle, determine a first confidence level corresponding to the first feature result.

[0121] The terminal device can determine the first confidence level corresponding to the first feature result when the first feature result represents that there is a child in the target vehicle. Among them, the third confidence level can be a fixed value set in advance, or can be determined according to the matching degree between the voiceprint feature corresponding to the children's identifier and the target voiceprint model, and there is no limitation on this. If the first feature result represents that there is no child in the target vehicle, the terminal device can set the third confidence level to 0, or not calculate the third confidence level, and only use other confidence levels to determine the target result in step 240 of the above embodiment.

[0122] In an embodiment of the present application, the terminal device may select any one of at least one voiceprint feature as the target voiceprint feature, and compare the target voiceprint feature with each voiceprint model to obtain the similarity between the target voiceprint feature and each voiceprint model. Among each voiceprint model, a target voiceprint model with a similarity greater than the similarity threshold to the target voiceprint feature is determined, and the voiceprint identifier corresponding to the target voiceprint model may be used as the voiceprint identifier corresponding to the target voiceprint feature. The terminal device may obtain the voiceprint identifier corresponding to each voiceprint feature of at least one voiceprint feature, and then determine a first feature result according to the voiceprint identifiers corresponding to each voiceprint feature. When the first feature result indicates that there is a child in the target vehicle, the first confidence corresponding to the first feature result is determined, and the accuracy of the third confidence can be further improved by improving the accuracy of the third feature result.

[0123] As Figure 4 shown, Figure 4 FIG. is a schematic flowchart of another method for prompting vehicle riding safety disclosed in an embodiment of the present application. This method for prompting vehicle riding safety may be applied to the terminal device in the above embodiment. The method for prompting vehicle riding safety may include the following steps:

[0124] Step 410, obtain the surrounding environment volume.

[0125] Optionally, the terminal device may obtain the surrounding environment volume through a decibel meter at a first time frequency. For example, the terminal device obtains the surrounding environment volume every 2 s (seconds). The terminal device may also obtain the surrounding environment volume through the decibel meter of the terminal device when detecting a volume acquisition operation, where the volume acquisition operation may include, but is not limited to, touch operations, voice operations, and gesture operations, etc., and no limitation is made thereto.

[0126] Step 420, if it is detected that the surrounding environment volume is less than the volume threshold, determine that the terminal device enters the target vehicle, detect the sound information in the target vehicle, and determine the first confidence according to the sound information.

[0127] The terminal device may determine whether the surrounding environment volume is less than the volume threshold, and when it is detected that the surrounding environment volume is less than the volume threshold, determine that the terminal device enters the target vehicle, and then detect the sound information in the target vehicle and determine the first confidence according to the sound information. Optionally, the terminal device may also detect the driving state of the current target vehicle, and when it is detected that the target vehicle is in a driving state, it may also determine that the terminal device enters the target vehicle, and then detect the sound information in the current target vehicle.

[0128] Step 430, obtain the location information of the navigation destination, and determine the second confidence according to the location information.

[0129] Step 440: Obtain time information and determine a third confidence level based on the time information.

[0130] Step 450: Determine a target result based on the first confidence level, the second confidence level, and the third confidence level.

[0131] The methods of steps 430 to 450 may refer to the methods of steps 220 to 240 in the above embodiments and will not be elaborated here.

[0132] Step 460: If the target result indicates that there is a child in the target vehicle, obtain navigation information, where the navigation information includes a target distance between the current position information and the location information and navigation voice broadcast information.

[0133] The terminal device may obtain navigation information when the target result indicates that there is a child in the target vehicle. The navigation information includes a target distance between the current position information and the location information and navigation voice broadcast information. The navigation information may be that of the terminal device in the navigation state or obtained by the terminal device from the target vehicle in the navigation state. The navigation voice broadcast information included in the navigation information may be output by the terminal device or detected by the terminal device from the voice information in the target vehicle, and there is no limitation on this.

[0134] Step 470: If the change speed of the target distance is greater than the speed threshold, determine that the target vehicle is in a driving state and output a prompt message; and / or, if it is detected that navigation voice broadcast information is being output, determine that the target vehicle is in a driving state and output a prompt message.

[0135] The terminal device may continuously obtain navigation information at a second time frequency and store the obtained navigation information in a database. The difference between two adjacent target distances obtained by the terminal device may be used to represent the change speed of the target distance. For example, if the previously obtained target distance is 800m and the currently obtained target distance is 750m, the change speed of the target distance may be represented by 50m each time. When the change speed is greater than the speed threshold, it is determined that the target vehicle is in a driving state, and the terminal device may output a prompt message.

[0136] The terminal device may also obtain the navigation voice broadcast information of the terminal device. When it is detected that the terminal device is outputting navigation voice broadcast information, it may be determined that the target vehicle is in a driving state, and the terminal device may output a prompt message. The terminal device may also detect the navigation voice broadcast information from the voice information in the target vehicle. When it is detected that there is navigation voice broadcast information in the voice in the target vehicle, it indicates that there is other equipment in the target vehicle outputting navigation voice broadcast information, and it may be determined that the target vehicle is in a driving state, and the terminal device outputs a prompt message.

[0137] In the embodiments of the present application, the terminal device can determine whether the terminal device is inside the target vehicle by detecting the ambient volume, and then detect the sound information inside the target vehicle when it is determined that the terminal device is inside the target vehicle, reducing the power consumption of the terminal device. The terminal device can also, when it is determined that the target result indicates that there is a child inside the target vehicle, determine whether the target vehicle is in a driving state based on the obtained navigation information, and only output a prompt message when the target vehicle is in a driving state, thereby improving the accuracy of the output prompt message.

[0138] As Figure 5 shown, Figure 5 is a modular schematic diagram of a ride safety prompt device disclosed in the embodiments of the present application. The ride safety prompt device 500 may include a first confidence determination module 510, a second confidence determination module 520, a third confidence determination module 530, a target result determination module 540, and a prompt message output module 550, where:

[0139] The first confidence determination module 510 is configured to detect the sound information inside the target vehicle and determine the first confidence based on the sound information;

[0140] The second confidence determination module 520 is configured to obtain the location information of the navigation destination and determine the second confidence based on the location information;

[0141] The third confidence determination module 530 is configured to obtain the time information and determine the third confidence based on the time information;

[0142] Wherein, the first confidence, the second confidence, and the third confidence are the confidences that there is a child inside the target vehicle;

[0143] The target result determination module 540 is configured to determine the target result based on the first confidence, the second confidence, and the third confidence;

[0144] The prompt message output module 550 is configured to output a prompt message if the target result indicates that there is a child inside the target vehicle.

[0145] In one embodiment, the terminal device is associated with and stores multiple voiceprint models and the corresponding voiceprint identifiers for each voiceprint model. The voiceprint identifiers include adult identifiers or child identifiers;

[0146] The first confidence determination module 510 is further configured to extract at least one voiceprint feature from the voice information; compare the target voiceprint feature with each voiceprint model to obtain the similarity between the target voiceprint feature and each voiceprint model; wherein, the target voiceprint feature is any one of the at least one voiceprint feature; in each voiceprint model, determine the target voiceprint model whose similarity with the target voiceprint feature is greater than the similarity threshold; determine the voiceprint identifier corresponding to the target voiceprint feature according to the target voiceprint model; determine the first feature result according to the voiceprint identifiers corresponding to the respective voiceprint features; if the first feature result indicates that there is a child in the target vehicle, determine the first confidence corresponding to the first feature result.

[0147] In one embodiment, the terminal device is associated with and stores multiple preset locations and the child matching degrees corresponding to each preset location, where the child matching degree is used to characterize the possibility that there is a child in the vehicle going to the preset location;

[0148] The second confidence determination module 520 is further configured to determine the target preset location corresponding to the location information among the respective preset locations; if the child matching degree corresponding to the target preset location is greater than the matching degree threshold, determine that the second feature result is that there is a child in the target vehicle, and determine the second confidence corresponding to the second feature result.

[0149] In one embodiment, the time information includes the current date and the current time. The third confidence determination module 530 is further configured to obtain at least one preset date segment and the preset time periods corresponding to the respective preset date segments; if the current date is within the target date segment among the at least one preset date segments, when the current time is within the preset time period corresponding to the target date segment, determine that the third feature result is that there is a child in the target vehicle, and determine the third confidence corresponding to the third feature result.

[0150] In one embodiment, the target result determination module 540 is further configured to perform weighted calculation on the first confidence, the second confidence, and the third confidence to obtain the target confidence;

[0151] If the target confidence is greater than the preset confidence threshold, determine that the target result is that there is a child in the target vehicle.

[0152] In one embodiment, the prompt information output module 550 is further configured to, if the target result indicates that there is a child in the target vehicle, obtain navigation information, where the navigation information includes the target distance between the current location information and the location information and the navigation voice broadcast information; if the change speed of the target distance is greater than the speed threshold, determine that the target vehicle is in a driving state, and output prompt information; and / or, if it is detected that the navigation voice broadcast information is being output, determine that the target vehicle is in a driving state, and output prompt information.

[0153] In one embodiment, the first confidence determination module 510 is further configured to obtain the ambient volume through the decibel meter of the terminal device; if it is detected that the ambient volume is less than the volume threshold, it is determined that the terminal device enters the target vehicle, and the step of detecting the sound information in the target vehicle is executed.

[0154] In an embodiment of the present application, the terminal device can detect the sound information in the target vehicle, determine the first confidence according to the sound information, then obtain the location information of the navigation destination, determine the second confidence according to the location information, and can also obtain the time information and determine the third confidence according to the time information. The terminal device determines the target result according to the first confidence, the second confidence, and the third confidence. If the target result indicates that there is a child in the target vehicle, a prompt message is output. The terminal device determines the confidence through the sound information, the location information, and the time information respectively, and then jointly determines the target result through the first confidence, the second confidence, and the third confidence, which can improve the accuracy of the target result and remind the user to lock the child lock when the target result is that there is a child in the target vehicle, improving the safety of children riding in the vehicle.

[0155] As Figure 6 shown, in one embodiment, a terminal device is provided, and the terminal device may include:

[0156] A memory 610 storing executable program code;

[0157] A processor 620 coupled to the memory 610;

[0158] The processor 620 calls the executable program code stored in the memory 610, and can implement the ride safety prompt method provided in the above embodiments.

[0159] The memory 610 may include a random access memory (RAM), and may also include a read-only memory (ROM). The memory 610 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 610 may include a program storage area and a data storage area. Among them, the program storage area may store instructions for implementing the operating system, instructions for implementing at least one function (such as touch function, sound playback function, image playback function, etc.), instructions for implementing the above method embodiments, etc. The data storage area may also store data created during the use of the terminal device.

[0160] The processor 620 may include one or more processing cores. The processor 620 connects various parts within the entire terminal device through various interfaces and circuits. By running or executing instructions, programs, code sets, or instruction sets stored in the memory 610, and by invoking the data stored in the memory 610, it performs various functions of the terminal device and processes data. Optionally, the processor 620 may be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), or programmable logic array (PLA). The processor 620 may integrate a combination of one or more of a central processing unit (CPU), a graphics processing unit (GPU), and a modem, etc. Among them, the CPU mainly processes the operating system, user interface, application programs, etc.; the GPU is responsible for rendering and drawing the display content; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 620 and may be implemented separately through a communication chip.

[0161] It can be understood that the terminal device may include more or fewer structural elements than those shown in the above structural block diagram. For example, it may include a power module, physical buttons, a WiFi (Wireless Fidelity) module, a speaker, a Bluetooth module, sensors, etc., and no further limitation will be made here.

[0162] An embodiment of the present application discloses a computer-readable storage medium that stores a computer program, where the computer program causes a computer to execute the methods described in the above various embodiments.

[0163] In addition, an embodiment of the present application further discloses a computer program product. When the computer program product runs on a computer, it enables the computer to execute all or part of the steps in any one of the ride safety prompt methods described in the above embodiments.

[0164] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program, and this program can be stored in a computer-readable storage medium. The storage medium includes read-only memory (ROM), random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), one-time programmable read-only memory (OTPROM), electrically-erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc memories, magnetic disk memories, tape memories, or any other medium that can be used to carry or store data and is computer-readable.

[0165] The above has introduced in detail a method, device, terminal device and storage medium for ride safety tips disclosed in the embodiments of the present application. Specific examples are used herein to elaborate on the principle and implementation manner of the present application. The description of the above embodiments is only used to help understand the method and its core idea of the present application; at the same time, for those of ordinary skill in the art, according to the idea of the present application, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation to the present application.

Claims

1. A method for providing car ride safety tips, characterized in that, Applied to a terminal device, the method includes: Detecting sound information inside a target vehicle and determining a first confidence level based on the sound information; Obtaining location information of a navigation destination and determining a second confidence level based on the location information; Obtaining time information and determining a third confidence level based on the time information; Wherein, the first confidence level, the second confidence level, and the third confidence level are the credibility of the presence of a child inside the target vehicle; Performing weighted calculation on the first confidence level, the second confidence level, and the third confidence level to obtain a target confidence level, where the first confidence level corresponds to a first weight, the second confidence level corresponds to a second weight, and the third confidence level corresponds to a third weight; If the target confidence level is greater than a preset confidence threshold, determining that the target result is that there is a child inside the target vehicle, and outputting a prompt message, where the prompt message is used to prompt to lock the child lock of the target vehicle.

2. The method according to claim 1, wherein The terminal device is associated with and stores multiple voiceprint models and the voiceprint identifiers corresponding to each of the voiceprint models, where the voiceprint identifiers include adult identifiers or child identifiers; The determining the first confidence level according to the sound information includes: Extracting at least one voiceprint feature from the sound information; Comparing the target voiceprint feature with each of the voiceprint models to obtain the similarity between the target voiceprint feature and each of the voiceprint models; wherein, the target voiceprint feature is any one of the at least one voiceprint feature; Among each of the voiceprint models, determining a target voiceprint model whose similarity with the target voiceprint feature is greater than a similarity threshold; Determining the voiceprint identifier corresponding to the target voiceprint feature according to the target voiceprint model; Determining a first feature result according to the voiceprint identifiers corresponding to each of the voiceprint features; If the first feature result indicates that there is a child inside the target vehicle, determining the first confidence level corresponding to the first feature result.

3. The method according to claim 1, wherein The terminal device is associated with and stores multiple preset locations and the child matching degrees corresponding to each of the preset locations, where the child matching degree is used to characterize the possibility of the presence of a child in a vehicle going to a preset location; The determining the second confidence level according to the location information includes: Among each of the preset locations, determining a target preset location corresponding to the location information; If the child matching degree corresponding to the target preset location is greater than a matching threshold, determining that the second feature result is that there is a child in the target vehicle, and determining the second confidence level corresponding to the second feature result.

4. The method according to claim 1, wherein The time information includes the current date and the current time, and the determining the third confidence level according to the time information includes: Obtaining at least one preset date segment and the preset time periods corresponding to each of the preset date segments; If the current date is within a target date segment among the at least one preset date segment, when the current time is within the preset time period corresponding to the target date segment, determining that the third feature result is that there is a child in the target vehicle, and determining the third confidence level corresponding to the third feature result.

5. The method according to any one of claims 1 to 4, characterized in that, The outputting the prompt message includes: Obtain navigation information, where the navigation information includes the target distance between the current location information and the location information of the place, and navigation voice broadcast information; If the change speed of the target distance is greater than the speed threshold, determine that the target vehicle is in a driving state and output a prompt message; and / or, If it is detected that the navigation voice broadcast information is being output, determine that the target vehicle is in the driving state and output a prompt message.

6. The method according to any one of claims 1 to 4, characterized in that, Before detecting the sound information in the target vehicle, the method further includes: Obtain the surrounding environment volume; If it is detected that the surrounding environment volume is less than the volume threshold, determine that the terminal device enters the target vehicle and perform the step of detecting the sound information in the target vehicle.

7. A vehicle safety prompt device, characterized in that, Applied to a terminal device, the device includes: A first confidence determination module, configured to detect the sound information in the target vehicle and determine a first confidence according to the sound information; A second confidence determination module, configured to obtain the location information of the navigation destination and determine a second confidence according to the location information; A third confidence determination module, configured to obtain time information and determine a third confidence according to the time information; Wherein, the first confidence, the second confidence, and the third confidence are the confidences that there is a child in the target vehicle; A target result determination module, configured to perform a weighted calculation on the first confidence, the second confidence, and the third confidence to obtain a target confidence, where the first confidence corresponds to a first weight, the second confidence corresponds to a second weight, and the third confidence corresponds to a third weight; if the target confidence is greater than a preset confidence threshold, determine that the target result is that there is a child in the target vehicle; A prompt message output module, configured to output a prompt message, where the prompt message is used to prompt to lock the child lock of the target vehicle.

8. A terminal device, characterized in that, Includes: A memory storing executable program code; A processor coupled to the memory; The processor calls the executable program code stored in the memory and executes the method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, wherein when the computer program is executed by a processor, the processor executes the method according to any one of claims 1 to 6.

Images