Vehicle warning methods, devices, equipment and storage media

Abstract

This application discloses a vehicle warning method, device, equipment, and storage medium, belonging to the field of vehicle technology. The method provided in this application, before a user parks, first detects whether there is a no-parking sign near the vehicle. If there is no no-parking sign, it detects whether there is a target object near the vehicle. If there is a target object and it is moving towards the vehicle, it determines the distance between the target object and the vehicle. Based on this distance, it issues a warning signal to remind the user not to park at the current location, thereby preventing illegal parking and affecting other users' travel. Furthermore, the method also determines a navigation route between a third permitted parking location and the second location where the first vehicle is located, guiding the user to the third parking location to meet the user's parking needs. Therefore, this method not only prevents illegal parking but also meets the user's parking requirements.

Description

Technical Field

[0001] This application relates to the field of vehicle technology, and in particular to a vehicle early warning method, device, equipment and storage medium. Background Technology

[0002] In recent years, with the sustained and rapid development of the economy, people's travel habits are changing, and the number of private cars is increasing rapidly year by year, bringing with it the problem of parking. Some roads have no-parking signs, and users, seeing these signs, know that parking is prohibited and will not park on those roads. However, some roads do not have no-parking signs and parking is prohibited. In such cases, users may unknowingly park their vehicles, which is illegal parking and can easily affect the travel of other users. Therefore, for roads without no-parking signs but where parking is prohibited, how to promptly remind users to park and prevent them from parking illegally has become an urgent problem to be solved. Summary of the Invention

[0003] This application provides a vehicle early warning method, device, equipment, and storage medium, which can not only prevent users from parking illegally but also meet users' parking needs. The technical solution is as follows:

[0004] On the one hand, a vehicle warning method is provided, the method comprising:

[0005] Acquire multiple frames of images captured by the camera module of the first vehicle;

[0006] The multi-frame images are subjected to marker detection, and if no no-stopping marker is detected, the multi-frame images are subjected to target detection.

[0007] Upon detecting a target object, determine the direction of travel of the target object;

[0008] When the target object's direction of travel is toward the first vehicle, a first distance is determined; wherein, the first distance is the distance between a first position and a second position, the first position is the position of the target object, and the second position is the position of the first vehicle;

[0009] Based on the first distance, a warning signal is issued; wherein, the warning signal is used to remind the driver not to park the first vehicle at the second location;

[0010] Determine a third location where the first vehicle is permitted to park; obtain a navigation route from the second location to the third location, and broadcast the navigation route.

[0011] In one possible implementation, the multi-frame images include a plurality of second vehicles located in front of or behind the first vehicle;

[0012] The issuance of a warning signal based on the first distance includes:

[0013] When the target object's direction of travel is toward the first vehicle, a first quantity is determined, which is the number of second vehicles located between the first position and the second position;

[0014] Based on the first quantity, a first duration is determined; wherein, the first duration is the time taken for the target object to travel from the first position to the second position;

[0015] The warning signal is issued and a first voice message is broadcast; wherein the first voice message carries the first duration and the first distance, and the first voice message is used to remind the driver to leave the second location.

[0016] In another possible implementation, determining the first duration based on the first quantity includes:

[0017] The target object is subjected to action recognition to obtain the action recognition result of the target object;

[0018] If the action recognition result includes a target action, a second duration is determined; wherein the target action is an action performed by the target object based on the parking position of the second vehicle, and the second duration is the duration taken by the target object to complete the target action;

[0019] The first duration is determined based on the first quantity and the second duration.

[0020] In another possible implementation, the target detection of the multi-frame images includes:

[0021] For each frame of the image, target detection is performed on the image;

[0022] If a human target is detected in the image, the clothing features of the human target are extracted;

[0023] If the clothing features of the human target meet preset conditions, the target object is determined to be detected in the image.

[0024] In another possible implementation, the method further includes:

[0025] If the driver is not in the first vehicle, a second distance is determined; wherein the second distance is the distance between the fourth position and the second position, and the fourth position is the location of the driver.

[0026] A third duration is determined based on the second distance; wherein, the third duration is the time taken for the driving object to travel from the fourth position to the second position;

[0027] Based on the first duration and the third duration, a vehicle relocation instruction is sent to the driver's terminal; wherein the vehicle relocation instruction is used to instruct the driver to move the first vehicle.

[0028] In another possible implementation, sending a vehicle relocation instruction to the driver's terminal based on the first duration and the third duration includes:

[0029] Determine the duration difference between the first duration and the third duration;

[0030] Based on the time difference, determine the urgency of moving the vehicle;

[0031] The vehicle relocation instruction is sent to the terminal, and the vehicle relocation instruction carries the urgency level of the relocation.

[0032] In another possible implementation, the method further includes:

[0033] If the first distance is less than a preset distance and the driving object is not in the first vehicle, a second voice message is played. The second voice message is used to remind the target object that the driving object has been instructed to move the vehicle.

[0034] On the other hand, a vehicle warning device is provided, the device comprising:

[0035] The first acquisition module is used to acquire multiple frames of images captured by the camera module of the first vehicle;

[0036] The detection module is used to perform identifier detection on the multi-frame images, and to perform target detection on the multi-frame images when no no-stopping identifier is detected.

[0037] The first determining module is used to determine the direction of movement of the target object when the target object is detected;

[0038] The second determining module is used to determine a first distance when the direction of movement of the target object is toward the first vehicle; wherein the first distance is the distance between a first position and a second position, the first position is the position of the target object, and the second position is the position of the first vehicle;

[0039] The warning module is used to issue a warning signal based on the first distance; wherein the warning signal is used to remind the driver not to park the first vehicle at the second location;

[0040] The third determining module is used to determine a third location where the first vehicle is allowed to park; obtain a navigation route from the second location to the third location; and broadcast the navigation route.

[0041] In one possible implementation, the multi-frame images include a plurality of second vehicles located in front of or behind the first vehicle;

[0042] The warning module is configured to: determine a first quantity, wherein the first quantity is the number of second vehicles located between the first position and the second position, when the direction of travel of the target object is toward the first vehicle; determine a first duration based on the first quantity, wherein the first duration is the time taken for the target object to travel from the first position to the second position; issue the warning signal and broadcast a first voice message, wherein the first voice message carries the first duration and the first distance, and the first voice message is used to remind the driver to leave the second position.

[0043] In another possible implementation, the warning module is used to perform action recognition on the target object to obtain the action recognition result of the target object; if the action recognition result includes a target action, a second duration is determined; wherein the target action is an action performed by the target object based on the parking position of the second vehicle, and the second duration is the duration taken by the target object to complete the target action; the first duration is determined based on the first quantity and the second duration.

[0044] In another possible implementation, the detection module is configured to perform target detection on each frame of the image; if a human target is detected in the image, extract the clothing features of the human target; and if the clothing features of the human target meet preset conditions, determine that the target object has been detected in the image.

[0045] In another possible implementation, the device further includes:

[0046] The fourth determining module is used to determine a second distance when the driving object is not in the first vehicle; wherein the second distance is the distance between the fourth position and the second position, and the fourth position is the position of the driving object;

[0047] The fifth determining module is used to determine a third duration based on the second distance; wherein the third duration is the time taken for the driving object to travel from the fourth position to the second position;

[0048] The sending module is used to send a vehicle relocation instruction to the driver's terminal based on the first duration and the third duration; wherein the vehicle relocation instruction is used to instruct the driver to move the first vehicle.

[0049] In another possible implementation, the sending module is configured to determine the duration difference between the first duration and the third duration; determine the urgency level of moving the vehicle based on the duration difference; and send the vehicle moving instruction to the terminal, wherein the vehicle moving instruction carries the urgency level of moving the vehicle.

[0050] In another possible implementation, the device further includes:

[0051] The broadcast module is used to broadcast a second voice message when the first distance is less than a preset distance and the driving object is not in the first vehicle. The second voice message is used to remind the target object that it has given the driving object a vehicle-moving instruction.

[0052] On the other hand, an electronic device is provided, comprising a processor and a memory, wherein the memory stores at least one piece of program code, which is loaded and executed by the processor to implement the vehicle warning method described in any of the preceding claims.

[0053] On the other hand, a computer-readable storage medium is provided, wherein at least one piece of program code is stored in the computer-readable storage medium, the at least one piece of program code being loaded and executed by a processor to implement the vehicle warning method described in any of the preceding claims.

[0054] On the other hand, a computer program product is provided, wherein at least one piece of program code is stored therein, the at least one piece of program code being loaded and executed by a processor to implement the vehicle warning method described in any of the preceding claims.

[0055] This application provides a vehicle warning method. Before a user parks, the method first detects whether there is a no-parking sign near the vehicle. If there is no no-parking sign, it detects whether there is a target object near the vehicle. If there is a target object and the target object is moving towards the vehicle, it determines the distance between the target object and the vehicle. Based on the distance, it issues a warning signal to remind the user not to park the vehicle at the current location, thereby preventing the user from parking illegally and affecting the travel of other users.

[0056] Furthermore, this method also determines a navigation route between the permitted third parking location and the second location where the first vehicle is located. This navigation route guides the user to the third parking location, thus meeting the user's parking needs. Therefore, this method not only prevents users from parking illegally but also satisfies their parking requirements.

[0057] It should be understood that the above general description and the following detailed description are merely exemplary and do not limit this disclosure. Attached Figure Description

[0058] Figure 1 This is a schematic diagram of the implementation environment of a vehicle warning method provided in an embodiment of this application;

[0059] Figure 2 This is a flowchart of a vehicle warning method provided in an embodiment of this application;

[0060] Figure 3 This is a flowchart of a vehicle warning method provided in an embodiment of this application;

[0061] Figure 4 This is a schematic diagram of a vehicle warning system provided in an embodiment of this application;

[0062] Figure 5 This is a schematic diagram of the structure of a vehicle warning device provided in an embodiment of this application;

[0063] Figure 6 This is a structural block diagram of a vehicle controller provided in an embodiment of this application. Detailed Implementation

[0064] To make the technical solution and advantages of this application clearer, the embodiments of this application will be described in further detail below.

[0065] The terms "first," "second," "third," and "fourth," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.

[0066] It should be noted that all information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.), and signals involved in this application have been authorized by the user or fully authorized by all parties, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the images, instructions, and locations involved in this application were obtained with full authorization.

[0067] Figure 1 This is a schematic diagram illustrating the implementation environment of a vehicle warning method provided in this application embodiment. See also... Figure 1 The implementation environment includes: electronic devices.

[0068] In one possible implementation, the electronic device is provided as a vehicle controller 101. Accordingly, the implementation environment also includes a camera module 102, which can be connected to the vehicle controller 101 via a wireless or wired network, without specific limitation.

[0069] The vehicle controller 101 and the camera module 102 are located in the same vehicle, which can be an electric vehicle, a hybrid vehicle, or a fuel vehicle, without any specific limitation.

[0070] In this embodiment, the camera module 102 is at least one of a front-view camera, a rear-view camera, a surround-view camera, and a dashcam. If the camera module 102 is a front-view camera, its installation position can be set and changed as needed, for example, it can be installed on the windshield, or above or below the front license plate frame; there is no specific limitation in this regard. If the camera module 102 is a rear-view camera, it can be installed on the trunk or in other locations; there is no specific limitation in this regard. If the camera module 102 is a surround-view camera, it can be installed around the vehicle body.

[0071] In this embodiment, the camera module 102 captures images of the front, rear, and / or surroundings of the vehicle and sends these images to the vehicle controller 101. Based on the images sent by the camera module 102, the vehicle controller 101 determines whether parking is permitted at the current second location. If parking is not permitted, a warning signal is issued to remind the driver that parking at the current location is prohibited. Furthermore, if parking is not permitted at the current location, the vehicle controller 101 also determines a permitted third parking location and establishes a navigation route from the current second location to the third location, thereby guiding the driver to park at the third location.

[0072] In another possible implementation, the electronic device is provided as an image processor within a camera module. In this implementation, the camera module includes an image processor and an image sensor. The image sensor converts optical signals into electrical signals, enabling the camera module to acquire images, which are then sent to the image processor. The image processor executes the method provided in this application based on the image sent by the image sensor.

[0073] In this embodiment of the application, only the example of the electronic device being provided as a vehicle controller is used for illustration.

[0074] Figure 2 This is a flowchart of a vehicle warning method provided in an embodiment of this application, executed by an electronic device. See also... Figure 2 The method includes:

[0075] Step 201: The electronic device acquires multiple frames of images captured by the camera module of the first vehicle.

[0076] The camera module can capture images in real time or periodically, and then send the captured images to electronic devices.

[0077] Step 202: The electronic device performs mark detection on multiple frames of images. If no no-stopping mark is detected, target detection is performed on multiple frames of images.

[0078] Each time the electronic device acquires an image frame, it performs marker detection on that image to determine if a no-parking sign exists. If a no-parking sign is detected, a third voice message is played to remind the driver that parking is prohibited at the current second location. If no no-parking sign is detected, object detection is performed on the image to determine if a target object exists. If a target object is detected, step 203 is executed.

[0079] In the embodiments of this application, the target object can be road traffic management personnel or the driver of other vehicles, and there is no specific limitation on this.

[0080] Step 203: If a target object is detected, the electronic device determines the direction of travel of the target object.

[0081] If a target object is detected, the electronic device can perform face detection on the target object. If no face is detected, the direction of movement of the target object is determined to be away from the first vehicle. If a face is detected, the direction of movement of the target object is determined to be towards the first vehicle, and then step 204 is executed.

[0082] Step 204: When the target object's direction of travel is toward the first vehicle, the electronic device determines the first distance.

[0083] The first distance is the distance between the first position and the second position, where the first position is the location of the target object and the second position is the location of the first vehicle.

[0084] Step 205: The electronic device issues a warning signal based on the first distance.

[0085] The warning signal is used to remind drivers that the first vehicle is not allowed to park in the second location.

[0086] Electronic devices can issue warning signals via the vehicle's audio components and broadcast a fourth voice message. This fourth voice message carries the first distance information to remind the driver to move away from the second location. For example, the fourth voice message could be, "Parking is prohibited here. The target is approaching and is 50 meters away. Please move away as soon as possible."

[0087] Step 206: The electronic device determines a third location where the first vehicle can be parked; obtains a navigation route from the second location to the third location, and broadcasts the navigation route.

[0088] There can be one or more third positions. When there is only one third position, it is the position closest to the second position. When there are multiple third positions, the electronic device determines the third position closest to the second position from among the multiple third positions.

[0089] The electronic device determines the shortest navigation route from the second location to the third location and broadcasts the route via an audio component to guide the driver to the third location to park the first vehicle, thereby meeting the user's parking needs.

[0090] This application provides a vehicle warning method. Before a user parks, the method first detects whether there is a no-parking sign near the vehicle. If there is no no-parking sign, it detects whether there is a target object near the vehicle. If there is a target object and the target object is moving towards the vehicle, it determines the distance between the target object and the vehicle. Based on the distance, it issues a warning signal to remind the user not to park the vehicle at the current location, thereby preventing the user from parking illegally and affecting the travel of other users.

[0091] Furthermore, this method also determines a navigation route between the permitted third parking location and the second location where the first vehicle is located. This navigation route guides the user to the third parking location, thus meeting the user's parking needs. Therefore, this method not only prevents users from parking illegally but also satisfies their parking requirements.

[0092] Figure 3 This is a flowchart of a vehicle warning method provided in an embodiment of this application, executed by an electronic device. See also... Figure 3 The method includes:

[0093] Step 301: The electronic device acquires multiple frames of images captured by the camera module of the first vehicle.

[0094] The camera module can capture images in real time or periodically, and then send the captured images to electronic devices.

[0095] In this embodiment, the camera module can capture one frame of image and send it to the electronic device immediately. Alternatively, the camera module can capture multiple frames of image first, and then send the preset number of frames together to the electronic device. Or, the camera module can capture multiple frames of image first, and then send the multiple frames captured within that period to the electronic device when the time interval between the current time and the last image transmission reaches a certain period. In this embodiment, no specific limitations are imposed.

[0096] The multi-frame images include multiple second vehicles, which are located in front of or behind the first vehicle.

[0097] Step 302: The electronic device performs mark detection on multiple frames of images. If no no-stopping mark is detected, target detection is performed on multiple frames of images.

[0098] The electronic device can perform marker detection on each frame of an image it acquires to determine whether a no-stopping marker exists in the image. The electronic device can also perform marker detection on a preset number of images to determine whether a no-stopping marker exists in that preset number of images. Alternatively, the electronic device can perform marker detection on multiple frames within a single period to determine whether a no-stopping marker exists in any of the multiple frames within that period.

[0099] If a no-parking sign is detected, the electronic device can issue a warning signal and broadcast a third voice message via the vehicle's audio component. This third voice message reminds the driver that parking is prohibited at the current second location. If no no-parking sign is detected, the electronic device performs target detection on multiple frames of images to determine if a target object is detected. If a target object is detected, step 303 is executed.

[0100] In the embodiments of this application, the target object can be road traffic management personnel or the driver of other vehicles, and there is no specific limitation on this.

[0101] If the target is a road traffic management personnel, the process of the electronic device performing target detection on multiple frames of images can be as follows: for each frame of image, the electronic device performs target detection on the image; if a human target is detected in the image, the clothing features of the human target are extracted; if the clothing features of the human target meet the preset conditions, it is determined that a target object has been detected in the image.

[0102] In this implementation, the electronic device can use a target recognition model to detect targets in the image and determine whether there is a human target in the image. If there is a human target, the target recognition model extracts the clothing features of the human target and determines whether the clothing features of the human target meet preset conditions. If the preset conditions are met, it is determined that a target object has been detected in the image.

[0103] The clothing features can include at least one of color features, text features, and hat features. For example, a preset condition is that the target's clothing is green and has text indicating that the target is a road traffic management officer. Accordingly, since the clothing features include color and text features, the electronic device determines whether the target's color feature is green and whether the text feature includes text matching the aforementioned features. If the target's color feature is green and includes the corresponding text, then the clothing features of the target satisfy the preset condition, indicating that the target is a road traffic management officer, meaning the target has been detected.

[0104] In this embodiment of the application, the clothing of road traffic management personnel is distinctive and easily captured and identified. Therefore, it can be identified through a target recognition model.

[0105] The target recognition model can be trained through the following process: an electronic device acquires a training image set and determines the attribute labels and clothing labels corresponding to human targets in the training image set; wherein, the attribute labels are used to indicate whether the human target is a target object, and the clothing labels are used to indicate whether the clothing features of the human target match the clothing features of the target object; based on the training image set and its corresponding attribute labels and clothing labels, the model is trained, and the parameter structure of the model is adjusted during the training process. When the loss function tends to be stable, the first machine learning model is obtained.

[0106] The training image set includes multiple training images; however, the number of training images is not specifically limited in this embodiment. If the human body is the target object, the corresponding attribute label and clothing label can be 1; if the human body is not the target object, the corresponding attribute label and clothing label can be 0. Furthermore, the electronic device can train the model based on a neural network. This neural network can be a YOLOv4 (You Only Look Once version 4) neural network, a residual network, a Faster R-CNN, or other neural networks; no specific limitation is made in this regard.

[0107] After obtaining the first machine learning model, the electronic device can first verify it using a verification image set. After passing the verification, it can then test it using a test image set. After passing the test, the first machine learning model can be used as the target recognition model.

[0108] The ratio of the training image set, validation image set, and test image set can be set and changed as needed. For example, the ratio of the training image set, validation image set, and test image set is 7:2:1.

[0109] If the target object is the driver of another vehicle, the electronic device can perform target detection on multiple frames of images as follows: for each frame of image, the electronic device performs target detection on the image; if a human target is detected in the image and the human target is getting off another vehicle, it is determined that a target object has been detected in the image.

[0110] Step 303: If a target object is detected, the electronic device determines the direction of travel of the target object.

[0111] When a target object is detected, the electronic device can determine the target object's direction of travel using a face detection model. For each frame in which a target object is detected, the electronic device performs face detection on that image. If a face is detected, the target object's direction of travel is determined to be towards the first vehicle; if no face is detected, the target object's direction of travel is determined to be away from the first vehicle.

[0112] In this embodiment, the face detection model and the target recognition model can be two independent models or integrated into one model; no specific limitation is made in this regard. The integrated model simultaneously has the function of detecting both target objects and faces.

[0113] Step 304: When the target object's direction of travel is toward the first vehicle, the electronic device determines the first distance.

[0114] The first distance is the distance between the first position and the second position, where the first position is the location of the target object and the second position is the location of the first vehicle.

[0115] The electronic device can acquire the shooting parameters of the camera module, determine the distance between the position of the target object in the image and the position of the first vehicle, and adjust the distance based on the shooting parameters to obtain the first distance.

[0116] The shooting parameters refer to the ratio by which the camera module reduces the size of the object when shooting it. For example, if the actual size of the object is a first size, and the size of the object in the image obtained by the camera module is a second size, then the shooting parameters are the ratio of the first size to the second size.

[0117] In this implementation, the electronic device determines the product of the shooting parameters and the distance to obtain the first distance.

[0118] Step 305: When the target object's direction of travel is toward the first vehicle, the electronic device determines the first quantity.

[0119] The electronic device determines the number of second vehicles located between the first and second positions from the image, thus obtaining the first number.

[0120] Step 306: The electronic device determines the first duration based on the first quantity.

[0121] In one possible implementation, the electronic device performs action recognition on the target object to obtain the action recognition result of the target object; if the action recognition result includes the target action, a second duration is determined; wherein the target action is the action performed by the target object based on the parking position of the second vehicle, and the second duration is the duration taken by the target object to complete the target action; and a first duration is determined based on a first quantity and a second duration.

[0122] In this implementation, the electronic device can perform action recognition on the target object using an action recognition model to obtain the action recognition result. The electronic device then determines whether the action recognition result includes the target action, and if it does, determines the second duration.

[0123] The target action is the action taken by the target object when the second vehicle is illegally parked. It can be one action or multiple actions. When the target action is a single action, it can be the target object taking a picture of the license plate with a device or the target object signaling to leave. When the target action is multiple actions, these multiple actions can include the target object taking a picture of the license plate with a device, the target object registering with an object in hand, and the target object affixing a notification document to the vehicle, etc. In this embodiment of the application, the target action is not specifically limited.

[0124] Electronic devices can determine the first frame image of the target object performing the target action and the last frame image after the target action is completed from multiple frames of images, determine the time interval between the first frame image and the last frame image, and use this time interval as the second duration.

[0125] The second duration is the time taken for the target object to perform the target action on each second vehicle located between the first and second positions. Therefore, the first duration taken for the target object to move from the first position to the second position is the product of the second duration and the first quantity. That is, the electronic device determines the product of the second duration and the first quantity to obtain the first duration.

[0126] In this embodiment of the application, the action recognition model can be trained through the following process: the electronic device acquires a training video set, which includes target actions of a human target, which may be a target object or a non-target object; the electronic device trains the model based on the training video set and its corresponding target actions to obtain a second machine learning model.

[0127] The electronic device can train a model based on a neural network, which can be an RNN (Recurrent Neural Network) or other deep learning neural networks, without any specific limitations.

[0128] After obtaining the second machine learning model, the electronic device can first verify it through a verification video set, and then test it through a test video set. After passing the test, the second machine learning model can be used as the action recognition model.

[0129] The ratio of the training video set, validation video set, and test video set can be set and changed as needed. For example, the ratio of the training video set, validation video set, and test video set is 7:2:1.

[0130] Step 307: The electronic device issues a warning signal and broadcasts the first voice message.

[0131] If the action recognition result includes the target's action, the electronic device determines that the second vehicle is illegally parked, meaning its parking location is a no-parking zone. Since the second vehicle is located in front of or behind the first vehicle, the first vehicle's location is also a no-parking zone. In this case, the electronic device can issue a warning signal via an audio component and broadcast a first voice message. This first voice message carries a first duration and a first distance, reminding the driver to move away from the second location. For example, the first voice message could be, "The target is 50 meters away and is expected to arrive in 10 minutes. Please move away as soon as possible."

[0132] In this embodiment, the electronic device may also, when determining that the target object's direction of travel is toward the first vehicle, perform motion recognition on the target object using a motion recognition model to obtain the motion recognition result; if the motion recognition result includes the target's motion, determine a first distance; and based on the first distance, issue a warning signal, see [link to relevant documentation]. Figure 4 .

[0133] In this implementation, taking road traffic management personnel as the target object as an example, the electronic device can achieve the following effects: If the target object is a road traffic management personnel and the target object has not performed the target action, the electronic device will not issue a warning signal; if the target object is not a road traffic management personnel and the target object performs the target action, the electronic device will not issue a warning signal; if the target object is not a road traffic management personnel and the target object has not performed the target action, the electronic device will not issue a warning signal. If the target object is a road traffic management personnel and the target object performs the target action, the electronic device determines the first distance and then issues a warning signal.

[0134] Step 308: The electronic device determines a third location where the first vehicle can be parked; obtains a navigation route from the second location to the third location, and broadcasts the navigation route.

[0135] The vehicle is equipped with a map application. Electronic devices can send a location retrieval request to the map application's server. This request carries the location information of a second location, used to request a third location within a first preset distance centered on the second location. Based on the location retrieval request, the map application's server determines the third location and returns it to the electronic device.

[0136] There can be one or more third positions. When there is only one third position, it is the position closest to the second position. When there are multiple third positions, the electronic device determines the third position closest to the second position from among the multiple third positions.

[0137] The electronic device determines the navigation route with the shortest travel time from the second location to the third location, or determines the navigation route with the best road traffic conditions from the second location to the third location, and broadcasts the navigation route through the audio component to guide the driver to park the first vehicle at the third location, thereby meeting the user's parking needs.

[0138] On roads without no-parking signs, users may be unsure whether parking is permitted. If parking is prohibited and the user is unsure, illegal parking is likely, affecting other users' travel. In this embodiment, when traffic management personnel are detected near the vehicle, it indicates that parking is prohibited, and the user is reminded to move the vehicle, thus preventing illegal parking. When other drivers are detected near the vehicle and indicate they must move, it indicates that parking is prohibited or that parking in that location will obstruct other drivers' travel, and the user is reminded to move the vehicle.

[0139] This application provides a vehicle warning method. Before a user parks, the method first detects whether there is a no-parking sign near the vehicle. If there is no no-parking sign, it detects whether there is a target object near the vehicle. If there is a target object and the target object is moving towards the vehicle, it determines the distance between the target object and the vehicle. Based on the distance, it issues a warning signal to remind the user not to park the vehicle at the current location, thereby preventing the user from parking illegally and affecting the travel of other users.

[0140] Furthermore, this method also determines a navigation route between the permitted third parking location and the second location where the first vehicle is located. This navigation route guides the user to the third parking location, thus meeting the user's parking needs. Therefore, this method not only prevents users from parking illegally but also satisfies their parking requirements.

[0141] If parking is prohibited at the current location, and the user has unknowingly parked their car there and is not currently in the vehicle, the electronic device can automatically activate the vehicle relocation reminder function. Under certain conditions, it will send a relocation command to the user's terminal, reminding them to move the car. Alternatively, the user can manually activate the relocation reminder function before leaving the vehicle; in this case, the electronic device will send a relocation command to the user's terminal, reminding them to move the car.

[0142] In one possible implementation, when a target object is detected, and the target object is moving towards the first vehicle, and the driver is not inside the first vehicle, the electronic device determines a second distance, determines a third duration based on the second distance, and sends a vehicle relocation command to the driver's terminal based on the first duration and the third duration.

[0143] The second distance is the distance between the fourth position and the second position, the fourth position is the position of the driving object, and the third duration is the time taken for the driving object to travel from the fourth position to the second position.

[0144] In this implementation, the electronic device can send a location acquisition request to the driver's terminal. Based on the location acquisition request, the terminal determines its current fourth location and sends this fourth location to the electronic device. The electronic device then determines the distance between the fourth location and the second location, obtaining the second distance. This second distance can be the straight-line distance between the fourth and second locations, the farthest distance between them, or the shortest distance between them; no specific limitation is imposed.

[0145] If the second distance is not greater than the second preset distance, the third duration can be the duration of walking. Accordingly, the electronic device determines the third duration based on the walking speed of the driver and the second distance. If the second distance is greater than the second preset distance, the third duration can be the duration of cycling. Accordingly, the electronic device determines the third duration based on the cycling speed and the second distance. Of course, the electronic device can also determine the third duration in other ways. In this embodiment, the method by which the electronic device determines the third duration is not specifically limited.

[0146] In this implementation, the electronic device can determine the time difference between the first time period and the third time period, determine the urgency of moving the vehicle based on the time difference, and send a vehicle moving instruction to the terminal, which carries the urgency of moving the vehicle.

[0147] Electronic devices can pre-determine the correspondence between time difference ranges and the urgency level of moving the vehicle. Different time difference ranges correspond to different levels of urgency; the smaller the time difference range, the higher the urgency level. Based on this correspondence, the electronic device determines the time difference range within which the time difference falls, and then determines the corresponding urgency level. This allows users to move their vehicles as quickly as possible based on the urgency level specified in the vehicle relocation command, thus avoiding illegal parking and obstructing other users' passage.

[0148] Of course, electronic devices can also send a vehicle relocation command directly to the terminal. The relocation command includes a first duration and a third duration, which the user uses to determine the urgency of relocation and then move the vehicle as soon as possible.

[0149] In this embodiment of the application, when the electronic device sends a vehicle relocation command to the terminal, it may also carry a target image. The target image may be an image of a detected target object or an image of a target object performing a target action. There is no specific limitation on this. In this way, the driver can move the vehicle as quickly as possible based on the target image.

[0150] In another possible implementation, when a target object is detected, and the target object is moving towards the first vehicle, and the driver is not inside the first vehicle, the electronic device directly sends a vehicle relocation command to the driver's terminal, which instructs the driver to move the first vehicle.

[0151] It should be noted that the vehicle relocation instruction can be sent in the form of SMS, pop-up message, email, client reminder message, or other forms. In this embodiment, the form of sending the vehicle relocation instruction is not specifically limited.

[0152] In this embodiment, the vehicle relocation reminder function is activated while the vehicle is parked. This function does not overlap with other functions of the vehicle that require computing power in terms of timing, and therefore does not require additional computing power.

[0153] In this embodiment of the application, when the target object moves toward the first vehicle and the distance between the target object and the second position of the first vehicle is less than a preset distance, and the driver is not in the first vehicle, the electronic device can broadcast a second voice message. The second voice message is used to remind the target object that the driver has been instructed to move the vehicle.

[0154] In this implementation, when the target is a road traffic management personnel, and the target is close to or near the first vehicle but the driver has not yet arrived at the location of the first vehicle, the electronic device broadcasts a second voice message through the audio component to remind the target that the driver is on his way.

[0155] In one possible implementation, if the first distance is less than a preset distance and the driver is not inside the first vehicle, the electronic device further determines the driver's terminal's current fifth location and fourth duration, and carries at least one of the fifth location and fourth duration in the second voice message. The fourth duration is the time taken for the driver to travel from the fifth location to the second location.

[0156] In this implementation, when the electronic device broadcasts the second voice message, it also carries at least one of the fifth location and the fourth duration. This allows the target to clearly understand the current location of the driver and the time taken for the driver to reach the second location. When the target is a road traffic management personnel, the target can determine whether to take the target action against the first vehicle based on the fifth location and the fourth duration. When the target is the driver of another vehicle, the target can patiently wait for the driver to move the vehicle.

[0157] In this embodiment of the application, when the driver is not in the first vehicle, the electronic device can also notify the driver to move the vehicle, thereby avoiding affecting the travel of drivers of other vehicles.

[0158] Figure 5 This is a schematic diagram of the structure of a vehicle warning device provided in an embodiment of this application. See also... Figure 5 The device includes:

[0159] The first acquisition module 501 is used to acquire multiple frames of images captured by the camera module of the first vehicle;

[0160] The detection module 502 is used to perform mark detection on multiple frames of images, and to perform target detection on multiple frames of images when no no-stopping mark is detected.

[0161] The first determining module 503 is used to determine the direction of movement of the target object when the target object is detected;

[0162] The second determining module 504 is used to determine a first distance when the target object's direction of travel is toward the first vehicle; wherein, the first distance is the distance between a first position and a second position, the first position is the position of the target object, and the second position is the position of the first vehicle;

[0163] The warning module 505 is used to issue a warning signal based on a first distance; wherein the warning signal is used to remind the driver not to park the first vehicle at the second location;

[0164] The third determining module 506 is used to determine the third location where the first vehicle is allowed to park; obtain the navigation route from the second location to the third location; and broadcast the navigation route.

[0165] In one possible implementation, the multi-frame images include multiple second vehicles, which are located in front of or behind the first vehicle;

[0166] The warning module 505 is used to determine a first quantity when the target object's direction of travel is toward the first vehicle, the first quantity being the number of second vehicles located between the first position and the second position; based on the first quantity, determine a first duration, wherein the first duration is the time taken for the target object to travel from the first position to the second position; issue a warning signal and broadcast a first voice message, wherein the first voice message carries the first duration and a first distance, and the first voice message is used to remind the driver to leave the second position.

[0167] In another possible implementation, the warning module 505 is used to perform action recognition on the target object to obtain the action recognition result of the target object; if the action recognition result includes the target action, a second duration is determined; wherein the target action is the action performed by the target object based on the parking position of the second vehicle, and the second duration is the duration taken by the target object to complete the target action; and a first duration is determined based on the first quantity and the second duration.

[0168] In another possible implementation, the detection module 502 is used to perform target detection on each frame of the image; if a human target is detected in the image, the clothing features of the human target are extracted; if the clothing features of the human target meet preset conditions, it is determined that a target object has been detected in the image.

[0169] In another possible implementation, the device also includes:

[0170] The fourth determining module is used to determine the second distance when the driving object is not in the first vehicle; wherein the second distance is the distance between the fourth position and the second position, and the fourth position is the position of the driving object;

[0171] The fifth determining module is used to determine the third duration based on the second distance; wherein the third duration is the time taken for the driving object to travel from the fourth position to the second position;

[0172] The sending module is used to send a vehicle relocation instruction to the driver's terminal based on a first duration and a third duration; wherein the vehicle relocation instruction is used to instruct the driver to move the first vehicle.

[0173] In another possible implementation, the sending module is used to determine the duration difference between the first duration and the third duration; based on the duration difference, determine the urgency level of moving the vehicle; and send a vehicle moving instruction to the terminal, the vehicle moving instruction carrying the urgency level of moving the vehicle.

[0174] In another possible implementation, the device also includes:

[0175] The broadcast module is used to broadcast a second voice message when the first distance is less than a preset distance and the driver is not in the first vehicle. The second voice message is used to remind the target that the driver has given the instruction to move the vehicle.

[0176] This application provides a vehicle warning device. Before a user parks, the device first detects whether there is a no-parking sign near the vehicle. If there is no no-parking sign, it detects whether there is a target object near the vehicle. If there is a target object and the target object is moving towards the vehicle, it determines the distance between the target object and the vehicle. Based on the distance, it issues a warning signal to remind the user not to park the vehicle at the current location, thereby preventing the user from parking illegally and affecting the travel of other users.

[0177] Furthermore, the device also determines a navigation route between the third permitted parking location and the second location where the first vehicle is located, guiding the user to the third parking location and thus meeting the user's parking needs. Therefore, this device not only prevents users from parking illegally but also satisfies their parking requirements.

[0178] The structural block diagram of the vehicle controller can be found in [reference needed]. Figure 6 The vehicle controller 600 can vary significantly depending on its configuration or performance. It may include a processor (central processing unit, CPU) 601 and a memory 602. The memory 602 stores at least one line of program code, which is loaded and executed by the processor 601 to implement the aforementioned vehicle warning method. Of course, the vehicle controller 600 may also have wired or wireless network interfaces, a keyboard, and input / output interfaces for input and output. The vehicle controller 600 may also include other components for implementing device functions, which will not be elaborated upon here.

[0179] In an exemplary embodiment, a computer-readable storage medium is also provided, which stores at least one piece of program code that is loaded and executed by a processor to implement the vehicle warning method in the above embodiments.

[0180] In an exemplary embodiment, a computer program product is also provided, which stores at least one piece of program code that is loaded and executed by a processor to implement the vehicle warning method in the above embodiments.

[0181] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0182] The above description is only for the purpose of enabling those skilled in the art to understand the technical solution of this application, and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A vehicle pre-warning method characterized by, The method comprises: acquiring a plurality of images collected by a camera module of a first vehicle, the plurality of images comprising a plurality of second vehicles, the plurality of second vehicles being located in front of or behind the first vehicle; performing identification detection on the plurality of images, and performing target detection on the plurality of images in a case where no stop-prohibited identification is detected; in a case where a target object is detected, determining a forward direction of the target object; in a case where the forward direction of the target object is toward the first vehicle, determining a first distance and a first quantity; wherein the first distance is a distance between a first position and a second position, the first position being a position of the target object, the second position being a position of the first vehicle, and the first quantity being a quantity of second vehicles located between the first position and the second position; performing action recognition on the target object to obtain an action recognition result of the target object; in a case where the action recognition result comprises a target action, determining a second time length; wherein the target action is an action made by the target object based on a parking position of the second vehicle, and the second time length is a time length for the target object to complete the target action; based on the first quantity and the second time length, determining a first time length; wherein the first time length is a time for the target object to travel from the first position to the second position; issuing a warning signal and playing a first voice message; wherein the first voice message carries the first time length and the first distance, and the first voice message is used to remind a driving object to drive away from the second position; wherein the warning signal is used to remind the driving object to prohibit parking the first vehicle at the second position; determining a third position at which the first vehicle is allowed to be parked, acquiring a navigation route from the second position to the third position, and playing the navigation route; in a case where the driving object is not in the first vehicle, determining a second distance; wherein the second distance is a distance between a fourth position and the second position, the fourth position being a position of the driving object; based on the second distance, determining a third time length; wherein the third time length is a time for the driving object to travel from the fourth position to the second position; determining a time length difference between the first time length and the third time length; based on a predetermined correspondence between a time length difference range and an urgency level of moving a vehicle, determining a time length difference range in which the time length difference is located; determining an urgency level of moving a vehicle corresponding to the time length difference range; sending a moving instruction to a terminal, the moving instruction carrying the urgency level of moving a vehicle and a target image; wherein the moving instruction is used to instruct the driving object to move the first vehicle, and the target image is an image in which the target object is detected or an image in which the target object makes the target action.

2. The method of claim 1, wherein, The target detection on the plurality of images comprises: for each image, performing target detection on the image; in a case where a human target is detected in the image, extracting a clothing feature of the human target; In a case where a clothing feature of the human target meets a preset condition, it is determined that the target object is detected in the image.

3. The method of claim 1, wherein, The method further includes: In a case where the first distance is less than a preset distance and the driving object is not in the first vehicle, a second voice message is played, the second voice message being used to remind the target object to make a move-away indication to the driving object.

4. A vehicle warning device, characterized by comprising: The device includes: A first acquisition module is configured to acquire a plurality of images collected by a camera module of a first vehicle, the plurality of images including a plurality of second vehicles, the plurality of second vehicles being located in front of or behind the first vehicle; A detection module is configured to perform identification detection on the plurality of images, and perform target detection on the plurality of images in a case where no no-parking identification is detected; A first determination module is configured to determine a forward direction of a target object in a case where the target object is detected; A second determination module is configured to determine a first distance and a first number in a case where the forward direction of the target object is toward the first vehicle, the first distance being a distance between a first position and a second position, the first position being a position where the target object is located, the second position being a position where the first vehicle is located, and the first number being a number of second vehicles located between the first position and the second position; A pre-warning module is configured to perform action recognition on the target object to obtain an action recognition result of the target object, determine a second time length in a case where the action recognition result includes a target action, the target action being an action made by the target object based on a parking position of the second vehicle, the second time length being a time length for the target object to complete the target action, determine a first time length based on the first number and the second time length, the first time length being a time for the target object to move from the first position to the second position, issue a pre-warning signal and play a first voice message, the first voice message carrying the first time length and the first distance, the first voice message being used to remind a driving object to drive away from the second position, and the pre-warning signal being used to remind the driving object to prohibit parking the first vehicle at the second position; A third determination module is configured to determine a third position where the first vehicle is allowed to be parked, acquire a navigation route from the second position to the third position, and play the navigation route; A fourth determination module is configured to determine a second distance in a case where the driving object is not in the first vehicle, the second distance being a distance between a fourth position and the second position, the fourth position being a position where the driving object is located; A fifth determination module is configured to determine a third time length based on the second distance, the third time length being a time for the driving object to move from the fourth position to the second position. The sending module is configured to determine a time difference between the first time length and the third time length; determine a time difference range in which the time difference is located based on a pre-determined correspondence between time difference ranges and urgency levels of moving a vehicle; determine the urgency level of moving a vehicle corresponding to the time difference range; and send a moving instruction to the terminal, the moving instruction carrying the urgency level of moving a vehicle and a target image; wherein the moving instruction is used to instruct the driving object to move the first vehicle, and the target image is an image in which the target object is detected or an image in which the target object performs the target action.

5. An electronic device, comprising: The electronic device includes a processor and a memory, and the memory stores at least one program code, which is loaded and executed by the processor to implement the vehicle warning method according to any one of claims 1 to 3.

6. A computer-readable storage medium, characterized in that, The computer readable storage medium stores at least one program code, which is loaded and executed by the processor to implement the vehicle warning method according to any one of claims 1 to 3.

Images