Vehicle early warning method and apparatus, device, storage medium, and product
Image recognition technology is used to identify whether there are target objects on the road that manage illegal parking, and send out early warning signals when the target objects face the vehicle, solving the problem of users parking on roads where no parking signs are set but prohibited from parking, and achieving avoidance of violations Parking and meeting parking needs.
Patent Information
- Application Number
- PCT/CN2024/096405
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-06-01
- Filing Date
- 2024-05-30
- Publication Date
- 2024-12-05
AI Technical Summary
On roads where no parking signs are set but parking vehicles are prohibited, users may park without their knowledge, resulting in illegal parking and affecting other users' travel.
Images are collected through the camera module, identification detection and target detection are carried out, and the forward direction and distance of the target object are identified. If the target object is facing the vehicle, an early warning signal is issued to remind the driver to prohibit parking of the vehicle, and to determine the third position that is allowed to be parked, providing navigation Route to guide users to park at the third location.
It effectively avoids users' parking on roads that are prohibited, reduces illegal parking situations, meets users' parking needs, and improves driving experience.
Smart Images

Figure CN2024096405_05122024_PF_FP_ABST
Abstract
Description
Vehicle early warning method, device, equipment, storage medium and product
[0001] This application claims priority to Chinese patent application number 202310651331.0, filed on June 1, 2023, entitled “Vehicle Warning Method, Device, Equipment and Storage Medium,” the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of vehicle technology, and in particular to a vehicle early warning method, device, equipment, storage medium and product. Background Art
[0003] In recent years, with the continued rapid development of the economy, people's travel patterns are changing, and the number of private cars has increased rapidly year by year, which has brought with it the problem of parking. Some roads have no parking signs. Users see the no-parking signs and know that parking is prohibited on the road, so they will not park there. On the other hand, some roads do not have no-parking signs, but parking is prohibited. In this case, users may park on the road without knowing it. This parking method is illegal and easily affects other users' travel. Therefore, for those roads that do not have no-parking signs but do prohibit parking, how to promptly remind users when they park to prevent users from parking illegally has become an urgent problem that needs to be solved.
[0004] Summary of the Invention
[0005] The embodiments of the present application provide a vehicle warning method, device, equipment, storage medium, and product that can not only prevent users from illegally parking but also meet their parking needs. The technical solution is as follows:
[0006] In one aspect, a vehicle early warning method is provided, the method comprising:
[0007] Acquire multiple frames of images captured by a camera module of the first vehicle;
[0008] performing sign detection on the multiple frames of images, and performing target detection on the multiple frames of images if no no-parking sign is detected in the multiple frames of images;
[0009] In the case where a target object is detected in the multiple frames of images, determining a moving direction of the target object, wherein the target object is an object for managing illegal parking;
[0010] When the target object is moving toward the first vehicle, determining a first distance; wherein the first distance is a distance between a first position and a second position, the first position being a position of the target object, and the second position being a position of the first vehicle;
[0011] Based on the first distance, issuing a warning signal; wherein the warning signal is used to remind the driver of the first vehicle not to park the first vehicle at the second location;
[0012] Determine a third location where the first vehicle is allowed to be parked; obtain a navigation route from the second location to the third location, and broadcast the navigation route.
[0013] In a possible implementation, the multiple frames of images include at least one second vehicle, and the at least one second vehicle is located in front of or behind the first vehicle;
[0014] The issuing of a warning signal based on the first distance includes:
[0015] determining a first number, the first number being the number of second vehicles located between the first location and the second location;
[0016] Determine a first duration based on the first number; wherein the first duration is the duration taken by the target object to move from the first position to the second position;
[0017] The warning signal is issued and a first voice message is broadcast; wherein the first voice message carries the first duration and the first distance, and the first voice message is used to remind the driving object to drive the first vehicle away from the second position.
[0018] In another possible implementation, determining the first duration based on the first number includes:
[0019] Performing action recognition on the target object to obtain an action recognition result of the target object;
[0020] When the action recognition result includes a target action, determining a second duration; wherein the target action is an action performed by the target object based on the parking position of the second vehicle, and the second duration is the duration taken by the target object to complete the target action;
[0021] The first duration is determined based on the first number and the second duration.
[0022] In another possible implementation, performing target detection on the multiple image frames includes:
[0023] For each frame of image, performing target detection on the image;
[0024] When a human target is detected in the image, extracting clothing features of the human target;
[0025] In a case where the clothing feature of the human target is a preset clothing feature, it is determined that the target object is detected in the image, and the preset clothing feature is a clothing feature of an object for managing illegal parking.
[0026] In another possible implementation, the method further includes:
[0027] When the driving object is not in the first vehicle, determining a second distance; wherein the second distance is a distance between a fourth position and the second position, and the fourth position is a position of the driving object;
[0028] Determining a third duration based on the second distance; wherein the third duration is the duration taken by the driving object to move from the fourth position to the second position;
[0029] Based on the first duration and the third duration, a vehicle moving notification is sent to the terminal of the driving object; wherein the vehicle moving notification is used to notify the driving object to move the first vehicle.
[0030] In another possible implementation, the sending of the vehicle moving notification to the driver's terminal based on the first duration and the third duration includes:
[0031] determining a duration difference between the first duration and the third duration;
[0032] Determine the urgency of moving the vehicle based on the time difference;
[0033] The vehicle moving notification is sent to the terminal, where the vehicle moving notification carries the urgency of the vehicle moving.
[0034] In another possible implementation, the method further includes:
[0035] When the first distance is less than a preset distance and the driving object is not in the first vehicle, a second voice message is broadcasted, where the second voice message is used to remind the target object that the target object has instructed the driving object to move the vehicle.
[0036] In another aspect, a vehicle warning device is provided, comprising:
[0037] A first acquisition module is used to acquire multiple frames of images captured by a camera module of the first vehicle;
[0038] a detection module, configured to perform sign detection on the multiple frames of images, and if no no-parking sign is detected in the multiple frames of images, perform target detection on the multiple frames of images;
[0039] A first determining module is configured to determine a moving direction of a target object when a target object is detected in the plurality of image frames, wherein the target object is an object for managing illegal parking;
[0040] a second determining module, configured to determine a first distance when the target object is moving toward the first vehicle; wherein the first distance is a distance between a first position and a second position, the first position being a position of the target object, and the second position being a position of the first vehicle;
[0041] a warning module, configured to issue a warning signal based on the first distance; wherein the warning signal is configured to remind the driver of the first vehicle that the first vehicle is prohibited from parking at the second location;
[0042] The third determining module is used to determine a third location where the first vehicle is allowed to be parked; obtain a navigation route from the second location to the third location, and broadcast the navigation route.
[0043] In a possible implementation, the multiple frames of images include at least one second vehicle, and the at least one second vehicle is located in front of or behind the first vehicle;
[0044] The early warning module is used to determine a first number when the target object is moving towards the first vehicle, the first number being the number of second vehicles located between the first position and the second position; determine a first duration based on the first number; wherein the first duration is the duration taken for the target object to move from the first position to the second position; issue the early warning signal and broadcast a first voice message; wherein the first voice message carries the first duration and the first distance, and the first voice message is used to remind the driving object to drive the first vehicle away from the second position.
[0045] In another possible implementation, the early warning module is used to perform action recognition on the target object to obtain an action recognition result of the target object; when the action recognition result includes the target action, a second duration is determined; wherein, the target action is the action performed by the target object based on the parking position of the second vehicle, and the second duration is the duration taken by the target object to complete the target action; the first duration is determined based on the first number and the second duration.
[0046] In another possible implementation, the detection module is used to perform target detection on each frame of the image; when it is detected that the image includes a human target, the clothing features of the human target are extracted; when the clothing features of the human target are preset clothing features, it is determined that the target object is detected in the image, and the preset clothing features are clothing features of objects for managing illegal parking.
[0047] In another possible implementation, the apparatus further includes:
[0048] a fourth determining module, configured to determine a second distance when the driving object is not in the first vehicle; wherein the second distance is a distance between a fourth position and the second position, and the fourth position is a position of the driving object;
[0049] a fifth determining module, configured to determine a third duration based on the second distance; wherein the third duration is the duration taken by the driving object to move from the fourth position to the second position;
[0050] A sending module is used to send a vehicle moving notification to the terminal of the driving object based on the first duration and the third duration; wherein the vehicle moving notification is used to notify the driving object to move the first vehicle.
[0051] In another possible implementation, the sending module is configured to determine a time difference between the first time duration and the third time duration; determine an urgency of moving the vehicle based on the time difference; and send the vehicle moving notification to the terminal, wherein the vehicle moving notification carries the urgency of moving the vehicle.
[0052] In another possible implementation, the apparatus further includes:
[0053] The broadcast module is used to broadcast a second voice message when the first distance is less than a preset distance and the driving object is not in the first vehicle. The second voice message is used to remind the target object that the driving object has been instructed to move the vehicle.
[0054] On the other hand, an electronic device is provided, comprising a processor and a memory, wherein the memory stores at least one program code, and the at least one program code is loaded and executed by the processor to implement any of the above-mentioned vehicle warning methods.
[0055] On the other hand, a computer-readable storage medium is provided, in which at least one program code is stored. The at least one program code is loaded and executed by a processor to implement any of the above-mentioned vehicle warning methods.
[0056] On the other hand, a computer program product is provided, wherein at least one program code is stored in the computer program product, and the at least one program code is loaded and executed by a processor to implement any of the above-mentioned vehicle warning methods.
[0057] An embodiment of the present application provides a vehicle warning method. Before a user parks the vehicle, the method uses image recognition technology to identify whether there is a target object moving toward the first vehicle when there is no no-parking sign near the vehicle. Since the target object is an object for managing illegal parking, if there is a target object moving toward the first vehicle, it means that although there is no no-parking sign on the road section where the vehicle is currently located, parking is prohibited on that road section. At this time, a warning signal is issued to remind the user that it is prohibited to park the vehicle at the current location, thereby avoiding the user from illegally parking and affecting the travel of other users.
[0058] Furthermore, the method further determines a navigation route between a third permitted parking location and the second location of the first vehicle, and guides the user to the third location using the navigation route to park, thereby satisfying the user's parking needs. Thus, this method can not only prevent users from illegally parking, but also satisfy the user's parking needs.
[0059] It should be understood that the foregoing general description and the following detailed description are exemplary only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0060] FIG1 is a schematic diagram of an implementation environment of a vehicle warning method provided in an embodiment of the present application;
[0061] FIG2 is a flow chart of a vehicle warning method provided by an embodiment of the present application;
[0062] FIG3 is a flow chart of a vehicle warning method provided by an embodiment of the present application;
[0063] FIG4 is a schematic diagram of a vehicle warning provided by an embodiment of the present application;
[0064] FIG5 is a schematic structural diagram of a vehicle warning device provided in an embodiment of the present application;
[0065] FIG6 is a structural block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0066] In order to make the technical solutions and advantages of the present application clearer, the implementation methods of the present application are described in further detail below.
[0067] The terms "first," "second," "third," and "fourth," etc. in the specification and claims of this application and the accompanying drawings are used to distinguish different objects, not to describe a specific order. In addition, the terms "including" and "having," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or elements is not limited to the listed steps or elements, but may optionally include steps or elements not listed, or may optionally include other steps or elements inherent to the process, method, product, or apparatus.
[0068] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, storage, display, etc.), and signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the images, instructions, locations, etc. involved in this application are all obtained with full authorization.
[0069] FIG1 is a schematic diagram of an implementation environment of a vehicle warning method provided in an embodiment of the present application. Referring to FIG1 , the implementation environment includes: an electronic device.
[0070] In a possible implementation, the electronic device is provided as a vehicle controller 101. Accordingly, the implementation environment further includes: a camera module 102. The vehicle controller 101 and the camera module 102 can be connected via a wireless or wired network, which is not specifically limited.
[0071] The vehicle controller 101 and the camera module 102 are located in the same vehicle, which may be an electric vehicle, a hybrid vehicle, or a fuel vehicle, without specific limitation.
[0072] In the embodiment of the present application, the camera module 102 is at least one of a vehicle's front-view camera, rear-view camera, surround-view camera, and driving recorder. In the case where the camera module 102 is a front-view camera, its installation position can be set and changed as needed. For example, the camera module 102 can be installed on the front windshield, or above or below the front license plate frame, without specific limitation. In the case where the camera module 102 is a vehicle's rear-view camera, it can be installed on the trunk or other locations, without specific limitation. In the case where the camera module 102 is a vehicle's surround-view camera, it can be installed around the vehicle body.
[0073] In an embodiment of the present application, the camera module 102 captures images of the front, rear, and / or surrounding areas of the vehicle and transmits the captured images to the vehicle controller 101. The vehicle controller 101 determines whether parking is permitted at the current second location based on the images transmitted by the camera module 102. If parking is not permitted, the vehicle controller 101 issues a warning signal, thereby reminding the driver that parking is prohibited at the current location. Furthermore, if parking is not permitted at the current location, the vehicle controller 101 further determines a third location where parking is permitted and determines a navigation route from the current second location to the third location, thereby guiding the driver to park at the third location.
[0074] In another possible implementation, the electronic device is provided as an image processor in a camera module. In this implementation, the camera module includes an image processor and an image sensor. The image sensor converts optical signals into electrical signals, enabling the camera module to capture images, which are then transmitted to the image processor. The image processor executes the method provided herein based on the images transmitted by the image sensor.
[0075] In the embodiments of the present application, only the electronic device provided as a vehicle controller is taken as an example for description.
[0076] FIG2 is a flow chart of a vehicle warning method provided by an embodiment of the present application, which is executed by an electronic device. Referring to FIG2 , the method includes:
[0077] Step 201: The electronic device obtains multiple frames of images captured by a camera module of a first vehicle.
[0078] The multiple frames of images include images of the front, rear, and / or surrounding areas of the first vehicle. In one possible implementation, the camera module may capture images in real time or periodically and then transmit the captured images to the electronic device. In another possible implementation, the camera module may capture images when the first vehicle is parked and then transmit the captured images to the electronic device.
[0079] Step 202: The electronic device performs sign detection on the multiple frames of images, and if no no-parking sign is detected, performs target detection on the multiple frames of images.
[0080] Each time the electronic device captures an image frame, it performs identification detection on the image to detect whether a no-parking sign is present in the image. If a no-parking sign is detected in the image, a third voice message is broadcast, which serves to remind the driver of the first vehicle that parking is prohibited at the second location. If no no-parking sign is detected in the image, object detection is performed on the image to detect whether a target object is present. If a target object is detected in the image, step 203 is executed. If no target object is detected in the image, identification recognition is performed on the next received image frame, and so on until the target object is detected in the image, at which point step 203 is executed.
[0081] A no-parking sign is a sign indicating that parking is prohibited; for example, a no-parking sign can be a no-parking sign or a no-parking stopper. In the embodiments of the present application, the target object is the object of illegal parking management; for example, the target object can be a road traffic management personnel, or the driver of other vehicles; the target object can also be a road volunteer or a pedestrian whose traffic is affected, etc., without specific limitation.
[0082] One thing that needs to be explained is that after the electronic device broadcasts the third voice message, the electronic device determines whether the first vehicle has been moved away; if the first vehicle has not been moved away, the electronic device will also perform target detection on the acquired image to detect whether there is a target object in the image; if the target object is detected in the image, step 203 is executed; if the first vehicle has been moved away, the electronic device may not perform target detection on the acquired image, that is, the electronic device does not perform further processing.
[0083] Step 203: When the target object is detected in the multiple frames of images, the electronic device determines the moving direction of the target object.
[0084] If the target object is detected in the multiple image frames, the electronic device may perform face detection on the target object in the multiple image frames. If no face is detected in the multiple image frames, the target object is determined to be moving away from the first vehicle, and the electronic device may not perform further processing. If a face is detected in the multiple image frames, the target object is determined to be moving toward the first vehicle, and step 204 is then executed.
[0085] Step 204 : When the target object is moving toward the first vehicle, the electronic device determines a first distance.
[0086] The first distance is a distance between a first position and a second position, the first position is a position of the target object, and the second position is a position of the first vehicle.
[0087] Step 205: The electronic device sends a warning signal based on the first distance.
[0088] The warning signal is used to remind the driver of the first vehicle that parking the first vehicle at the second location is prohibited. The electronic device can transmit the warning signal via the vehicle's audio component and broadcast a fourth voice message via the audio component. The fourth voice message includes the first distance and is used to remind the driver of the first vehicle to leave the second location. For example, the fourth voice message may be "No parking here. The target vehicle is approaching. It is 50 meters away. Please leave as soon as possible."
[0089] After the electronic device issues a warning signal, it can also determine whether the first vehicle has been moved away. If the first vehicle has not been moved away, the warning signal is issued again, and the warning level of the warning signal is increased. For example, the sound intensity of the warning signal issued by the electronic device for the first time is a first intensity, and the sound intensity of the warning signal issued for the second time is a second intensity, and the second intensity is greater than the first intensity. In an embodiment of the present application, if the driver of the first vehicle does not move away from the first vehicle in a timely manner, a high-intensity warning signal will be used to warn the driver of the first vehicle, thereby improving the warning effect.
[0090] Step 206: The electronic device determines a third location where the first vehicle is allowed to be parked; obtains a navigation route from the second location to the third location, and broadcasts the navigation route.
[0091] The electronic device determines a candidate area range, and determines a third position where the first vehicle is allowed to be parked from the candidate area range. The candidate area range is an area range composed of position points whose distance from the second position is not greater than a first preset distance. The third position can be one or more. When there are multiple third positions, the electronic device determines the third position closest to the second position from the multiple third positions; or, when there are multiple third positions, the electronic device determines the destination of the first vehicle's current drive, and determines the third position closest to the destination from the multiple third positions. For example, if the destination of the first vehicle's current drive is a shopping mall, the electronic device determines the third position closest to the shopping mall from the multiple third positions, and then, based on the navigation route from the second position to the third position, instructs the driver of the first vehicle to drive the first vehicle to the third position for parking, thereby reducing the distance the driver of the first vehicle has to walk and improving the driving experience.
[0092] The electronic device determines a navigation route with the shortest time from the second position to the third position, and broadcasts the navigation route through the audio component to guide the driver of the first vehicle to drive the first vehicle to the third position for parking, thereby meeting the user's parking needs.
[0093] An embodiment of the present application provides a vehicle warning method. Before a user parks the vehicle, the method uses image recognition technology to identify whether there is a target object moving toward the first vehicle when there is no no-parking sign near the vehicle. Since the target object is an object for managing illegal parking, if there is a target object moving toward the first vehicle, it means that although there is no no-parking sign on the road section where the vehicle is currently located, parking is prohibited on that road section. At this time, a warning signal is issued to remind the user that it is prohibited to park the vehicle at the current location, thereby avoiding the user from illegally parking and affecting the travel of other users.
[0094] Furthermore, the method further determines a navigation route between a third permitted parking location and the second location of the first vehicle, and guides the user to the third location using the navigation route to park, thereby satisfying the user's parking needs. Thus, this method can not only prevent users from illegally parking, but also satisfy the user's parking needs.
[0095] FIG3 is a flow chart of a vehicle warning method provided by an embodiment of the present application, which is executed by an electronic device. Referring to FIG3 , the method includes:
[0096] Step 301: The electronic device obtains multiple frames of images captured by a camera module of a first vehicle.
[0097] The multiple frames of images include images of the front, rear, and / or surrounding areas of the first vehicle. In one possible implementation, the camera module may capture images in real time or periodically and then transmit the captured images to the electronic device. In another possible implementation, the camera module may capture images when the first vehicle is parked and then transmit the captured images to the electronic device.
[0098] The camera module can send each frame of image it captures to the electronic device. The camera module can also capture images first, and when the number of frames of the captured images reaches a preset number of frames, send the preset number of frames of images together to the electronic device. The camera module can also capture multiple frames of images first, and when the time interval between the current time and the last time an image was sent reaches a cycle, send the multiple frames of images captured within the cycle together to the electronic device. In the embodiments of the present application, this is not specifically limited.
[0099] The multiple frames of images include at least one second vehicle, and the at least one second vehicle is located in front of or behind the first vehicle.
[0100] Step 302: The electronic device performs sign detection on the multiple frames of images, and if no no-parking sign is detected, performs target detection on the multiple frames of images.
[0101] In step 301, the camera module sends each frame of image it captures to the electronic device, and in step 302, the electronic device can perform identification detection on each frame of image it captures to detect whether there is a no-parking sign in the image. In step 301, when the number of frames of image captured by the camera module reaches a preset number of frames, the preset number of frames of image are sent together to the electronic device, and in step 302, the electronic device can simultaneously perform identification detection on the preset number of frames of image to detect whether there is a no-parking sign in the preset number of frames of image. In step 301, the camera module sends multiple frames of image captured in one cycle to the electronic device together, and in step 302, the electronic device can perform identification detection on multiple frames of image in one cycle to detect whether there is a no-parking sign in the multiple frames of image in the cycle.
[0102] If a no-parking sign is detected in the multiple image frames, the electronic device may issue a warning signal and broadcast a third voice message via the audio component of the first vehicle. The third voice message serves to remind the driver that parking is prohibited at the second location. If no no-parking sign is detected in the multiple image frames, the electronic device performs target detection on the multiple image frames to determine whether a target object exists in the multiple image frames. If a target object is detected in the multiple image frames, step 303 is executed; if no target object is detected in the multiple image frames, the process ends.
[0103] In the embodiment of the present application, the target object is the object of managing illegal parking; for example, the target object can be a road traffic management personnel, or it can be the driver of other vehicles; the target object can also be a road volunteer or a pedestrian whose passage is affected, etc., and there is no specific limitation on this.
[0104] In the case where the target object is a road traffic management personnel, the process of the electronic device performing target detection on multiple frames of images can be: for each frame of image, the electronic device performs target detection on the image; when a human target is detected in the image, the clothing features of the human target are extracted; when the clothing features of the human target are preset clothing features, it is determined that the target object is detected in the image; when the clothing features of the human target are not preset clothing features, it is determined that the target object is not detected in the image, and the preset clothing features are the clothing features of the object of managing illegal parking.
[0105] In this implementation, the electronic device can perform target detection on the image through a target recognition model to determine whether there is a human target in the image. If there is a human target in the image, the electronic device can extract the clothing features of the human target through the target recognition model to determine whether the clothing features of the human target are preset clothing features. If the clothing features of the human target are preset clothing features, it is determined that the target object is detected in the image.
[0106] The clothing feature may include at least one of a color feature, a text feature, and a hat feature. For example, the preset clothing feature is that the target person's clothing is green and has text on the clothing that indicates the target person is a road traffic control officer. Accordingly, the clothing feature includes a color feature and a text feature. The electronic device then determines whether the target person's color feature is green and whether the text feature includes text that matches the aforementioned features. If the target person's color feature is green and includes the corresponding text, the electronic device determines that the target person's clothing feature is the preset clothing feature, indicating that the target person is a road traffic control officer, i.e., the target object has been detected. If the target person's color feature is not green or does not include the corresponding text, the electronic device determines that the target person's clothing feature is not the preset clothing feature, indicating that the target person is not a road traffic control officer, i.e., the target object has not been detected.
[0107] In the embodiment of the present application, the clothing of road traffic management personnel is unique and can be easily captured and identified, and therefore can be identified through the target recognition model.
[0108] The target recognition model can be trained through the following process: the electronic device obtains a training image set and determines the attribute labels and clothing labels corresponding to the human targets in the training image set; wherein the attribute labels are used to indicate whether the human target is the target object, and the clothing labels are used to indicate whether the clothing characteristics of the human target conform to the clothing characteristics of the target object; based on the training image set and its corresponding attribute labels and clothing labels, the model is trained, and the parameter structure of the model is adjusted during the training process. When the loss function tends to be stable, a first machine learning model is obtained. After the electronic device obtains the first machine learning model, it can first verify the first machine learning model through the verification image set. After passing the verification, the first machine learning model is tested through the test image set. After passing the test, the first machine learning model is used as the target recognition model.
[0109] The training image set includes multiple training images. In the embodiment of the present application, the number of training images is not specifically limited. When a human target is a target object, the corresponding attribute label and clothing label can be 1. When a human target is not a target object, the corresponding attribute label and clothing label can be 0. In addition, the electronic device can perform model training based on a neural network. The neural network can be a yolo_v4 (You Only Look Once version 4) neural network, a residual network, a Faster RCNN, or other neural networks, without specific limitation.
[0110] The ratio of the training image set, the validation image set, and the test image set can be set and changed as needed. For example, the ratio of the training image set, the validation image set, and the test image set is 7:2:1.
[0111] In the case where the target object is a driving object of another vehicle, the process of the electronic device performing target detection on multiple frames of images can be: for each frame of image, the electronic device performs target detection on the image; when it is detected that there is a human target in the image, and the human target is getting off from another vehicle, it is determined that the target object is detected in the image; when it is detected that there is no human target in the image, or the human target is not getting off from another vehicle, it is determined that no target object is detected in the image.
[0112] Step 303: When the target object is detected in the multiple frames of images, the electronic device determines the moving direction of the target object.
[0113] When a target object is detected in multiple image frames, the electronic device may determine the target object's heading using a face detection model. For each image frame in which the target object is detected, the electronic device performs face detection on the image. If a face is detected in the image, the target object is determined to be heading toward the first vehicle. If no face is detected in the image, the target object is determined to be heading away from the first vehicle.
[0114] In the embodiment of the present application, the face detection model and the target recognition model can be two independent models or integrated into one model, which is not specifically limited. The integrated model has the function of detecting both the target object and the face.
[0115] Step 304 : When the target object is moving toward the first vehicle, the electronic device determines a first distance.
[0116] The first distance is a distance between a first position and a second position, the first position is a position of the target object, and the second position is a position of the first vehicle.
[0117] The electronic device can obtain shooting parameters of the camera module, determine the distance between the position of the target object in the image and the position of the first vehicle, and correct the distance based on the shooting parameters to obtain the first distance.
[0118] The shooting parameter is the ratio by which the camera module reduces the size of an object when photographing the object. For example, if the actual size of the object is a first size, and the size of the object in the image obtained by the camera module is a second size, then the shooting parameter is the ratio of the first size to the second size. In this implementation, the step of the electronic device correcting the distance to obtain the first distance based on the shooting parameter may include: the electronic device determines the product of the shooting parameter and the distance to obtain the first distance.
[0119] Step 305 : When the target object is moving toward the first vehicle, the electronic device determines a first quantity.
[0120] The electronic device determines the number of second vehicles located between the first position and the second position from the image to obtain a first number.
[0121] Step 306: The electronic device determines a first duration based on the first quantity.
[0122] In one possible implementation, the electronic device performs action recognition on the target object to obtain an action recognition result of the target object; when the action recognition result includes the target action, the second duration is determined; wherein the target action is an action performed by the target object based on the parking position of the second vehicle, and the second duration is the duration taken by the target object to complete the target action; based on the first quantity and the second duration, the first duration is determined.
[0123] The target action is the action performed by the target object when the second vehicle is illegally parked; and the target action can be one action or multiple actions. In the case where the target action is one action, the action can be the target object holding a device to take a picture of the license plate, or the target object signaling the vehicle to leave. In the case where the target action is multiple actions, the multiple actions can include the target object holding a device to take a picture of the license plate, the target object holding an object to register, and the target object attaching a notification document to the vehicle, etc. In the embodiment of the present application, the target action is not specifically limited.
[0124] The electronic device can determine the first frame image in which the target object performs the target action and the last frame image in which the target object completes the target action from multiple frames of images, determine the time interval between the shooting time of the first frame image and the shooting time of the last frame image, and use the time interval as the second duration.
[0125] The second duration is the duration taken by the target object to perform the target action on a second vehicle located between the first position and the second position. Therefore, the first duration taken by the target object to move from the first position to the second position is the product of the second duration and the first quantity. Accordingly, the electronic device may determine the first duration based on the first quantity and the second duration in the step of: the electronic device determines the product of the second duration and the first quantity to obtain the first duration.
[0126] In this implementation, the electronic device may perform motion recognition on the target object using the motion recognition model to obtain a motion recognition result. The electronic device determines whether the motion recognition result includes the target motion, and if so, determines the second duration; if not, terminates the process.
[0127] In an embodiment of the present application, the action recognition model can be trained through the following process: the electronic device obtains a training video set, the training video set includes a target action of a human target, and the human target is a target object or a non-target object; the electronic device performs model training based on the training video set and its corresponding target action to obtain a second machine learning model. After obtaining the second machine learning model, the electronic device can also first verify the second machine learning model through the verification video set, and after passing the verification, test the second machine learning model through the test video set. After passing the test, the second machine learning model is used as the action recognition model.
[0128] The electronic device can perform model training based on a neural network, which can be an RNN (Recurrent Neural Network) or other deep learning neural network, without specific limitation. The ratio of the training video set, the verification video set, and the test video set can be set and changed as needed, for example, the ratio of the training video set, the verification video set, and the test video set is 7:2:1.
[0129] Step 307: The electronic device sends a warning signal and broadcasts a first voice message, where the first voice message carries the first duration and the first distance.
[0130] When the action recognition result includes the target action, the electronic device determines that the second vehicle is illegally parked, that is, the parking position of the second vehicle is a prohibited parking position. The second vehicle is located in front of or behind the first vehicle, so the position of the first vehicle is also a prohibited parking position. In this case, the electronic device can send an early warning signal through the audio component and broadcast a first voice message through the audio component. The first voice message carries a first duration and a first distance. The first voice message is used to remind the driving object of the first vehicle to leave the second position. For example, the first voice message can be "The target object is 50 meters away from the current position and is expected to arrive in 10 minutes. Please leave as soon as possible."
[0131] In an embodiment of the present application, the electronic device may also perform motion recognition on the target object through a motion recognition model when determining that the target object's forward direction is toward the first vehicle to obtain a motion recognition result of the target object; when the motion recognition result includes the target motion, determine the first distance; and based on the first distance, issue a warning signal, see Figure 4.
[0132] In this implementation, taking a road traffic control officer as an example, the electronic device can achieve the following effects: if the target object is a road traffic control officer and the target object does not perform the target action, the electronic device will not issue a warning signal; if the target object is not a road traffic control officer and the target object performs the target action, the electronic device will not issue a warning signal; if the target object is not a road traffic control officer and the target object does not perform the target action, the electronic device will not issue a warning signal either. If the target object is a road traffic control officer and the target object performs the target action, the electronic device determines a first distance and then issues a warning signal based on the first distance.
[0133] Step 308: The electronic device determines a third location where the first vehicle is allowed to be parked; obtains a navigation route from the second location to the third location, and broadcasts the navigation route.
[0134] An electronic device having a map application installed therein can send a location acquisition request to a server of the map application. The location acquisition request includes location information of a second location, and the location acquisition request is used to request acquisition of a third location that is no more than a first preset distance from the second location. The map application server determines the third location based on the location acquisition request and returns the third location to the electronic device.
[0135] The third location can be one or more. If there are multiple third locations, the electronic device determines the third location closest to the second location from the multiple third locations. Alternatively, if there are multiple third locations, the electronic device determines the destination of the first vehicle's current drive and determines the third location closest to the destination from the multiple third locations. For example, if the first vehicle's current destination is a shopping mall, the electronic device determines the third location closest to the shopping mall from the multiple third locations. Then, based on the navigation route from the second location to the third location, the electronic device instructs the driver of the first vehicle to drive the first vehicle to the third location for parking, thereby reducing the distance the driver of the first vehicle has to travel and improving the driving experience.
[0136] The electronic device determines a navigation route with the shortest driving time from the second location to the third location, or determines a navigation route with the best road traffic conditions from the second location to the third location, and broadcasts the navigation route through the audio component to guide the driver of the first vehicle to drive the first vehicle to the third location for parking, thereby meeting the user's parking needs.
[0137] For roads without no-parking signs, users may be unsure whether parking is prohibited on the road. If parking is prohibited on the road and the user is unaware of it, they may park illegally, affecting other users' travel. In an embodiment of the present application, when a road traffic management officer is detected near the first vehicle, it indicates that parking is prohibited at the current location, and the user is reminded to move the vehicle, thereby preventing the user from illegally parking. When the driver of another vehicle is detected near the vehicle and the driver of the other vehicle makes a gesture to indicate that the vehicle is leaving, it indicates that parking is prohibited at the current location or that parking at the current location will affect the travel of the driver of the other vehicle, and the user is reminded to move the vehicle.
[0138] An embodiment of the present application provides a vehicle warning method. Before a user parks the vehicle, the method uses image recognition technology to identify whether there is a target object moving toward the first vehicle when there is no no-parking sign near the vehicle. Since the target object is an object for managing illegal parking, if there is a target object moving toward the first vehicle, it means that although there is no no-parking sign on the road section where the vehicle is currently located, parking is prohibited on that road section. At this time, a warning signal is issued to remind the user that it is prohibited to park the vehicle at the current location, thereby avoiding the user from illegally parking and affecting the travel of other users.
[0139] Furthermore, the method further determines a navigation route between a third permitted parking location and the second location of the first vehicle, and guides the user to the third location using the navigation route to park, thereby satisfying the user's parking needs. Thus, this method can not only prevent users from illegally parking, but also satisfy the user's parking needs.
[0140] If parking is prohibited at the current location and the user has parked the vehicle at the current location without their knowledge but is not in the vehicle, the electronic device can automatically activate the move reminder function and, upon issuing a warning signal, send a move notification to the user terminal to remind the user to move the vehicle. Alternatively, if the user manually activates the move reminder function before leaving the vehicle, the electronic device will issue a warning signal and send a move notification to the user terminal to remind the user to move the vehicle.
[0141] In one possible implementation, when a target object is detected and the target object is moving in a direction toward the first vehicle, and the driving object is not in the first vehicle, the electronic device determines a second distance, determines a third duration based on the second distance, and sends a vehicle moving notification to the driving object's terminal based on the first duration and the third duration.
[0142] The second distance is the distance between the fourth position and the second position, the fourth position is the position of the driving object, and the third duration is the duration taken by the driving object to move from the fourth position to the second position.
[0143] In this implementation, the electronic device may send a location acquisition request to the terminal of the driving object. The terminal determines the current fourth location based on the location acquisition request and sends the fourth location to the electronic device. The electronic device then determines the distance between the fourth location and the second location to obtain the second distance. The second distance may be the straight-line distance between the fourth location and the second location, the farthest distance between the fourth location and the second location, the shortest distance between the fourth location and the second location, or the navigation distance between the fourth location and the second location, without specific limitation.
[0144] When the second distance is not greater than the second preset distance, the third duration may be the time taken by the driving object to walk from the fourth position to the second position. Accordingly, the electronic device determines the third duration based on the walking speed of the driving object and the second distance. When the second distance is greater than the second preset distance, the third duration may be the time taken by the driving object to ride from the fourth position to the second position. Accordingly, the electronic device determines the third duration based on the riding speed and the second distance. Of course, the electronic device may also determine the third duration in other ways. In the embodiment of the present application, the way in which the electronic device determines the third duration is not specifically limited.
[0145] In this implementation, the electronic device can determine the time difference between the first time length and the third time length, determine the urgency of moving the car based on the time difference, and send a car moving notification to the terminal, with the car moving notification carrying the urgency of moving the car; the urgency of moving the car is negatively correlated with the time difference, that is, the greater the time difference, the lower the urgency of moving the car; the smaller the time difference, the higher the urgency of moving the car.
[0146] The electronic device can predetermine a correspondence between the time difference range and the degree of urgency for moving the vehicle. Different time difference ranges correspond to different degrees of urgency, with the smaller the time difference range, the higher the degree of urgency. Based on this correspondence, the electronic device determines the time difference range within which the time difference falls, and further determines the degree of urgency for moving the vehicle within this time difference range. This allows users to move their vehicles as quickly as possible based on the urgency of the moving notification, thereby avoiding illegal parking and affecting other users' passage.
[0147] Of course, the electronic device can also directly send a car moving notification to the terminal, which carries the first time length and the third time length. The driver determines the urgency of moving the car based on the first time length and the third time length, and then moves the car as soon as possible.
[0148] In an embodiment of the present application, when the electronic device sends a vehicle moving notification to the terminal, it can also carry a target image. The target image can be an image of a detected target object or an image of a target object performing a target action. There is no specific limitation on this. In this way, the driving object can move the car as quickly as possible according to the target image.
[0149] In another possible implementation, when a target object is detected and the target object is moving in the direction toward the first vehicle, and the driving object is not in the first vehicle, the electronic device directly sends a vehicle moving notification to the driving object's terminal, and the vehicle moving notification is used to notify the driving object to move the first vehicle.
[0150] In another possible implementation, the vehicle movement notification carries a navigation route from the second location to the third location and an option to move the vehicle (move or not). After receiving the vehicle movement notification, the driver's terminal displays the vehicle movement notification, and the driver can then click the vehicle movement option. In response to the vehicle movement option being triggered, the terminal sends a vehicle movement instruction to the electronic device. The electronic device receives the vehicle movement instruction and, in response to the vehicle movement instruction, moves the first vehicle from the second location to the third location based on the navigation route from the second location to the third location. Furthermore, after moving the first vehicle from the second location to the third location, the electronic device sends a notification message to the driver's terminal, notifying the driver that the first vehicle is now parked at the third location.
[0151] One thing that needs to be explained is that the car moving notification can be sent in the form of a text message, a pop-up message, an email, a client reminder message, or other forms. In the embodiment of the present application, there is no specific limitation on the form of sending the car moving notification.
[0152] In another possible implementation, when a target object is detected and is moving toward the first vehicle, and the driver is not in the first vehicle, the electronic device uses an autonomous driving function to drive the first vehicle from the second location to the third location based on a navigation route from the second location to the third location. Furthermore, after driving the first vehicle from the second location to the third location, the electronic device sends a notification message to the driver's terminal, notifying the driver that the first vehicle is now parked at the third location.
[0153] In the embodiment of the present application, the vehicle moving reminder function is turned on in the parked state, and there is no timing overlap with other functions of the vehicle that require computing power, and no additional computing power is required.
[0154] In an embodiment of the present application, when the target object is moving toward the first vehicle and the distance between the target object and the second position of the first vehicle is less than a preset distance, and the driving object is not in the first vehicle, the electronic device can broadcast a second voice message, and the second voice message is used to remind the target object that the driving object has been notified to move the vehicle.
[0155] In this implementation, when the target object is a road traffic management personnel, when the target object is close to the first vehicle or arrives near the first vehicle, but the driving object has not yet arrived at the location of the first vehicle, the electronic device broadcasts a second voice message through the audio component, thereby reminding the target object that the driving object is on the way.
[0156] In one possible implementation, when the first distance is less than a preset distance and the driver is not in the first vehicle, the electronic device further determines a fifth location of the driver's terminal and a fourth duration, and includes at least one of the fifth location and the fourth duration in the second voice message. The fourth duration is the time it takes the driver to move from the fifth location to the second location.
[0157] In this implementation, when the electronic device broadcasts the second voice message, it also includes at least one of the fifth location and the fourth duration. This allows the target user to clearly understand the driver's current location and the time it took the driver to reach the second location. If the target user is a traffic control officer, the target user can determine whether to perform the target action on the first vehicle based on the fifth location and the fourth duration. If the target user is the driver of another vehicle, the target user can patiently wait for the driver to move.
[0158] In an embodiment of the present application, when the driver is not in the first vehicle, the electronic device may also notify the driver to move the vehicle, thereby avoiding affecting the travel of the drivers of other vehicles.
[0159] FIG5 is a schematic diagram of the structure of a vehicle warning device provided in an embodiment of the present application. Referring to FIG5 , the device includes:
[0160] A first acquisition module 501 is configured to acquire multiple frames of images captured by a camera module of a first vehicle;
[0161] A detection module 502 is configured to perform sign detection on the multiple image frames, and if no parking prohibition sign is detected in the multiple image frames, perform target detection on the multiple image frames;
[0162] A first determining module 503 is configured to determine a moving direction of a target object when a target object is detected in multiple image frames, wherein the target object is an object for managing illegal parking;
[0163] A second determining module 504 is configured to determine a first distance when the target object is moving toward the first vehicle; wherein the first distance is a distance between a first position and a second position, the first position being a position of the target object and the second position being a position of the first vehicle;
[0164] The warning module 505 is configured to issue a warning signal based on the first distance; wherein the warning signal is configured to remind the driver not to park the first vehicle at the second location;
[0165] The third determining module 506 is configured to determine a third location where the first vehicle is allowed to be parked; obtain a navigation route from the second location to the third location, and broadcast the navigation route.
[0166] In a possible implementation, the multiple frames of images include at least one second vehicle, and the at least one second vehicle is located in front of or behind the first vehicle;
[0167] The early warning module 505 is used to determine a first number when the target object is moving towards the first vehicle, where the first number is the number of second vehicles located between the first position and the second position; determine a first duration based on the first number; wherein the first duration is the duration taken by the target object to move from the first position to the second position; issue an early warning signal and broadcast a first voice message; wherein the first voice message carries the first duration and the first distance, and the first voice message is used to remind the driver to drive the first vehicle away from the second position.
[0168] In another possible implementation, the early warning module 505 is used to perform action recognition on the target object and obtain an action recognition result of the target object; when the action recognition result includes the target action, the second duration is determined; wherein, the target action is the action performed by the target object based on the parking position of the second vehicle, and the second duration is the duration taken by the target object to complete the target action; based on the first quantity and the second duration, the first duration is determined.
[0169] In another possible implementation, the detection module 502 is used to perform target detection on each frame of the image; when a human target is detected in the image, the clothing features of the human target are extracted; when the clothing features of the human target are preset clothing features, it is determined that a target object is detected in the image, and the preset clothing features are clothing features of an object for managing illegal parking.
[0170] In another possible implementation, the apparatus further includes:
[0171] a fourth determining module, configured to determine a second distance when the driving object is not in the first vehicle; wherein the second distance is a distance between a fourth position and the second position, and the fourth position is a position of the driving object;
[0172] a fifth determining module, configured to determine a third duration based on the second distance; wherein the third duration is the duration taken by the driving object to move from the fourth position to the second position;
[0173] The sending module is used to send a vehicle moving notification to the terminal of the driving object based on the first duration and the third duration; wherein the vehicle moving notification is used to instruct the driving object to move the first vehicle.
[0174] In another possible implementation, the sending module is configured to determine a time difference between the first time duration and the third time duration; determine an urgency of moving the vehicle based on the time difference; and send a vehicle moving notification to the terminal, wherein the vehicle moving notification carries the urgency of moving the vehicle.
[0175] In another possible implementation, the apparatus further includes:
[0176] The broadcast module is used to broadcast a second voice message when the first distance is less than a preset distance and the driving object is not in the first vehicle. The second voice message is used to remind the target object that the driving object has been instructed to move the vehicle.
[0177] An embodiment of the present application provides a vehicle warning device, which, before a user parks the vehicle, uses image recognition technology to identify whether there is a target object moving toward the first vehicle when there is no no-parking sign near the vehicle. Since the target object is an object for managing illegal parking, if there is a target object moving toward the first vehicle, it means that although there is no no-parking sign on the road section where the vehicle is currently located, parking is prohibited on that road section. At this time, a warning signal is issued to remind the user that it is prohibited to park the vehicle at the current location, thereby avoiding the user from illegally parking and affecting the travel of other users.
[0178] Furthermore, the device determines a navigation route between a third location where parking is permitted and the second location where the first vehicle is located, and uses the navigation route to guide the user to park at the third location, thereby satisfying the user's parking needs. Thus, the device can not only prevent users from illegally parking, but also satisfy users' parking needs.
[0179] It should be noted that the vehicle warning device provided in the above embodiment is only illustrated by the division of the above functional modules when performing vehicle warning. In actual application, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the electronic device can be divided into different functional modules to complete all or part of the functions described above. In addition, the vehicle warning device provided in the above embodiment and the vehicle warning method embodiment are based on the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.
[0180] The structural block diagram of the electronic device can be seen in FIG6 . The electronic device 600 may vary significantly due to different configurations or performances, and may include a processor (central processing unit, CPU) 601 and a memory 602. The memory 602 stores at least one program code, which is loaded and executed by the processor 601 to implement the above-mentioned vehicle warning method. Of course, the electronic device 600 may also have components such as a wired or wireless network interface, a keyboard, and an input / output interface for input and output. The electronic device 600 may also include other components for implementing device functions, which will not be detailed here.
[0181] In an exemplary embodiment, a computer-readable storage medium is further provided, the computer-readable storage medium storing at least one program code, which is loaded and executed by a processor to implement the vehicle warning method in the above-described embodiment. Optionally, the storage medium may be a non-transitory computer-readable storage medium, such as a ROM (Read-Only Memory), a RAM (Random Access Memory), a CD-ROM (Compact Disc Read-Only Memory), a magnetic tape, a floppy disk, or an optical data storage device.
[0182] In an exemplary embodiment, a computer program product is further provided. The computer program product stores at least one program code, and the at least one program code is loaded and executed by a processor to implement the vehicle warning method in the above embodiment.
[0183] In an exemplary embodiment, the computer program product involved in the embodiments of the present application can be deployed and executed on an electronic device, or on multiple electronic devices located in one location, or on multiple electronic devices distributed in multiple locations and interconnected through a communication network. Multiple electronic devices distributed in multiple locations and interconnected through a communication network can constitute a blockchain system.
[0184] Those skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware, or may be accomplished by a program to instruct the relevant hardware, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.
[0185] The above description is only for the purpose of facilitating those skilled in the art to understand the technical solution of this application and is not intended to limit this application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of this application shall be included in the scope of protection of this application.
Claims
1. A vehicle early warning method, It is characterized in that The method comprises: Acquire multiple frames of images captured by a camera module of the first vehicle; Performing sign detection on the multiple frames of images, and when no no-parking sign is detected in the multiple frames of images, performing target detection on the multiple frames of images; In the case where a target object is detected in the multiple frames of images, determining a moving direction of the target object, wherein the target object is an object for managing illegal parking; In the case where the target object is moving in a direction toward the first vehicle, determining a first distance; wherein the first distance is a distance between a first position and a second position, the first position is a position of the target object, and the second position is a position of the first vehicle; Based on the first distance, issuing a warning signal; wherein the warning signal is used to remind the driver of the first vehicle not to park the first vehicle at the second position; Determine a third location where the first vehicle is allowed to be parked; obtain a navigation route from the second location to the third location, and broadcast the navigation route.
2. The method according to claim 1, It is characterized in that The multiple frames of images include at least one second vehicle, and the at least one second vehicle is located in front of or behind the first vehicle; The issuing of a warning signal based on the first distance includes: determining a first number, the first number being the number of second vehicles located between the first location and the second location; Based on the first number, determining a first duration; wherein the first duration is the duration taken by the target object to move from the first position to the second position; The warning signal is issued and a first voice message is broadcast; wherein the first voice message carries the first duration and the first distance, and the first voice message is used to remind the driving object to drive the first vehicle away from the second position.
3. The method according to claim 2, It is characterized in that The determining a first duration based on the first quantity includes: Performing action recognition on the target object to obtain an action recognition result of the target object; In the case where the action recognition result includes a target action, determining a second duration; wherein the target action is an action performed by the target object based on the parking position of the second vehicle, and the second duration is the duration taken by the target object to complete the target action; Based on the first number and the second duration, the first duration is determined.
4. The method according to claim 1, It is characterized in that The performing target detection on the multiple frames of images includes: For each frame of image, performing target detection on the image; When a human target is detected in the image, extracting clothing features of the human target; In a case where the clothing feature of the human target is a preset clothing feature, it is determined that the target object is detected in the image, and the preset clothing feature is a clothing feature of an object for managing illegal parking.
5. The method according to claim 2 or 3, It is characterized in that The method further comprises: In the case where the driving object is not in the first vehicle, determining a second distance; wherein the second distance is a distance between a fourth position and the second position, and the fourth position is a position where the driving object is located; Determine a third duration based on the second distance; wherein the third duration is the duration taken by the driving object to move from the fourth position to the second position; Based on the first duration and the third duration, a vehicle moving notification is sent to the terminal of the driving object; wherein the vehicle moving notification is used to notify the driving object to move the first vehicle.
6. The method according to claim 5, It is characterized in that The sending a vehicle moving notification to the terminal of the driving object based on the first duration and the third duration includes: determining a duration difference between the first duration and the third duration; Based on the time difference, determine the urgency of moving the vehicle; The vehicle moving notification is sent to the terminal, wherein the vehicle moving notification carries the urgency of the vehicle moving.
7. The method according to claim 5, It is characterized in that The method further comprises: When the first distance is less than a preset distance and the driving object is not in the first vehicle In this case, a second voice message is broadcasted, where the second voice message is used to remind the target object that the driving object has been instructed to move the vehicle.
8. A vehicle warning device, It is characterized in that The device comprises: A first acquisition module, used to acquire multiple frames of images captured by a camera module of a first vehicle; A detection module, configured to perform sign detection on the multiple frames of images, and perform target detection on the multiple frames of images when no no-parking sign is detected in the multiple frames of images; A first determination module is used to determine the moving direction of the target object when a target object is detected in the multiple frames of images, wherein the target object is an object for managing illegal parking; A second determination module is used to determine a first distance when the target object is moving in a direction toward the first vehicle; wherein the first distance is a distance between a first position and a second position, the first position is a position of the target object, and the second position is a position of the first vehicle; an early warning module, configured to issue an early warning signal based on the first distance; wherein the early warning signal is used to remind the driver of the first vehicle not to park the first vehicle at the second position; The third determination module is used to determine a third position where the first vehicle is allowed to be parked; obtain a navigation route from the second position to the third position, and broadcast the navigation route.
9. The device according to claim 8, It is characterized in that The multiple frames of images include at least one second vehicle, and the at least one second vehicle is located in front of or behind the first vehicle; The early warning module is used to determine a first number when the target object is moving in a direction toward the first vehicle, the first number being the number of second vehicles located between the first position and the second position; Based on the first number, a first duration is determined; wherein the first duration is the duration taken by the target object to move from the first position to the second position; the warning signal is issued and a first voice message is broadcast; wherein the first voice message carries the first duration and the first distance, and the first voice message is used to remind the driving object to drive the first vehicle away from the second position.
10. The device according to claim 9, It is characterized in that The early warning module is used to perform action recognition on the target object to obtain the action recognition result of the target object; when the action recognition result includes the target action, determine the second duration; wherein the target action is the action performed by the target object based on the parking position of the second vehicle, and the second duration is the duration taken by the target object to complete the target action; based on the first number and the second duration, determine the first duration.
11. The device according to claim 8, It is characterized in that The detection module is used to perform target detection on each frame of the image; when it is detected that the image includes a human target, extract the clothing features of the human target; when the clothing features of the human target are preset clothing features, determine that the target object is detected in the image, and the preset clothing features are clothing features of objects for managing illegal parking.
12. The device according to claim 9 or 10, It is characterized in that The device also includes: a fourth determination module, configured to determine a second distance when the driving object is not in the first vehicle; wherein the second distance is a distance between a fourth position and the second position, and the fourth position is a position of the driving object; a fifth determining module, configured to determine a third duration based on the second distance; wherein the third duration is the duration taken by the driving object to move from the fourth position to the second position; A sending module is used to send a vehicle moving notification to the terminal of the driving object based on the first duration and the third duration; wherein the vehicle moving notification is used to notify the driving object to move the first vehicle.
13. The device according to claim 12, It is characterized in that The sending module is used to determine the time difference between the first time length and the third time length; based on the time difference, determine the urgency of moving the vehicle; The vehicle moving notification is sent to the terminal, wherein the vehicle moving notification carries the urgency of the vehicle moving.
14. The device according to claim 12, It is characterized in that The device also includes: The broadcast module is used to broadcast a second voice message when the first distance is less than a preset distance and the driving object is not in the first vehicle, and the second voice message is used to remind the target object that the driving object has been instructed to move the vehicle.
15. An electronic device, It is characterized in that The electronic device includes a processor and a memory, wherein the memory stores at least one program code, and the at least one program code is loaded and executed by the processor to implement the vehicle warning method as described in any one of claims 1 to 7.
16. A computer-readable storage medium, It is characterized in that At least one program code is stored in the computer-readable storage medium, and the at least one program code is loaded and executed by the processor to implement the vehicle warning method as described in any one of claims 1 to 7.
17. A computer program product, It is characterized in that The computer program product stores at least one program code, and the at least one program code is loaded and executed by a processor to implement the vehicle warning method as described in any one of claims 1 to 7.
Citation Information
Patent Citations
Vehicle early warning method, device and equipment and storage medium
CN116959282A
Violation information management system and guide path generating method thereof
CN106875721A
Roadside parking reminding method and system based on vehicle terminal and vehicle terminal
CN110648508A
Vehicle moving reminding system
CN112440873A
Vehicle control method and device, control equipment and automobile
CN114677855A
