Vehicle automatic driving assistance system
By introducing ambulance detection and avoidance mechanisms in autonomous driving vehicles, using convolutional neural networks and real-time picture capture technology, the problem of insufficient ambulance detection by autonomous driving vehicles is solved, effective avoidance and power consumption savings are achieved, and the system is improved intelligence and flexibility.
Patent Information
- Application Number
- CN202411181756.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2024-03-28
- Filing Date
- 2024-08-27
- Publication Date
- 2024-11-15
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Self-driving vehicles lack detection mechanisms for ambulances, and cannot effectively avoid ambulances and lead to energy loss.
A vehicle autonomous driving assistance system was designed to detect ambulances using convolutional neural networks through signal analysis devices, adaptive capture devices, smooth spatial filtering devices, content enhancement devices, image rendering devices, geometric identification mechanisms and distance setting mechanisms. And trigger the safe distance setting operation, performing real-time screen capture only when ambulance beeps are sensed to reduce power consumption.
It realizes effective avoidance of ambulances and saves system power consumption, improving the intelligence and flexibility of autonomous driving vehicles.
Abstract
Description
Technical Field
[0001] The present invention relates to the field of traffic management, and in particular to a vehicle automatic driving assistance system. Background Art
[0002] An ambulance is a vehicle that rescues patients. The word "AMBULANCE" on the body of the ambulance is written in reverse, so that the driver of the car in front can see the word "Ambulance" in the forward direction through the rearview mirror and quickly give way. With the flashing warning lights and the whistling sirens, there is no doubt that an ambulance is rushing to the scene of an emergency call. All major traffic routes need to be cleared for it. The driver can drive on the edge of the road, on the sidewalk, or even in the opposite direction - anywhere is fine as long as the ambulance can pass. Like firefighters rushing to the scene of a fire, rescuers also need to race against time, because it may mean the difference between life and death.
[0003] However, for autonomous driving vehicles, there is a lack of autonomous driving mechanism for ambulance detection, and it is impossible to trigger the operation of setting a safe distance above the set distance from the nearest surrounding objects, so as to achieve effective avoidance of surrounding ambulance objects. In addition, if the above-mentioned avoidance control mode is maintained, it will also cause considerable loss of internal energy of the autonomous driving vehicle. Summary of the invention
[0004] In order to solve the technical problems in related fields, the present invention provides a vehicle automatic driving assistance system, which can introduce an avoidance mechanism in the automatic driving vehicle. When the existence of an ambulance object is intelligently detected nearby, it triggers the operation of setting a safe distance to maintain a set distance from the nearest surrounding vehicle, thereby achieving effective avoidance of the surrounding ambulance objects. Among them, the real-time image capture operation of the rear environment of the car is performed only when a sound signal with a frequency corresponding to the ambulance beep is sensed in the traffic environment where the rear of the car is located, thereby reducing the waste of system power consumption.
[0005] According to the present invention, a vehicle automatic driving assistance system is provided, the system comprising: The signal analysis device is arranged at the rear of the vehicle, and is used to issue a first analysis command when sensing that there is a sound signal of a frequency corresponding to the beeping sound of an ambulance in the traffic environment where the rear of the vehicle is located, otherwise, issue a second analysis command; An adaptive capture device, arranged at the rear of the vehicle and connected to the signal analysis device, for executing a real-time image capture operation of the environment at the rear of the vehicle upon receiving the first analysis command, so as to obtain and output a corresponding adaptive capture image; A smoothing spatial filtering device, connected to the adaptive capture device, for performing smoothing spatial filtering processing on the received adaptive capture picture to obtain and output a corresponding smoothing spatial filtering image; a content enhancement device, connected to the smooth spatial filtering device, for performing image content enhancement processing based on logarithmic transformation on the received smooth spatial filtering image to obtain and output a corresponding content enhanced image; an image rendering device, connected to the content enhancement device, for performing image rendering processing on the received content enhancement image to obtain and output a corresponding current rendered image; a geometric identification mechanism connected to the image rendering device, for detecting a plurality of geometric features of an image region where each vehicle in the current rendered image is located, the plurality of geometric features including the number of pixels in the length direction and the width direction of the corresponding image region and the maximum curvature and the minimum curvature of the region edge curve, inputting the plurality of geometric features of the image region where each vehicle is located, the plurality of geometric features of the standard image corresponding to the ambulance, the signal-to-noise ratio of the current rendered image and the area ratio occupied by the background region of the current rendered image into a convolutional neural network model and running the convolutional neural network model to determine whether there is an ambulance in the image region where each vehicle is located, and when there is no ambulance in each image region where each vehicle in the current rendered image is respectively located, issuing an object non-identification signal, otherwise issuing an object identification signal; The distance setting mechanism is connected to the geometric identification mechanism and is used to trigger a safety distance setting operation of maintaining a set distance or more from the nearest surrounding vehicles when receiving the object identification signal.
[0006] It can be seen that the present invention mainly has the following significant technical effects: First, detecting multiple geometric features of the image region where each vehicle is located in the current rendered image, wherein the multiple geometric features include the number of pixels in the length direction and the width direction of the corresponding image region, and the maximum curvature and the minimum curvature of the region edge curve, inputting the multiple geometric features of the image region where each vehicle is located, the signal-to-noise ratio of the current rendered image, and the area ratio occupied by the background region of the current rendered image into a convolutional neural network model and running the convolutional neural network model to determine whether there is a set object in the image region where each vehicle is located, and sending an object unidentified signal when there is no set object in each image region where each vehicle in the current rendered image is located; Second: upon receiving an object identification signal indicating that an ambulance object exists nearby, triggering a safety distance setting operation of maintaining a set distance or more from the nearest surrounding vehicles, thereby achieving effective avoidance of the surrounding ambulance objects; Third, only when a sound signal with a frequency corresponding to the beeping sound of an ambulance is sensed in the traffic environment at the rear of the car, the real-time image capture operation of the environment at the rear of the car is performed, thereby reducing the waste of system power consumption.
[0007] The vehicle automatic driving assistance system of the present invention operates intelligently, flexibly and controllably. Since an avoidance mechanism can be introduced into the automatic driving vehicle, and when an ambulance object is intelligently detected nearby, a safe distance setting operation of maintaining a set distance from the nearest surrounding vehicle is triggered, and intelligent detection of the ambulance object is performed only when a sound signal with a frequency corresponding to the ambulance buzzer is sensed in the traffic environment where the rear of the car is located, the intelligent avoidance of the ambulance and the power consumption saving of the system are taken into account. DETAILED DESCRIPTION
[0008] The following is a detailed description of an embodiment of the vehicle automatic driving assistance system of the present invention. First embodiment
[0009] According to a first embodiment of the present invention, a vehicle automatic driving assistance system is shown, the system comprising: The signal analysis device is arranged at the rear of the vehicle, and is used to issue a first analysis command when sensing that there is a sound signal of a frequency corresponding to the beeping sound of an ambulance in the traffic environment where the rear of the vehicle is located, otherwise, issue a second analysis command; For example, a signal analysis device is arranged at the rear of a car, and is used to issue a first analysis command when sensing that a sound signal of a frequency corresponding to an ambulance beep exists in the traffic environment where the rear of the car is located, otherwise, issuing a second analysis command includes: the signal analysis device includes a sound sensing unit, an analysis processing unit, and a command output unit; And in the signal analysis device, the sound sensing unit, the analysis processing unit and the command output unit are connected in sequence; An adaptive capture device, arranged at the rear of the vehicle and connected to the signal analysis device, for executing a real-time image capture operation of the environment at the rear of the vehicle upon receiving the first analysis command, so as to obtain and output a corresponding adaptive capture image; A smoothing spatial filtering device, connected to the adaptive capture device, for performing smoothing spatial filtering processing on the received adaptive capture picture to obtain and output a corresponding smoothing spatial filtering image; a content enhancement device, connected to the smooth spatial filtering device, for performing image content enhancement processing based on logarithmic transformation on the received smooth spatial filtering image to obtain and output a corresponding content enhanced image; an image rendering device, connected to the content enhancement device, for performing image rendering processing on the received content enhancement image to obtain and output a corresponding current rendered image; a geometric identification mechanism connected to the image rendering device, for detecting a plurality of geometric features of an image region where each vehicle in the current rendered image is located, the plurality of geometric features including the number of pixels in the length direction and the width direction of the corresponding image region and the maximum curvature and the minimum curvature of the region edge curve, inputting the plurality of geometric features of the image region where each vehicle is located, the plurality of geometric features of the standard image corresponding to the ambulance, the signal-to-noise ratio of the current rendered image and the area ratio occupied by the background region of the current rendered image into a convolutional neural network model and running the convolutional neural network model to determine whether there is an ambulance in the image region where each vehicle is located, and when there is no ambulance in each image region where each vehicle in the current rendered image is respectively located, issuing an object non-identification signal, otherwise issuing an object identification signal; A distance setting mechanism, connected to the geometric identification mechanism, is used to trigger a safety distance setting operation of maintaining a set distance or more from the nearest surrounding vehicle upon receiving the object identification signal; Among them, the multiple geometric features of the standard image corresponding to the ambulance include the number of pixels in the length direction of the standard image, the number of pixels in the width direction, and the maximum curvature and the minimum curvature of the edge curve of the standard image. Second embodiment
[0010] A second embodiment of the present invention shows a vehicle automatic driving assistance system.
[0011] Compared with the first embodiment, the vehicle automatic driving assistance system shown in the second embodiment of the present invention may further include: a volume recognition mechanism, arranged near the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism and connected to the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism respectively; Among them, the volume recognition mechanism is arranged near the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism and is respectively connected to the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism, including: the volume recognition mechanism includes multiple volume recognition units, which are used to measure the respective physical volumes of the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism based on a three-dimensional picture analysis mechanism. Third embodiment
[0012] A third embodiment of the present invention shows an automatic driving assistance system for a vehicle.
[0013] Compared with the first embodiment, the vehicle automatic driving assistance system shown in the third embodiment of the present invention may further include: a routing service mechanism, which is arranged near the smoothing spatial filtering device, the content enhancing device, the image rendering device and the geometric identification mechanism and is connected to the smoothing spatial filtering device, the content enhancing device, the image rendering device and the geometric identification mechanism respectively; Among them, the routing service mechanism is arranged near the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism and is respectively connected to the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism, including: the routing service mechanism is used to provide routing services for accessing the nearest wireless communication network for the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism respectively.
[0014] Next, the specific structure of the vehicle automatic driving assistance system of the present invention will be further described.
[0015] In each of the vehicle automatic driving assistance systems according to the embodiments of the present invention: Using a data correction device to perform image data processing on the output data of the smoothing spatial filtering device, the content enhancement device, the image rendering device, and the geometric identification mechanism to obtain output processing data corresponding to the smoothing spatial filtering device, the content enhancement device, the image rendering device, and the geometric identification mechanism respectively; Wherein, using a data correction device to perform image data processing on the output data of the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism to obtain the output processing data corresponding to the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism respectively comprises: performing Sobel operator sharpening on the output data of the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism to obtain the output processing data corresponding to the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism respectively; The method of using a data correction device to perform image data processing on the output data of the smoothing spatial filtering device, the content enhancement device, the image rendering device, and the geometric identification mechanism to obtain the output processing data corresponding to the smoothing spatial filtering device, the content enhancement device, the image rendering device, and the geometric identification mechanism includes: performing logarithmic image enhancement on the output data of the smoothing spatial filtering device, the content enhancement device, the image rendering device, and the geometric identification mechanism to obtain the output processing data corresponding to the smoothing spatial filtering device, the content enhancement device, the image rendering device, and the geometric identification mechanism; Wherein, using a data correction device to perform image data processing on the output data of the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism to obtain the output processing data corresponding to the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism respectively comprises: performing morphological processing on the output data of the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism to obtain the output processing data corresponding to the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism respectively; And wherein, a data correction device is used to perform image data processing on the output data of the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism to obtain the output processing data corresponding to the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism respectively, including: performing Gaussian low-pass filtering on the output data of the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism to obtain the output processing data corresponding to the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism respectively.
[0016] In addition, in the vehicle automatic driving assistance system, the distance setting mechanism is further used to end the safety distance setting operation of maintaining a set distance or more from the nearest surrounding vehicle when receiving the object identification signal; The signal analysis device is further configured to stop executing the real-time image capture operation of the rear environment of the automobile when receiving the second analysis command.
[0017] It should be understood by those skilled in the art that the embodiments of the present invention shown in the above description are only examples and do not limit the present invention. The purpose of the present invention has been fully and effectively achieved. The functional and structural principles of the present invention have been demonstrated and explained in the embodiments, and the embodiments of the present invention may be deformed or modified in any way without departing from the principles.
Claims
1. A vehicle automatic driving assistance system, characterized in that: The system comprises: The signal analysis device is arranged at the rear of the vehicle, and is used to issue a first analysis command when sensing that there is a sound signal of a frequency corresponding to the beeping sound of an ambulance in the traffic environment where the rear of the vehicle is located, otherwise, issue a second analysis command; An adaptive capture device, arranged at the rear of the vehicle and connected to the signal analysis device, for executing a real-time image capture operation of the environment at the rear of the vehicle upon receiving the first analysis command, so as to obtain and output a corresponding adaptive capture image; A smoothing spatial filtering device, connected to the adaptive capture device, for performing smoothing spatial filtering processing on the received adaptive capture picture to obtain and output a corresponding smoothing spatial filtering image; a content enhancement device, connected to the smooth spatial filtering device, for performing image content enhancement processing based on logarithmic transformation on the received smooth spatial filtering image to obtain and output a corresponding content enhanced image; an image rendering device, connected to the content enhancement device, for performing image rendering processing on the received content enhancement image to obtain and output a corresponding current rendered image; a geometric identification mechanism connected to the image rendering device, for detecting a plurality of geometric features of an image region where each vehicle in the current rendered image is located, the plurality of geometric features including the number of pixels in the length direction and the width direction of the corresponding image region and the maximum curvature and the minimum curvature of the region edge curve, inputting the plurality of geometric features of the image region where each vehicle is located, the plurality of geometric features of the standard image corresponding to the ambulance, the signal-to-noise ratio of the current rendered image and the area ratio occupied by the background region of the current rendered image into a convolutional neural network model and running the convolutional neural network model to determine whether there is an ambulance in the image region where each vehicle is located, and when there is no ambulance in each image region where each vehicle in the current rendered image is respectively located, issuing an object non-identification signal, otherwise issuing an object identification signal; The distance setting mechanism is connected to the geometric identification mechanism and is used to trigger a safety distance setting operation of maintaining a set distance or more from the nearest surrounding vehicles when receiving the object identification signal.
2. The vehicle automatic driving assistance system according to claim 1, characterized in that: The multiple geometric features of the standard image corresponding to the ambulance include the number of pixels in the length direction and the number of pixels in the width direction of the standard image, and the maximum curvature and the minimum curvature of the edge curve of the standard image.
3. The vehicle automatic driving assistance system according to claim 2, characterized in that: The system further comprises: a volume recognition mechanism, arranged near the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism and connected to the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism respectively; Among them, the volume recognition mechanism is arranged near the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism and is respectively connected to the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism, including: the volume recognition mechanism includes multiple volume recognition units, which are used to measure the respective physical volumes of the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism based on a three-dimensional picture analysis mechanism.
4. The vehicle automatic driving assistance system according to claim 2, characterized in that: The system further comprises: a routing service mechanism, which is arranged near the smoothing spatial filtering device, the content enhancing device, the image rendering device and the geometric identification mechanism and is connected to the smoothing spatial filtering device, the content enhancing device, the image rendering device and the geometric identification mechanism respectively; Among them, the routing service mechanism is arranged near the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism and is respectively connected to the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism, including: the routing service mechanism is used to provide routing services for accessing the nearest wireless communication network for the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism respectively.
5. The vehicle automatic driving assistance system according to any one of claims 2 to 4, characterized in that: A data correction device is used to perform image data processing on the output data of the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism to obtain output processing data corresponding to the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism respectively.
6. The vehicle automatic driving assistance system according to claim 5, characterized in that: The data correction device is used to perform image data processing on the output data of the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism to obtain the output processing data corresponding to the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism respectively, including: performing Sobel operator sharpening on the output data of the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism to obtain the output processing data corresponding to the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism respectively.
7. The vehicle automatic driving assistance system according to claim 5, characterized in that: The data correction device is used to perform image data processing on the output data of the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism to obtain the output processing data corresponding to the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism respectively, including: performing logarithmic image enhancement on the output data of the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism to obtain the output processing data corresponding to the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism respectively.
8. The vehicle automatic driving assistance system according to claim 5, characterized in that: The data correction device is used to perform image data processing on the output data of the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism to obtain the output processing data corresponding to the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism respectively, including: performing morphological processing on the output data of the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism to obtain the output processing data corresponding to the smooth spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism respectively.
9. The vehicle automatic driving assistance system according to claim 5, characterized in that: The data correction device is used to perform image data processing on the output data of the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism to obtain the output processing data corresponding to the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism respectively, including: performing Gaussian low-pass filtering on the output data of the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism to obtain the output processing data corresponding to the smoothing spatial filtering device, the content enhancement device, the image rendering device and the geometric identification mechanism respectively.
Citation Information
Patent Citations
Special vehicle identification method for driverless vehicle
CN107633684A
Traffic scene monitoring system and method applied to intelligent automobile
CN115373327A
Special vehicle identification method and device and vehicle
CN116665697A
Method and apparatus for performing UWB (ultra wide band) secure ranging
KR1020220155867A
