Vehicle blind area monitoring and early warning system based on artificial intelligence

Abstract

The invention discloses a vehicle blind area monitoring and early warning system based on artificial intelligence, and the system comprises cameras, a millimeter wave radar, an ultrasonic sensor, a vehicle-mounted display screen, a vehicle-mounted control host, a cloud storage server, and a mobile phone APP. The camera, the millimeter wave radar and the ultrasonic sensor are arranged in blind areas in front of, on the side of and behind a vehicle respectively, the vehicle-mounted control host is arranged in the vehicle, the vehicle-mounted display screen is arranged in a cab of the vehicle, and a central processing unit, a storage module, a GPS positioning module and a 5G communication module are arranged in the vehicle-mounted control host. The camera, the millimeter wave radar, the ultrasonic sensor and the vehicle-mounted display screen are electrically connected with the vehicle-mounted control host, the vehicle-mounted control host is in data connection with the cloud storage server, and the mobile phone APP is in data connection with the cloud storage server. According to the technical scheme, the situation of each blind area of the vehicle can be monitored in real time, the occurrence rate of traffic accidents is effectively reduced, and the driving safety is effectively improved.

Description

Technical Field

[0001] The present invention relates to the field of artificial intelligence technology, and particularly to a vehicle blind spot monitoring and warning system based on artificial intelligence. Background Art

[0002] Vehicle blind spots are one of the important hidden dangers of traffic accidents. A vehicle blind spot refers to the area that a driver cannot directly observe during driving due to factors such as the vehicle's own structure, vision limitations, and the surrounding environment. The following is a detailed introduction to vehicle blind spots: Front blind spot: It mainly refers to the area in front of the vehicle's engine hood. Generally speaking, the longer the vehicle's front end and the higher the vehicle body, the larger the front blind spot. In addition, factors such as the driver's height, sitting posture, and the adjustment of the vehicle's seat also affect the size of the front blind spot. For example, the front blind spot of a sedan is usually smaller than that of an SUV.

[0003] Rear blind spot: The area located behind the vehicle's tail. When the driver observes the rear situation through the rearview mirror inside the vehicle, there will be a certain range of blind spots due to the size of the vehicle's rear windshield and the vehicle body structure. Especially for some hatchbacks or vehicles with a more inclined rear end, the rear blind spot may be larger.

[0004] Side blind spot: The areas near the vehicle's A-pillar, B-pillar, and C-pillar on both sides, as well as the part between the vehicle's side and the adjacent lane. The A-pillar blind spot is more obvious when the vehicle is turning and affects the driver's observation of the inner side of the curve; the B-pillar and C-pillar blind spots affect the driver's judgment of vehicles and pedestrians on the side and rear during the vehicle's driving process. In addition, large buses and trucks have larger side blind spots than small cars due to their higher and wider bodies.

[0005] Rearview mirror blind spot: It refers to the area that the vehicle's rearview mirror cannot cover. Even if the driver adjusts the rearview mirror correctly, there will still be some blind spots. Generally located at the side rear of the vehicle, when other vehicles are in this area, the driver cannot directly see them through the rearview mirror, and it is easy to cause collision accidents when changing lanes or turning.

[0006] Other vehicles, pedestrians, or obstacles in the vehicle blind spot are not easily noticed by the driver, and it is easy to cause collision accidents during vehicle operations such as changing lanes, turning, and reversing, resulting in casualties and property losses. For example, on a highway, if a driver changes lanes without noticing the vehicle in the rearview mirror blind spot, it is very likely to cause a side collision accident. Summary of the Invention

[0007] The main object of the present invention is to propose an artificial intelligence-based vehicle blind spot monitoring and warning system, which aims to monitor the blind spots around the vehicle in real time, timely detect vehicles, pedestrians or obstacles in the blind spots, and remind the driver in the form of alarms or image displays, so that the driver can take braking or avoidance measures in advance, thereby avoiding collision accidents, reducing the incidence of traffic accidents, and protecting life and property safety.

[0008] To achieve the above object, the artificial intelligence-based vehicle blind spot monitoring and warning system proposed by the present invention includes a camera, a millimeter wave radar, an ultrasonic sensor, an in-vehicle display screen, an in-vehicle control host, a cloud storage server, and a mobile phone APP. The camera, the millimeter wave radar, and the ultrasonic sensor are respectively arranged in the blind spot areas in front of, on the side of, and behind the vehicle. The in-vehicle control host is arranged inside the vehicle, and the in-vehicle display screen is arranged in the vehicle cab. The in-vehicle control host is provided with a central processing unit, a storage module, a GPS positioning module, and a 5G communication module. The camera, the millimeter wave radar, the ultrasonic sensor, and the in-vehicle display screen are respectively electrically connected to the in-vehicle control host. The in-vehicle control host is data-connected to the cloud storage server through the built-in 5G communication module, and the mobile phone APP is data-connected to the cloud storage server. The camera includes a first housing, a high-definition wide-angle camera module, a first speaker, a mounting bracket, and a mounting base. The high-definition wide-angle camera module is embedded in the front end of the first housing. The first speaker is arranged inside the first housing. A plurality of first sound transmission holes are provided at the lower end and the upper end of the first housing. The mounting bracket protrudes from the upper end of the first housing, and the mounting base is fixedly connected to the vehicle. The upper end of the mounting bracket is rotatably connected to the mounting base.

[0009] Further, the millimeter wave radar includes a millimeter wave radar sensor, a second housing, a second mounting base, and fastening screws. The millimeter wave radar sensor is embedded in the front end of the second housing. A first accommodation groove is provided at the front end of the second mounting base. The second housing is detachably embedded in the first accommodation groove. Threaded holes are respectively recessed on both sides of the rear end of the second housing. The fastening screws respectively pass through the second housing and are screwed into the threaded holes. A connector protrudes from the rear end of the second housing, and a wire passing hole is recessed at the rear end of the second mounting base. The connector is arranged through the wire passing hole. Fixing plates respectively protrude from both side walls of the second mounting base, and mounting holes are respectively recessed in the fixing plates. The fixing plates are fixedly connected to the vehicle through the mounting holes. The millimeter wave radar probe adopts a 79 GHz millimeter wave radar probe.

[0010] Further, a plurality of heat dissipation fins protrude from the rear end of the second housing.

[0011] Further, the in-vehicle display screen includes a third housing, a touch display screen module, a second speaker, buttons, an indicator light, and a second speaker. The touch display screen module is embedded in the front end of the third housing. The buttons and the indicator light are arranged at the lower end of the touch display screen module. The second speaker is arranged inside the third housing. A plurality of second sound transmission holes are provided at the rear end of the third housing.

[0012] Further, it further includes a stylus. A receiving groove is convexly provided at the rear end of the third housing. The lower end of the stylus is detachably embedded in the receiving groove.

[0013] Further, it further includes a snap plate. The snap plate is detachably arranged at the rear end of the third housing. A snap groove is recessed at the lower end of the snap plate.

[0014] Further, it further includes magnetic attraction blocks. A plurality of second accommodation grooves are recessed at the rear end of the third housing. The magnetic attraction blocks are embedded in the second accommodation grooves.

[0015] Adopting the technical solution of the present invention has the following beneficial effects: With the technical solution of the present invention, the camera can capture the image information around the vehicle, the millimeter-wave radar can accurately measure the distance, speed, and angle of the target object, and the ultrasonic sensor is mainly used for short-distance detection. These sensors work together to comprehensively perceive the conditions of the vehicle blind spots. The in-vehicle control host receives the data transmitted by the sensors, analyzes and processes it, and judges whether there is an object entering the blind spot and whether there is a potential danger according to the preset artificial intelligence algorithm, and then decides whether to trigger an alarm. When it is determined that there is a dangerous situation, an alarm signal will be sent to the driver through the display screen in the vehicle and the built-in speaker. The real-time image of the blind spot may be displayed on the display screen or the position of the dangerous object may be marked. Different types of alarm sounds will be emitted by the display screen and the built-in speaker of the camera to attract the attention of the driver and passers-by. At the same time, the in-vehicle control host is connected to the cloud storage server through the built-in 5G communication module, and the mobile phone APP is connected to the cloud storage server to realize the real-time upload and remote viewing of data such as the vehicle driving trajectory and blind spot conditions, so as to monitor the conditions of each blind spot of the vehicle in real time. Whether during driving or parking, it can continuously monitor whether there are abnormal situations in the blind spot, effectively reducing the incidence of traffic accidents. Description of the Drawings

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained based on the structures shown in these drawings.

[0017] Figure 1 Schematic diagram of the overall framework structure of an artificial intelligence-based vehicle blind spot monitoring and warning system according to an embodiment of the present invention; Figure 2 Schematic diagram of the overall structure of the camera of an artificial intelligence-based vehicle blind spot monitoring and warning system according to an embodiment of the present invention; Figure 3 Schematic diagram of the overall structure of the camera of an artificial intelligence-based vehicle blind spot monitoring and warning system from another perspective according to an embodiment of the present invention; Figure 4 Schematic diagram of the overall structure of the millimeter wave radar of an artificial intelligence-based vehicle blind spot monitoring and warning system according to an embodiment of the present invention; Figure 5 Schematic diagram of the overall structure of the millimeter wave radar of an artificial intelligence-based vehicle blind spot monitoring and warning system from another perspective according to an embodiment of the present invention; Figure 6 Exploded view of the millimeter wave radar of an artificial intelligence-based vehicle blind spot monitoring and warning system according to an embodiment of the present invention; Figure 7 Schematic diagram of the overall structure of the in-vehicle display screen of an artificial intelligence-based vehicle blind spot monitoring and warning system according to an embodiment of the present invention; Figure 8 Schematic diagram of the overall structure of the in-vehicle display screen of an artificial intelligence-based vehicle blind spot monitoring and warning system from another perspective according to an embodiment of the present invention; Figure 9 Exploded view of the in-vehicle display screen of an artificial intelligence-based vehicle blind spot monitoring and warning system according to an embodiment of the present invention.

[0018] The realization, functional features and advantages of the present invention will be further described with reference to the embodiments and the accompanying drawings. Detailed implementation manners

[0019] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all of the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0020] It should be noted that all directional indications (such as up, down, left, right, front, back...) in the embodiments of the present invention are only used to explain the relative positional relationship and movement conditions between components in a specific posture (as shown in the attached drawings). If the specific posture changes, the directional indications will also change accordingly.

[0021] In addition, the technical solutions between various embodiments can be combined with each other, but it must be based on the ability of those of ordinary skill in the art to implement. When the combination of technical solutions results in contradictions or cannot be implemented, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection required by the present invention.

[0022] The present invention provides a vehicle blind spot monitoring and warning system based on artificial intelligence.

[0023] As Figures 1 to 9 shown, in an embodiment of the present invention, the vehicle blind spot monitoring and warning system based on artificial intelligence includes a camera 100, a millimeter wave radar 200, an ultrasonic sensor 300, an in-vehicle display screen 400, an in-vehicle control host 500, a cloud storage server 600, and a mobile phone APP 700. The camera 100, the millimeter wave radar 200, and the ultrasonic sensor 300 are respectively arranged in the blind spot areas in the front, side, and rear of the vehicle. The in-vehicle control host 500 is arranged inside the vehicle, and the in-vehicle display screen 400 is arranged in the vehicle cab. The in-vehicle control host 500 is provided with a central processing unit, a storage module, a GPS positioning module, and a 5G communication module. The camera 100, the millimeter wave radar 200, the ultrasonic sensor 300, and the in-vehicle display screen 400 are respectively electrically connected to the in-vehicle control host 500. The in-vehicle control host 500 is data-connected to the cloud storage server 600 through the built-in 5G communication module, and the mobile phone APP 700 is data-connected to the cloud storage server 600. The camera 100 includes a first housing 101, a high-definition wide-angle camera module 102, a first speaker (not shown), a mounting bracket 103, and a mounting base (not shown). The high-definition wide-angle camera module 102 is embedded in the front end of the first housing 101. The first speaker is arranged inside the first housing 101. A plurality of first sound transmission holes 1011 are provided at the lower and upper ends of the first housing 101. The mounting bracket 103 protrudes from the upper end of the first housing 101. The mounting base is fixedly connected to the vehicle, and the upper end of the mounting bracket 103 is rotatably connected to the mounting base.

[0024] Specifically, the millimeter-wave radar 200 includes a millimeter-wave radar sensor 201, a second housing 202, a second mounting base 203, and fastening screws 204. The millimeter-wave radar sensor 201 is embedded in the front end of the second housing 202. A first accommodation groove 2031 is provided at the front end of the second mounting base 203. The second housing 202 is detachably embedded in the first accommodation groove 2031. Threaded holes 2021 are respectively recessed on both sides of the rear end of the second housing 202. The fastening screws 204 respectively pass through the second housing 202 and are screwed into the threaded holes 2021. A connector 2022 protrudes from the rear end of the second housing 202. A wire passing hole 2031 is recessed at the rear end of the second mounting base 203. The connector 2022 is arranged through the wire passing hole 2031. Fixing plates 2032 respectively protrude from both side walls of the second mounting base 203. Mounting holes 2033 are respectively recessed in the fixing plates 2032. The fixing plates 2032 are fixedly connected to the vehicle through the mounting holes 2033. The millimeter-wave radar probe 201 uses a 79 GHz millimeter-wave radar probe.

[0025] Specifically, a plurality of heat dissipation fins 2023 protrude from the rear end of the second housing 202, which plays a role in accelerating heat dissipation.

[0026] Specifically, the in-vehicle display screen 400 includes a third housing 401, a touch display screen module 402, a second speaker 403, buttons 404, indicator lights 405, and a second speaker (not shown). The touch display screen module 402 is embedded in the front end of the third housing 401. The buttons 404 and the indicator lights 405 are arranged at the lower end of the touch display screen module 402. The second speaker is arranged in the third housing 401. A plurality of second sound transmission holes 4011 are provided at the rear end of the third housing 401.

[0027] Specifically, it further includes a stylus (not shown). A storage groove 4012 protrudes from the rear end of the third housing 401. The lower end of the stylus is detachably embedded in the storage groove 4012, which is convenient for storing the stylus and prevents it from being lost at the same time.

[0028] Specifically, it further includes a snap plate 406. The snap plate 406 is detachably arranged at the rear end of the third housing 401. A snap groove 4061 is recessed at the lower end of the snap plate 406, which makes the installation of the in-vehicle display screen more convenient and fast.

[0029] Specifically, it further includes magnetic attraction blocks (not shown). A plurality of second accommodation grooves 4013 are recessed at the rear end of the third housing 401. The magnetic attraction blocks are embedded in the second accommodation grooves 4013, which makes the installation of the in-vehicle display screen more convenient and fast.

[0030] Specifically, the camera collects image information of different angles around the vehicle, analyzes the images using image processing technology, identifies objects such as vehicles, pedestrians, and obstacles, and determines their positions in the images. The millimeter-wave radar detects the distance and relative speed between the target object and the vehicle by transmitting and receiving millimeter-wave signals. The ultrasonic sensor detects the presence of obstacles by transmitting and receiving ultrasonic waves within the close range of the vehicle. The control unit fuses the data of these sensors to construct an environmental model of the blind area around the vehicle, and presents the blind area information to the driver in a more intuitive way through a display screen, and displays the objects in the blind area within the driver's field of vision in real time, enabling the driver to more clearly understand the situation around the vehicle and further improving driving safety. When an object enters the preset dangerous area, the system will issue corresponding warning signals according to the degree of danger. By more precisely fusing the data of multiple sensors such as cameras, radars, and sensors, the detection accuracy and reliability of the system are improved, and the situations of false alarms and missed detections are reduced.

[0031] Specifically, the artificial intelligence and machine learning algorithms adopted in the present invention are prior arts and will not be elaborated herein.

[0032] Specifically, the working principle of the present invention is as follows: The camera can capture the image information around the vehicle. The millimeter-wave radar can accurately measure the distance, speed, and angle of the target object. The ultrasonic sensor is mainly used for close-range detection. These sensors work together to comprehensively perceive the conditions of the vehicle's blind spots. The in-vehicle control host receives the data transmitted by the sensors, analyzes and processes it, and determines whether there is an object entering the blind spot and whether there is a potential danger according to the preset artificial intelligence algorithm. Then, it decides whether to trigger an alarm. When a dangerous situation is determined, an alarm signal will be sent to the driver through the in-vehicle display screen and the built-in speaker. The real-time image of the blind spot may be displayed on the display screen, or the position of the dangerous object may be marked. Different types of alarm sounds will be emitted by the speaker built into the display screen and the camera to attract the attention of the driver and passers-by. At the same time, the in-vehicle control host is connected to the cloud storage server through the built-in 5G communication module, and the mobile phone APP is connected to the cloud storage server to realize the real-time upload and retention and remote viewing of data such as the vehicle's driving trajectory and blind spot conditions, so as to monitor the conditions of each blind spot of the vehicle in real time. Whether during driving or parking, it can continuously monitor whether there are abnormal situations in the blind spot, effectively reducing the incidence of traffic accidents. Moreover, the millimeter-wave radar probe can not only filter out the adverse effects brought by bad weather, but also has a farther detection range, faster discovery of potential targets, and more accurate distance judgment, which can reduce the possibility of collision accidents when changing lanes while driving. When the vehicle is about to merge lanes, the system will detect whether there is a vehicle approaching quickly in the blind spot of the adjacent lane. If so, it will promptly remind the driver to avoid accidents caused by forcibly merging lanes without noticing the vehicle in the blind spot. When reversing, the system can monitor the obstacles in the rear and side blind spots of the vehicle. When it detects that there is an obstacle approaching or within a dangerous distance, it will issue an alarm to help the driver reverse safely and prevent collisions with the vehicles, pedestrians, or obstacles behind. And it can achieve dynamic warning: not only can it detect static objects, but also track and warn moving objects. For example, when a vehicle quickly enters the blind spot from the rear, the system will predict the possible danger in advance according to its speed and driving trajectory and promptly send an alarm to the driver, effectively improving driving safety.

[0033] The above are only the preferred embodiments of the present invention, and do not limit the patent scope of the present invention accordingly. Any equivalent structural transformation made under the inventive concept of the present invention by using the content of the specification and drawings of the present invention, or any direct / indirect application in other related technical fields is included in the patent protection scope of the present invention.

Claims

1. A vehicle blind spot monitoring and warning system based on artificial intelligence, characterized in that: The invention comprises a camera, a millimeter-wave radar, an ultrasonic sensor, a vehicle-mounted display screen, a vehicle-mounted control host, a cloud storage server and a mobile phone APP. The camera, the millimeter-wave radar and the ultrasonic sensor are respectively arranged in the blind spots in front, on the side and at the rear of the vehicle. The vehicle-mounted control host is arranged in the vehicle, and the vehicle-mounted display screen is arranged in the driving compartment of the vehicle. A central processing unit, a storage module, a GPS positioning module and a 5G communication module are arranged in the vehicle-mounted control host. The camera, the millimeter-wave radar, the ultrasonic sensor and the vehicle-mounted display screen are respectively electrically connected to the vehicle-mounted control host. The vehicle-mounted control host is connected to the cloud storage server through the built-in 5G communication module. The mobile phone APP is connected to the cloud storage server. The camera comprises a first shell, a high-definition wide-angle camera module, a first speaker, a mounting bracket and a mounting seat. The high-definition wide-angle camera module is embedded in the front end of the first shell. The first speaker is arranged in the first shell. A plurality of first sound-transmitting holes are arranged at the lower end and the upper end of the first shell. The mounting bracket is convexly provided with an upper end of the first shell. The mounting seat is fixedly connected to the vehicle, and the upper end of the mounting bracket is rotatably connected to the mounting seat.

2. The vehicle blind spot monitoring and warning system based on artificial intelligence according to claim 1 is characterized in that: The millimeter-wave radar includes a millimeter-wave radar sensor, a second shell, a second mounting seat and a fastening screw. The millimeter-wave radar sensor is embedded in the front end of the second shell, the front end of the second mounting seat is provided with a first accommodating groove, the second shell is detachably embedded in the first accommodating groove, both sides of the rear end of the second shell are respectively recessed with a threaded hole, the fastening screws are respectively penetrated through the second shell and screwed into the threaded holes, the rear end of the second shell is protruding with a connector, the rear end of the second mounting seat is recessed with a threading hole, the connector is penetrated through the threading hole, the two side walls of the second mounting seat are respectively protruding with a fixing plate, the fixing plates are respectively recessed with mounting holes, the fixing plates are fixedly connected to the vehicle through the mounting holes, and the millimeter-wave radar probe adopts a 79 GHz millimeter-wave radar probe.

3. The vehicle blind spot monitoring and warning system based on artificial intelligence according to claim 2 is characterized in that: A plurality of heat dissipation fins are protruded from the rear end portion of the second shell.

4. The vehicle blind spot monitoring and warning system based on artificial intelligence according to claim 1 is characterized in that: The vehicle-mounted display screen includes a third shell, a touch display screen module, a second speaker, a button, an indicator light and a second speaker. The touch display screen module is embedded in the front end of the third shell, the button and the indicator light are arranged at the lower end of the touch display screen module, the second speaker is arranged in the third shell, and the rear end of the third shell is provided with a plurality of second sound holes.

5. The vehicle blind spot monitoring and warning system based on artificial intelligence according to claim 4 is characterized in that: It also includes a stylus pen. A storage groove is protruding from the rear end of the third shell, and the lower end of the stylus pen is detachably embedded in the storage groove.

6. The vehicle blind spot monitoring and warning system based on artificial intelligence according to claim 4 is characterized in that: It also includes a snap plate, which is detachably arranged on the rear end of the third shell, and a snap groove is recessed at the lower end of the snap plate.

7. The vehicle blind spot monitoring and warning system based on artificial intelligence according to claim 4 is characterized in that: It also includes a magnetic block. The rear end of the third shell is concavely provided with a plurality of second accommodating grooves, and the magnetic block is embedded in the second accommodating grooves.

Images