Vehicle video data management method and system based on intellectualization

Abstract

The invention discloses a vehicle video data management method and system based on intelligentization, and belongs to the technical field of vehicle safety. The system comprises a state monitoring device, a vibration sensor, an intelligent terminal, a first camera device and a plurality of second camera devices, and a vehicle front detection module and a vehicle periphery detection module are arranged in the intelligent terminal. The state monitoring device monitors the running state of the vehicle, the vibration sensor obtains an engine vibration signal and transmits the engine vibration signal to the intelligent terminal, the intelligent terminal drives the first camera device to shoot the front of the vehicle according to the running state of the vehicle and the vibration signal, and the vehicle front detection module judges whether the environment in front of the vehicle is abnormal or not; if yes, the second camera shooting device shoots the periphery of the vehicle, the vehicle periphery detection module judges whether the periphery of the vehicle is abnormal or not, and if yes, the video is transmitted to the mobile terminal. By means of the mode, safety and guarantee of large automobiles such as a trailer entering the idling state in the operation process are improved, and losses generated in the transportation process are reduced.

Description

Technical Field

[0001] The present invention relates to the field of vehicle safety technology, and in particular to an intelligent vehicle video data management method and system. Background Art

[0002] A trailer is a cargo transport vehicle consisting of a tractor and a trailer. There are many types of trailers. As a cargo transport vehicle, it is mainly used for long-distance transportation and freight services. They can be seen on highways, urban roads and even some country roads. In their carriages, you can see piles of neatly arranged crops or live poultry.

[0003] At present, most trailer truck drivers adopt the method of "hiding during the day and going out at night" to transport goods so as to enjoy less traffic pressure at night. However, since goods usually need to be transported over long distances and drivers need to drive for a long time, the goods in the car are often unattended when they take a short break at a place where they can stop. Since the trailer car is basically a hollow structure on all sides, the goods are easily lost due to emergencies. In addition, traffic jams may occur during driving, and the driver's attention is focused on the front, and he cannot take into account the safety of the goods. Therefore, there is an urgent need for a system that can automatically record and save videos when the vehicle is idling, so as to effectively supervise the goods in the car and ensure that the lost goods can be quickly tracked in the event of an accident. Summary of the invention

[0004] The object of the present invention is to provide a method for solving the problems mentioned in the above background technology.

[0005] In order to solve the above technical problems, the present invention provides an intelligent vehicle video data management method, which includes the following steps:

[0006] Step 1: Acquire the vibration signal of the engine and monitor the driving status of the vehicle in real time, and transmit the vibration signal and driving status information to the smart terminal, which determines whether the driving status of the vehicle is normal and whether the vibration signal exceeds a preset vibration threshold.

[0007] Step 2: If it is determined that the vibration signal exceeds the vibration threshold and the vehicle is in a stopped state, a first instruction is generated to trigger a first camera device to take a picture of the environment in front of the vehicle and determine whether the environment in front of the vehicle is abnormal.

[0008] Step 3: If it is determined that the environment in front of the vehicle is abnormal, a second instruction is generated to trigger a plurality of second camera devices to continuously photograph the environment around the vehicle; if the environment in front of the vehicle is not abnormal, the first camera device is turned off.

[0009] Step 4: monitor the video captured by the continuous camera, and if it is determined that there is an abnormality, intercept the abnormal process and transmit it to the mobile terminal.

[0010] In the above technical solution, the vehicle driving state is obtained by obtaining the vehicle GPS positioning, and the vibration threshold is calibrated according to the range of vibration frequency of different engine types at idle and driving states.

[0011] The vehicle driving state includes an idling state and a driving state, which is specifically obtained by obtaining the GPS positioning of the vehicle. The vibration threshold is calibrated according to the range of vibration frequencies of different types of engines in an idling or driving state.

[0012] In the above technical solution, the first instruction specifically includes:

[0013] S1. Start a first camera device to take a picture of the area in front of the vehicle for a predetermined time.

[0014] S2. Decompose the obtained video data into a number of image frames, and preprocess them to obtain an image frame sequence.

[0015] S3. Analyze the image frame sequence to obtain a determination result.

[0016] In the above technical solution, the analysis of the image frame sequence specifically includes: primary recognition, secondary recognition and tertiary recognition, wherein the primary recognition includes recognizing the traffic light through the recognition algorithm according to the preprocessed image frame sequence. When it is recognized that there is a traffic light in front of the vehicle, secondary recognition is performed, and when it is recognized that there is no traffic light in front of the vehicle, tertiary recognition is directly performed.

[0017] In the above technical solution, the secondary identification includes:

[0018] S1. Crop and select the traffic light sign parts in all the image frames in the image frame sequence to obtain a primary sequence.

[0019] S2. Normalize the sizes of the images in the selected sequence to eliminate the influence of different sizes and obtain a normalized sequence.

[0020] S3. Perform contrast enhancement on the images in the normalized sequence, and select effective color areas in the enhanced images to obtain a final sequence.

[0021] S4. Identify the color of the traffic lights in the effective area in the final sequence. If the color in the effective area in the final sequence turns red, it is determined to be waiting for the traffic lights. If the color in the effective area in the final sequence turns green, it is determined to be starting and waiting.

[0022] There are no abnormalities when waiting for traffic lights and waiting to start. If the vehicle does not enter the driving state after the preset time and the vibration signal still exceeds the vibration threshold, it is determined that there is no abnormality and three recognitions are performed.

[0023] In the above technical solution, the secondary recognition includes: identifying the lane ahead and the vehicle information in the lane through a recognition algorithm based on the preprocessed image frame sequence. If there are vehicles in all lanes ahead, it is determined to be a traffic jam and a second instruction is generated.

[0024] In the above technical solution, the three recognitions include recognizing the background environment in the image frame sequence. If it is recognized as a building, a green belt or a parking lot, it is determined to be abnormal, and the third instruction is generated.

[0025] In the above technical solution, the second instruction includes:

[0026] S1. Start the second camera behind the vehicle to continuously shoot and obtain a real-time video sequence.

[0027] S2. Real-time monitoring is performed on the real-time video sequence, and the rear part of the vehicle in the real-time video sequence is used as the first background, and the rest of the vehicle is used as the second background.

[0028] S3. Analyze and determine whether there is a moving object in the second background by using a background difference method. If there is a moving object, further determine whether the moving object is in contact with the first background.

[0029] S4. If the moving object does not come into contact with the first background, the real-time video sequence is deleted. If the moving object comes into contact with the second background, the time when the moving object appears in the second background in the real-time video sequence is used as the starting segment, and the time when the moving object leaves the second background is used as the ending segment. The entire video from the starting segment to the ending segment is captured and transmitted to the mobile terminal.

[0030] S5. After receiving the video, the mobile terminal plays a preset specific audio.

[0031] In the above technical solution, the third instruction includes:

[0032] S1. Start all second camera devices to continuously shoot the environment around the vehicle to obtain several real-time video sequences.

[0033] S2. All real-time video sequences are monitored in real time, and the portion of the real-time video sequence where the vehicle body exists is used as the first background, and the rest of the portion is used as the second background.

[0034] S3. Analyze and determine whether there is a moving object in the second background in each real-time video sequence by using a background difference method. If there is a moving object, further determine whether the moving object is in contact with the first background.

[0035] S4. If the moving object does not come into contact with the first background, the real-time video sequence is deleted. If the moving object comes into contact with the second background, the time when the moving object appears in the second background in the real-time video sequence is used as the starting segment, and the time when the moving object leaves the second background is used as the ending segment. The entire video from the starting segment to the ending segment is captured and transmitted to the mobile terminal.

[0036] S5. After receiving the video, the mobile terminal plays a preset specific audio.

[0037] The intelligent vehicle video data management system includes a state monitoring device, a vibration sensor, an intelligent terminal installed in the vehicle, a state monitoring device, a vibration sensor and a processor respectively connected to the intelligent terminal, a first camera device and a plurality of second camera devices.

[0038] The status monitoring device is used to monitor the driving status of the vehicle and transmit it to the intelligent terminal to determine whether the vehicle is in a proper state; the vibration sensor is used to obtain the vibration signal of the engine at intervals and transmit it to the intelligent interactive terminal to determine whether the vibration signal exceeds a preset vibration threshold.

[0039] The intelligent terminal is provided with a front vehicle detection module and a vehicle surrounding detection module. The front vehicle detection module is provided with a splitting unit, a preprocessing unit and a recognition unit. The splitting unit is responsible for decomposing the video output by the first camera device. The preprocessing unit is responsible for preprocessing the decomposed image frames. The recognition unit pre-stores various image information including traffic lights, colors in traffic lights, road traffic markings, building bodies, green belts and parking lots.

[0040] The vehicle perimeter detection module includes a video processing unit and a video transmission unit. The video processing unit is used to analyze and determine moving objects in the video output by the second camera device, and to intercept abnormal parts and transmit them to the mobile terminal via the video transmission unit.

[0041] Additional aspects and advantages of the present invention will become apparent in the following description, or through the practice of the present invention, by adding a number of second camera devices to the vehicle body to effectively record the environment around the vehicle body, and analyzing the acquired real-time video sequence, it can be known whether there is a situation of cargo loss. Compared with the method of adding a number of driving recorders, the second camera device in the present invention does not need to be plugged in, and the second camera device performs targeted video shooting, which effectively reduces the space occupied by the memory.

[0042] Taking into account that during the driving process of the vehicle, the body of the vehicle may shake or vibrate due to the unevenness of some roads or other reasons, which may easily cause the engine to suddenly produce abnormal shaking and cause the vibration sensor to receive an error signal, a status monitoring device is added to monitor the driving status of the vehicle in real time. Relying on the mutual cooperation between the two, only when the vehicle is in a stopped state and the vibration signal generated by the engine is outside the range of the vibration threshold, will a subsequent instruction be generated to effectively determine whether the vehicle is in an idle state. This increases the triggering requirements for the idle state judgment, thereby improving the judgment accuracy and work efficiency of the system and reducing the probability of accidents.

[0043] In the present invention, by judging the traffic lights, lanes and vehicles, the situation of waiting for traffic lights or traffic jams at intersections is eliminated, thereby preventing the system from being activated due to misjudgment, and effectively improving the judgment accuracy of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0045] Figure 1 It is a flow chart of the intelligent vehicle video data management method of the present invention. DETAILED DESCRIPTION

[0046] In order to more clearly understand the above-mentioned purpose, features and advantages of the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that the embodiments of the present application and the features in the embodiments can be combined with each other without conflict.

[0047] In the following description, many specific details are set forth to facilitate a full understanding of the present invention. However, the present invention may also be implemented in other ways different from those described herein. Therefore, the protection scope of the present invention is not limited to the specific embodiments disclosed below.

[0048] See also Figure 1 The embodiment of the present invention provides an intelligent vehicle video data management method, comprising the following steps:

[0049] Step 1: Acquire the vibration signal of the engine and monitor the driving status of the vehicle in real time, and transmit the vibration signal and driving status information to the smart terminal, which determines whether the driving status of the vehicle is normal and whether the vibration signal exceeds a preset vibration threshold.

[0050] Step 2: If it is determined that the vibration signal exceeds the vibration threshold and the vehicle is in a stopped state, a first instruction is generated to trigger a first camera device to take a picture of the environment in front of the vehicle and determine whether the environment in front of the vehicle is abnormal.

[0051] Step 3: If it is determined that the environment in front of the vehicle is abnormal, a second instruction is generated to trigger a plurality of second camera devices to continuously photograph the environment around the vehicle; if the environment in front of the vehicle is not abnormal, the first camera device is turned off.

[0052] Step 4: monitor the video captured by the continuous camera, and if it is determined that there is an abnormality, intercept the abnormal process and transmit it to the mobile terminal.

[0053] Specifically, in step one, by acquiring vibration signals and combining vehicle driving status monitoring, a decision is made as to whether to enter the idle state of the vehicle, thereby increasing the triggering requirements and thereby improving the judgment accuracy of the system.

[0054] In one embodiment, the vehicle driving state is obtained by obtaining the vehicle GPS positioning, and the vibration threshold is calibrated according to the range of vibration frequencies of different engine types under idling and driving states.

[0055] It should be noted that the vibration threshold value may be a normal range value of the vibration generated by the engine in an idle state, or may be a normal range value of the vibration generated by the engine during driving.

[0056] In one embodiment, if it is determined that the vehicle is in motion and the acquired engine vibration signal exceeds the vibration threshold for a long time, an alarm is sent to a mobile terminal or displayed on a display screen in the vehicle system to remind the driver to perform a safety check on the vehicle.

[0057] Specifically, when it is determined that the vibration signal exceeds the vibration threshold and the vehicle is in a stopped state, the first instruction generated specifically includes the image frame sequence identifying the traffic light through the recognition algorithm. When it is recognized that there is a traffic light in front of the vehicle, a secondary recognition is performed, specifically including:

[0058] S1. Crop and select the traffic light sign parts in all the image frames in the image frame sequence to obtain a primary sequence.

[0059] S2. Normalize the sizes of the images in the selected sequence to eliminate the influence of different sizes and obtain a normalized sequence.

[0060] S3. Perform contrast enhancement on the images in the normalized sequence, and select effective color areas in the enhanced images to obtain a final sequence.

[0061] S4. Identify the color of the traffic lights in the effective area in the final sequence. If the color in the effective area in the final sequence turns red, it is determined to be waiting for the traffic lights. If the color in the effective area in the final sequence turns green, it is determined to be starting and waiting.

[0062] In one embodiment, if the vehicle does not enter the driving state after a preset time and the vibration signal still exceeds the vibration threshold, it is determined that there is no abnormality and three identifications are performed. Specifically, it includes: identifying the number of vehicles in the lane ahead and in the lane through the recognition algorithm according to the pre-processed image frame sequence. If the vehicles in all lanes ahead are arranged in sequence, it is determined to be a traffic jam waiting. At this time, a second instruction is generated, and the second instruction includes:

[0063] S1. Start the second camera behind the vehicle to continuously shoot and obtain a real-time video sequence.

[0064] S2. Real-time monitoring is performed on the real-time video sequence, and the rear part of the vehicle in the real-time video sequence is used as the first background, and the rest of the vehicle is used as the second background.

[0065] S3. Analyze and determine whether there is a moving object in the second background by using a background difference method. If there is a moving object, further determine whether the moving object is in contact with the first background.

[0066] S4. If the moving object does not come into contact with the first background, the real-time video sequence is deleted. If the moving object comes into contact with the second background, the time when the moving object appears in the second background in the real-time video sequence is used as the starting segment, and the time when the moving object leaves the second background is used as the ending segment. The entire video from the starting segment to the ending segment is captured and transmitted to the mobile terminal.

[0067] S5. After receiving the video, the mobile terminal plays a preset specific audio.

[0068] Through the above method, after being determined to be waiting in a traffic jam, the rear of the car is recorded and saved as the first idling recording method, and real-time monitoring is performed.

[0069] After it is determined to be a traffic jam waiting, when the vehicle's driving state enters normal driving and the engine's vibration signal is within the vibration threshold, the first camera device is started again to shoot the front of the vehicle for a preset time, and steps S1Y and S2 in the first instruction are repeated, and the obtained image sequence is compared with the image sequence containing lane and vehicle information in the lane in the above three recognitions. When the number of lanes is significantly less than the number of lanes in the three recognitions, it is determined that the ground vehicle waiting is over, and the first camera device is immediately turned off, and the video sequence taken by the first camera device is deleted.

[0070] It should be noted that the video sequence obtained by starting the first camera device again to shoot the video in front of the vehicle within a preset time has a video length equal to the first time the video was shot in front of the vehicle within a preset time. During the comparison, the relative image frame sequences are compared one by one.

[0071] In one embodiment, when it is determined that there is no traffic light in front of the vehicle, three recognitions are directly performed. The three recognitions at this time include recognizing the background environment in the image frame sequence. If it is recognized as a building, a green belt or a parking lot, it is determined to be abnormal, and the third instruction is generated:

[0072] S1. Start all second camera devices to continuously shoot the environment around the vehicle to obtain several real-time video sequences.

[0073] S2. All real-time video sequences are monitored in real time, and the portion of the real-time video sequence where the vehicle body exists is used as the first background, and the rest of the portion is used as the second background.

[0074] S3. Analyze and determine whether there is a moving object in the second background in each real-time video sequence by using a background difference method. If there is a moving object, further determine whether the moving object is in contact with the first background.

[0075] S4. If the moving object does not come into contact with the first background, the real-time video sequence is deleted. If the moving object comes into contact with the second background, the time when the moving object appears in the second background in the real-time video sequence is used as the starting segment, and the time when the moving object leaves the second background is used as the ending segment. The entire video from the starting segment to the ending segment is captured and transmitted to the mobile terminal.

[0076] S5. After receiving the video, the mobile terminal plays a preset specific audio.

[0077] By means of the above method, the idling video of the trailer under different environmental conditions is recorded, thereby improving the utilization rate of the second camera device, thereby improving the working efficiency of the system.

[0078] In one embodiment, the mobile terminal includes but is not limited to mobile devices such as mobile phones and tablet computers.

[0079] The present invention also provides an intelligent vehicle video data management system, including a status monitoring device, a vibration sensor, an intelligent terminal installed in the vehicle, a status monitoring device, a vibration sensor and a processor respectively connected to the intelligent terminal, a first camera device and a plurality of second camera devices.

[0080] The status monitoring device is used to monitor the driving status of the vehicle and transmit it to the intelligent terminal to determine whether the vehicle is in a proper state; the vibration sensor is used to obtain the vibration signal of the engine at intervals and transmit it to the intelligent interactive terminal to determine whether the vibration signal exceeds a preset vibration threshold.

[0081] The intelligent terminal is provided with a front vehicle detection module and a vehicle surrounding detection module. The front vehicle detection module is provided with a splitting unit, a preprocessing unit and a recognition unit. The splitting unit is responsible for decomposing the video output by the first camera device. The preprocessing unit is responsible for preprocessing the decomposed image frames. The recognition unit pre-stores various image information including traffic lights, colors in traffic lights, road traffic markings, building bodies, green belts and parking lots.

[0082] The vehicle perimeter detection module includes a video processing unit and a video transmission unit. The video processing unit is used to analyze and determine moving objects in the video output by the second camera device, and to intercept abnormal parts and transmit them to the mobile terminal via the video transmission unit.

[0083] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0084] Finally, it should be noted that the above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art can still modify the technical solutions described in the aforementioned embodiments or replace some of the technical features therein by equivalents. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. An intelligent vehicle video data management method, characterized in that: The method comprises the following steps: Step 1: Acquire the vibration signal of the engine and monitor the driving state of the vehicle in real time, and transmit the vibration signal and driving state information to the intelligent terminal, and the intelligent terminal determines whether the driving state of the vehicle is normal and whether the vibration signal exceeds a preset vibration threshold; Step 2: if it is determined that the vibration signal exceeds the vibration threshold and the vehicle is in a stopped state, a first instruction is generated to trigger a first camera device to take a picture of the environment in front of the vehicle and determine whether the environment in front of the vehicle is abnormal; Step 3: if it is determined that the environment in front of the vehicle is abnormal, a second instruction is generated to trigger a plurality of second camera devices to continuously take pictures of the environment around the vehicle; if the environment in front of the vehicle is not abnormal, the first camera device is turned off; Step 4: monitor the video captured by the continuous camera, and if it is determined that there is an abnormality, intercept the abnormal process and transmit it to the mobile terminal.

2. The intelligent vehicle video data management method according to claim 1 is characterized in that: The vehicle driving state includes an idle state and a driving state, which is specifically obtained by obtaining the vehicle GPS positioning. The vibration threshold is calibrated according to the range of vibration frequencies of different types of engines in an idle or driving state.

3. The intelligent vehicle video data management method according to claim 1 is characterized in that: The first instruction specifically includes: S1, starting a first camera device to take a picture of the front of the vehicle for a predetermined time; S2, decomposing the obtained video data into a number of image frames, and preprocessing them to obtain an image frame sequence; S3. Analyze the image frame sequence to obtain a determination result.

4. The intelligent vehicle video data management method according to claim 3 is characterized in that: The analysis of the image frame sequence specifically includes: primary recognition, secondary recognition and tertiary recognition, wherein the primary recognition includes recognizing the traffic light through the recognition algorithm according to the preprocessed image frame sequence; when it is recognized that there is a traffic light in front of the vehicle, secondary recognition is performed, and when it is recognized that there is no traffic light in front of the vehicle, tertiary recognition is directly performed.

5. The intelligent vehicle video data management method according to claim 4 is characterized in that: The secondary identification includes: S1, cropping and selecting the traffic light sign in all the image frames in the image frame sequence to obtain a primary sequence; S2, normalizing the sizes of the images in the selected sequence to eliminate the influence of different sizes and obtain a normalized sequence; S3, performing contrast enhancement on the images in the normalized sequence, and selecting effective color regions in the enhanced images to obtain a final sequence; S4, distinguishing the color of the traffic lights in the effective area in the final sequence, if the color in the effective area in the final sequence turns red, it is determined to be waiting for the traffic lights; if the color in the effective area in the final sequence turns green, it is determined to be starting and waiting; There are no abnormalities in the waiting for the traffic light and the starting waiting. If the vehicle does not enter the driving state after the preset time, and the vibration signal still exceeds the vibration threshold, it is determined that there is no abnormality and three identifications are performed.

6. The intelligent vehicle video data management method according to claim 5 is characterized in that: The secondary recognition includes: recognizing the lane ahead and the vehicle information in the lane through a recognition algorithm according to the pre-processed image frame sequence; if there are vehicles in all lanes ahead, it is determined to be a traffic jam, and a second instruction is generated at this time.

7. The intelligent vehicle video data management method according to claim 5 is characterized in that: The three recognitions include recognizing the background environment in the image frame sequence. If it is recognized as a building, a green belt or a parking lot, it is determined to be abnormal, and the third instruction is generated.

8. The intelligent vehicle video data management method according to claim 6 is characterized in that: The second instruction includes: S1, start the second camera behind the car to continuously shoot and obtain a real-time video sequence; S2, monitoring the real-time video sequence in real time, taking the rear part of the vehicle in the real-time video sequence as the first background, and the rest of the vehicle as the second background; S3, analyzing and judging whether there is a moving object in the second background by a background difference method, and if there is a moving object, further judging whether the moving object is in contact with the first background; S4. If the moving object does not come into contact with the first background, the real-time video sequence is deleted. If the moving object comes into contact with the second background, the start segment is taken as the time when the moving object appears in the second background in the real-time video sequence, and the end segment is taken as the time when the moving object leaves the second background. The entire video from the start segment to the end segment is intercepted and transmitted to the mobile terminal. S5. After receiving the video, the mobile terminal plays a preset specific audio.

9. The intelligent vehicle video data management method according to claim 7 is characterized in that: The third instruction includes: S1, start all second camera devices to continuously shoot the environment around the vehicle to obtain several real-time video sequences; S2, monitoring all real-time video sequences in real time, taking the part of the real-time video sequence with the vehicle body as the first background, and the rest as the second background; S3, analyzing and judging whether there is a moving object in the second background in each real-time video sequence by a background difference method, and if there is a moving object, further judging whether the moving object is in contact with the first background; S4. If the moving object does not come into contact with the first background, the real-time video sequence is deleted. If the moving object comes into contact with the second background, the start segment is taken as the time when the moving object appears in the second background in the real-time video sequence, and the end segment is taken as the time when the moving object leaves the second background. The entire video from the start segment to the end segment is intercepted and transmitted to the mobile terminal. S5. After receiving the video, the mobile terminal plays a preset specific audio.

10. An intelligent vehicle video data management system, particularly used to execute the method according to any one of claims 1 to 9, characterized in that: include: A state monitoring device, a vibration sensor, an intelligent terminal installed in a vehicle, a state monitoring device, a vibration sensor and a processor respectively connected to the intelligent terminal, a first camera device and a plurality of second camera devices; The state monitoring device is used to monitor the driving state of the vehicle and transmit it to the intelligent terminal to determine whether the vehicle is in a state of motion; the vibration sensor is used to obtain the vibration signal of the engine at intervals and transmit it to the intelligent interactive terminal to determine whether the vibration signal exceeds a preset vibration threshold; The intelligent terminal is provided with a front vehicle detection module and a vehicle surrounding detection module. The front vehicle detection module is provided with a splitting unit, a preprocessing unit and a recognition unit. The splitting unit is responsible for decomposing the video output by the first camera device; the preprocessing unit is responsible for preprocessing the decomposed image frames; the recognition unit pre-stores various types of image information including traffic lights, colors of traffic lights, road traffic markings, building bodies, green belts and parking lots; The vehicle perimeter detection module includes a video processing unit and a video transmission unit. The video processing unit is used to analyze and determine moving objects in the video output by the second camera device, and to capture abnormal parts and transmit them to the mobile terminal via the video transmission unit.

Images