Safety monitoring method and system during starting of vehicle

Abstract

The invention provides a safety monitoring method and system during starting of a vehicle. The safety monitoring method comprises the steps of S1, S2, S3 and S4. S1, camera shooting data of the surrounding environment of the vehicle are obtained through a camera shooting device; s2, radar data of the surrounding environment of the vehicle are obtained through a radar device, camera data and the radar data are compared, if the two data are consistent, the step S3 is executed, and if the two data are not consistent, the step S4 is executed, and a warning signal is sent out; s3, satellite image data of the surrounding environment of the vehicle is obtained through a satellite device, the camera data, the radar data and the satellite image data are compared, if the three pieces of data are consistent, it is indicated that the camera data are correct, the vehicle is allowed to start, and if the three pieces of data are not consistent, the step S4 is executed, and a warning signal is sent out; and S4, ending the execution method. According to the safety monitoring method during vehicle starting, the problem that whether obstacles exist around or not cannot be automatically judged during vehicle starting can be solved.

Description

Technical Field

[0001] The invention relates to the field of automobile automation control, and in particular to a safety monitoring method when a vehicle starts. Background Art

[0002] At present, mainstream cars on the market are equipped with a series of vehicle surrounding monitoring devices such as reversing radar, but there is no effective monitoring system when the vehicle moves forward, which causes the driver to look around the vehicle and even get off the vehicle to check the surrounding conditions when starting the vehicle. This gives the driver a poor driving experience, and if these necessary inspections are not performed, it is very likely that the impact of the surrounding environment will be ignored, causing unnecessary damage to the vehicle and personnel. Summary of the invention

[0003] In view of the shortcomings of the prior art mentioned above, the purpose of the present invention is to provide a method and system for safety monitoring when a vehicle starts, which is used to solve the problem in the prior art that the safety situation around the vehicle cannot be automatically monitored to ensure the safety of starting. The present invention mainly improves the vehicle starting monitoring method, and improves the safety of vehicle starting by collecting camera data, radar data and satellite image data and comparing the three-party data.

[0004] The present invention provides a safety monitoring method for a vehicle when starting, comprising:

[0005] S1: Obtaining camera data of the vehicle's surrounding environment through a camera device;

[0006] S2: obtaining radar data of the vehicle's surrounding environment through a radar device, comparing the camera data with the radar data, and if the two data match, proceeding to S3; if the two data do not match, proceeding to S4 and issuing a warning signal;

[0007] S3: obtaining satellite image data of the vehicle's surroundings through a satellite device, comparing the camera data, the radar data and the satellite image data; if the three data match, it means that the camera data is correct and the vehicle is allowed to start; if they do not match, the process goes to S4 and the warning signal is issued;

[0008] S4: End the execution of the method.

[0009] In one embodiment of the present invention, before S1, it also includes monitoring whether the driver enters the passenger compartment and sits down. After the driver sits down, the vehicle controller starts the safety monitoring method, and when it is detected that the driver is seated, a start signal is output to the vehicle controller.

[0010] In one embodiment of the present invention, in S1, when the vehicle controller receives the start signal, it sends a camera instruction to the camera device, and the camera device collects the camera data of the vehicle's surrounding environment after receiving the camera instruction.

[0011] In one embodiment of the present invention, in S1, the camera device sends the camera data to the image processing center and performs obstacle analysis. When there are obstacles around the vehicle, the process proceeds to S4, and the image processing center sends the warning signal to the vehicle controller. When there are no obstacles around the vehicle, the process proceeds to S2, and the image processing center sends a camera confirmation signal to the vehicle controller. At the same time when the image processing center sends the camera confirmation signal to the vehicle controller, the image processing center sends the camera data to the data processing center.

[0012] In one embodiment of the present invention, in S1, when the image processing center processes the camera data, it also determines the cleanliness of the camera device. When the cleanliness is too low, the image processing center sends a cleaning instruction to the vehicle controller, and the vehicle controller controls the camera device to clean the camera.

[0013] In one embodiment of the present invention, in S2, the radar device outputs the radar data to a data processing center for comparison with the camera data.

[0014] In one embodiment of the present invention, in S3, the satellite device outputs the satellite image data to the data processing center for comparison with the camera data and the radar data.

[0015] The present invention also provides a safety monitoring system for vehicle starting, comprising:

[0016] A camera system, wherein the camera system acquires camera data of the vehicle's surrounding environment;

[0017] A radar system, the radar system acquiring radar data of the vehicle's surroundings;

[0018] A satellite system, the satellite system acquiring satellite image data of the vehicle's surroundings;

[0019] a data processing center, the data processing center receiving the camera data, the radar data and the satellite image data, and performing comparative analysis on the data to determine whether the vehicle can start safely;

[0020] Wherein, the camera system, the radar system, the satellite system and the data processing center are communicatively connected.

[0021] In one embodiment of the present invention, the camera system also includes an image processing center, the camera data is sent to the image processing center and an obstacle signal is output according to the obstacle situation displayed by the image; when the camera data, the radar data and the satellite map real-scene data are consistent, the data processing center outputs a confirmation signal to the vehicle; when the camera data, the radar data and the satellite map real-scene data are inconsistent, the data processing center sends a warning signal to the vehicle.

[0022] In one embodiment of the present invention, it also includes a self-cleaning camera system. When the camera data is processed by the image processing center, the cleanliness of the camera device is judged at the same time. When the cleanliness is too low, the image processing center sends a cleaning instruction to the vehicle controller, and the vehicle controller controls the camera device to clean the camera.

[0023] The present invention provides a method and system for safety monitoring when a vehicle starts, which can automatically monitor the surrounding environment after the driver gets on the vehicle and determine whether the vehicle can be started safely.

[0024] Furthermore, the safety monitoring method and system of the present invention improves the safety of vehicle startup by collecting camera data, radar data and satellite image data and performing three-way data comparison, thereby preventing misjudgment due to problems in a certain device. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for describing the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.

[0026] Figure 1 is a flow chart of the steps of the safety monitoring method of the present invention;

[0027] Figure 2 4 is a system architecture diagram of the safety monitoring system of the present invention. DETAILED DESCRIPTION

[0028] The following describes the embodiments of the present invention through specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention.

[0029] It should be noted that, in the absence of conflict, the features in the following examples and embodiments can be combined with each other. It should also be understood that the terms used in the examples of the present invention are intended to describe specific embodiments rather than to limit the scope of the present invention. The test methods in the following examples that do not specify specific conditions are usually carried out under conventional conditions or under conditions recommended by the manufacturers.

[0030] See also Figure 1 to Figure 2 . It should be noted that the structures, proportions, sizes, etc. illustrated in the drawings in this specification are only used to match the contents disclosed in the specification for people familiar with this technology to understand and read, and are not used to limit the limiting conditions for the implementation of the present invention, so they have no substantial technical significance. Any modification of the structure, change in the proportional relationship, or adjustment of the size should still fall within the scope of the technical content disclosed by the present invention without affecting the effects and purposes that can be achieved by the present invention. At the same time, the terms such as "upper", "lower", "left", "right", "middle" and "one" quoted in this specification are only for the convenience of description, and are not used to limit the scope of the implementation of the present invention. Changes or adjustments in their relative relationships should also be regarded as the scope of the implementation of the present invention without substantially changing the technical content.

[0031] The present invention provides a method and system for safety monitoring when a vehicle starts, which can solve the problem that the vehicle cannot automatically determine whether there are obstacles around when it starts. Specifically, the method for safety monitoring when a vehicle starts of the present invention includes S1, S2, S3 and S4. S1: Obtaining camera data of the vehicle's surroundings through a camera device; S2: Obtaining radar data of the vehicle's surroundings through a radar device, comparing the camera data with the radar data, if the two data match, entering S3, if the two data do not match, turning to S4 and issuing a warning signal; S3: Obtaining satellite image data of the vehicle's surroundings through a satellite device, comparing the camera data, the radar data and the satellite image data, if the three data match, it means that the camera data is correct, allowing the vehicle to start, if they do not match, turning to S4 and issuing the warning signal; S4: Ending the execution of the method.

[0032] like Figure 1As shown, the safety monitoring method for vehicle starting provided by the present invention includes four steps, namely: obtaining camera data, obtaining radar data and comparing it with camera data, obtaining satellite data and comparing it with radar data and camera data, and ending the process. Before step S1, a startup process is also provided. When the driver enters the driver's seat, the passenger compartment camera will automatically monitor the seating situation. When the driver is detected to be seated, the passenger compartment camera sends a startup signal to the vehicle controller to start the safety monitoring method provided by the present invention. In step S1, when the vehicle controller receives the startup signal, the vehicle controller sends a camera instruction to the camera device. After receiving the camera instruction, the camera device automatically collects the camera data of the vehicle's surrounding environment and sends the camera data to the image processing center. After receiving the camera data, the image processing center performs cleanliness analysis and obstacle analysis on the camera data in sequence. When performing cleanliness analysis, the image processing center judges the cleanliness of the camera according to the pre-input judgment criteria. When the cleanliness is lower than the cleanliness threshold pre-input by the image processing center, the on-board camera cleaning device automatically starts and cleans the camera. After the cleaning is completed, the vehicle's surrounding environment is re-photographed and the camera data is sent and the cleanliness analysis is repeated until the cleanliness is higher than the cleanliness threshold. When the cleanliness is higher than the cleanliness threshold, the image processing center performs obstacle analysis on the camera data. When there is an obstacle, the image processing center sends a warning signal to the vehicle controller, the vehicle controller controls the vehicle audio to emit a prompt sound, and displays a problem warning on the vehicle's central control screen, reminding the driver not to start the vehicle and go to step S4. When there is no obstacle, the image processing center sends a camera confirmation signal to the vehicle controller, and the image processing center sends the camera data to the data processing center, and proceeds to step S2.

[0033] Further, in step S2, when the vehicle controller receives the camera confirmation signal, the vehicle controller sends a radar instruction to the radar device, and the radar device starts and scans around the vehicle to obtain radar data. After the scan is completed, the radar device sends the radar data to the data processing center. In the data processing center, the camera data and the radar data are compared. When the camera data and the radar data do not match, the data processing center sends a warning signal to the vehicle controller, and the vehicle controller controls the vehicle audio to emit a prompt sound, and displays a problem warning on the large screen of the vehicle central control to remind the driver not to start the vehicle. When the camera data and the radar data match, the data processing center sends a radar confirmation signal to the vehicle controller and proceeds to step S3. In step S3, when the vehicle controller receives the radar confirmation signal, the vehicle controller sends a satellite instruction to the satellite device, and the satellite device starts and scans around the vehicle to obtain satellite image data. After obtaining the satellite image data, the satellite device sends the satellite image data to the data processing center. In the data processing center, the satellite image data is compared with the camera data and the radar data. When the three data do not match, the data processing center sends a warning signal to the vehicle controller, and the vehicle controller controls the vehicle audio to emit a prompt sound, and displays a problem warning on the vehicle's central control screen, reminding the driver not to start the vehicle and go to S4. When the three data match, the vehicle controller controls the vehicle audio to emit a start prompt sound, and displays on the vehicle's central control screen that the vehicle can be started, and goes to S4. In step S4, the safety monitoring method process ends and starts the process the next time the driver sits down.

[0034] The present invention also includes a safety monitoring system when the vehicle starts, including: a camera system, the camera system obtains camera data of the vehicle's surrounding environment; a radar system, the radar system obtains radar data of the vehicle's surrounding environment; a satellite system, the satellite system obtains satellite image data of the vehicle's surrounding environment; a data processing center, the data processing center receives the camera data, radar data and satellite image data, and compares them. The camera system also includes an image processing center, the camera data is sent to the image processing center and an obstacle signal is output according to the obstacle situation displayed in the image. When the camera data, radar data and satellite map real-view data are consistent, the data processing center outputs a signal to the vehicle to confirm that the vehicle can be started; when the camera data, radar data and satellite map real-view data are inconsistent, the data processing center outputs a warning signal to the vehicle. It also includes a self-cleaning camera system. When the camera data is processed in the image processing center, the cleanliness of the camera device is judged at the same time. When the cleanliness is too low, the image processing center sends a cleaning instruction to the vehicle controller, and the vehicle controller controls the camera device to clean the camera.

[0035] Among them, the camera system, radar system, satellite system and data processing center are connected in communication. The camera system takes pictures of obstacles around the vehicle based on the camera, and the data is returned to the image processing center at a transmission speed of more than one gigabit per second. The image processing center calculates and determines the surrounding environment, and sends a confirmation signal to the data processing center after confirming that there is no problem. After receiving the confirmation signal, the data processing center sends a signal to the radar. The radar system monitors the surrounding situation based on the radar at a detection rate of 37.5Msps, and sends the radar data to the data processing center. The data processing center obtains real-life data from the satellite map at a speed of 319Tb / s, and compares it with the camera data and radar data to further eliminate errors. After confirming that the data of the three parties are consistent, the car audio and the central control screen issue a prompt to allow startup, indicating that the driver can start the vehicle. In the communication connection provided by the present invention, direct communication between user terminals can be adopted, such as direct transmission through hardware devices such as Bluetooth, NFC (near field wireless communication) and WIFI (wireless communication); it can also be transmitted through an intermediate server, such as indirect communication between user terminals-server-user terminals for communication connection.

[0036] The present invention proposes a safety monitoring method and system for vehicle starting, which compares camera data, radar data and satellite image data at one time to confirm that there are no obstacles around the vehicle and issue a start command. Multiple comparisons reduce the monitoring risk caused by equipment failure.

[0037] Therefore, the method and system for safety monitoring when a vehicle starts of the present invention can solve the problem that the vehicle cannot automatically determine whether there are obstacles around it when it starts.

[0038] The above embodiments are merely illustrative of the principles and effects of the present invention, and are not intended to limit the present invention. Anyone familiar with the art may modify or alter the above embodiments without departing from the spirit and scope of the present invention. Therefore, all equivalent modifications or alterations made by a person of ordinary skill in the art without departing from the spirit and technical concept disclosed by the present invention shall still be covered by the claims of the present invention.

Claims

1. A safety monitoring method for vehicle starting, characterized in that: include: S1: Obtaining camera data of the vehicle's surrounding environment through a camera device; S2: obtaining radar data of the vehicle's surrounding environment through a radar device, comparing the camera data with the radar data, and if the two data match, proceeding to S3; if not, proceeding to S4 and issuing a warning signal; S3: obtaining satellite image data of the vehicle's surroundings through a satellite device, comparing the camera data, the radar data and the satellite image data; if the three data match, it means that the camera data is correct and the vehicle is allowed to start; if they do not match, the process goes to S4 and the warning signal is issued; S4: End the execution of the method.

2. The method for safety monitoring when a vehicle starts according to claim 1, characterized in that: Before S1, it also includes monitoring whether the driver enters the passenger compartment and sits down. After the driver sits down, the vehicle controller starts the safety monitoring method, and when it is detected that the driver sits down, a start signal is output to the vehicle controller.

3. The vehicle start safety monitoring method according to claim 2, characterized in that: In S1, when the vehicle controller receives the start signal, it sends a camera instruction to the camera device, and the camera device collects the camera data of the vehicle's surrounding environment after receiving the camera instruction.

4. The vehicle starting safety monitoring method according to claim 3, characterized in that: In S1, the camera device sends the camera data to the image processing center and performs obstacle analysis. When there are obstacles around the vehicle, the process goes to S4, and the image processing center sends the warning signal to the vehicle controller. When there are no obstacles around the vehicle, the process goes to S2, and the image processing center sends a camera confirmation signal to the vehicle controller. At the same time when the image processing center sends the camera confirmation signal to the vehicle controller, the image processing center sends the camera data to the data processing center.

5. The vehicle starting safety monitoring method according to claim 4, characterized in that: In S1, when the image processing center processes the camera data, it also determines the cleanliness of the camera device. When the cleanliness is too low, the image processing center sends a cleaning instruction to the vehicle controller, and the vehicle controller controls the camera device to clean the camera.

6. The vehicle start safety monitoring method according to claim 1 or 4, characterized in that: In S2, the radar device outputs the radar data to a data processing center for comparison with the camera data.

7. The method for safety monitoring when a vehicle starts according to claim 6, characterized in that: In S3, the satellite device outputs the satellite image data to the data processing center for comparison with the camera data and the radar data.

8. A safety monitoring system for a vehicle when starting, characterized in that: include: A camera system, wherein the camera system acquires camera data of the vehicle's surrounding environment; A radar system, the radar system acquiring radar data of the vehicle's surroundings; A satellite system, the satellite system acquiring satellite image data of the vehicle's surroundings; a data processing center, the data processing center receiving the camera data, the radar data and the satellite image data, and performing comparative analysis on the data to determine whether the vehicle can start safely; Wherein, the camera system, the radar system, the satellite system and the data processing center are communicatively connected.

9. The vehicle starting safety monitoring system according to claim 8, characterized in that: The camera system also includes an image processing center, to which the camera data is sent and an obstacle signal is output according to the obstacle situation displayed in the image; when the camera data, the radar data and the real-view data of the satellite map are consistent, the data processing center outputs a confirmation signal to the vehicle; when the camera data, the radar data and the real-view data of the satellite map are inconsistent, the data processing center sends a warning signal to the vehicle.

10. The vehicle start-up safety monitoring system according to claim 9, characterized in that: It also includes a self-cleaning camera system. When the camera data is processed by the image processing center, the cleanliness of the camera device is judged at the same time. When the cleanliness is too low, the image processing center sends a cleaning instruction to the vehicle controller, and the vehicle controller controls the camera device to clean the camera.

Images