Automobile door opening anti-collision ultrasonic ranging alarm method and system

Abstract

The invention discloses an automobile door opening anti-collision ultrasonic ranging alarm method and system, and the method comprises the steps: predicting the final position information of a surrounding moving object through a movement position prediction seven-layer deep learning neural network according to the position information of the surrounding moving object collected before the door opening of the automobile; whether a dangerous situation is caused during door opening is judged, and if yes, the behavior of opening the door is stopped through a vehicle control system, so that the traffic safety problem caused by collision during door opening is avoided; if the danger does not exist, the behavior of opening the door is allowed through the vehicle control system; the alarm system comprises a hardware control module, an information storage module, a deep learning module, an information sampling module and the like which are required for supporting the automobile ultrasonic ranging alarm method, and effective avoidance of the collision problem of the upward opening door of the road safety is completed under the condition of not relying on subjective control of people.

Description

Technical Field

[0001] The invention relates to the technical field of ultrasonic measurement and traffic safety, and in particular to an ultrasonic distance measurement alarm method and system for automobile door opening anti-collision. Background Art

[0002] With the development of economy and the progress of society, the number of motor vehicles in my country is increasing. By the end of June 2024, the number of cars in China will reach 345 million, and the number of new energy vehicles will reach 24.72 million. These data show that with the rapid development of my country's economy, people's commuting has become more convenient. At the same time, with the increase in vehicles, traffic safety management and related traffic hazards have become more prominent. For example, the problem of door opening collision is caused by the fact that the passengers on the car do not carefully observe whether there are pedestrians or vehicles behind them when opening the door, and rashly open the door, resulting in pedestrians or vehicles passing by without time to react, causing collisions, and even causing casualties in serious cases. In recent years, with the increase in the number of vehicles, the number of door opening collisions caused by blind spots and omissions of the passengers on the car has increased, and the problem of door opening collision has become a difficult problem that needs to be solved in traffic management.

[0003] The present invention provides an ultrasonic ranging alarm method and system for preventing collision when opening a car door, aiming to solve the door opening collision problem from the vehicle control system end by adding an artificial intelligence method and system, without relying on the reaction and judgment of the people in the car. Summary of the invention

[0004] The purpose of the present invention is to solve the technical problems existing in the prior art and to provide an ultrasonic ranging alarm method and system for preventing collision when a car door is opened.

[0005] To achieve the above object, the present invention provides a technical solution: an ultrasonic ranging alarm method for preventing collision when a car door is opened, the ultrasonic ranging alarm method comprising the following steps:

[0006] S1, training data collection stage: define the prediction area, determine the position of the moving object entering the prediction area through the ultrasonic wave of the automobile ultrasonic detection device, sample according to the moving speed-time interval, extract the position information of the moving object within the extraction time interval, and form a speed-averaged position information matrix;

[0007] S2, training data set determination stage: randomly extracting a training position information set and a training real position information set from the speed average position information matrix;

[0008] S3, test data set determination stage: stripping the predicted position information set from the speed average position information matrix, establishing the test position information set and the test real position information set;

[0009] S4, deep learning network establishment stage: according to the application scenario, a seven-layer deep learning network with good generalization ability and strong robustness suitable for mobile location prediction is established;

[0010] S5, deep learning network training stage: The training position information set in S2 is based on two-dimensional coordinates , The axis splits the data into training positions Axis information set, training position Axis information set; using trained positions Axis information set, training position The seven-layer deep learning network for mobile position prediction is trained based on the axis information set, and the average positioning accuracy threshold and the maximum positioning error threshold are set. When the prediction accuracy of the trained network reaches the standard, the network training is stopped, and the corresponding hyperparameters and weight parameter information of the seven-layer deep learning network for mobile position prediction are output;

[0011] S6, mobile location prediction network test phase: the test location information set in S3 is based on two-dimensional coordinates , The axis splits the data into test positions Axis information set, test position Axis information set; pass test position Axis information set, test position The axis information set and the test real position information set are used to test whether the trained seven-layer deep learning network predicts the positioning accuracy.

[0012] S7, actual moving object position prediction stage: two modes are set: low-energy automobile ultrasonic ranging mode and low-latency automobile ultrasonic ranging mode. According to different choices of the occupants, the automobile ultrasonic detection device determines the position of the moving object entering the prediction area, extracts the online position information set of all moving objects in the automobile prediction area, substitutes it into the trained seven-layer deep learning network, and outputs the online prediction position information set of all moving objects;

[0013] S8, door opening collision safety control stage: set the car door opening collision danger zone, compare the final positions of all moving objects in the online predicted position information set of moving objects entering the prediction area with the car door opening collision danger zone, if there is a moving object in the car door opening collision danger zone within the predicted time interval of door opening, it is determined to be a dangerous state, and the behavior of opening the door is stopped through the vehicle control system, thereby avoiding the occurrence of door opening collision traffic safety problems; if all moving objects are not in the car door opening collision danger zone within the predicted time interval of door opening, it is determined to be a safe state, and the behavior of opening the door is allowed through the vehicle control system.

[0014] Preferably, the specific contents of the training data collection stage in S1 include: in the training data collection stage, the size of the prediction area is defined according to the extraction time interval, and the car extraction time interval is recorded as , the extraction time interval includes the sampling time interval and the prediction time interval, which are respectively denoted as , , there is the following relationship: ;

[0015] Then, the radius of the prediction area defined by the car is for: ;

[0016] in, To preset the maximum moving object speed, The prediction area defined by the car is is the area within a circle of radius;

[0017] Use the automobile ultrasonic ranging device to sample the position of the moving object according to the moving speed and sampling time interval within the extraction time interval: the sampling time interval is , then the two-dimensional position coordinates of the moving object entering the defined area and the average speed of the moving object are extracted according to the sampling time interval within the extraction time interval to form a speed position information matrix, which is recorded as :

[0018] ;

[0019] Among them, the number of moving objects entering the prediction area within the extraction time interval is Each moving object has a sampling time interval Extracting two-dimensional position information of the moving object for the sampling period; Indicates The moving object is Two-dimensional position coordinates at time intervals; For 1, 2, 3... ; For 1, 2, 3... ; Sample position information of each moving object Group, Represents a moving object The average moving speed is calculated as follows:

[0020] ;

[0021] From the speed position information matrix The velocity-averaged position information matrix is ​​further extracted according to the average moving speed of the moving object. ;

[0022] First, the average moving speed of the moving object is divided into four groups: Group 1, the actual average moving speed is not more than 8m / s; Group 2, the actual average moving speed is not more than 12m / s; Group 3, the actual average moving speed is not more than 20m / s; Group 4, the actual average speed is more than 20m / s; Then, according to the average speed of the moving object, the position speed information is extracted from the speed position information matrix with equal data volume to form the corresponding speed average position information matrix :

[0023] ;

[0024] in, Indicates group Middle The average speed of a moving object; Indicates the group Middle The moving object is Two-dimensional position information in a sampling period; Indicates that there are a total of The two-dimensional position information path of a moving object; by extracting the speed-averaged position information matrix, the motion trajectories of objects with different moving speeds are sampled with equal priority, which increases the comprehensiveness and reliability of the data and the robustness of the network after training.

[0025] Preferably, the method of randomly extracting the training position information set and the training real position information set in S2 includes: , from the velocity average position information matrix Extract the training position information set from ,but:

[0026] ;

[0027] in, Indicates from group The first The average speed of a moving object; Indicates that each group is randomly selected The two-dimensional position information path of a moving object; four groups are randomly selected with equal probability The speed position information of the moving object; according to the corresponding position of the moving object in the training position information set, the speed average position information matrix Extract the training real position information set, denoted as ,but:

[0028] ;

[0029] Training real location information set It represents the average speed and final position sampling information of the moving object corresponding to the training position information set; in order to facilitate the input of the subsequent training stage and the needs of the deep learning network, the training position information set According to the two-dimensional coordinates , Split the data into training positions by axis: Axis Information Set , Training Position Axis Information Set ;

[0030] ,

[0031] ,

[0032]

[0033] in, Indicates group Middle The moving object is The two-dimensional position information in the sampling period corresponds to , Indicates the corresponding horizontal and vertical coordinate information.

[0034] Preferably, the method of stripping the predicted location information set, establishing the test location information set and predicting the real location information set in S3 includes: , delete the training position information set from the speed average position information matrix The corresponding mobile object information in the training position information set is extracted to form the corresponding test position information set, which is recorded as ,but:

[0035] ;

[0036] in, represents the first The average speed of moving objects, each group is drawn separately The two-dimensional position information path of a moving object, four groups are randomly selected with equal probability The speed and position information of the moving object; according to the corresponding position of the moving object in the test position information set, the speed average position information matrix Extract the real test location information set from ,but:

[0037] ;

[0038] Testing the real location information set It represents the average speed and final position sampling information of the moving object corresponding to the test position information set; in order to facilitate the input of the subsequent test phase and the needs of the deep learning network, the test position information set According to the two-dimensional coordinates , The axis splits the data into test positions Axis Information Set , Test location Axis Information Set ;

[0039] ,

[0040] ,

[0041]

[0042] in, Indicates group Middle The moving object is The two-dimensional position information in the sampling period corresponds to , Indicates the corresponding horizontal and vertical coordinate information.

[0043] Preferably, the seven-layer deep learning network in the deep learning network establishment stage in S4: the first layer of the network is the input layer, and the input is two The matrices represent Axis and The positions of the axes are treated as two channels, so the input shape is:

[0044]

[0045] in, =2 is the number of channels, indicating Axis and The axis position matrix, =4 is the height, indicating the number of rows, = is the width, indicating the number of columns;

[0046] The second layer of the network is the first convolutional layer, which uses The convolution kernel, is the sampling time, the step size is 1, the padding is 0, and the output shape is: ;

[0047] The third layer of the network is the first pooling layer. The pooling layer uses a 2×2 maximum pooling with a step size of 2. The output shape is: ;

[0048] The fourth layer of the network is the second convolutional layer. The second convolutional layer uses 32 3×3 convolution kernels, with a step size of 1 and a padding of 1. The output shape is: ;

[0049] The fifth layer of the network is a flattening operation. Before entering the fully connected layer, the output of the convolutional layer needs to be flattened into a one-dimensional vector. The flattening operation turns (32, 1, 4) into 128 neurons.

[0050] The sixth layer of the network is the first fully connected layer, which has 128 neurons as input and 64 neurons as output;

[0051] The seventh layer of the network is the second fully connected layer, which is also the final output layer. The second fully connected layer has 64 neurons as input and 2 neurons as output, representing the two-dimensional coordinates predicted by the final network ( , ).

[0052] Preferably, the deep learning network training stage in S5 includes: setting the training position Axis information set, training position The axis information set is input into the seven-layer deep learning network and trained in batches. The minimum batch size is set to 100. Random sampling is used to extract data. The average positioning accuracy threshold is set to and the maximum positioning error threshold The output two-dimensional coordinates are compared with the corresponding position information in the training real position information set. The loss function of the network is set to the mean square error function to measure the difference between the predicted coordinates and the real coordinates. The optimizer selected is the Adam optimizer, and the learning rate is set to 0.002 to minimize the loss function to update the network parameters and determine the optimal seven-layer deep learning network. When the average positioning accuracy and the maximum positioning error are both less than the threshold, the network training is stopped, and the deep learning network, the weights and hyperparameters in the network are output and saved.

[0053] Preferably, the mobile location prediction network test phase in S6 includes: substituting the test location Axis information set, test position The axis information set is used as the input of the trained seven-layer deep learning network, and the output data is the final position prediction coordinates of the moving object. It is compared with the corresponding real position information in the test real position information set to obtain the average error value of the test positioning, which is recorded as :

[0054] ;

[0055] in, Represents the total number of moving objects in the test real position information set; the average test positioning error value obtained is And the average positioning accuracy threshold set For comparison, if it is less than the average positioning accuracy threshold, the network meets the standard. If it is greater than or equal to the average positioning accuracy threshold, S6 needs to be repeated to train the network until the average positioning error value is tested. Less than the set positioning average accuracy threshold .

[0056] Preferably, in S7, when the energy efficiency of the car is good, the low-latency car ultrasonic ranging mode is selected: the low-latency car ultrasonic ranging mode focuses on the system being able to quickly make a judgment on whether to open the door or not, and requires the car ultrasonic device to collect the position information data set of the moving objects entering the prediction area in real time. The car extraction time interval is ,The extraction time interval consists of two parts, the sampling time interval and prediction time interval , within the sampling time interval The two-dimensional position information of the moving objects is extracted for the sampling period. When the occupant makes a door opening request, the online position information set of the moving objects entering the predicted area is immediately input into the trained seven-layer deep learning network for mobile position prediction, and the online predicted position information set of all moving objects is output. , which is expressed as follows:

[0057] ;

[0058] in It represents the total number of moving objects entering the prediction area; Indicates The two-dimensional coordinate information of the predicted position of a moving object entering the prediction area; the reaction delay is the calculation time of the seven-layer deep learning network, and the car can enter the prediction area within the prediction time interval, that is, After the time has passed, the door is opened or a danger alarm is issued;

[0059] In the case of poor energy efficiency of the car, choose the low-energy car ultrasonic ranging mode: The low-energy car ultrasonic ranging mode focuses on the low energy consumption of the system. When the occupants make a door opening request, the car ultrasonic device starts to collect the position information data set of the moving objects entering the prediction area. The car extraction time interval is ,The extraction time interval consists of two parts, the sampling time interval and prediction time interval , within the sampling time interval Extract the two-dimensional position information of the moving object for the sampling period, input the collected online position information set of the moving object into the trained seven-layer deep learning network for mobile position prediction, and output the online predicted position information set of all moving objects ,The reaction delay is the sum of the computation time and sampling time interval of the seven-layer deep learning network. The car can extract the time interval, i.e. After the time has passed, the door is opened or a danger alarm is issued.

[0060] Preferably, the door opening collision danger zone in S8 includes: setting the door opening collision danger zone according to the size of the car door, where the door size is recorded as , the environmental state parameters are recorded as ; The corresponding door opening collision danger zone is the 90-degree fan-shaped area corresponding to the two doors, and the radius of the fan-shaped area is :

[0061] ;

[0062] The online prediction location information set The predicted position information of the moving objects in the vehicle door opening collision risk zone is compared with the door opening collision risk zone. If there is a moving object in the door opening collision risk zone within the predicted time interval of the door opening, it is determined to be a dangerous state. The vehicle control system is used to stop the door from being opened and issue a danger alarm to avoid the door opening collision traffic safety problem. If all moving objects are not in the door opening collision risk zone within the predicted time interval of the door opening, it is determined to be a safe state, and the vehicle control system is used to allow the door to be opened.

[0063] The present invention also discloses an alarm system of the ultrasonic ranging alarm method for preventing collision of automobile door opening as described above, wherein the alarm system comprises an on-board system module, a danger alarm, an ultrasonic ranging module, an ultrasonic ranging sampling module, and a door opening trigger judgment module; the on-board system module comprises a deep learning module, an information storage module, and a central control module;

[0064] When the central control module receives the mode information, the position sampling information of the moving object entering the predicted area is stored in the information storage module through the ultrasonic ranging module and the ultrasonic ranging sampling module. After the central control module receives the door opening request from the occupant of the vehicle, the position sampling information of the moving object is extracted and transmitted to the deep learning module. The deep learning module extracts the deep learning network and the corresponding network weights and hyperparameter values ​​from the information storage module to obtain the corresponding predicted position information. The predicted position information and the door opening collision danger zone are judged through the door opening trigger judgment module, and the door opening command or danger alarm command is output to the danger alarm.

[0065] Beneficial effects of the present invention:

[0066] The present invention realizes high-precision monitoring of moving objects through ultrasonic ranging and deep learning technology. In the training stage, the speed-averaged position information matrix is ​​used to enhance the comprehensiveness and reliability of the data, thereby improving the robustness of the network. In the testing stage, a seven-layer deep learning network with strong generalization ability is established to ensure the positioning accuracy and stability of the system in complex environments. Finally, the system significantly improves driving safety by real-time monitoring of moving objects and judging the risk of door opening through a seven-layer deep learning network, effectively eliminating the traffic safety problem of door opening collision and ensuring the safety of the vehicle and passengers. BRIEF DESCRIPTION OF THE DRAWINGS

[0067] The drawings described herein are used to provide further understanding of the present invention and constitute a part of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations on the present invention.

[0068] Figure 1 It is a schematic diagram of the steps of the present invention;

[0069] Figure 2 It is a schematic diagram of the automobile area in the present invention;

[0070] Figure 3 is a schematic diagram of a seven-layer deep learning network for mobile position prediction in the present invention;

[0071] Figure 4 It is a schematic diagram of the terminal structure of the present invention. DETAILED DESCRIPTION

[0072] This section will describe in detail the specific embodiments of the present invention. The preferred embodiments of the present invention are shown in the accompanying drawings. The purpose of the accompanying drawings is to supplement the description of the text part of the specification with graphics, so that people can intuitively and vividly understand each technical feature and the overall technical solution of the present invention, but it cannot be understood as a limitation on the scope of protection of the present invention.

[0073] In the description of the present invention, "several" means one or more, "more" means more than two, "greater than", "less than", "exceed" etc. are understood as not including the number itself, and "above", "below", "within" etc. are understood as including the number itself. If there is a description of "first" or "second", it is only used for the purpose of distinguishing the technical features, and cannot be understood as indicating or implying the relative importance or implicitly indicating the number of the indicated technical features or implicitly indicating the order of the indicated technical features.

[0074] The present invention proposes an ultrasonic ranging alarm method for preventing collision when opening a car door. The alarm method relies on the position information of moving objects around the vehicle collected before opening the door, and predicts the final position information of the surrounding moving objects through the seven-layer deep learning neural network for mobile position prediction provided by the present invention, to determine whether opening the door will cause a dangerous situation. If there is a danger, the vehicle control system is used to stop the behavior of opening the door, thereby avoiding the occurrence of traffic safety problems such as door-opening collisions; if there is no danger, the vehicle control system is used to allow the behavior of opening the door. The present invention also proposes an ultrasonic ranging alarm system for preventing collision when opening a car door, comprising the hardware control module, information storage module, deep learning module and information sampling module required by the ultrasonic ranging alarm method for preventing collision when opening a car door, so as to effectively avoid the problem of door-opening collisions in road safety without relying on subjective human control.

[0075] Reference Figure 1-Figure 4 , a preferred embodiment of the present invention, an ultrasonic ranging alarm method for automobile door opening anti-collision, the alarm method comprises the following steps:

[0076] S1, training data collection stage: define the prediction area, determine the position of the moving object entering the prediction area through the ultrasonic wave of the automobile ultrasonic detection device, sample according to the moving speed-time interval, extract the position information of the moving object within the extraction time interval, and form a speed-averaged position information matrix;

[0077] Specifically, in the training data collection stage, the prediction area size is defined according to the extraction time interval, and the car extraction time interval is denoted as , the extraction time interval includes the sampling time interval and the prediction time interval, which are respectively denoted as , , there is the following relationship:

[0078] ;

[0079] Then, the radius of the prediction area defined by the car is for:

[0080] ;

[0081] in, To preset the maximum moving object speed, The prediction area defined by the car is is the area within a circle of radius;

[0082] Use the automobile ultrasonic ranging device to sample the position of the moving object according to the moving speed and sampling time interval within the extraction time interval: the sampling time interval is , then the two-dimensional position coordinates of the moving object entering the defined area and the average speed of the moving object are extracted according to the sampling time interval within the extraction time interval to form a speed position information matrix, which is recorded as :

[0083] ;

[0084] Among them, the number of moving objects entering the prediction area within the extraction time interval is Each moving object has a sampling time interval Extracting two-dimensional position information of the moving object for the sampling period; Indicates The moving object is Two-dimensional position coordinates at time intervals; For 1, 2, 3... ; For 1, 2, 3... ; Sample position information of each moving object Group, Represents a moving object The average moving speed is calculated as follows:

[0085] ;

[0086] From the speed position information matrix The velocity-averaged position information matrix is ​​further extracted according to the average moving speed of the moving object. ;

[0087] First, the average moving speed of the moving object is divided into four groups: Group 1, the actual average moving speed is not more than 8m / s; Group 2, the actual average moving speed is not more than 12m / s; Group 3, the actual average moving speed is not more than 20m / s; Group 4, the actual average speed is more than 20m / s; Then, according to the average speed of the moving object, the position speed information is extracted from the speed position information matrix with equal data volume to form the corresponding speed average position information matrix :

[0088] ;

[0089] in, Indicates group Middle The average speed of a moving object; Indicates the group Middle The moving object is Two-dimensional position information in a sampling period; Indicates that there are a total of The two-dimensional position information path of a moving object; by extracting the speed-averaged position information matrix, the motion trajectories of objects with different moving speeds are sampled with equal priority, which increases the comprehensiveness and reliability of the data and the robustness of the network after training.

[0090] S2, training data set determination stage: randomly extract the training position information set and the training real position information set from the speed average position information matrix; specifically, according to the sampling time interval , from the velocity average position information matrix Extract the training position information set from ,but:

[0091] ;

[0092] in, Indicates from group The first The average speed of a moving object; Indicates that each group is randomly selected The two-dimensional position information path of a moving object; four groups are randomly selected with equal probability The speed position information of the moving object; according to the corresponding position of the moving object in the training position information set, the speed average position information matrix Extract the training real position information set, denoted as ,but:

[0093] ;

[0094] Training real location information set It represents the average speed and final position sampling information of the moving object corresponding to the training position information set; in order to facilitate the input of the subsequent training stage and the needs of the deep learning network, the training position information set According to the two-dimensional coordinates Split the data into training positions by axis: Axis Information Set , Training Position Axis Information Set ;

[0095] ,

[0096] ,

[0097]

[0098] in, Indicates group Middle The moving object is The two-dimensional position information in the sampling period corresponds to , Indicates the corresponding horizontal and vertical coordinate information.

[0099] S3, test data set determination stage: stripping the predicted position information set from the speed average position information matrix, establishing the test position information set and the test real position information set;

[0100] Specifically, according to the sampling time interval , delete the training position information set from the speed average position information matrix The corresponding mobile object information in the training position information set is extracted to form the corresponding test position information set, which is recorded as ,but:

[0101] ;

[0102] in, represents the first The average speed of moving objects, each group is drawn separately The two-dimensional position information path of a moving object, four groups are randomly selected with equal probability The speed and position information of the moving object; according to the corresponding position of the moving object in the test position information set, the speed average position information matrix Extract the real test location information set from ,but:

[0103] ;

[0104] Testing the real location information set It represents the average speed and final position sampling information of the moving object corresponding to the test position information set; in order to facilitate the input of the subsequent test phase and the needs of the deep learning network, the test position information set According to the two-dimensional coordinates , The axis splits the data into test positions Axis Information Set , Test location Axis Information Set ;

[0105] ,

[0106] ,

[0107]

[0108] in, Indicates group Middle The moving object is The two-dimensional position information in the sampling period corresponds to , Indicates the corresponding horizontal and vertical coordinate information.

[0109] S4, deep learning network establishment stage: according to the application scenario, a seven-layer deep learning network with good generalization ability and strong robustness suitable for mobile location prediction is established;

[0110] Specifically, the seven-layer deep learning network is as follows Figure 3 As shown, according to the outdoor open road scene, the first layer of the network is the input layer, and the input is two The matrices represent Axis and The positions of the axes are treated as two channels, so the input shape is:

[0111]

[0112] in, =2 is the number of channels, indicating Axis and The axis position matrix, =4 is the height, indicating the number of rows, = is the width, indicating the number of columns;

[0113] The second layer of the network is the first convolutional layer, which uses The convolution kernel, is the sampling time, the step size is 1, the padding is 0, and the output shape is: ;

[0114] The third layer of the network is the first pooling layer. The pooling layer uses a 2×2 maximum pooling with a step size of 2. The output shape is: ;

[0115] The fourth layer of the network is the second convolutional layer. The second convolutional layer uses 32 3×3 convolution kernels, with a step size of 1 and a padding of 1. The output shape is: ;

[0116] The fifth layer of the network is a flattening operation. Before entering the fully connected layer, the output of the convolutional layer needs to be flattened into a one-dimensional vector. The flattening operation turns (32, 1, 4) into 128 neurons.

[0117] The sixth layer of the network is the first fully connected layer, which has 128 neurons as input and 64 neurons as output;

[0118] The seventh layer of the network is the second fully connected layer, which is also the final output layer. The second fully connected layer has 64 neurons as input and 2 neurons as output, representing the two-dimensional coordinates predicted by the final network ( , ).

[0119] S5, deep learning network training stage: The training position information set in S2 is based on two-dimensional coordinates , The axis splits the data into training positions Axis information set, training position Axis information set; using trained positions Axis information set, training position The seven-layer deep learning network for mobile position prediction is trained based on the axis information set, and the average positioning accuracy threshold and the maximum positioning error threshold are set. When the prediction accuracy of the trained network reaches the standard, the network training is stopped, and the corresponding hyperparameters and weight parameter information of the seven-layer deep learning network for mobile position prediction are output;

[0120] Specifically, the training position Axis information set, training position The axis information set is input into the seven-layer deep learning network and trained in batches. The minimum batch size is set to 100. Random sampling is used to extract data. The average positioning accuracy threshold is set to and the maximum positioning error threshold The output two-dimensional coordinates are compared with the corresponding position information in the training real position information set. The loss function of the network is set to the mean square error function to measure the difference between the predicted coordinates and the real coordinates. The optimizer selected is the Adam optimizer, and the learning rate is set to 0.002 to minimize the loss function to update the network parameters and determine the optimal seven-layer deep learning network. When the average positioning accuracy and the maximum positioning error are both less than the threshold, the network training is stopped, and the deep learning network, the weights and hyperparameters in the network are output and saved.

[0121] S6, mobile location prediction network test phase: the test location information set in S3 is based on two-dimensional coordinates , The axis splits the data into test positions Axis information set, test position Axis information set; pass test position Axis information set, test position The axis information set and the test real position information set are used to test whether the trained seven-layer deep learning network predicts the positioning accuracy.

[0122] Specifically, substitute the test position Axis information set, test position The axis information set is used as the input of the trained seven-layer deep learning network, and the output data is the final position prediction coordinates of the moving object. It is compared with the corresponding real position information in the test real position information set to obtain the average error value of the test positioning, which is recorded as :

[0123] ;

[0124] in, Represents the total number of moving objects in the test real position information set; the average test positioning error value obtained is And the average positioning accuracy threshold set For comparison, if it is less than the average positioning accuracy threshold, the network meets the standard. If it is greater than or equal to the average positioning accuracy threshold, S6 needs to be repeated to train the network until the average positioning error value is tested. Less than the set positioning average accuracy threshold .

[0125] Specific implementation examples Figure 2 As shown in the figure, the method and system verification embodiment is carried out on a certain open road section, wherein the positioning average accuracy threshold The predicted position coordinates obtained by the trained seven-layer deep learning network and the corresponding real position coordinates in the test real position information set obtained by S3 are sampled as shown in Table 1:

[0126] Table 1: Sampling table of position prediction coordinates and real position coordinates of seven-layer deep learning network

[0127] Location prediction coordinates （12.3,24.6） （22.2,23.6） （42.7,98.3） （42.3,12.7） （2.4.5.6） Real location coordinates （12.7,24.2） （22.3,24.0） （43.1,98.5） （42.5,12.3） （3.0,5.5） Location prediction coordinates （18.4,12.7） （45.6,66.9） （45.6,63.6） （56.8,49.1） （6.4,3.3） Real location coordinates （19.1,13.2） （45.4,67.2） （45.7,63.0） （56.3,49.2） （6.7,3.3）

[0128] The sampling group data is 5 groups, and the average error value of the test positioning is obtained It is 0.5709m, which is less than the preset average accuracy threshold of 0.6m, demonstrating the excellent performance and generalization ability of the designed and trained seven-layer deep learning network.

[0129] S7, actual moving object position prediction stage: two modes are set: low-energy automobile ultrasonic ranging mode and low-latency automobile ultrasonic ranging mode. According to different choices of the occupants, the automobile ultrasonic detection device determines the position of the moving object entering the prediction area, extracts the online position information set of all moving objects in the automobile prediction area, substitutes it into the trained seven-layer deep learning network, and outputs the online prediction position information set of all moving objects;

[0130] Specifically, two modes are set according to the actual energy efficiency of the car: When the car's energy efficiency is good, the low-latency car ultrasonic ranging mode is selected: The low-latency car ultrasonic ranging mode focuses on the system's ability to quickly determine whether to open the door or not. The car ultrasonic device is required to collect the position information data set of the moving objects entering the prediction area in real time. The car extraction time interval is ,The extraction time interval consists of two parts, the sampling time interval and prediction time interval , within the sampling time interval The two-dimensional position information of the moving objects is extracted for the sampling period. When the occupant makes a door opening request, the online position information set of the moving objects entering the predicted area is immediately input into the trained seven-layer deep learning network for mobile position prediction, and the online predicted position information set of all moving objects is output. , which is expressed as follows:

[0131] ;

[0132] in It represents the total number of moving objects entering the prediction area; Indicates The two-dimensional coordinate information of the predicted position of a moving object entering the prediction area; the reaction delay is the calculation time of the seven-layer deep learning network, and the car can enter the prediction area within the prediction time interval, that is, After the time has passed, the door is opened or a danger alarm is issued;

[0133] In the case of poor energy efficiency of the car, choose the low-energy car ultrasonic ranging mode: The low-energy car ultrasonic ranging mode focuses on the low energy consumption of the system. When the occupants make a door opening request, the car ultrasonic device starts to collect the position information data set of the moving objects entering the prediction area. The car extraction time interval is ,The extraction time interval consists of two parts, the sampling time interval and prediction time interval , within the sampling time interval Extract the two-dimensional position information of the moving object for the sampling period, input the collected online position information set of the moving object into the trained seven-layer deep learning network for mobile position prediction, and output the online predicted position information set of all moving objects ,The reaction delay is the sum of the computation time and sampling time interval of the seven-layer deep learning network. The car can extract the time interval, i.e. After a certain time, the door opening action is completed or a danger alarm prediction is issued; according to the energy efficiency requirements of the car and the driving delay requirements of the occupants, the present invention provides two tendency modes, which are more humane and reasonable.

[0134] Specific implementation examples Figure 2 As shown in the figure, the method and system verification example is carried out on an open road section in Nanchang, wherein the vehicle extraction time interval is preset. The sampling interval is 3s. The prediction time interval is 2s. 1s, within the sampling time interval The two-dimensional position information of the moving object extracted in the sampling period of 0.4s is as shown in Table 2:

[0135] Table 2: 2D position sampling information table of moving objects in the prediction area

[0136] Number time 1 2 3 4 5 0.4s (12.00,15.00) (16.00,18.00) (−50.00,−36.00) (67,−48) (1.2,−26.3) 0.8s (14.27,17.27) (19.46,20.00) (−46.00,−29.07) (61.9,−42.9) (1.2,−22.3) 1.2s (16.54,19.54) (22.93,22.00) (−42.00,−22.14) (56.8,−38.8) (1.2,−18.3) 1.6s (18.81,21.81) (26.39,24.00) (−38.00,−15.22) (51.7,−33.7) (1.2,−14.3) 2.0s (21.08,24.08) (29.86,26.00) (−34.00,−8.29) (46.6,−28.6) (1.2,−10.3)

[0137] The above is the two-dimensional position sampling information of the five moving objects entering the prediction area in the sampling time interval, which is input into the trained seven-layer deep learning network for mobile position prediction, and the online predicted position information of all moving objects is output as shown in Table 3 below:

[0138] Table 3: Prediction information table of two-dimensional position of moving objects in the prediction area

[0139] serial number 1 2 3 4 5 Predicted location (27.89,30.89) (40.25,32.00) (−22.00,12.50) (31.30,−13.30) (1.20,1.10)

[0140] The above is the online predicted position information of the five moving objects entering the prediction area obtained through the seven-layer deep network.

[0141] S8, door opening collision safety control stage: set the car door opening collision danger zone, compare the final positions of all moving objects in the online predicted position information set of moving objects entering the prediction area with the car door opening collision danger zone, if there is a moving object in the car door opening collision danger zone within the predicted time interval of door opening, it is determined to be a dangerous state, and the behavior of opening the door is stopped through the vehicle control system, thereby avoiding the occurrence of door opening collision traffic safety problems; if all moving objects are not in the car door opening collision danger zone within the predicted time interval of door opening, it is determined to be a safe state, and the behavior of opening the door is allowed through the vehicle control system.

[0142] Specifically, the door opening collision danger zone is set according to the size of the car door, and the door size is recorded as , the environmental state parameters are recorded as ; The corresponding door opening collision danger zone is the 90-degree fan-shaped area corresponding to the two doors, and the radius of the fan-shaped area is :

[0143] ;

[0144] The online prediction location information set The predicted position information of the moving objects in the vehicle door opening collision risk zone is compared with the door opening collision risk zone. If there is a moving object in the door opening collision risk zone within the predicted time interval of the door opening, it is determined to be a dangerous state. The vehicle control system is used to stop the door from being opened and issue a danger alarm to avoid the door opening collision traffic safety problem. If all moving objects are not in the door opening collision risk zone within the predicted time interval of the door opening, it is determined to be a safe state, and the vehicle control system is used to allow the door to be opened.

[0145] Specific implementation examples Figure 2 As shown in the figure, the method and system verification example is carried out on an open road section in Nanchang, where the door size It is 1.5m. From the data in Table 3, it can be seen that the online predicted position of the moving object No. 5 will fall in the preset door opening collision danger zone, which is a dangerous predicted position. Therefore, although the online predicted positions of the moving objects No. 1 to No. 4 fall in the non-door opening collision danger zone, the moving object No. 5 has a safety hazard and is determined to be in a dangerous state. The vehicle control system stops the behavior of opening the door and issues a danger alarm to avoid the occurrence of door opening collision traffic safety problems.

[0146] like Figure 4 As shown, the present invention also discloses an alarm system according to the above-mentioned ultrasonic ranging alarm method for automobile door opening anti-collision, the alarm system comprising a vehicle system module, a hazard alarm, an ultrasonic ranging module, an ultrasonic ranging sampling module, and a door opening trigger judgment module;

[0147] On-board system module: includes deep learning module, information storage module and central control module; among them, the deep learning module has two functions: on the one hand, it is used to receive the position sampling information of real-time moving objects, and output the corresponding predicted position information of moving objects through the trained deep learning network; on the other hand, it is used to receive the position sampling information of moving objects in the training stage, and output the neural network and corresponding network weights and hyperparameter values ​​that have reached the accuracy through training; the information storage module is used to store the position sampling information of moving objects entering the prediction area, the deep learning network, the network weights and hyperparameter values ​​trained by the neural network module, and all size information parameters; the central control module has two functions: on the one hand, it is used to receive mode selection information and control the operation of the ultrasonic module; on the other hand, after receiving the door opening request, it extracts the position sampling information of the moving object and transmits it to the deep learning module to obtain the predicted position information of the moving object, controls the transmission of this information to the door opening trigger judgment module, receives the corresponding judgment information, outputs the corresponding door opening command or outputs the danger command to the danger alarm module;

[0148] Danger alarm module: receives the danger command from the central control module, rejects the operator's request to open the door, and sends out a danger alarm message to inform the occupants that the door is prohibited from opening at this time;

[0149] Ultrasonic module: used to select the mode of the central control module, perform sampling according to the extraction time interval, and complete the distance and position extraction of the moving object entering the vehicle prediction area through the ultrasonic ranging principle;

[0150] Door opening trigger judgment module: used to receive the predicted position information of the corresponding moving objects obtained by the deep learning module, and make a positional relationship judgment between the predicted position information and the door opening collision danger zone: if the predicted positions of all moving objects are not in the door opening collision danger zone, the door opening command is output; otherwise, the danger alarm command is output to the danger alarm module;

[0151] Preferably, a computer storage medium stores a computer program, which, when executed by a processor, implements the above-mentioned ultrasonic ranging alarm method for preventing collision when opening a car door;

[0152] Preferably, a computer device comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned ultrasonic ranging alarm method for automobile door opening anti-collision when executing the computer program.

[0153] The present invention realizes high-precision monitoring of moving objects through ultrasonic ranging and deep learning technology. In the training stage, the speed-averaged position information matrix is ​​used to enhance the comprehensiveness and reliability of the data, thereby improving the robustness of the network. In the testing stage, a seven-layer deep learning network with strong generalization ability is established to ensure the positioning accuracy and stability of the system in complex environments. Finally, the system significantly improves driving safety by real-time monitoring of moving objects and judging the risk of door opening through a seven-layer deep learning network, effectively eliminating the traffic safety problem of door opening collision and ensuring the safety of the vehicle and passengers.

[0154] Under the premise that no conflict occurs, those skilled in the art may freely combine and superimpose the above-mentioned additional technical features.

[0155] The above description is only a preferred implementation mode of the present invention. Any technical solution that achieves the purpose of the present invention by substantially the same means belongs to the protection scope of the present invention.

Claims

1. An ultrasonic ranging alarm method for preventing collision when opening a car door, characterized in that: The ultrasonic ranging alarm method includes the following steps: S1, training data collection stage: define the prediction area, determine the position of the moving object entering the prediction area through the ultrasonic wave of the automobile ultrasonic detection device, sample according to the moving speed-time interval, extract the position information of the moving object within the extraction time interval, and form a speed-averaged position information matrix; S2, training data set determination stage: randomly extracting a training position information set and a training real position information set from the speed average position information matrix; S3, test data set determination stage: stripping the predicted position information set from the speed average position information matrix, establishing the test position information set and the test real position information set; S4, deep learning network establishment stage: according to the application scenario, a seven-layer deep learning network with good generalization ability and strong robustness suitable for mobile location prediction is established; S5, deep learning network training stage: The training position information set in S2 is based on two-dimensional coordinates , The axis splits the data into training positions Axis information set, training position Axis information set; using trained positions Axis information set, training position The seven-layer deep learning network for mobile position prediction is trained based on the axis information set, and the average positioning accuracy threshold and the maximum positioning error threshold are set. When the prediction accuracy of the trained network reaches the standard, the network training is stopped, and the corresponding hyperparameters and weight parameter information of the seven-layer deep learning network for mobile position prediction are output; S6, mobile location prediction network test phase: the test location information set in S3 is based on two-dimensional coordinates , The axis splits the data into test positions Axis information set, test position Axis information set; pass test position Axis information set, test position The axis information set and the test real position information set are used to test whether the trained seven-layer deep learning network predicts the positioning accuracy. S7, actual moving object position prediction stage: two modes are set: low-energy automobile ultrasonic ranging mode and low-latency automobile ultrasonic ranging mode. According to different choices of the occupants, the automobile ultrasonic detection device determines the position of the moving object entering the prediction area, extracts the online position information set of all moving objects in the automobile prediction area, substitutes it into the trained seven-layer deep learning network, and outputs the online prediction position information set of all moving objects; S8, door opening collision safety control stage: set the car door opening collision danger zone, compare the final positions of all moving objects in the online predicted position information set of moving objects entering the prediction area with the car door opening collision danger zone, if there is a moving object in the car door opening collision danger zone within the predicted time interval of door opening, it is determined to be a dangerous state, and the behavior of opening the door is stopped through the vehicle control system, thereby avoiding the occurrence of door opening collision traffic safety problems; if all moving objects are not in the car door opening collision danger zone within the predicted time interval of door opening, it is determined to be a safe state, and the behavior of opening the door is allowed through the vehicle control system.

2. The ultrasonic ranging alarm method for preventing collision when opening a car door according to claim 1 is characterized in that: The specific contents of the training data collection stage in S1 include: In the training data collection stage, the prediction area size is demarcated according to the extraction time interval, and the car extraction time interval is recorded as , the extraction time interval includes the sampling time interval and the prediction time interval, which are respectively denoted as , , there is the following relationship: ； Then, the radius of the prediction area defined by the car is for: ； in, To preset the maximum moving object speed, The prediction area defined by the car is is the area within a circle of radius; Use the automobile ultrasonic ranging device to sample the position of the moving object according to the moving speed and sampling time interval within the extraction time interval: the sampling time interval is , then the two-dimensional position coordinates of the moving object entering the defined area and the average speed of the moving object are extracted according to the sampling time interval within the extraction time interval to form a speed position information matrix, which is recorded as : ； Among them, the number of moving objects entering the prediction area within the extraction time interval is Each moving object has a sampling time interval Extracting two-dimensional position information of the moving object for the sampling period; Indicates The moving object is Two-dimensional position coordinates at time intervals; For 1, 2, 3... ; For 1, 2, 3... ; Sample position information of each moving object Group, Represents a moving object The average moving speed is calculated as follows: ； From the speed position information matrix The velocity-averaged position information matrix is ​​further extracted according to the average moving speed of the moving object. ; First, the average moving speed of the moving object is divided into four groups: Group 1, the actual average moving speed is not more than 8m / s; Group 2, the actual average moving speed is not more than 12m / s; Group 3, the actual average moving speed is not more than 20m / s; Group 4, the actual average speed is more than 20m / s; Then, according to the average speed of the moving object, the position speed information is extracted from the speed position information matrix with equal data volume to form the corresponding speed average position information matrix : ； in, Indicates group Middle The average speed of a moving object; Indicates the group Middle The moving object is Two-dimensional position information in a sampling period; Indicates that there are a total of The two-dimensional position information path of a moving object; by extracting the speed-averaged position information matrix and sampling the motion trajectories of objects with different moving speeds with equal priority, the comprehensiveness and reliability of the data are increased, and the robustness of the network after training is increased.

3. The ultrasonic ranging alarm method for preventing collision when opening a car door according to claim 2 is characterized in that: The method of randomly extracting the training position information set and the training real position information set in S2 includes: , from the velocity average position information matrix Extract the training position information set from ,but: ； in, Indicates from group The first The average speed of a moving object; Indicates that each group is randomly selected The two-dimensional position information path of a moving object; four groups are randomly selected with equal probability The speed position information of the moving object; according to the corresponding position of the moving object in the training position information set, the speed average position information matrix Extract the training real position information set, denoted as ,but: ； Training real location information set It represents the average speed and final position sampling information of the moving object corresponding to the training position information set; in order to facilitate the input of the subsequent training stage and the needs of the deep learning network, the training position information set According to the two-dimensional coordinates , Split the data into training positions by axis: Axis Information Set , Training Position Axis Information Set ; 、 、 ； in, Indicates group Middle The moving object is The two-dimensional position information in the sampling period corresponds to , Indicates the corresponding horizontal and vertical coordinate information.

4. The ultrasonic distance measurement alarm method for automobile door opening anti-collision according to claim 3 is characterized in that: The method of stripping the predicted position information set, establishing the test position information set and predicting the real position information set in S3 includes: , delete the training position information set from the speed average position information matrix The corresponding mobile object information in the training position information set is extracted to form the corresponding test position information set, which is recorded as ,but: ； in, represents the first The average speed of moving objects, each group is drawn separately The two-dimensional position information path of a moving object, four groups are randomly selected with equal probability The speed and position information of the moving object; according to the corresponding position of the moving object in the test position information set, the speed average position information matrix Extract the real test location information set from ,but: ； Testing the real location information set It represents the average speed and final position sampling information of the moving object corresponding to the test position information set; in order to facilitate the input of the subsequent test phase and the needs of the deep learning network, the test position information set According to the two-dimensional coordinates , The axis splits the data into test positions Axis Information Set , Test location Axis Information Set ; 、 、 ； in, Indicates group Middle The moving object is The two-dimensional position information in the sampling period corresponds to , Indicates the corresponding horizontal and vertical coordinate information.

5. The ultrasonic distance measurement alarm method for automobile door opening anti-collision according to claim 4, characterized in that: The seven-layer deep learning network in the deep learning network establishment phase in S4: The first layer of the network is the input layer, and the input is two The matrices represent Axis and The positions of the axes are treated as two channels, so the input shape is: ； in, =2 is the number of channels, indicating Axis and The axis position matrix, =4 is the height, indicating the number of rows, is the width, indicating the number of columns; The second layer of the network is the first convolutional layer, which uses The convolution kernel, is the sampling time, the step size is 1, the padding is 0, and the output shape is: ; The third layer of the network is the first pooling layer. The pooling layer uses a 2×2 maximum pooling with a step size of 2. The output shape is: ; The fourth layer of the network is the second convolutional layer. The second convolutional layer uses 32 3×3 convolution kernels, with a step size of 1 and a padding of 1. The output shape is: ; The fifth layer of the network is a flattening operation. Before entering the fully connected layer, the output of the convolutional layer needs to be flattened into a one-dimensional vector. The flattening operation turns (32, 1, 4) into 128 neurons. The sixth layer of the network is the first fully connected layer, which has 128 neurons as input and 64 neurons as output; The seventh layer of the network is the second fully connected layer, which is also the final output layer. The second fully connected layer has 64 neurons as input and 2 neurons as output, representing the two-dimensional coordinates predicted by the final network ( , ).

6. The ultrasonic distance measurement alarm method for automobile door opening anti-collision according to claim 5, characterized in that: The deep learning network training phase in S5 includes: Axis information set, training position The axis information set is input into the seven-layer deep learning network and trained in batches. The minimum batch size is set to 100. Random sampling is used to extract data. The average positioning accuracy threshold is set to and the maximum positioning error threshold The output two-dimensional coordinates are compared with the corresponding position information in the training real position information set. The loss function of the network is set to the mean square error function to measure the difference between the predicted coordinates and the real coordinates. The optimizer selected is the Adam optimizer, and the learning rate is set to 0.002 to minimize the loss function to update the network parameters and determine the optimal seven-layer deep learning network. When the average positioning accuracy and the maximum positioning error are both less than the threshold, the network training is stopped, and the deep learning network, the weights and hyperparameters in the network are output and saved.

7. The ultrasonic distance measurement alarm method for preventing collision when opening a car door according to claim 6 is characterized in that: The mobile location prediction network test phase in S6 includes: Substituting the test location Axis information set, test position The axis information set is used as the input of the trained seven-layer deep learning network, and the output data is the final position prediction coordinates of the moving object. It is compared with the corresponding real position information in the test real position information set to obtain the average error value of the test positioning, which is recorded as : ； in, Represents the total number of moving objects in the test real position information set; the average test positioning error value obtained is And the average positioning accuracy threshold set For comparison, if it is less than the average positioning accuracy threshold, the network meets the standard. If it is greater than or equal to the average positioning accuracy threshold, S6 needs to be repeated to train the network until the average positioning error value is tested. Less than the set average positioning accuracy threshold .

8. The ultrasonic distance measurement alarm method for automobile door opening anti-collision according to claim 7, characterized in that: In S7, when the car energy efficiency is good, the low-latency car ultrasonic ranging mode is selected: the low-latency car ultrasonic ranging mode focuses on the system to quickly make a judgment on whether to open the door or not. The car ultrasonic device is required to collect the position information data set of the moving objects entering the prediction area in real time. The car extraction time interval is ,The extraction time interval consists of two parts, the sampling time interval and prediction time interval , within the sampling time interval The two-dimensional position information of the moving objects is extracted for the sampling period. When the occupant makes a door opening request, the online position information set of the moving objects entering the predicted area is immediately input into the trained seven-layer deep learning network for mobile position prediction, and the online predicted position information set of all moving objects is output. , which is expressed as follows: ； in It represents the total number of moving objects entering the prediction area; Indicates The two-dimensional coordinate information of the predicted position of a moving object entering the prediction area; the reaction delay is the calculation time of the seven-layer deep learning network, and the car can enter the prediction area within the prediction time interval, that is, After the time has passed, the door is opened or a danger alarm is issued; In the case of poor energy efficiency of the car, choose the low-energy car ultrasonic ranging mode: The low-energy car ultrasonic ranging mode focuses on the low energy consumption of the system. When the occupants make a door opening request, the car ultrasonic device starts to collect the position information data set of the moving objects entering the prediction area. The car extraction time interval is ,The extraction time interval consists of two parts, the sampling time interval and prediction time interval , within the sampling time interval Extract the two-dimensional position information of the moving object for the sampling period, input the collected online position information set of the moving object into the trained seven-layer deep learning network for mobile position prediction, and output the online predicted position information set of all moving objects ,The reaction delay is the sum of the computation time and sampling time interval of the seven-layer deep learning network. The car can extract the time interval, i.e. After the time has passed, the door is opened or a danger alarm is issued.

9. The ultrasonic distance measurement alarm method for automobile door opening anti-collision according to claim 8, characterized in that: The car door opening collision danger zone in S8 includes: setting the door opening collision danger zone according to the size of the car door, and the door size is recorded as , the environmental state parameters are recorded as ; The corresponding door opening collision danger zone is the 90-degree fan-shaped area corresponding to the two doors, and the radius of the fan-shaped area is : ； The online prediction location information set The predicted position information of the moving objects in the vehicle door opening collision risk zone is compared with the door opening collision risk zone. If there is a moving object in the door opening collision risk zone within the predicted time interval of the door opening, it is determined to be a dangerous state. The vehicle control system is used to stop the door from being opened and issue a danger alarm to avoid the door opening collision traffic safety problem. If all moving objects are not in the door opening collision risk zone within the predicted time interval of the door opening, it is determined to be a safe state, and the vehicle control system is used to allow the door to be opened.

10. An alarm system of an ultrasonic ranging alarm method for preventing collision when opening a car door according to any one of claims 1 to 9, characterized in that: The alarm system includes a vehicle-mounted system module, a hazard alarm, an ultrasonic ranging module, an ultrasonic ranging sampling module, and a door opening trigger judgment module; the vehicle-mounted system module includes a deep learning module, an information storage module, and a central control module; When the central control module receives the mode information, the position sampling information of the moving object entering the predicted area is stored in the information storage module through the ultrasonic ranging module and the ultrasonic ranging sampling module. After the central control module receives the door opening request from the occupant of the vehicle, the position sampling information of the moving object is extracted and transmitted to the deep learning module. The deep learning module extracts the deep learning network and the corresponding network weights and hyperparameter values ​​from the information storage module to obtain the corresponding predicted position information. The predicted position information and the door opening collision danger zone are judged through the door opening trigger judgment module, and the door opening command or danger alarm command is output to the danger alarm.

Images